• Home... >
  • Blog >
  • Job Scheduling in Hadoop – A 7 Year Perspective

Blog

 
 
 

Job Scheduling in Hadoop – A 7 Year Perspective

 

job-scheduling-in-hadoop_big
In a recent presentation at Flipkart’s 2014 SlashN conference, I summarized seven years of progress in Hadoop and Big Data. In its beginning stages, Hadoop exhibited several weaknesses in its job scheduling. As a result, users who shared a Hadoop cluster would experience a slow cluster due to a bad job, or one user might take down an entire cluster with a job. Due to these and other consequences, developers turned to push scheduling with Corona. To learn more about the past and future of Hadoop scheduling, see my full presentation below.

Hadoop Scheduling – a 7 year perspective from Joydeep Sen Sarma


Leave a Reply

Your email address will not be published. Required fields are marked *

Are you human? *

 
 
 
 
clear