In this episode, we will understand the life cycle of Dags and see how scheduler picks up tasks and sends them to be executed. We will also understand how Dag runs and Task instances go through various states and what all components are involved in the changing of the states.
Free access to Qubole for 30 days to build data pipelines, bring machine learning to production, and analyze any data type from any data source.
See what our Open Data Lake Platform can do for you in 35 minutes.