Apache Airflow is an open-source platform to Author, Schedule and Monitor workflows. It was created at Airbnb and currently is a part of Apache Software Foundation. Airflow helps you to create workflows using Python programming language and these workflows can be scheduled and monitored easily with it. The video illustrates the process of baking a pizza as a workflow to help understand the concept even better.
Free access to Qubole for 30 days to build data pipelines, bring machine learning to production, and analyze any data type from any data source.