Apache Airflow is one of the most powerful platforms used by Data Engineers for orchestrating workflows. Airflow is used to solve a variety of data ingestion, preparation and consumption problems. It can also orchestrate complex ML workflows. It is designed as a configuration-as-a-code system and it can be heavily customized with plugins. In this tutorial series, We will explain beginner and advanced concepts of Apache airflow with examples which will provide you hands-on experience in solving problems that are encountered by Data engineers in their day to day operations.
Free access to Qubole for 30 days to build data pipelines, bring machine learning to production, and analyze any data type from any data source.
See what our Open Data Lake Platform can do for you in 35 minutes.