Apache Airflow: Dask Executor

Airflow is a python-based workflow management tool suited for scheduled jobs and data pipeline orchestration. Airflow’s development lifecycle is rapid and as a result, the core technologies that Airflow integrates with have experienced change over time. At the heart of Airflow is a concept called the executor; the choice of executor impacts Airflow’s ability to distribute and scale its workloads. Airflow offers a mix of local executors…