In an earlier post on Airflow, I shared my experience moving from the MesosExecutor to the DaskExecutor. This post focuses on deploying the Airflow KubernetesExecutor to dynamically launch worker pods in Kubernetes.

Prior to the release of Airflow 1.10.13, documentation to standing up the Airflow KubernetesExecutor was fairly difficult to…

Airflow is a python-based workflow management tool suited for scheduled jobs and data pipeline orchestration. Airflow’s development lifecycle is rapid and as a result, the core technologies that Airflow integrates with have experienced change over time. At the heart of Airflow is a concept called the executor; the choice of…

Branden Pleines

Open-source automation

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store