Airflow — Boilerplate

After writing a lot of ETL code, I recently came across Airflow & realised how much efforts can be saved by using Airflow. Sometimes, when we have that strong urge to blog, we will not have sufficient time to write it. Today is one such day. Keeping aside a detailed blog for another day. For now, posting the basic boiler plate code for Airflow here. Here is a gist.

Boiler Plate Code — Airflow — A sample dag

The graph view and the tree view of the above is also posted below

Tree View showing the run status of the DAG

Graph View showing the run status of the DAG

Task dependencies like the below can also be achieved. Code, graph view and tree view screenshots have also been updated as below.

Achieving task dependencies in airflow

Graph view of the DAG showing the task dependenices

Tree view of the DAG showing the task dependencies