concept triggerdagrunoperator in category apache airflow

This is an excerpt from Manning's book Data Pipelines with Apache Airflow MEAP V05. Login to get full access to this book.

This scenario can be achieved with the TriggerDagRunOperator. This operator allows triggering other DAGs, which you can apply for decoupling parts of a workflow:

The string provided to the trigger_dag_id argument of the TriggerDagRunOperator must match the dag_id of the DAG to trigger. The end result is that we now have two DAGs, one for ingesting data from the supermarkets and one for computing metrics on the data:

Figure 6.13 DAGs split in two, with DAG #1 triggering DAG #2 using the TriggerDagRunOperator. The logic in DAG #2 is now defined just once, simplifying the situation shown in Figure 6.12.