chapter seven
7 Triggering workflows with external input
This chapter covers
- Waiting for certain external conditions to be met with sensors
- Deciding how to set dependencies between tasks in different DAGs
- Executing workflows via the CLI and REST API
- Triggering DAGs when messages are published on a Message Queue
In previous chapters, we’ve seen how to trigger pipelines based on time intervals (chapter 3) and updates to assets (chapter 4). Here, we’ll explore ways to trigger workflows in response to events that occur outside of Airflow, including examples such as files being uploaded to a shared drive, developers pushing their code to a repository, messages published on a message bus, etc.; any of which could be reasons to start running your pipeline in a modern enterprise.