liveBook · Manning

Timetable

As explained in Data Pipelines with Apache Airflow, Second Edition

An Airflow timetable is a scheduling abstraction that determines the times at which DAG runs are created.

An Airflow timetable determines when DAG runs are created. For incremental pipelines, a data-interval timetable divides time into discrete windows, then runs the DAG after each window has passed so its tasks can process the completed data. section 3.4.2 section 3.4.4

A data-interval timetable gives each DAG run a precise processing context:

  • Airflow executes the DAG at the end of the interval rather than at its start. section 3.4.2 section 3.4.4
  • data_interval_start and data_interval_end identify the interval assigned to the run. section 3.4.2
  • logical_date generally identifies the interval, usually by pointing to its start. section 3.4.4
  • Trigger timetables specify execution points, while data-interval timetables specify spans that tasks can process directly. section 3.4.2

Process one day of events

Configure a DAG with CronDataIntervalTimetable("@daily", timezone="UTC"), then template the events API request with data_interval_start and data_interval_end. The resulting run fetches only the completed interval and can write results using logical_date as the file identifier.

Choose timetable classes explicitly when schedule semantics matter. Airflow supports trigger points, data intervals, and time-delta intervals; shorthand schedules can vary with scheduler configuration and Airflow version. section 12.1.7

How Data Pipelines with Apache Airflow, Second Edition covers it

How deep it goes
Explains interval boundaries, execution timing, context variables, and explicit timetable choices without detailing custom timetable implementation.
Examples
Demonstrates daily event retrieval, interval-based DAG configuration, templated API dates, and per-interval output files.
What you can do after
Apply it via Airflow timetable classes and templates to build interval-aware incremental DAGs.
How it connects
Connects timetables to DAG runs, data intervals, trigger timetables, cron schedules, logical dates, catchup, and templating.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Data Pipelines with Apache Airflow, Second Edition. The section links point to the parts of the book it draws on.