welcome

Thank you for purchasing the MEAP of the second edition of Data Pipelines with Apache Airflow, Second Edition.

When we released the first edition of the book it was based on Airflow 2.0. Since then, Airflow has significantly evolved in many aspects including the addition of many new features and functionality. On top of that, Airflow 3.0 is just around the corner, so it is important to be ready and up to date for its arrival.

Despite Airflow’s maturity, new users are still getting onboard every day. With its continuously growing ecosystem and its vast set of features, it can be quite a daunting tool for those just starting out. While Airflow’s versatility is most of the time an asset, it can sometimes lead users to build suboptimal workflows as it can be hard to figure out the right way to use its features. For this reason, we decided to update the book to guide new and experienced users to make the most of what Airflow has to offer.

In these first few chapters, you will find updated content from the first edition and added content aimed at some of the new features and capabilities added since 2021. Just like in the previous version, each topic is covered extensively providing plenty of code examples, figures and explanations to make sure everything is clear.

We hope that you enjoy the second edition of Data Pipelines with Apache Airflow and that it earns a special spot on your digital (and physical!) bookshelf.