Part 3 Airflow in practice
Now that you’ve learned how to build complex pipelines, it’s time to put your newfound skills in practice. To help you get started, part 3 discusses best practices for building pipelines in real-life situations and demonstrates these practices in two example use cases.
First, chapter 12 reviews some of the practices we’ve seen for implementing pipelines and highlights several best practices that should help you build efficient, maintainable pipelines. Chapters 13 and 14 tie all previous chapters together in two summary use cases. Chapter 13 focuses on the more generic use case of gathering different data sets into a combined result, and chapter 14 shows how to use Airflow in a generative AI context.
After completing part 3, you should be able to write efficient, maintainable pipelines in Airflow to solve actual business problems.