liveBook · Manning

Chapter 1: Before You Begin

What you will learn in chapter 1 of Learn AI Data Engineering

The chapter introduction frames modern AI as a major technological shift and positions it as a way for skilled professionals to reduce routine work rather than replace human judgment.

After this chapter you will be able to

Section by section

Introduction

The chapter introduction frames modern AI as a major technological shift and positions it as a way for skilled professionals to reduce routine work rather than replace human judgment.

Key terms: limited compute power, rule-based systems, scalable models, vast datasets, real-world applications, enhances rather than replaces human intelligence, mundane tasks, high-value work, prompt engineering, agentic systems

1.1 Why AI Matters to Data Engineering

This section explains why AI matters to data engineering: it can take on repetitive work, support coding and review, and help engineers focus on business value.

Key terms: data engineering, business transformations, business value, infrastructure tasks, coding companion, large language models, scaffolding, multi-tool, human intervention, data personas

1.2 Is This Book for You?

This section identifies the book’s intended readers and explains its focus on applying AI programmatically in data workflows rather than stopping at interactive prompts.

Key terms: AI coding companions, programmatic applications, data ingestion, transformation, enrichment, data engineers, analysts, data scientists, AI enthusiasts, SQL

1.2.1 The Many Uses for AI

This section surveys familiar uses of AI and introduces the ways it can support data engineering work.

Key terms: virtual assistants, personalized recommendations, fraud detection, Google Vertex AI, data cleansing, transformation, unstructured data, synthetic datasets, entity recognition, sentiment analysis

1.2.2 The Many Flavors of AI

This section introduces LLMs as a varied ecosystem, explains their shared function, and states why the book primarily uses OpenAI’s GPT models.

Key terms: large language models (LLMs), natural language, machine-learned patterns, OpenAI’s GPT models, LLM providers, strengths and trade-offs

1.3 How to Use This Book

This section explains the book’s one-chapter-per-day reading and practice rhythm.

Key terms: Month of Lunches, one chapter per day

1.3.1 The Main Chapters

This subsection maps the main chapters from foundational AI concepts through data engineering applications to advanced workflows.

Key terms: AI coding companions, prompt engineering, data transformations, feature extraction, AI-powered automation, structured data extraction

1.3.2 Hands-on Labs

This section explains that the book’s short labs are hands-on practice and encourages readers to try them before consulting the solutions.

1.3.3 Chapter Setup Files

This section directs readers to chapter-specific GitHub setup guides so they can prepare for hands-on labs without getting stuck on configuration.

Key terms: setup/ directory, companion GitHub repository, environment variables, API key management

1.4 Setting Up Your Environment

This section identifies the local tools and account needed to follow the book’s examples and points readers to setup instructions.

Key terms: PostgreSQL, pgAdmin, Jupyter Lab, OpenAI account, GitHub repo

1.4.1 Installing PostgreSQL and pgAdmin

1.4.2 Installing Jupyter Lab for Python Work

1.4.3 Creating an OpenAI Account

This subsection tells readers how to obtain the OpenAI API key needed for the book’s AI-driven examples.

Key terms: OpenAI API key, API token, setup guide

1.5 Being Immediately Effective with AI and Data Engineering

This section presents the book as a hands-on guide to using AI immediately in data engineering work rather than studying AI theory in depth.

Key terms: practical application, LLM architectures, generate and validate SQL queries, clean and transform datasets, unstructured data, feature engineering

Where this is used later

Concepts explained in this chapter

Chapter 2: Advantages & Disadvantages of Using a Coding Companion →

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.