liveBook · Manning

Data engineering

Data engineering is the discipline of designing and operating systems and processes that collect, transform, integrate, store, and deliver data for computational use.

How 2 Manning books explain it

Data Without Labels

Data engineering is the discipline of designing and operating systems and processes that collect, transform, store, and deliver data.

How it is used
Prepares reliable, accessible data for analysis, reporting, machine learning, and other data-driven functions.
How deep it goes
Traces capture through loading, ETL, cleaning, enrichment, and preparation, but stops short of implementation-specific tools or deployment procedures.
Examples
Uses ETL pipelines, hosted datasets, derived variables, null-value treatment, cleaned records, reports, and dashboards.
What you can do after
Operate data-preparation workflows that deliver cleansed, transformed, enriched, analysis-ready datasets.

Read how Data Without Labels explains data engineering →

Architecture Modernization: Socio-technical alignment of software, strategy, and structure

Data engineering is the discipline of designing, building, and operating systems and processes that collect, transform, store, and deliver data.

How it is used
Connects data collection and delivery to business decisions, analytical products, and the operational realities of architecture and team ownership.
How deep it goes
Traces databases, warehouses, and lakes through ingestion trade-offs, but stops short of implementation details.
Examples
Uses an auto-parts retailer’s receipts, loyalty data, B2B and B2C flows, warehouses, and lakes to expose ingestion complexity.
What you can do after
Evaluate data architectures by comparing ingestion simplicity, consumer burden, domain expertise, and operational cost.

Read how Architecture Modernization: Socio-technical alignment of software, strategy, and structure explains data engineering →

Also covered in

What to know first

Related concepts

Questions about data engineering

What is data engineering?

Data engineering is the discipline of designing and operating systems and processes that collect, transform, integrate, store, and deliver data for computational use.

Which Manning books explain data engineering?

Data Without Labels and Architecture Modernization: Socio-technical alignment of software, strategy, and structure.

What should I know before learning data engineering?

Manning books that teach data engineering usually introduce data warehouse, data source, machine learning and pipeline first.

What is the difference between data engineering and pipeline?

Data engineering is the discipline of designing and operating systems and processes that collect, transform, integrate, store, and deliver data for computational use. A pipeline is an ordered sequence of connected processing stages through which data or work flows, with each stage passing or transforming its output for subsequent stages.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.