Data lake
A data lake is a repository that stores large volumes of data in raw or lightly processed form and varied formats for later processing and analysis.
Think Like a CTO
A data lake is a large-scale storage repository that retains data in its original or varied formats for later processing and analysis.
- How it is used
- Positions a data lake as a staging and storage option when varied incoming data lacks a permanent home or awaits transformation.
- How deep it goes
- Defines the storage role and compares it with other stores, but does not detail lake implementation.
- Examples
- Uses AWS S3 as a possible starting point for parking data before deciding how and where to transform it.
- What you can do after
- Evaluate/understand when varied files need staging rather than a structured database or an analytics-focused warehouse.
Architecting an Apache Iceberg Lakehouse
A data lake is a storage-centered data platform that retains data in flexible formats on relatively inexpensive storage for varied downstream processing.
- How it is used
- Stores diverse, fast-growing data for downstream analytics when warehouse storage is too rigid or expensive.
- How deep it goes
- Explains storage architecture, file formats, historical engines, and governance failures, but defers detailed table-format implementation.
- Examples
- Uses clickstream events, application logs, IoT readings, social media data, HDFS, Amazon S3, Parquet, ORC, and CSV.
- What you can do after
- Evaluate data-lake tradeoffs and understand why table formats support more reliable lakehouse analytics.
Read how Architecting an Apache Iceberg Lakehouse explains data lake →
Effective Data Analysis
A centralized repository that stores large volumes of raw data in structured, semi-structured, or unstructured form for later processing and analysis.
- How it is used
- Positions raw data before warehouse curation, supporting varied analytical needs across wide and high-volume sources.
- How deep it goes
- Explains storage format, schema flexibility, suitable workloads, and cleanup requirements, but stops short of implementation details.
- Examples
- Uses mixed source formats, wide and big data, and company records covering clicks, sign-ups, purchases, and installations.
- What you can do after
- Evaluate storage options and justify whether a data lake suits anticipated analytical needs.
Also covered in
- Digital Twins in Action
- Apache Kafka in Action
- Snowflake Data Engineering
- Architecture Modernization: Socio-technical alignment of software, strategy, and structure
- DuckDB in Action
What to know first
- SQLSQL is a standardized declarative language for defining, querying, and manipulating data in relational database systems.
- data warehouseA data warehouse is a repository that integrates and organizes data for analytical querying, reporting, and analysis.
- columnar storageColumnar storage is a data layout that stores values grouped by column rather than by row.
- CSVCSV is a text format for tabular data in which records contain fields separated by commas, with conventions for quoting fields that contain special characters.
Related concepts
- object storeuses · An object store is a storage system that persists and retrieves discrete data objects by identifiers or keys, often with associated metadata.
- architectural stylekind of · An architectural pattern is a reusable high-level organization of software components, interactions, and constraints for addressing recurring system-design concerns.
- columnar storageuses · Columnar storage is a data layout that stores values grouped by column rather than by row.
- data lakehouseused by · A data lakehouse is a data architecture pattern combining the flexible storage of data lakes with the governance, reliability, and analytical capabilities of data warehouses.
Questions about data lake
What is data lake?
A data lake is a repository that stores large volumes of data in raw or lightly processed form and varied formats for later processing and analysis.
Which Manning books explain data lake?
Think Like a CTO, Architecting an Apache Iceberg Lakehouse and Effective Data Analysis.
What should I know before learning data lake?
Manning books that teach data lake usually introduce SQL, data warehouse, columnar storage and CSV first.
What is the difference between data lake and data swamp?
A data lake is a repository that stores large volumes of data in raw or lightly processed form and varied formats for later processing and analysis. A data swamp is a poorly governed data repository whose contents are difficult to discover, understand, query, or trust.
What is data lake a kind of?
Data lake is a kind of architectural style. An architectural pattern is a reusable high-level organization of software components, interactions, and constraints for addressing recurring system-design concerns.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.


