liveBook · Manning

Strong consistency

As explained in Architecting an Apache Iceberg Lakehouse

Strong consistency is a storage property in which successful writes become immediately visible to subsequent reads and operations observe a single current state.

Strong consistency makes successful writes immediately visible to subsequent reads, while operations observe one current state. In Iceberg lakehouses, this reduces stale or partially visible metadata during concurrent commits, snapshot reads, and rollbacks. section 5.4.4 section 5.5.3

Strong consistency supports predictable storage behavior by:

  • Reducing delayed file visibility during ingestion, metadata commits, and cleanup. section 5.4.4
  • Preserving reliable metadata and file references during frequent schema evolution. section 5.5.3
  • Making snapshot creation and commit rollbacks behave predictably under high write frequency. section 5.5.3

Frequently evolving feature store

A startup repeatedly changes Iceberg schemas and commits metadata. Strong consistency from Google Cloud Storage or Azure Data Lake Storage helps keep metadata and file references immediately visible and intact. section 5.5.3

How Architecting an Apache Iceberg Lakehouse covers it

How deep it goes
Explains immediate visibility and atomic overwrites, but stops short of detailing storage-system implementation internals.
Examples
Uses Google Cloud Storage and Azure Data Lake Storage for frequently changing Iceberg feature-store metadata.
What it assumes
Assumes familiarity with Iceberg tables, object storage, metadata, snapshots, and schema changes.
What you can do after
Evaluate storage backends for predictable Iceberg commits, reads, rollbacks, and metadata visibility.
How it connects
Links storage consistency to Iceberg metadata commits, snapshot reads, schema evolution, commit rollbacks, and file references.

Also explained in

Compare how 2 books explain strong consistency →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Architecting an Apache Iceberg Lakehouse. The section links point to the parts of the book it draws on.