liveBook · Manning

Branching and tagging

As explained in Architecting an Apache Iceberg Lakehouse

Branching and tagging is a version-reference technique that isolates mutable data changes and names stable data states.

Branching and tagging isolate data changes while giving stable names to known table states. In Apache Iceberg, both are snapshot references: branches can advance, while tags remain fixed. section 11.2.2

Use the references according to the required governance behavior:

  • Use branches for development, QA, or analyst testing where new snapshots should advance the reference. section 11.2.2
  • Use tags for releases and rerunnable jobs that must point permanently to one known-good snapshot. section 11.2.2
  • Attach retention limits to references so unused snapshots can be garbage-collected according to governance rules. section 11.2.2
SELECT ref_name, type, snapshot_id, max_reference_age_in_ms
FROM "db "."critical_fact_table.refs ";

Inspect a table’s refs table to list reference names, types, snapshots, and maximum reference ages. section 11.2.2

Release and development references

A refs listing can show main as the stable production branch, dev as a seven-day branch for testing, and release_2023_09 as an immutable release tag. section 11.2.2

How Architecting an Apache Iceberg Lakehouse covers it

How deep it goes
Defines mutable branches, immutable tags, refs-table inspection, and reference-based garbage collection, but stops short of cross-table isolation.
Examples
Uses main, dev, and release_2023_09 references plus a SQL query and tabular refs listing.
What it assumes
Contrasts traditional environment separation with Iceberg references while introducing branches, tags, snapshots, and refs-table inspection.
What you can do after
Operate/configure Iceberg snapshot references for development isolation, reproducible releases, and retention-aware lifecycle management.
How it connects
Connects snapshot references with rollback, snapshot isolation, lineage, retention policies, and environment separation.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Architecting an Apache Iceberg Lakehouse. The section links point to the parts of the book it draws on.