liveBook · Manning

Internal catalog

As explained in Architecting an Apache Iceberg Lakehouse

An internal catalog is a catalog whose table registrations and metadata operations are managed within the catalog service.

An internal catalog keeps table registration, metadata updates, and access coordination inside the catalog service while table data and metadata remain in configured cloud storage. Query engines interact through the Iceberg REST interface, separating storage from compute and supporting shared access across engines. section 7.4.10 section 7.4.4

Operational characteristics include:

  • Supports multi-engine access from Spark, Flink, Trino, Snowflake, or other Iceberg REST-compatible engines. section 7.4.10
  • Applies centralized RBAC through service principals, principal roles, and catalog roles at catalog, namespace, and table levels. section 7.4.4
  • Uses credential vending to provide temporary runtime access without exposing cloud storage credentials directly. section 7.4.10
  • Contrasts with external catalogs, whose synchronized tables are read-only from the managing service's perspective. section 7.4.4

How Architecting an Apache Iceberg Lakehouse covers it

How deep it goes
Explains managed registration, storage-path isolation, REST access, RBAC, and credential vending without detailing protocol internals.
Examples
Uses Spark, Flink, Trino, Snowflake, S3, ADLS, and GCS as engine and storage examples.
What it assumes
Assumes familiarity with Iceberg tables, cloud storage, query engines, and REST-based catalog access.
What you can do after
Operate/configure a managed Iceberg catalog with scoped engine access, storage isolation, and temporary credentials.
How it connects
Connects Iceberg REST Catalog, cloud object storage, RBAC, credential vending, external catalogs, and multi-engine architectures.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Architecting an Apache Iceberg Lakehouse. The section links point to the parts of the book it draws on.