liveBook · Manning

Compliance

As explained in Architecting an Apache Iceberg Lakehouse

A compliance posture is an organization's current condition of adherence to applicable laws, regulations, policies, and data-handling requirements.

Compliance is an organization’s current adherence to applicable laws, regulations, policies, and data-handling requirements. In a lakehouse, it is an architectural constraint: storage location, catalog controls, query access, encryption, retention, and auditability must work together rather than being treated as isolated features. section 4.4.1 section 7.2.3

A compliance-oriented platform typically addresses:

  • Data residency: keep regulated datasets within required geographic or on-premises boundaries, and use region-aware catalogs or partitioning where locality rules apply. section 4.4.1 section 9.5.6
  • Identity and authorization: integrate the catalog with IAM, LDAP, OAuth, or SSO systems so roles control table discovery, querying, metadata changes, and sensitive metrics. section 7.2.3 section 9.5.6
  • Protection and accountability: encrypt data and metadata in transit and at rest, log administrative and query activity, track snapshots, and apply masking or retention policies. section 7.2.3 section 9.5.6
  • Operational fit: select storage and archival policies alongside regulatory obligations, existing infrastructure, workload timing, durability, and cost. section 5.5 section 5.5.1

Apache Iceberg contributes schema enforcement, transactional integrity, metadata-based queryability, and snapshot history, but the catalog remains central to compliance enforcement. It governs who can access tables and metadata, protects persisted metadata, and supports residency, logging, retention, and deletion requirements. section 4.4.1 section 7.2.3

Regional healthcare analytics

A healthcare provider stores patient data in geographically and departmentally partitioned Iceberg tables. A region-aware catalog tags locality requirements, while Dremio enforces them during query planning. Power BI serves clinical dashboards from a compliant regional cloud environment, and containerized JupyterHub environments provide isolated research access. Federated semantic definitions standardize sensitive metrics, while role-based access, masking, query logs, and snapshot tracking preserve governance across analytics and machine-learning workloads. section 9.5.6

How Architecting an Apache Iceberg Lakehouse covers it

How deep it goes
Explains controls across storage and catalog layers, then applies them to a governed healthcare workload without descending into regulatory interpretation.
Examples
Uses regulated banking storage, archived regulatory reports, and regional healthcare analytics with dashboards, notebooks, and federated queries.
What it assumes
Assumes applicable regulatory obligations and organizational identity systems, while explaining how catalogs, storage, and query layers enforce them.
What you can do after
Operate/configure a lakehouse that localizes regulated data, restricts access, protects metadata, preserves audit trails, and supports compliant analytics.
How it connects
Connects data residency, identity and access management, encryption, audit trails, metadata lifecycle, data masking, and Apache Iceberg.

Also explained in

Compare how 12 books explain compliance →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Architecting an Apache Iceberg Lakehouse. The section links point to the parts of the book it draws on.