liveBook · Manning

Encryption at rest

As explained in Architecting an Apache Iceberg Lakehouse

Encryption at rest is the protection of stored data by encoding it so that it cannot be read without the required cryptographic key.

Encryption at rest protects stored data files by encoding them so they cannot be read without the required cryptographic key. It forms part of a broader storage security design alongside access control, auditability, and compliant data placement. section 5.1.2

Apply encryption at rest across the lakehouse’s persistent layers:

  • Enable server-side encryption for storage data, using provider-managed keys or BYOK/KMS integration when compliance requires greater lifecycle control. section 5.1.2
  • Protect catalog metadata as well as data files, including snapshot history, partition values, schema records, and persisted catalog state. section 7.2.3
  • Pair encryption with identity controls, access logging, key-management records, and residency policies; encryption alone does not govern who may access data. section 5.1.2 section 7.2.3

Regulated healthcare lakehouse

A healthcare analytics platform encrypts patient records at rest, retains access and modification trails, and uses storage such as ADLS or StorageGRID with granular policies and identity integration. section 5.5.2

Figure 5.2 Factors to consider when analyzing a storage layer’s security

Use the security-factor diagram to compare encryption with permissions, auditability, and location when evaluating a storage layer. section 5.1.2

How Architecting an Apache Iceberg Lakehouse covers it

How deep it goes
Explains storage-layer encryption, key-management options, metadata coverage, and compliance dependencies without detailing cryptographic algorithms.
Examples
Uses ADLS, StorageGRID, Amazon S3, and Google Cloud Storage in regulated healthcare and public-cloud scenarios.
What it assumes
Assumes familiarity with storage layers, catalogs, access control, and compliance concerns while explaining encryption requirements in context.
What you can do after
Operate/configure storage and catalogs with encryption, managed keys, audit trails, and complementary access controls.
How it connects
Connects encryption at rest to access control, key management, auditability, data residency, and catalog security.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Architecting an Apache Iceberg Lakehouse. The section links point to the parts of the book it draws on.