liveBook · Manning

WORM policy

As explained in Architecting an Apache Iceberg Lakehouse

WORM is a storage property that permits data to be written once while preventing subsequent modification or deletion for the protected retention period.

WORM (write once, read many) is a storage property that permits data to be written once while preventing alteration or deletion during a defined retention period. It protects records from tampering or accidental loss and supports regulatory, legal, and audit requirements. section 5.4.8

A WORM policy contributes to storage architecture in several ways:

  • Preserves financial records, medical data, logs, and compliance documents as immutable records. section 5.4.8
  • Implements immutability through specialized hardware or software-defined object-storage controls such as S3 Object Lock, Azure Immutable Blob Storage, and Google Cloud Storage retention policies. section 5.4.8
  • Combines with object locking, versioning, lifecycle rules, audit logging, encryption, and access controls to strengthen integrity and compliance. section 5.5.2 section 5.5.3

Long-term government retention

A government agency retaining historical Iceberg records for more than a decade can use Amazon S3, Wasabi, or NetApp StorageGRID with object locking and WORM capabilities. These controls prevent deletion or overwriting for the required retention period; S3 can enforce bucket-level compliance-mode locks, while Wasabi makes immutability a default storage feature. section 5.5.3

How Architecting an Apache Iceberg Lakehouse covers it

How deep it goes
Defines immutability, distinguishes hardware and software implementations, and stops short of detailed product configuration.
Examples
Uses financial, healthcare, government, log, and compliance records, including decade-long government archives.
What you can do after
Operate/configure object storage with retention locks that prevent deletion or overwriting during mandated periods.
How it connects
Connects WORM with object locking, retention policies, audit logging, encryption, access control, and Iceberg storage.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Architecting an Apache Iceberg Lakehouse. The section links point to the parts of the book it draws on.