How deeply does Architecting an Apache Iceberg Lakehouse cover Azure Data Lake Storage?

Explains Blob Storage versus ADLS Gen2 through namespaces, filesystem operations, access controls, performance, and governance scenarios.

Azure Data Lake Storage

As explained in Architecting an Apache Iceberg Lakehouse

Azure Data Lake is Microsoft's cloud storage and analytics environment for storing and processing large volumes of data.

Azure Data Lake Storage (ADLS) provides a scalable Azure foundation for Iceberg lakehouses and analytics workloads. ADLS Gen2 builds on Blob Storage with a hierarchical namespace, filesystem semantics, atomic renames, and granular permissions. section 5.4.5

Choose ADLS capabilities according to workload and governance requirements:

Use Blob Storage for flat object storage, HTTPS access, durability, geo-redundancy, and Hot, Cool, or Archive performance tiers. section 5.4.5
Use ADLS Gen2 when analytics workloads require directory structures, atomic rename operations, or filesystem-like access. section 5.4.5
Apply Azure Active Directory authentication and POSIX-style ACLs when permissions must be enforced at file level or across restricted user groups. section 5.4.5 section 5.5.2

Cloud-native Iceberg ingestion

Azure Data Factory can use Copy activities to write directly to Iceberg tables in ADLS Gen2, supporting downstream Microsoft Fabric or Databricks on Azure integrations. section 6.4.9

How Architecting an Apache Iceberg Lakehouse covers it

Cover of Architecting an Apache Iceberg Lakehouse

liveBook manning.com

Read Architecting an Apache Iceberg Lakehouse on liveBook Get the book at manning.com

Related concepts

Apache Icebergused by · Apache Iceberg is an open table format for managing large analytical datasets with metadata, schema evolution, snapshots, and transactional operations across distributed or object storage.
Azure Blob Storageimplements · Azure Blob Storage is Microsoft Azure’s managed cloud object-storage service for storing and accessing unstructured data as blobs.
Microsoft Entra IDuses · Microsoft Entra ID is Microsoft's cloud-based identity and access-management service for authenticating users, applications, and services and controlling their access to resources.
access control listuses · An access control list is a collection of rules specifying which subjects or traffic may access a resource or perform particular operations.
Dremio Cloudused by · Dremio Cloud is a managed cloud data lakehouse platform for querying, managing, and accelerating access to data across diverse sources.

This explainer was generated by Manning's knowledge graph from the text of Architecting an Apache Iceberg Lakehouse. The section links point to the parts of the book it draws on.