liveBook · Manning

Hierarchical execution model

As explained in Architecting an Apache Iceberg Lakehouse

A query-execution technique that organizes processing into hierarchical stages to coordinate work across distributed data sources.

A hierarchical execution model organizes a distributed query into nested units of work. In Trino, queries contain stages, stages contain tasks, and tasks process splits that can run concurrently across worker nodes. section 8.3.7

The hierarchy coordinates execution across distributed and federated environments:

  • Queries represent complete analytical requests and are decomposed into stages. section 8.3.7
  • Stages divide processing into tasks that can execute independently across cluster machines. section 8.3.7
  • Tasks operate on splits, enabling parallel reads, aggregations, filter pushdown, and reduced data movement. section 8.3.7

The model suits federation because it coordinates work across object storage, relational databases, and other sources while supporting concurrency, workload isolation, and scalable coordinator–worker deployments. section 8.3.7 section 8.7

Figure 8.10 Trino clusters are made up of a coordinator node that distributes work among worker nodes. The worker nodes can be horizontally scaled by adding more workers to handle more queries.

Use the cluster diagram to connect coordinator-distributed work with horizontally scalable worker capacity. section 8.3.7

How Architecting an Apache Iceberg Lakehouse covers it

How deep it goes
Explains execution from queries through stages and tasks to splits, including parallelism, pushdown, and data-movement reduction.
Examples
Uses object storage, relational databases, remote sources, parallel reads, and aggregations as execution examples.
What you can do after
Evaluate how Trino parallelizes federated workloads and scales compute across coordinator–worker clusters.
How it connects
Connects distributed query engines with federation, filter pushdown, coordinator–worker architecture, workload isolation, and runtime filtering.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Architecting an Apache Iceberg Lakehouse. The section links point to the parts of the book it draws on.