Query engine
A query engine is a software component that processes queries against data or knowledge sources and produces results.
Architecting an Apache Iceberg Lakehouse
A query engine is a software system that parses, plans, and executes queries against data sources.
- How it is used
- Deploys query engines as the execution layer between catalogs, data sources, federation services, and analytical consumers.
- How deep it goes
- Explains metadata resolution, scan planning, commits, security enforcement, distributed execution, and client connectivity without descending into engine internals.
- Examples
- Uses Dremio, Trino, Spark SQL, Docker Compose, Nessie, MinIO, Superset, JDBC, and ODBC as concrete platform examples.
- What you can do after
- Operate/configure query engines within Iceberg lakehouse, federated, governed, and BI-consumption architectures.
Read how Architecting an Apache Iceberg Lakehouse explains query engine →
DuckDB in Action
A query engine is the database component that transforms submitted queries into computed results.
- How it is used
- Deploys query execution for efficient analytics across files, pipelines, external stores, and in-memory DataFrames.
- How deep it goes
- Explains parsing, planning, runtime, and vectorized execution, then stops short of implementation internals.
- Examples
- Demonstrates filtering an authors DataFrame, parameterized queries, cursor results, DataFrame results, and relational chaining.
- What you can do after
- Apply it via DuckDB to query files, pipelines, external stores, and pandas DataFrames without duplicating datasets.
Hugging Face in Action
A query engine is a software component that accepts a query and returns a response from an underlying data or knowledge source.
- How it is used
- Answers questions over indexed documents and connects those answers to interactive applications.
- How deep it goes
- Explains configuration, device selection, interaction methods, and deployment trade-offs without detailing retrieval internals.
- Examples
- Uses PDF receipts, local Llama inference, OpenAI querying, Gradio interfaces, and follow-up purchase questions.
- What you can do after
- Build it from scratch by configuring a LlamaIndex query engine and exposing it through Python or Gradio.
Related concepts
- Dremio Cloudincludes · Dremio Cloud is a managed cloud data lakehouse platform for querying, managing, and accelerating access to data across diverse sources.
- DuckDBpart of · DuckDB is an open-source, in-process analytical database management system with a columnar-vectorized execution engine for fast local querying.
- lakehouse cataloguses · A catalog is a service or interface that registers lakehouse tables, resolves their metadata, and coordinates table updates across data engines.
- sessioncontrasts with · A session is a bounded interaction context associated with a user, client, or process that may maintain state across related operations or requests.
- authorizationimplements · Authorization is the determination and enforcement of rules governing which subjects may access resources or perform operations.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.