liveBook · Manning

Embedded analytics database

As explained in DuckDB in Action

An embedded database is a database system that executes within the process of an application or notebook.

An embedded analytics database runs inside an application, notebook, or command-line process rather than through a separate network service. DuckDB applies this model to local analytical work, efficiently querying gigabytes across files, databases, and in-memory data structures. section 1.1 section 2.1

This deployment model connects directly to practical data workflows:

  • Query CSV, JSON, Parquet, Apache Arrow, cloud-bucket or URL data without first loading everything into a separate server. section 1.1
  • Use SQL from the CLI, or query pandas and Polars DataFrames from Python and notebooks. section 1.1 section 6.0
  • Move query results into DataFrames or Apache Arrow tables for subsequent analysis. section 6.0

A practical starting point

Open the DuckDB CLI and query local analytical files directly; use the Python API when the surrounding workflow already operates on pandas or other Python objects. section 2.1 section 6.0

Figure 1.1 DuckDB and other tools in the ecosystem
figure

Use the ecosystem overview to place DuckDB alongside applications, file formats, Python tools, and other data systems. section 1.1

How DuckDB in Action covers it

How deep it goes
Defines embedded execution and surveys integrations, but stops short of detailed query-processing internals.
Examples
Uses DuckDB CLI queries, local and remote files, pandas DataFrames, Polars DataFrames, and Apache Arrow tables as workflow examples.
What it assumes
Assumes basic data-querying familiarity while introducing serverless CLI use and Python-object querying.
What you can do after
Operate/configure DuckDB through its CLI or Python API and move analytical results between files, queries, and DataFrames.
How it connects
Connects SQL with Python, pandas, Polars, Apache Arrow, CLI workflows, cloud storage, and multiple file and database formats.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of DuckDB in Action. The section links point to the parts of the book it draws on.