Columnar storage engine

Q: How deeply does Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI cover columnar storage engine?

Defines columnar storage and contrasts it with row-based storage, but does not descend into storage-engine internals.

As explained in Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI

A columnar storage format stores values from the same table column contiguously to support efficient column-oriented access.

A columnar storage format keeps values from the same table column together, making dense tabular data more efficient to store and access than with row-based storage. section 2.3.1

Polars uses columnar storage alongside high-performance execution, improved memory management, and large-dataset handling. Its DataFrame API resembles pandas, while eager and lazy modes support different execution patterns. section 2.3.1

Choosing a tabular-data engine

For massive or dense tabular datasets, evaluate Polars alongside pandas and Spark. Check whether required pandas functions are available before refactoring, then compare the options against dataset size and usage. section 2.3.1

How Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI covers it

Cover of Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI

liveBook manning.com

Read Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI on liveBook Get the book at manning.com

Related concepts

databasekind of · A database is an organized collection of persistent data managed by software for storage, retrieval, querying, and modification.
DuckDBused by · DuckDB is an open-source, in-process analytical database management system with a columnar-vectorized execution engine for fast local querying.
TimescaleDBused by · TimescaleDB is a PostgreSQL extension optimized for storing and querying time-series data.

This explainer was generated by Manning's knowledge graph from the text of Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI. The section links point to the parts of the book it draws on.