liveBook · Manning

Vector compression

Vector compression reduces the storage required for numerical vector representations, typically by encoding them with fewer or lower-precision values while retaining useful information.

How 2 Manning books explain it

Retrieval Augmented Generation, The Foundational Ideas

Vector compression reduces the memory required to store vector representations, usually by encoding them with fewer or lower-precision values.

How it is used
Reduces vector-storage memory requirements within approximate nearest neighbor search systems.
How deep it goes
Defines compression's architectural role and memory impact but defers its implementation details.
Examples
Uses FAISS and million-vector searches to illustrate compressed, clustered retrieval.
What you can do after
Operate FAISS-style retrieval with substantially lower vector-storage requirements.

Read how Retrieval Augmented Generation, The Foundational Ideas explains vector compression →

Building Reliable AI Systems

A technique for reducing the memory footprint of high-dimensional embeddings while preserving most of their semantic properties.

How it is used
Reduce vector-index memory demands as retrieval systems scale, while retaining information needed for semantic search.
How deep it goes
Describes product, scalar, and binary quantization and a reranking workflow, without detailing implementation code or algorithms.
Examples
Compares codebook-based product quantization, int8 scalar quantization, one-bit binary quantization, and compressed first-pass search followed by reranking.
What you can do after
Apply quantization with tools such as FAISS, Qdrant, or Weaviate, or use compressed embeddings for scalable vector storage.

Read how Building Reliable AI Systems explains vector compression →

Related concepts

Questions about vector compression

What is vector compression?

Vector compression reduces the storage required for numerical vector representations, typically by encoding them with fewer or lower-precision values while retaining useful information.

Which Manning books explain vector compression?

Retrieval Augmented Generation, The Foundational Ideas and Building Reliable AI Systems.

What kinds of vector compression are there?

Kinds of vector compression include binary quantization, product quantization and scalar quantization.

What is vector compression a kind of?

Vector compression is a kind of compression. Compression is the encoding of data or information in a more compact representation to reduce its size while retaining content needed for recovery or use.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.