liveBook · Manning

Bottleneck layer

As explained in Retrieval Augmented Generation, The Foundational Ideas

A dense bottleneck is a constrained continuous vector representation through which an encoder compresses input information.

A dense bottleneck is a constrained, fixed-size vector through which an encoder compresses text for dense retrieval. It acts as a lossy compressor: surface details that do not fit are discarded while core semantic and topical patterns remain. section 7.3

In HyDE, the bottleneck helps retrieval tolerate hallucinated details in a hypothetical document. Wrong dates or names may disappear during compression, but a wrong question framing remains and can steer retrieval toward the wrong subject area. section 7.3

HyDE retrieval pipeline

A language model generates a hypothetical passage, and an encoder maps it to one vector. The same encoder embeds corpus documents so both representations occupy the same vector space; retrieval then compares the hypothetical-document vector with corpus vectors. section 7.3

How Retrieval Augmented Generation, The Foundational Ideas covers it

How deep it goes
Explains lossy compression, semantic preservation, hallucination filtering, and framing failures, but not encoder internals.
Examples
Uses HyDE hypothetical passages, corpus embeddings, Contriever, and a LangChain HypotheticalDocumentEmbedder listing.
What it assumes
Assumes familiarity with text embeddings and retrieval while defining lossy compression through image and audio analogies.
What you can do after
Apply it via LangChain by generating a hypothetical passage and embedding it with the same encoder used for corpus documents.
How it connects
Connects dense retrieval with embeddings, encoders, contrastive learning, hallucinations, and vector spaces.

Also explained in

Compare how 6 books explain bottleneck layer →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Retrieval Augmented Generation, The Foundational Ideas. The section links point to the parts of the book it draws on.