liveBook · Manning

Retrieve-then-generate pipeline

A retrieve-then-generate pipeline retrieves relevant information in a fixed pass and then generates an output conditioned on that information.

How 2 Manning books explain it

Retrieval Augmented Generation, The Foundational Ideas

Single-pass RAG is a retrieval-augmented generation architecture that performs one retrieval pass and then generates an answer without iterative planning or correction.

How it is used
Serves as a simple RAG baseline for answering knowledge questions when queries match a well-structured document collection.
How deep it goes
Explains indexing and query-time steps, then diagnoses ranking, freshness, and multi-hop failures; defers adaptive correction and planning.
Examples
Uses a 155-chunk PDF retrieval test and a compliance trace where an outdated policy outranks a newer directive.
What you can do after
Operate/configure it by adjusting top-k and curating evidence, while evaluating retrieval and generation separately.

Read how Retrieval Augmented Generation, The Foundational Ideas explains retrieve-then-generate pipeline →

Designing AI Systems

Pipeline-based RAG is a retrieval-augmented generation approach in which retrieval runs as a fixed mechanical step for each request.

How it is used
Grounds responses with organizational documents when each user message provides a usable search query.
How deep it goes
Implements indexing, search thresholds, document formatting, and context injection, but stops short of conversational query reformulation.
Examples
Uses vacation-policy lookup, Q2 planning outcomes, engineering commitments, and a company-knowledge index.
What you can do after
Apply it via the Data Service to retrieve filtered documents and supply grounded context to generation.

Read how Designing AI Systems explains retrieve-then-generate pipeline →

What to know first

Related concepts

Questions about retrieve-then-generate pipeline

What is retrieve-then-generate pipeline?

A retrieve-then-generate pipeline retrieves relevant information in a fixed pass and then generates an output conditioned on that information.

Which Manning books explain retrieve-then-generate pipeline?

Retrieval Augmented Generation, The Foundational Ideas and Designing AI Systems.

What should I know before learning retrieve-then-generate pipeline?

Manning books that teach retrieve-then-generate pipeline usually introduce knowledge base and similarity search first.

What is the difference between retrieve-then-generate pipeline and agentic RAG?

A retrieve-then-generate pipeline retrieves relevant information in a fixed pass and then generates an output conditioned on that information. Agentic RAG is a retrieval-augmented generation approach in which an agent dynamically decides how and when to retrieve information, often iterating or using tools before generating a response.

What kinds of retrieve-then-generate pipeline are there?

Kinds of retrieve-then-generate pipeline include retrieval-augmented generation.

What is retrieve-then-generate pipeline a kind of?

Retrieve-then-generate pipeline is a kind of pipeline. A pipeline is an ordered sequence of connected processing stages through which data or work flows, with each stage passing or transforming its output for subsequent stages.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.