Retrieve-then-generate pipeline
A retrieve-then-generate pipeline retrieves relevant information in a fixed pass and then generates an output conditioned on that information.
Retrieval Augmented Generation, The Foundational Ideas
Single-pass RAG is a retrieval-augmented generation architecture that performs one retrieval pass and then generates an answer without iterative planning or correction.
- How it is used
- Serves as a simple RAG baseline for answering knowledge questions when queries match a well-structured document collection.
- How deep it goes
- Explains indexing and query-time steps, then diagnoses ranking, freshness, and multi-hop failures; defers adaptive correction and planning.
- Examples
- Uses a 155-chunk PDF retrieval test and a compliance trace where an outdated policy outranks a newer directive.
- What you can do after
- Operate/configure it by adjusting top-k and curating evidence, while evaluating retrieval and generation separately.
Designing AI Systems
Pipeline-based RAG is a retrieval-augmented generation approach in which retrieval runs as a fixed mechanical step for each request.
- How it is used
- Grounds responses with organizational documents when each user message provides a usable search query.
- How deep it goes
- Implements indexing, search thresholds, document formatting, and context injection, but stops short of conversational query reformulation.
- Examples
- Uses vacation-policy lookup, Q2 planning outcomes, engineering commitments, and a company-knowledge index.
- What you can do after
- Apply it via the Data Service to retrieve filtered documents and supply grounded context to generation.
Read how Designing AI Systems explains retrieve-then-generate pipeline →
What to know first
- knowledge baseA knowledge base is an organized body or representation of information that people or computational systems can consult to support retrieval, reference, reasoning, or tasks.
- similarity searchSimilarity search is a retrieval technique that finds or ranks items by their similarity to a query, often by comparing feature or vector representations under a similarity or distance measure.
Related concepts
- pipelinekind of · A pipeline is an ordered sequence of connected processing stages through which data or work flows, with each stage passing or transforming its output for subsequent stages.
- agentic RAGalternative to · Agentic RAG is a retrieval-augmented generation approach in which an agent dynamically decides how and when to retrieve information, often iterating or using tools before generating a response.
- multi-hop reasoningcontrasts with · Multi-hop reasoning is reasoning that connects evidence or inferences across multiple sources or intermediate steps to reach a conclusion.
- retrieval-augmented generationincludes · Retrieval-augmented generation is a technique that retrieves relevant information from external sources and supplies it as context to a generative model when producing an output.
Questions about retrieve-then-generate pipeline
What is retrieve-then-generate pipeline?
A retrieve-then-generate pipeline retrieves relevant information in a fixed pass and then generates an output conditioned on that information.
Which Manning books explain retrieve-then-generate pipeline?
Retrieval Augmented Generation, The Foundational Ideas and Designing AI Systems.
What should I know before learning retrieve-then-generate pipeline?
Manning books that teach retrieve-then-generate pipeline usually introduce knowledge base and similarity search first.
What is the difference between retrieve-then-generate pipeline and agentic RAG?
A retrieve-then-generate pipeline retrieves relevant information in a fixed pass and then generates an output conditioned on that information. Agentic RAG is a retrieval-augmented generation approach in which an agent dynamically decides how and when to retrieve information, often iterating or using tools before generating a response.
What kinds of retrieve-then-generate pipeline are there?
Kinds of retrieve-then-generate pipeline include retrieval-augmented generation.
What is retrieve-then-generate pipeline a kind of?
Retrieve-then-generate pipeline is a kind of pipeline. A pipeline is an ordered sequence of connected processing stages through which data or work flows, with each stage passing or transforming its output for subsequent stages.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

