A baseline is a reference system or result used to judge whether another system improves. In retrieval-augmented generation, metrics matter only beside a comparable reference: a baseline turns an isolated score into evidence about progress, tradeoffs, and failure points. section 3.2.1 section 15.5.3
Build and use a baseline before adding sophisticated techniques:
- Choose a structurally similar reference system so training or knowledge-integration changes can be isolated. section 3.2.1
- Evaluate on an unseen test split; memorized training examples can make an apparent improvement misleading. section 3.2.1
- Record accuracy together with inference time and parameter count, because higher recall may cost latency or index memory. section 3.2.1
- Establish RAGAS-triad measurements before advanced methods, then optimize the largest observed failure gap. section 15.5.3
A new RAG deployment
Start with naive RAG plus reranking for mostly factual queries. Measure retrieval and reader behavior from k=1 through k=20. If performance peaks and declines, improve reranking or context compression before increasing retrieval depth; if it improves and plateaus, retrieving more passages may be safe. section 15.5.3


























