Context precision measures whether retrieved documents provide relevant information and whether the most relevant chunks appear near the top of the ranked results. It helps verify that generation receives useful context rather than merely a large context window. section 6.5.2
Use context precision as one component of systematic RAG evaluation:
- Check retrieval quality by examining the relevance of returned documents and the placement of the best chunks. section 6.5.2
- Pair it with context recall, faithfulness, and answer relevancy to evaluate retrieval coverage, grounding, and response quality. section 6.5.2 section 6.6
- Use the composite RAGAS score to compare configurations and track improvements over time alongside individual metric results. section 6.5.2
Ranked retrieval results
For a query, a retrieval system can return several chunks. Context precision is higher when the chunks containing the most relevant information occupy the top positions, giving the language model better evidence for generation. section 6.5.2
Figure 6.7 RAGAS Core Metric extensively covers LLM Grounding and Response (Source)
Use the RAGAS metric overview to place context precision alongside measures of grounding and response quality. section 6.5.2

