liveBook · Manning

Fidelity

As explained in Build an Advanced RAG Application (From Scratch)

Faithfulness measures whether the claims in a generated response are factually inferable from the retrieved context.

Faithfulness measures whether every claim in a generated response can be factually inferred from the retrieved context. It evaluates grounding rather than general correctness, helping detect hallucinated information in a RAG pipeline. section 6.5.1 section 6.5.2

Use faithfulness to inspect the generation component after evaluating retrieval quality:

  • Check whether the response remains within the information supplied by the retrieved documents. section 6.5.1
  • Treat unsupported claims as evidence that the response is not faithful, even when the answer appears relevant to the query. section 6.5.1
  • Use the metric alongside context precision, context recall, and answer relevancy for broader RAG evaluation. section 6.5.2
Figure 6.7 RAGAS Core Metric extensively covers LLM Grounding and Response (Source)

Use the grounding-and-response figure to place faithfulness within the RAGAS evaluation view. section 6.5.2

How Build an Advanced RAG Application (From Scratch) covers it

How deep it goes
Defines claim-level factual consistency and its purpose, but does not specify a scoring algorithm or implementation procedure.
Examples
Uses retrieved documents, generated responses, and their individual claims as evaluation artifacts.
What it assumes
Assumes a RAG system provides retrieved documents, a user query, and a generated response for comparison.
What you can do after
Evaluate whether a RAG response is grounded and identify unsupported information that may indicate hallucination.
How it connects
Connects retrieval quality with generation evaluation, context adherence, context precision, context recall, and answer relevancy.

Also explained in

Compare how 11 books explain fidelity →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Build an Advanced RAG Application (From Scratch). The section links point to the parts of the book it draws on.