What is faithfulness in RAG?

Faithfulness in RAG asks whether the claims in a generated answer are supported by the retrieved context supplied to the model. A faithful answer does not add unsupported details, even if those details sound plausible.

Beginner-friendly example

A retrieved HR policy states:

> Employees may carry forward up to 5 unused leave days with manager approval.

Faithful answer: “Employees can carry forward up to five unused leave days if their manager approves.”

Unfaithful answer: “Employees can carry forward ten days without approval.”

The second answer contradicts the source. Another unfaithful answer might correctly say “five days” but invent an application deadline absent from the retrieved text.

How is faithfulness different from other qualities?

• Faithfulness: Does the *provided context* support the answer's factual claims?
• Answer relevance: Does the answer address what the user actually asked?
• Retrieval relevance: Did the search return useful evidence?
• Real-world correctness: Is the statement factually true outside the provided context?

A model can give a factually correct answer from prior knowledge that is not faithful to the supplied evidence. Conversely, a faithful answer can repeat an incorrect statement from a flawed source. This is why source quality and answer faithfulness are separate checks.

How is faithfulness evaluated?

1. Identify the answer's distinct factual claims.
2. Check each claim against the supplied retrieved context.
3. Label claims supported, contradicted, or not established by the evidence.
4. Compute a supported-claim ratio as one simple metric: supported claims / total factual claims.
5. Review important conditions such as dates, quantities, scope, and exceptions separately.

For example, if an answer makes 4 factual claims and the context supports only 3, its illustrative claim-support score is 3/4 = 0.75. Real evaluation frameworks can use more nuanced judgments or entailment models instead of this basic ratio.

How can a RAG system improve faithfulness?

• Retrieve complete, applicable passages rather than fragmented statements.
• Preserve source version, section, and qualifiers during context construction.
• Instruct the generator to answer from retrieved evidence and acknowledge missing information.
• Require traceable citations for important claims, then verify that cited passages actually support those claims.
• Run a claim-level verification pass for high-stakes use cases.

Important: A citation marker alone is not proof of faithfulness. The cited passage must support the particular claim.

Interview takeaway

Faithfulness measures the degree to which a RAG answer is supported by its retrieved evidence—not just whether it sounds correct or includes citations. Evaluate factual claims against the context and avoid unsupported additions.