liveBook · Manning

Confidence

As explained in The Art of AI Product Development

Confidence is a degree of belief or certainty in the validity of a conclusion or expected outcome.

Confidence expresses how strongly an AI output should be trusted. It is useful when the system can explain uncertainty and show which parts require human review rather than presenting every result as equally reliable. section 10.2.1 section 10.4

A confidence-aware experience should:

  • Warn users when required data is missing before displaying the result. section 10.2.1
  • Show an overall score alongside granular scores for individual paragraphs, statements, or passages. section 10.2.1
  • Explain low scores, such as missing data or ambiguity in regulatory text. section 10.2.1
  • Let users edit, shorten, remove, or otherwise reject uncertain content before publication. section 10.2.1 section 10.4

Reviewing an AI-generated draft

A draft displays high-confidence passages in green and uncertain passages in yellow. The user opens an explanation for a low score, supplies missing information, edits the highlighted text, and reruns the check before publishing. section 10.2.1

Figure 10.10 The draft of the report section is provided together with confidence scores; lower scores indicate statements and passages that should be verified by the user.
A screenshot of a document

AI-generated content may be incorrect.

Use the figure to inspect how overall and passage-level confidence scores direct verification. section 10.2.1

How The Art of AI Product Development covers it

How deep it goes
Explains overall and granular scores, causes of low confidence, review cues, and corrective editing, stopping short of scoring internals.
Examples
Uses color-coded paragraph scores, explanatory tooltips, highlighted phrases, editing actions, and a final publication check.
What it assumes
Assumes users can review and edit generated content; teaches them how uncertainty signals focus that work.
What you can do after
Apply it via confidence indicators to verify uncertain passages, improve drafts, and maintain critical oversight of AI contributions.
How it connects
Links confidence to uncertainty, transparency, trust, missing data, user feedback, and human control over AI outputs.

Also explained in

Compare how 13 books explain confidence →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of The Art of AI Product Development. The section links point to the parts of the book it draws on.