liveBook · Manning

F-score

As explained in Generative AI in Action

F-measure is a metric that combines precision and recall into a single balanced score.

F-score combines precision and recall into one balanced measure. It helps assess fine-tuned models when both the relevance of what a system returns and the content it misses matter. It is one evaluation signal, not a complete judgment of quality. section 9.3.2 section 12.2.2

Evaluating a content filter

A content filter can block appropriate content or let harmful content through. Use precision and recall—and their combined F1 score—to assess that balance. Also inspect false-positive and false-negative rates, user feedback, bias, and the filter’s effect on system performance. section 13.5.3

The way precision and recall are obtained depends on the evaluation method. For summarization, ROUGE compares generated text with a human reference using text overlap and reports an F-measure. BERTScore instead matches tokens using contextual embeddings, then combines its precision and recall scores into F1. ROUGE’s overlap does not establish semantic meaning or fluency, so use other metrics and human judgment when those qualities matter. section 12.2.2 section 12.2.3

How Generative AI in Action covers it

How deep it goes
Defines the balance concept and identifies uses in ROUGE and BERTScore, without giving a calculation formula.
Examples
Illustrates F-score through reference-based summary evaluation, embedding-based text comparison, and content-filter assessment.
What it assumes
Introduces precision and recall through captured reference content and useful generated content, without requiring mathematical derivation.
What you can do after
Evaluate/understand precision–recall trade-offs in content filters while checking error rates and qualitative feedback.
How it connects
Links precision and recall to ROUGE, BERTScore, fine-tuning evaluation, and content filtering.

Also explained in

Compare how 14 books explain f-score →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Generative AI in Action. The section links point to the parts of the book it draws on.