BLEU score

As explained in Sutskever's List

BLEU is an automatic machine-translation metric based on n-gram overlap between generated and reference translations.

How Sutskever's List covers it

How deep it goes

Defines n-gram-overlap evaluation and interprets scores, but does not explain the metric’s internal calculation.

Examples

Uses English-to-French WMT results, comparing BLEU scores of 25.9 and 29.03 after dropout regularization.

What you can do after

Evaluate translation quality by interpreting higher BLEU scores as closer resemblance to human-written references.

How it connects

Connects BLEU score with machine translation, dropout, recurrent neural networks, perplexity, and transformer architecture.

liveBookmanning.com

Read Sutskever's List on liveBook Get the book at manning.com

Also explained in

• 

  liveBookmanning.com
  Generative AI in ActionBLEU is an automatic metric that evaluates machine-translated text by measuring its n-gram overlap with a human reference translation.
• 

  liveBookmanning.com
  LLMs in ProductionBLEU is an evaluation metric for machine translation that measures modified n-gram precision against one or more reference translations.
• 

  liveBookmanning.com
  Deep Learning with R, Third EditionA BLEU score measures the similarity of machine-translated text to one or more high-quality reference translations using n-gram overlap.

Compare how 4 books explain BLEU score →

Related concepts

• machine translationmeasures · Machine translation is the automated computational conversion of text or speech from one natural language into another.
• ROUGEcontrasts with · ROUGE is a family of automatic text-generation evaluation metrics that compare generated text with reference text using lexical overlap, often emphasizing recall.
• n-gramuses · An n-gram is a contiguous sequence of n consecutive items, commonly linguistic tokens or characters, drawn from a larger sequence.
• mathematical equivalencecontrasts with · Mathematical equivalence is a relation in which different expressions or representations have the same value or meaning under a specified interpretation.

This explainer was generated by Manning's knowledge graph from the text of Sutskever's List. The section links point to the parts of the book it draws on.