liveBook · Manning

Linear regression

As explained in LLM Evaluation and Alignment, The Foundational Ideas

A regression model predicts a continuous numerical value from input features.

Regression predicts an exact numerical score from evaluation features. In COMET, it estimates translation quality from the source, candidate, and reference, then learns to match human ratings. section 3.3.2 section 3.3.3

A regression estimator follows this workflow:

  • Collect examples with source text, candidate translation, reference translation, and absolute human scores. section 3.3.2
  • Extract features describing source alignment, reference similarity, and differences between the translations. section 3.3.3
  • Train the estimator by minimizing the difference between predicted scores and human ratings. section 3.3.2
  • Use the trained model to output a numerical quality estimate, such as 78 or 78.5. section 3.3.2

Absolute translation-quality prediction

Given a source, candidate, and reference, an estimator can learn that similar combinations of features typically receive a score around 78. This suits DA ratings, MQM scores, and HTER values, where numerical supervision is available. section 3.3.2

Figure 3.13 Two flavors of COMET. Regression predicts exact scores; ranking learns relative quality by positioning better translations closer to anchors in embedding space.

Compare exact-score regression with ranking, which learns relative quality instead of predicting an absolute value. section 3.3.2

How LLM Evaluation and Alignment, The Foundational Ideas covers it

How deep it goes
Defines prediction and loss, then connects them to a feed-forward regressor while deferring deeper implementation details.
Examples
Uses DA ratings, MQM scores, HTER values, and predicted outputs such as 78 or 78.5.
What it assumes
Assumes source, candidate, reference, and absolute human-judgment scores; contrasts with pairwise data used for ranking.
What you can do after
Apply it via COMET when absolute human quality scores are available for training.
How it connects
Connects regression to COMET, human judgments, ranking models, source alignment, reference alignment, and feed-forward regressors.

Also explained in

Compare how 28 books explain linear regression →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of LLM Evaluation and Alignment, The Foundational Ideas. The section links point to the parts of the book it draws on.