A baseline is an existing model, method, heuristic, or reference result used to give a new approach’s measurements practical meaning. Without one, a metric such as recall@10 does not show whether performance is good, improved, or harmful to the product experience. section 3.6.3 section 2.2.2
Choose a comparison point that matches the decision you need to make:
- Compare with the current production model or a previous version to measure practical progress. section 3.6.3
- Use a simple heuristic, such as popularity-based recommendations, to establish a transparent minimum reference. section 3.6.3
- Compare user segments, content types, or aggregate performance to expose regressions that an overall score can hide. section 3.6.3 section 6.2
- Keep latency, cost, safety, fairness, calibration, and other guardrails within acceptable ranges; a higher primary metric alone is not enough. section 6.2
Movie recommendations
Suppose a new recommender achieves 12% recall@10 for cold-start users. Compare it with returning users at 28%, the previous model’s long-tail exposure of 12%, or a popularity baseline. These comparisons reveal whether the issue is a segment gap, a diversity trade-off, or a broader model regression. section 3.6.3 section 3.3.2
A baseline also anchors counterfactual evaluation: estimate how a candidate policy would perform from logged decisions, then compare its value with the baseline policy. Trust the comparison only when logging is accurate, policies overlap, and decision context is sufficiently captured. section 5.2.1


























