Distribution drift occurs when the data or behavior encountered during use differs from what a model or metric was trained or calibrated on. For COMET, changes in input data can degrade performance; for best-of-N sampling, selecting high-reward responses shifts outputs away from the base policy’s distribution. section 3.3.4 section 7.5.7
In production translation, a sudden drop in a low-cost proxy metric can signal drift or model degradation and prompt investigation. Best-of-N creates a different risk: a reward model calibrated on base-policy samples may not remain calibrated on the selected responses. section 3.4.3 section 7.5.7

















