A baseline model is a reference student trained on ground-truth labels without teacher guidance. Comparing it with a distilled student isolates the benefit of adding a teacher’s soft targets, especially when both students use the same architecture. section 8.6.3
Comparing student training approaches
Train the same student architecture with hard labels alone, with hard labels plus teacher soft targets at T=3, and compare both with the teacher as an upper bound. The distilled student outperforms the baseline but does not match the teacher; gains are especially pronounced on ambiguous examples and challenging benchmarks such as AIME. section 8.6.3


























