Operational independence means running a model without relying on an external provider’s availability, limits, or policies. A distilled student runs on your infrastructure, so it can keep serving requests if the teacher API is unavailable or the teacher model is deprecated. section 7.3 section 7.0
Distillation does not remove every provider dependency: the teacher may still be used to generate training data. The separation is at inference time, when the student no longer needs the teacher API. section 7.3 section 7.0
The operational tradeoff is clearest when an API-dependent deployment faces:
- Provider outages or rate limits that interrupt service. section 7.3
- Pricing changes or deprecation notices that affect continued API use. section 7.3
