liveBook · Manning

Student model

As explained in AI Governance

A distilled model is a model trained to approximate the behavior of another model, often using that model’s outputs as training data.

A distilled model is trained to approximate another model’s behavior. One route is to expose a high-value model through an API, capture its outputs as labeled data, and train a competing model on them. section 6.6.3

This creates intellectual-property risk even without a direct breach: captured outputs can encode valuable system behavior. Terms of service can restrict scraping, large-scale caching, and competitive reuse of generated outputs, though broad reuse rights may make disputes harder to litigate. section 6.6.3

API outputs as training data

OpenAI alleged that DeepSeek systematically queried ChatGPT outputs to train a competing model. section 6.6.3

How AI Governance covers it

How deep it goes
Describes how API outputs become labeled training data and identifies contractual limits, without detailing distillation methods.
Examples
Cites an allegation that DeepSeek queried ChatGPT outputs to train a competing model.
What you can do after
Evaluate exposure by reviewing output-use terms for restrictions on scraping, bulk caching, and competitor training.
How it connects
Connects model distillation to APIs, intellectual property, fine-tuning, and retrieval-augmented generation.

Also explained in

Compare how 6 books explain student model →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of AI Governance. The section links point to the parts of the book it draws on.