Concept drift
Concept drift is a change over time in the data-generating process, including the distribution of inputs or the relationship between inputs and target outcomes.
Machine Learning System Design
A change over time in the relationship between input features and the target outcome, making previously learned patterns invalid.
- How it is used
- Frames changing input-outcome relationships as a production model reliability problem.
- How deep it goes
- Defines drift types and outlines monitoring, investigation, and retraining choices without exhaustively covering every response scenario.
- Examples
- Uses tax-service marketing, pandemic-driven behavior changes, and equipment wear to illustrate changing relationships.
- What you can do after
- Diagnose/debug with it by investigating performance degradation and considering retraining or rebuilding when relationships change.
Read how Machine Learning System Design explains concept drift →
Financial AI in Practice
A change over time in the relationship between input data and the target a model is intended to predict.
- How it is used
- Frames concept drift as an operational risk for fraud detection models facing adaptive adversaries.
- How deep it goes
- Defines the risk and outlines monitoring, feedback, validation, and retraining without specifying a concept-drift detection algorithm.
- Examples
- Uses fraudsters exploiting macroeconomic events and loopholes in new financial products to illustrate changing tactics.
- What you can do after
- Evaluate and understand how changing fraud patterns can weaken models and why monitoring and retraining are needed.
Deep Learning with Python, Third Edition
A change over time in the statistical properties of production data that can degrade a deployed model's performance.
- How it is used
- Frames changing production data as a central reason deployed models lose accuracy and require continuing maintenance.
- How deep it goes
- Explains temporal change, causes, examples, and retraining responses, but does not specify detection metrics or algorithms.
- Examples
- Uses music recommendation, IMDB sentiment classification, and credit card fraud detection to illustrate different drift rates.
- What you can do after
- Operate a maintenance loop that watches production changes, refreshes annotations, and retrains models as their data environment evolves.
Read how Deep Learning with Python, Third Edition explains concept drift →
Designing Deep Learning Systems: A guide for software engineers
A change over time in the relationship between model inputs and the target behavior being predicted.
- How it is used
- Detects production model degradation through continuous monitoring and informs alerts or retraining.
- How deep it goes
- Treats concept drift as a monitoring signal connected to alerting and retraining, without detailing statistical detection methods.
- Examples
- Uses continuous-monitoring pipelines, model-serving APIs, quality gates, developer alerts, and automated retraining as operational examples.
- What you can do after
- Diagnose production degradation with continuous-monitoring pipelines and respond through alerts or model retraining.
Read how Designing Deep Learning Systems: A guide for software engineers explains concept drift →
Deep Learning with R, Third Edition
Concept drift is a change over time in the data-generating patterns or relationships that a deployed machine-learning model depends on.
- How it is used
- Guides dataset collection and maintenance when deployed prediction patterns change over time.
- How deep it goes
- Defines changing production properties, gives domain examples, and stops short of detailed detection methods.
- Examples
- Uses IMDb sentiment across years and rapidly changing credit-card fraud patterns as examples.
- What you can do after
- Diagnose gradual accuracy decay and respond through current-data collection, annotation, and model retraining.
Read how Deep Learning with R, Third Edition explains concept drift →
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
Concept drift is a change over time in the relationships between input predictors and the target that can make a previously trained model ineffective.
- How it is used
- Frames model validation and lifecycle planning around changing future data and retraining.
- How deep it goes
- Defines changed predictor-target relationships, explains performance decay, and links drift to retraining without detailing detection.
- Examples
- Uses economic, consumer, social, and political change, plus an XGBoost pipeline retrained through repeated modeling cycles.
- What you can do after
- Operate/configure retraining cycles when predictor-target relationships change and validation results stop representing later performance.
Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains concept drift →
LLM Customization and Fine-Tuning
A change in the relationship between a model’s input data and the concepts or outcomes it is expected to represent.
- How it is used
- Distinguishes changed input-to-answer relationships from other causes of production model degradation.
- How deep it goes
- Defines four drift forms and gives freshness checks, while rejecting scheduled retraining as the default response.
- Examples
- Uses an Active Directory-to-SSO migration to show unchanged password-reset questions receiving outdated answers.
- What you can do after
- Diagnose stale answers by reviewing recent questions, training vocabulary, and changes reported by support leads.
Read how LLM Customization and Fine-Tuning explains concept drift →
Delivering Machine Learning Projects: From design to deployment
Concept drift is a change in the underlying relationships between inputs and outcomes that reduces the applicability of a previously trained model.
- How it is used
- Frames post-deployment model maintenance around changing domains, data flows, interfaces, and infrastructure.
- How deep it goes
- Defines relationship, noise, and interface changes, then recommends monitoring and assertions without detailing adaptation algorithms.
- Examples
- Uses clothing recommendations disrupted by a pandemic and changing data-noise patterns as concrete drift examples.
- What you can do after
- Diagnose model degradation by monitoring performance, checking behavioral assertions, and investigating domain, noise, or interface changes.
Read how Delivering Machine Learning Projects: From design to deployment explains concept drift →
Also covered in
What to know first
- accuracyAccuracy is the degree to which a result agrees with a specified truth, reference, or criterion, commonly measured as the proportion of evaluated predictions that are correct.
- language modelA language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- machine learningMachine learning is a field of computational methods in which systems learn patterns or relationships from data to make predictions, decisions, or other outputs.
- retrainingModel retraining is the process of training an existing machine-learning model again, often with new or updated data or changed training conditions.
Related concepts
- driftkind of · Drift is a change or divergence over time in a system’s data, state, behavior, or performance relative to a reference or intended condition.
- stale dataproduced by · Stale data is information that no longer reflects the latest state of its source or relevant conditions.
- strategy and monitoring layerused by · The decision-system layer that interprets model signals against business objectives, policies, regulations, and monitored outcomes.
- canary checkaddressed by · A canary check is a limited evaluation of selected system behaviors, often using prompts, to detect harmful changes or regressions before broader deployment or reliance.
- real datauses · Data originating from or collected in actual real-world activities, systems, or environments rather than being artificially generated solely for testing or simulation.
Questions about concept drift
What is concept drift?
Concept drift is a change over time in the data-generating process, including the distribution of inputs or the relationship between inputs and target outcomes.
Which Manning books explain concept drift?
Machine Learning System Design, Financial AI in Practice, Deep Learning with Python, Third Edition, Designing Deep Learning Systems: A guide for software engineers, Deep Learning with R, Third Edition, Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI, LLM Customization and Fine-Tuning and Delivering Machine Learning Projects: From design to deployment.
What should I know before learning concept drift?
Manning books that teach concept drift usually introduce accuracy, language model, machine learning and retraining first.
What kinds of concept drift are there?
Kinds of concept drift include gradual concept drift.
What is concept drift a kind of?
Concept drift is a kind of drift. Drift is a change or divergence over time in a system’s data, state, behavior, or performance relative to a reference or intended condition.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.







