Minimum detectable effect
The minimum detectable effect is the smallest true effect an experiment is designed to detect at specified statistical significance and power levels.
Machine Learning System Design
The smallest effect size that an experiment is designed to detect with specified statistical power and significance criteria.
- How it is used
- Guides A/B test planning by setting the smallest group difference the experiment should reliably detect.
- How deep it goes
- Defines the MDE and its sample-size inputs, then describes simulation checks for the planned error rates.
- Examples
- Uses photo-search metrics and regression for an initial estimate, then simulates an uplift to check detection sensitivity.
- What you can do after
- Evaluate an A/B test design by comparing its MDE with expected uplift and checking error rates through simulation.
Read how Machine Learning System Design explains minimum detectable effect →
AI Model Evaluation
The minimum detectable effect is the smallest true change in an outcome that an experiment is designed to detect with specified statistical power and significance.
- How it is used
- Guides sample-size planning and launch decisions for online model experiments.
- How deep it goes
- Defines the planning role of MDE and links it to power analysis, but does not derive its statistical formula.
- Examples
- Uses a movie recommendation test with contextual features, user-level randomization, and product guardrails.
- What you can do after
- Apply via power analysis to size experiments and judge whether measured product gains justify operational trade-offs.
Read how AI Model Evaluation explains minimum detectable effect →
Related concepts
- offline metricused by · An offline metric is a quantitative measure of model or algorithm performance evaluated on fixed, non-live data rather than through live system interaction.
- sample sizeconfigures · Sample size is the number of observations, units, or items included in a sample or group being analyzed.
Questions about minimum detectable effect
What is minimum detectable effect?
The minimum detectable effect is the smallest true effect an experiment is designed to detect at specified statistical significance and power levels.
Which Manning books explain minimum detectable effect?
Machine Learning System Design and AI Model Evaluation.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

