liveBook · Manning

Z-score

As explained in Machine Learning System Design

A z-score is the number of standard deviations by which a value differs from the mean of a reference distribution.

A z-score expresses how far a value lies from a reference mean in standard-deviation units. In production, that turns raw data into an alarm rule: compare current missingness or feature statistics with cleaned historical behavior. section 14.5.1

Two practical roles stand out:

  • Monitor data quality by setting alarms at three z-scores for important features and four for other features. Use comparable thresholds for expected feature ranges, alongside domain checks such as nonnegative sales values. section 14.5.1
  • Plan experiments with Zα for the desired Type I error rate and Zβ for desired power. Combined with estimated variance and minimum detectable change, these values contribute to the required sample size per group. section 12.2.1

A data-quality alarm

Suppose missing values for an important feature rise three standard deviations beyond cleaned historical behavior. Trigger an alarm, then check schema compliance, expected ranges, and invalid statistics before treating the change as a pipeline or data problem. section 14.5.1

How Machine Learning System Design covers it

How deep it goes
Explains threshold-based monitoring and Zα/Zβ in a sample-size equation, without deriving the underlying statistics.
Examples
Uses three- and four-z-score alarms, expected feature ranges, and Zα/Zβ in experiment planning.
What it assumes
Assumes historical data, estimated variance, error rates, statistical power, and minimum detectable change.
What you can do after
Apply it via historical baselines for monitoring and experiment-design calculations.
How it connects
Connects z-scores with data quality, feature importance, variance, significance levels, statistical power, and sample size.

Also explained in

Compare how 8 books explain z-score →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machine Learning System Design. The section links point to the parts of the book it draws on.