liveBook · Manning

Variance

As explained in Delivering Machine Learning Projects: From design to deployment

Variance is a statistical measure of the average squared deviation of values from their mean.

Variance measures how widely key data properties are spread around their typical values. In exploratory data analysis, that spread helps determine whether validation data will represent the target domain well. section 6.1.1

Use variance as an EDA signal for modelling decisions:

  • Estimate validation-set size from the variance of important dataset properties. section 6.1.1
  • Use the spread of key variables to inform how data is ordered during training. section 6.1.1

How Delivering Machine Learning Projects: From design to deployment covers it

How deep it goes
Connects dataset variance to validation-set sizing and training order, without detailing calculation methods.
Examples
Uses key-variable spread as the signal for validation-set sizing and training-order decisions.
What you can do after
Apply it via exploratory data analysis to size validation data and inform training-data ordering.
How it connects
Links variance to exploratory data analysis, validation sets, training data, and target-domain representation.

Also explained in

Compare how 19 books explain variance →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Delivering Machine Learning Projects: From design to deployment. The section links point to the parts of the book it draws on.