liveBook · Manning

Imputation

As explained in Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI

Imputation is the replacement of missing data with estimated values or classes derived from available information.

Imputation replaces missing values with estimated values or classes so tabular learning algorithms can use the data. It is especially useful when classical machine-learning methods cannot handle missing values directly. section 2.2.4

Choose the replacement strategy according to the available information and the meaning of missingness:

  • Simple univariate imputation uses information from the same column, such as its mean or median. section 2.2.4 section 6.1.1
  • Multivariate imputation uses the other available columns to reconstruct a more informed value or class. section 2.2.4 section 6.1.1
  • A missing indicator can preserve the fact that a value was absent when missingness carries useful information. section 2.2.4 section 6.1.1

Comparing simple and multivariate estimates

A continuous-feature workflow creates 5% artificial missingness, fills one copy with SimpleImputer, and fills another with IterativeImputer using a RandomForestRegressor. The reported mean absolute errors are lower for multivariate imputation across the listed features, including number_of_reviews and availability_365.

How Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI covers it

How deep it goes
Defines univariate and multivariate replacement, compares their errors, and defers specialized treatment of MNAR data.
Examples
Compares mean-based SimpleImputer with Random Forest-based IterativeImputer on continuous tabular features and mean absolute error.
What it assumes
Assumes tabular features and missing values, while distinguishing missingness mechanisms and teaching simple replacement from the basics.
What you can do after
Apply imputation with scikit-learn’s SimpleImputer or IterativeImputer and evaluate replacement quality with mean absolute error.
How it connects
Links missing data with missing indicators, MCAR, MAR, MNAR, and gradient-boosted decision trees.

Also explained in

Compare how 2 books explain imputation →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI. The section links point to the parts of the book it draws on.