liveBook · Manning

Variance inflation factor

As explained in Statistics Every Programmer Needs

A variance inflation factor measures how much the variance of an estimated regression coefficient is inflated by collinearity among predictors.

A variance inflation factor (VIF) measures how much multicollinearity among predictors increases the variance of an estimated regression coefficient. section 5.2.2

Use VIF to guide predictor selection in regression models:

  • Treat VIF values of 1 or more as evidence that some predictor collinearity exists. section 5.2.2
  • Prioritize remediation when one or more predictors has a VIF of 10 or more. section 5.2.2
  • Calculate a predictor’s VIF by regressing it on the remaining predictors, obtaining R², and using that result in the VIF calculation. section 5.2.2
  • Consider discarding offending predictors and refitting a reduced model. section 5.2.2

Raisins logistic regression

Regressing MinorAxisLength on the other predictors produces R² = 0.9751 and VIF = 40.21. Automatic calculation returns high VIFs for Area, MajorAxisLength, MinorAxisLength, and ConvexArea. section 5.2.2

How Statistics Every Programmer Needs covers it

How deep it goes
Defines VIF, explains auxiliary regressions and R², demonstrates calculation, and stops short of deeper statistical derivation.
Examples
Uses raisin predictors, an auxiliary OLS regression, R² = 0.9751, and an automated VIF table.
What it assumes
Assumes familiarity with regression predictors and R² while demonstrating the auxiliary regression procedure explicitly.
What you can do after
Diagnose multicollinearity with statsmodels, identify high-VIF predictors, and refit a reduced logistic regression.
How it connects
Connects multicollinearity, logistic regression, linear regression, ordinary least squares, predictors, and coefficient variance.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Statistics Every Programmer Needs. The section links point to the parts of the book it draws on.