liveBook · Manning

Multicollinearity

As explained in Statistics Slam Dunk

Multicollinearity is strong dependence among explanatory variables in a regression model, making their individual effects difficult to estimate reliably.

Multicollinearity occurs when two or more regression predictors are strongly correlated, making their separate effects difficult to estimate reliably. It can inflate explained variance because the model effectively counts overlapping information more than once. section 5.1 section 5.7.4

Check and respond to multicollinearity during regression development:

  • Inspect correlations among continuous or numeric variables before fitting or refining the model. section 5.1
  • Use car::vif() to calculate the variance inflation factor for each predictor. section 5.1 section 5.7.4
  • When a predictor’s VIF exceeds 5, remove offending variables and fit a reduced model to improve validity and reliability. section 5.7.4 section 5.9

NBA hustle-statistics regression

A multiple linear regression tested hustle statistics as predictors of regular-season wins. VIF values ranged from 1.06 to 3.05, so none exceeded the threshold of 5 and no predictor required removal for multicollinearity. section 5.7.4 section 5.9

vif(fit1)
## screen_assists_pts        deflections        loose_balls      
##           1.155995           1.062677           1.314189           
## contested_2pt    contested_shots 
##      3.052934           2.637588

Use the displayed VIF listing to compare predictors and identify values that may warrant a reduced model. section 5.7.4

How Statistics Slam Dunk covers it

How deep it goes
Defines strong predictor correlation, explains inflated variance, and gives a VIF threshold, but does not develop formal estimation theory.
Examples
Uses NBA hustle-statistic predictors, correlation checks, and a VIF listing with values between 1.06 and 3.05.
What it assumes
Assumes familiarity with predictors and linear regression while introducing correlation checks, VIF, and reduced-model correction.
What you can do after
Diagnose multicollinearity with car::vif() and refit a reduced regression when predictor VIF values exceed 5.
How it connects
Connects multicollinearity with multiple linear regression, correlation matrices, variance inflation factor, adjusted R2, and overfitting.

Also explained in

Compare how 7 books explain multicollinearity →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Statistics Slam Dunk. The section links point to the parts of the book it draws on.