liveBook · Manning

Multicollinearity

As explained in Effective Data Analysis

Multicollinearity is strong correlation among independent variables in a regression model.

Multicollinearity is strong correlation among independent variables in a regression model. It is a linear-regression assumption because correlated predictors can affect the accuracy and interpretation of model outputs. section 4.3.2 section 9.2.2

Assess multicollinearity during exploratory analysis and model evaluation:

  • Review correlations among independent variables and identify strongly correlated predictors. section 4.3.2 section 9.2.1
  • Select between variables when strong correlations indicate that one predictor adds little new information. section 4.3.2 section 9.2.1
  • Compare predictor effects in the fitted model with correlation results to judge whether remaining collinearity affects predictions. section 9.2.2

Weather and rat-sighting predictors

Monthly temperature patterns may make month redundant with daily high temperature, so month can be excluded. Day of week adds a distinct behavioral pattern and is unlikely to introduce collinearity with temperature or wind speed. section 9.2.1

Figure 9.25 Correlation matrix including the new binary weekday column.
figure

Use the correlation matrix to inspect relationships among high temperature, wind speed, weekday, and rat sightings. section 9.2.1

How Effective Data Analysis covers it

How deep it goes
Defines the assumption and recommends correlation review, but does not develop advanced diagnostics beyond predictor selection and model comparison.
Examples
Uses temperature, month, wind speed, weekday, and daily rat sightings to compare redundant and distinct predictors.
What it assumes
Assumes a linear regression setup with dependent and independent variables and treats multicollinearity as an assumption to assess.
What you can do after
Diagnose/debug with it: review predictor correlations, remove redundant variables, and evaluate whether collinearity affects predictions.
How it connects
Connects multicollinearity with linear regression, correlation matrices, independent variables, predictor selection, and model interpretation.

Also explained in

Compare how 7 books explain multicollinearity →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Effective Data Analysis. The section links point to the parts of the book it draws on.