liveBook · Manning

Regression coefficient

As explained in Causal Inference for Data Science

A regression coefficient is a parameter quantifying the change in a modeled outcome associated with a one-unit change in a predictor while other predictors are held fixed.

A regression coefficient measures how the modeled outcome changes when one predictor increases by one unit while the other included predictors remain fixed. Linear regression estimates the coefficients that best fit observed data, making the result both practical and interpretable for continuous variables. section 6.0

Airline price and demand

Suppose demand is modeled from ticket price and whether a flight occurs on a holiday. The price coefficient describes the change in booked seats associated with a one-unit price increase while holiday status stays unchanged. That interpretation is descriptive unless the model also addresses confounding: an airline might lower prices during economic crises and raise them in stronger periods, when demand is affected by other causes. section 6.0

The same coefficient can support different questions depending on the causal structure. A confounder can make the unadjusted coefficient misleading; including the confounder in Y ~ X + Z can estimate X's coefficient when the adjustment is appropriate. A mediator separates the direct effect from the total effect, whereas conditioning on a collider can create misleading correlation. Regression coefficients therefore require more than a good fit: interpret the variables and paths before treating them as causal effects. section 6.1.2 section 6.2.2

Use a regression coefficient by asking:

  • What outcome and predictor does it connect, and what units express a one-unit change? section 6.0
  • Which variables should be held fixed because they are confounders, and which should remain unconditioned because they are mediators or colliders? section 6.1.2
  • Does the coefficient represent a direct effect, a total effect, or merely an association? section 6.1.2

How Causal Inference for Data Science covers it

How deep it goes
Explains coefficient interpretation, adjustment, and path-based calculations, while stopping short of a complete treatment of model assumptions.
Examples
Uses airline pricing and demand, distance and customers, and kidney-stone causal diagrams to distinguish association from causal effect.
What it assumes
Assumes basic causal-inference ideas and statistical equations for variance, covariance, correlation, and linear expectations.
What you can do after
Evaluate regression coefficients by calculating associations, adjusting for confounders, and distinguishing direct from total effects.
How it connects
Connects regression coefficients to linear models, correlation, causal effects, confounders, mediators, colliders, and path analysis.

Also explained in

Compare how 5 books explain regression coefficient →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Causal Inference for Data Science. The section links point to the parts of the book it draws on.