liveBook · Manning

AIC

As explained in Statistics Every Programmer Needs

AIC is an information criterion that balances a model's log-likelihood against a penalty for the number of estimated parameters.

Akaike Information Criterion (AIC) compares model fit while penalizing estimated parameters. It favors models that explain observed data well without unnecessary complexity; lower values are preferred. section 7.3.10

Use AIC to support model-comparison decisions:

  • Compare competing models fitted to the same observations. section 7.3.10
  • Interpret log-likelihood together with parameter count rather than treating fit alone as sufficient. section 7.3.10
  • Use BIC or HQIC alongside AIC when a stronger or sample-size-sensitive complexity penalty matters. section 7.3.10

Comparing Holt–Winters and ARIMA

A Holt–Winters model with additive trend and seasonality produced AIC = 198.23435477953498. Its AIC was lower than the corresponding ARIMA value, supporting Holt–Winters as the better-fitting model for this comparison. section 7.4.7

>>> print(f"AIC: {hw_model.aic}")
AIC: 198.23435477953498

>>> print(f"BIC: {hw_model.bic}")
BIC: 223.54401397788672

Inspect the fitted Holt–Winters model's AIC and BIC values directly. section 7.4.7

How Statistics Every Programmer Needs covers it

How deep it goes
Defines the fit-complexity trade-off and comparison rule, but does not derive the criterion or validate its assumptions in detail.
Examples
Uses fitted ARIMA and Holt–Winters time-series models, including printed AIC output for Holt–Winters.
What it assumes
Assumes fitted competing models and familiarity with log-likelihood, parameters, and basic time-series model evaluation.
What you can do after
Evaluate model alternatives by reading AIC values and preferring the lower value in a same-data comparison.
How it connects
Connects AIC to log-likelihood, model fit, BIC, HQIC, ARIMA, and Holt–Winters models.

Also explained in

Compare how 3 books explain AIC →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Statistics Every Programmer Needs. The section links point to the parts of the book it draws on.