When several models fit the same data, BIC balances goodness of fit against complexity. It starts from maximized likelihood and penalizes additional parameters; lower values indicate a more favorable balance and help guard against overfitting. section 3.7.2
BIC penalizes complexity more strongly than AIC, particularly as sample size increases, and tends to favor simpler models. It is not a full Bayesian inference procedure: its basis is a Bayesian approximation to marginal likelihood under suitable assumptions, rather than direct application of Bayes’ theorem. section 2.4.1 section 3.7.2
Information criteria offer an alternative when candidate models are not nested and likelihood ratio tests are inappropriate. BIC supports model comparison, not predictions or belief updates. section 2.4.1 section 3.7.2




