A baseline is an initial performance measure used to judge later models. A quickly implemented baseline model provides a bottom line for comparison and early feedback on whether a modelling problem looks promising. section 6.0 section 6.6.2
Compare performance both with a simple alternative and with the business requirement. A sophisticated model should improve enough to justify its cost, not merely perform slightly better than a simple system. section 6.3
Establish a baseline early:
- Define and implement a simple model, such as a majority-class predictor, decision tree, or low-dimensional perceptron. A small data sample can support quick iteration. section 6.3
- Measure its performance and record the assumptions and limitations. Early models may overfit or fail to capture the data’s complexity; they indicate challenges rather than solve the problem. section 6.3 section 6.6.2
- Compare later models against the baseline and the improvement needed for the project’s required return on investment. section 6.3
Accuracy needs context
A classifier with 99% accuracy may be no better than always predicting the majority class if that class accounts for 99% of the test set. The majority-class prediction provides a simple comparison point. section 6.3
Demand and churn
For an inventory and customer-churn project, a quick regression model provided baseline measures using limited data. Its predictions correlated with observed fluctuations, but substantial assumptions meant the problem was far from solved. section 6.6.2


























