Intermittent demand occurs irregularly, with zero-demand periods between nonzero observations. Forecast evaluation must account for this pattern rather than rely on generic error metrics. section 5.3.1
Metric choices require specific cautions:
- Avoid MAPE when any future realization is zero; it becomes undefined. section 5.3.1
- Treat sMAPE cautiously because a zero actual contributes 2 regardless of the point forecast. section 5.3.1
- Question MSE when unusually high forecast errors could dominate evaluation. section 5.3.1
- Check relative errors for undefined values when a benchmark has zero error. section 5.3.1
- Consider MSR, MAR, or sMSE, while making any short-term weighting explicit. section 5.3.1
