Forgetting adapts decision-making to changing markets by reducing the influence of older observations when estimating payoff relationships. If an advertisement's click-through rate changes, relying too heavily on yesterday's evidence can preserve a bad choice. section 5.6
A campaign that has moved on
Customer tastes evolve, creative performance decays, competitors launch campaigns, and seasonality reshapes traffic. Discounting older campaign outcomes helps a bandit remain responsive instead of treating stale evidence as equally relevant. section 5.6
Forgetting belongs to a small set of responses to non-stationarity:
- Discount older data so recent outcomes carry more influence. section 5.6
- Use sliding windows that retain only recent outcomes. section 5.6
- Reset estimates when a meaningful change is detected. section 5.6
