EXP3 is an adversarial bandit algorithm for decisions whose rewards may react to the algorithm. It fits settings such as ad auctions and social feeds, where competitors, ranking systems, or bad actors can change the reward landscape rather than merely introduce random variation. section 5.6
Use EXP3 when the decision environment has these characteristics:
- Rewards may be actively influenced by competitors, platforms, or other participants. section 5.6
- A classical stochastic bandit assumption—that the world is noisy but broadly stable—looks unsafe. section 5.6
- The system needs robustness against changing rules instead of relying only on stationary reward patterns. section 5.6
Ad auctions and social feeds
Suppose an ad-selection system operates while competitors adjust bids and a platform changes its ranking algorithm. EXP3 provides a more robust bandit choice than a method built for stable stochastic rewards. It belongs in a broader continuous-experimentation system that keeps learning rather than running a single fixed A/B test. section 5.6 section 5.7
