A reward probability is the chance that an action produces a reward in a random process. For a slot machine, p = 0.5 rewards roughly half of pulls, while p = 0.01 rewards roughly one in 100; the true value remains hidden. section 5.1.1
Choosing among slot machines
When several machines have different hidden reward probabilities, each pull supplies evidence but also consumes one opportunity. A strategic player must explore machines to discover which has the highest probability while exploiting promising choices to maximize total reward. section 5.1.1
Figure 5.1 A slot machine with an arm that can be pulled. The machine may return coins according to its reward probability when its arm is pulled.
Use the slot-machine diagram to connect an action—the arm pull—with its probabilistic reward. section 5.1.1
