In a Bellman equation, the discount factor γ scales the expected value of the next state when calculating a state's value. It controls how far into the future the calculation looks. section 4.2
Figure 4.3 Backup diagram for state value function.
A backup diagram visualizes how future state values contribute to the current state's value. section 4.2




