A trajectory is a complete sequence of states, actions, and rewards generated as a policy interacts with an environment. Its discounted return is the sum of its rewards, weighted by time. section 9.2
Policy quality is the expected cumulative reward across possible trajectories. Because a policy influences actions, visited states, and rewards, its parameters shape which trajectories occur. section 9.2
In REINFORCE, trajectories provide the learning signal:
- Collect complete trajectories, compute their returns, and update the policy to make high-return trajectories more probable. section 9.8
- Subtracting a state-value baseline from the return measures how much better or worse an action performed than expected, reducing variance. section 9.8
























