In reinforcement learning, an experience is a sampled transition: a state, the action taken, the reward received, and the next state. Model-free methods learn from these interactions without relying on a transition function; this can require more interactions, computation, and time. section 4.0
Figure 12.1 The anatomy of a deep reinforcement learning algorithm.

See how the experience source fits among the main parts of a deep reinforcement learning algorithm. section 12.1
