Top-p sampling, also called nucleus sampling, sorts candidate tokens by probability and keeps the smallest set whose probabilities sum to at least p. The next token is sampled from that set, excluding the low-probability long tail. In PPO rollouts, this stochastic choice produces varied responses for exploration while keeping them coherent. section 10.8.5
Top-p at 0.9
With top_p = 0.9, the model samples from tokens making up the top 90% of probability mass. That set might contain three tokens or fifty, depending on the model’s certainty. section 10.8.5













