A rejected response is the less-preferred answer in a preference pair. In DPO, training lowers its probability relative to the chosen answer while a frozen reference model constrains how far the policy changes. section 8.2 section 8.2.5
Enterprise support preference
For a development-tool installation question, a response directing the user to an unapproved public download can be rejected in favor of one that follows the organization’s steps through its Software Center—even when both answers are technically correct. section 8.2.1
Figure 8.3 The DPO training mechanism: raise the chosen response, lower the rejected one, stay near the frozen reference.

The diagram shows the rejected response’s role in DPO alongside the chosen response and frozen reference. section 8.2.5
