A reasoning model is a language model that works through intermediate steps before giving its final answer. Rather than responding immediately, it analyzes the question, tries partial solutions, and critiques its own attempts. section 2.7
Reinforcement learning trains models such as o1 to produce long chains of thought (CoT) during inference. The precise training details remain undisclosed. section 2.7
Constraining a poem
Given a request for a four-line poem whose lines begin with the seasons and rhyme, a chat model answers directly. A reasoning model first plans the structure, tests possible rhymes, revises weak choices, and then responds. section 2.7
