liveBook · Manning

Reasoning model

As explained in Context Engineering

A language model optimized to solve demanding problems by generating intermediate reasoning steps before a final output.

A reasoning model is an LLM optimized for demanding problem solving. It generates intermediate reasoning tokens to break a task into smaller steps before producing a final answer. This extends the same next-token prediction process over a longer chain, increasing token use and response time; reasoning tokens also occupy the context window. section 1.2.1

Prompt these models by specifying the task and its grounding data, constraints, examples, and tool definitions. Explicit procedural directions such as chain-of-thought, tree-of-thought, or self-consistency prompting are largely redundant and can constrain the model’s trained reasoning process. section 6.3.7

How Context Engineering covers it

How deep it goes
Defines intermediate reasoning tokens and their relation to next-token prediction, without detailing the underlying mechanism further.
Examples
Names mathematics, coding, and planning as tasks suited to reasoning models.
What you can do after
Apply reasoning models by specifying the task, grounding data, operational constraints, examples, and tool definitions.
How it connects
Relates reasoning models to next-token prediction, prompting, chain-of-thought, tree-of-thought, self-consistency, and context windows.

Also explained in

Compare how 7 books explain reasoning model →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Context Engineering. The section links point to the parts of the book it draws on.