liveBook · Manning

Chain-of-thought prompting

As explained in Sutskever's List

Chain-of-thought prompting is a prompting technique that elicits explicit intermediate reasoning steps before a model produces its final answer.

Chain-of-thought prompting asks a language model to produce intermediate reasoning steps before its final answer. It turns a direct question into a sequence of simpler steps, giving the model an explicit scratchpad during inference. section 7.5.3

The technique grew from informal prompts such as “Let’s think step by step.” It can improve multistep reasoning without changing model architecture or parameters. Few-shot chain-of-thought reasoning also acts as a scaffold: performance can improve, but reasoning remains brittle when rules change. section 7.5 section 7.5.3

A multistep word problem

For a farm with 23 cows and 17 chickens, the model can work through the animals’ legs before giving a total. This illustrates why an explicit sequence can help where a direct answer may fail. section 7.5

How Sutskever's List covers it

How deep it goes
Explains the stepwise mechanism through examples and notes that it changes neither model architecture nor parameters.
Examples
Uses a farm-legs arithmetic problem, math word problems, and logic puzzles to illustrate stepwise solving.
What you can do after
Apply it by prompting a model to generate intermediate natural-language steps before its final answer.
How it connects
Connects chain-of-thought prompting to few-shot learning, test-time compute, multistep reasoning, and planning.

Also explained in

Compare how 18 books explain chain-of-thought prompting →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Sutskever's List. The section links point to the parts of the book it draws on.