appendix-a
appendix A References and further reading
A.1 Chapter 1: Understanding reasoning models
A.1.1 References
This is the announcement article for OpenAI's o1 model, which is regarded as the first LLM-based reasoning model:
- OpenAI, “Introducing OpenAI o1-preview” (Sept. 12, 2024), https://openai.com/index/introducing-openai-o1-preview/
DeepSeek-R1 is the first open source reasoning model to be accompanied by a comprehensive technical report showing that reasoning emerges from reinforcement learning with verifiable rewards (a topic covered in more detail in chapter 5):
- DeepSeek-AI, Daya Guo, Dejian Yang, et al., “DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning” (Jan. 22, 2025), https://arxiv.org/abs/2501.12948
This is the OpenAI CEO’s comment on the reasoning (“chain-of-thought”) capabilities of future models: “We will next ship GPT-4.5, the model we called Orion internally, as our last non-chain-of-thought model.”
- Sam Altman, post on X (Feb. 12, 2025), https://x.com/sama/status/1889755723078443244
A research paper by AI researchers at Apple found that reasoning models are sophisticated (but very capable) pattern matchers:
- Parshin Shojaee, Iman Mirzadeh, Keivan Alizadeh, et al., “The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity” (Jun. 2025), https://machinelearning.apple.com/research/illusion-of-thinking