9 When machines seem to think
This chapter covers
- Convincing AI performance and why it can deceive.
- Analyzing how intelligence emerges from simple mechanisms.
- Assessing skeptical arguments against machine intelligence.
- Evaluating whether AI can possess qualified intelligence.
The question of whether AI thinks cannot be settled by pointing to its failures. Hallucinations, bias, brittleness, and lack of grounding remain serious limitations, but failure is not the same as absence of intelligence. Human cognition is also error-prone, uneven, and dependent on context. If every mistake were enough to deny thought, we would have to apply the same standard to ourselves.
Yet the opposite reaction is no better. The fact that AI systems produce fluent explanations, solve problems, write code, translate, summarize, and adapt to instructions does not by itself prove that they think. Impressive behavior can come from mechanisms that are very different from ours, and similar outputs may hide very different processes. We should not mistake every convincing performance for understanding, just as we should not dismiss every unfamiliar mechanism as empty imitation.