liveBook · Manning

Intelligence

As explained in How Large Language Models Work

Intelligence is the broad and disputed capacity to perform cognitive tasks such as reasoning, learning, and adapting to situations.

Intelligence is a broad, disputed capacity rather than a single measurable substance. IQ tests measure limited abilities, such as timed logic puzzles, but do not define intelligence; people can be book-smart without being street-smart. section 1.4

Artificial intelligence attempts to make rigid, rule-following computers perform tasks people handle without precise instructions, such as recognizing a cat in an arbitrary picture. For large language models, capabilities and reliability are more useful questions than whether the systems are truly intelligent. Their possible self-improvement also remains uncertain because intelligence is hard to quantify and computational limits persist. section 1.4 section 9.2.1 section 1.9

Figure 9.2 The S-curve, or sigmoid, shows the classic plateau behavior: at some point, you hit diminishing returns. The counterpoint to this expressed by the iterative S-curve model is that progress continues past the plateau of diminishing returns by discovering new techniques, each represented by a new S-curve. The new techniques may start worse than the existing methods but have a higher potential to surpass them.
figure

The iterative S-curve illustrates why improving intelligence may encounter diminishing returns while new techniques can begin further improvement. section 9.2.1

How How Large Language Models Work covers it

How deep it goes
Defines intelligence through IQ limitations and task examples, then stops short of a precise definition or universal scale.
Examples
Uses IQ tests, book-smart versus street-smart abilities, cat recognition, and iterative S-curves as concrete illustrations.
What you can do after
Evaluate/understand LLM potential by separating capabilities from reliability instead of relying on the label intelligence.
How it connects
Connects intelligence with IQ tests, artificial intelligence, machine learning, large language models, self-improvement, and computational limits.

Also explained in

Compare how 6 books explain intelligence →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of How Large Language Models Work. The section links point to the parts of the book it draws on.