liveBook · Manning

Hallucination

As explained in Sutskever's List

A hallucination is content generated by an AI model that is fluent or plausible but factually unsupported or false.

GPT-2’s “Ovid’s Unicorn” sample read like a news story. It followed a whimsical prompt about English-speaking unicorns in the Andes with a scientist, a university affiliation, fabricated quotes, and consistent journalistic style. Yet it also described “four-horned” unicorns and “fires burning underwater.” These details exposed the gap between convincing prose and a reliable world model. section 1.2

A hallucination is generated content that sounds plausible but lacks factual support or is false. Fictional details in a fictional prompt are not, by themselves, the problem: the warning is that fluent writing can make unsupported claims seem credible. GPT-2’s sample showed both how far language-model coherence had advanced and why fluency alone could not establish accuracy. section 1.2

How Sutskever's List covers it

How deep it goes
Illustrates hallucination through sample details, without explaining an internal cause or a remedy.
Examples
Contrasts the journalistic style of “Ovid’s Unicorn” with its “four-horned” unicorns and “fires burning underwater.”
What you can do after
Evaluate/understand fluent model output without treating its coherence as proof of accuracy.
How it connects
Connects hallucination to language models, scaling, fluency, and world models.

Also explained in

Compare how 29 books explain hallucination →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Sutskever's List. The section links point to the parts of the book it draws on.