liveBook · Manning

Post hoc detection

As explained in Introduction to Generative AI, Second Edition

Post hoc detection is the analysis of generated content after production to determine whether it was created by an artificial-intelligence system.

Post hoc detection analyzes content after production to judge whether an artificial-intelligence system created it. For large language model (LLM) text, reliable detection remains unsolved: increasingly fluent, humanlike outputs narrow the gap between generated and human writing. section 10.23

Detection can support accountability in education, publishing, and public communication, but it should not be treated as conclusive evidence. An OpenAI classifier showed low accuracy and was discontinued in July 2023. Image, audio, and video generation may remain detectable in some cases, although those gaps are also closing. section 10.23

Watermarking offers a different route by embedding proof of machine generation into output. It would require broad adoption and public verification, yet users could alter text to evade checks, attackers could imitate watermark patterns, and quality could decline. section 10.23

How Introduction to Generative AI, Second Edition covers it

How deep it goes
Explains the problem, practical limitations, and watermarking alternative without detailing detection algorithms.
Examples
Uses OpenAI’s low-accuracy classifier, its July 2023 discontinuation, and watermark-evasion scenarios.
What you can do after
Evaluate detection claims cautiously while recognizing accuracy limits and watermarking trade-offs.
How it connects
Connects synthetic media, large language models, watermarking, and generative artificial intelligence.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Introduction to Generative AI, Second Edition. The section links point to the parts of the book it draws on.