liveBook · Manning

AI-generated content

As explained in Introduction to Generative AI, Second Edition

AI-generated text is written language produced wholly or partly by an artificial-intelligence system.

AI-generated content is work produced wholly or partly by an artificial-intelligence system. It includes text drafted by language models and visuals made from prompts. When a student edits an AI-drafted essay or a chatbot response is paraphrased into an email, the boundary between human and machine authorship becomes unclear. section 6.9 section 4.7

Detection methods look for statistical patterns, classify text, embed watermarks, or track provenance. These approaches can misfire, be evaded through small edits or paraphrasing, and become less effective as language models change. No single technical method reliably identifies all AI-generated content. section 6.9 section 6.12

Examples of detection approaches include:

  • GLTR highlights how likely each word is according to a language model; its usefulness declined as models evolved. section 6.9
  • Text watermarking subtly biases word choices to leave a detectable signal, which edits or paraphrasing can remove. section 6.12
Figure 6.9 How a language model uses highlighted word biasing to embed watermarks in the generated text
A screenshot of a computer

AI-generated content may be incorrect.

The figure illustrates how biased word choices can embed a watermark in generated text. section 6.9

How Introduction to Generative AI, Second Edition covers it

How deep it goes
Compares detection approaches and explains their limitations, but does not establish a reliable method for identifying all AI-generated content.
Examples
Uses an edited student essay, a paraphrased chatbot email, GLTR word highlights, and watermarking as examples.
What you can do after
Evaluate detection claims with awareness that statistical tools can misfire and edits can evade detection.
How it connects
Links AI-generated content to language models, authorship, watermarking, provenance, and human oversight.

Also explained in

Compare how 2 books explain AI-generated content →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Introduction to Generative AI, Second Edition. The section links point to the parts of the book it draws on.