Disinformation is false or misleading information intentionally spread to manipulate public perception or pursue an agenda. It differs from accidental misinformation because intent is central. Generated content can blur fact and fiction, making false narratives easier to accept and circulate. section 5.3.2 section 5.10
A fabricated incendiary video
A person could use generative AI to create a convincing video of people burning a sacred book. Shared as genuine, the video could provoke extreme reactions, manipulate opinion, and deepen social division. section 5.10 section 5.3.2
Disinformation can produce several practical harms:
- Misleads people about current events, health choices, and political or social issues. section 5.3.2
- Weakens trust in news organizations, governments, and scientific authorities when genuine and fabricated content become difficult to distinguish. section 5.3.2
- Amplifies propaganda through repeated messaging and enables large volumes of realistic text, images, and video. section 5.10
Figure 5.2 ChatGPT prompt and output required five attempts to generate correct information.
The figure illustrates how repeated prompting was needed before ChatGPT produced correct information, underscoring why generated claims require verification. section 5.3.2
