liveBook · Manning

Voice cloning

As explained in Introduction to Generative AI, Second Edition

A voice clone is synthetic speech or an audio representation designed to imitate a particular person's voice.

A familiar voice can make a song moving—or make a fraudulent phone call frightening. Voice cloning uses generated audio to imitate a particular person’s voice. Its consequences depend not just on how convincing it sounds, but on who authorized its use and what listeners are led to believe. section 4.9 section 5.3

The same capability appears in sharply different settings:

  • With the artist’s support, an AI-generated version of Randy Travis’s voice was used for the 2024 song “Where That Came From.” Travis had lost the ability to sing after a stroke. The release also raised questions about control over an artist’s work and legacy. section 4.9
  • Without the artists’ consent, the 2023 viral track “Heart on My Sleeve” mimicked Drake and The Weeknd. It drew millions of plays before streaming platforms removed it. section 4.9
  • In a 2023 kidnapping hoax, scammers played what sounded like an Arizona girl’s panicked voice to her mother. They had cloned the voice from a short audio clip; no ransom was paid in that case. section 5.3

Cloned voices have also been used to impersonate relatives in WhatsApp scams. Synthetic speech has appeared in election-related robocalls, ads, and disinformation campaigns. These uses make consent, attribution, compensation, and verification practical concerns—not questions that a convincing voice can settle on its own. section 10.12 section 4.9

How Introduction to Generative AI, Second Edition covers it

How deep it goes
Explains voice cloning through real-world uses and consequences, without detailing how the audio is generated.
Examples
Uses a Randy Travis release, an unauthorized viral track, a kidnapping hoax, and scams impersonating relatives.
What you can do after
Evaluate/understand it by distinguishing supported creative uses from unauthorized imitation and deceptive impersonation.
How it connects
Links voice cloning to synthetic speech, deepfakes, consent, copyright, and disinformation.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Introduction to Generative AI, Second Edition. The section links point to the parts of the book it draws on.