liveBook · Manning

Text-to-speech conversion

As explained in How Large Language Models Work

Text-to-speech is the conversion of written text into synthesized spoken audio.

Text-to-speech conversion turns written text into synthesized speech that a user can hear. In a voice-support system, it reads an LLM’s text output aloud. section 8.3 section 8.3.2

A voice interaction can connect several stages:

  • Speech-to-text transcribes the caller’s words into input for an LLM. section 8.3.2
  • The system produces text, then text-to-speech converts that output into something the caller can hear and understand. section 8.3.2
  • A bail-out mechanism lets callers leave automation when the system cannot understand or solve the problem. section 8.3.2

Customer support by phone

A caller describes a problem while waiting, receives an automated spoken response based on a known solution, and can transfer to a human analyst if it fails. section 8.3 section 8.3.2

Figure 8.5 This diagram describes our “better solution” to customer support requests, where customers describe their problem while waiting to talk to someone. The LLM uses an embedding representation of the problem to compare similar problems with known solutions. While the user waits, an automated system can provide information that may help them solve their problem without support personnel intervention. If that fails, there’s always the possibility to “bail out” and talk to a real person. The model used to generate the embeddings does not necessarily have to be the same as the LLM that walks the user through the solution.
figure

Trace the support design from a caller’s problem description through embeddings, known solutions, spoken guidance, and human escalation. section 8.3.2

How How Large Language Models Work covers it

How deep it goes
Defines the conversion and places it in a voice pipeline, but does not explain synthesis internals or implementation details.
Examples
Uses phone-based customer support, spoken automated solutions, and transfer to a human analyst as examples.
What it assumes
Assumes basic familiarity with written text and voice interaction while introducing speech-to-text and LLM-based support flows.
What you can do after
Operate a voice-support flow that reads generated responses aloud and provides a human fallback.
How it connects
Connects text-to-speech with speech-to-text, LLMs, embeddings, clustering, and human customer support.

Also explained in

Compare how 4 books explain text-to-speech conversion →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of How Large Language Models Work. The section links point to the parts of the book it draws on.