liveBook · Manning

Speech recognition

As explained in Effective Conversational AI

Speech-to-text, or automatic speech recognition, converts spoken audio into written text.

A caller says “residential,” but the voice assistant hears “presidential.” The chatbot may then misunderstand the request or fail to resolve the call. Speech recognition—also called speech-to-text or automated speech recognition—turns spoken input into text before a text-driven chatbot classifier interprets it. That makes transcription accuracy part of the whole conversation, not just a voice feature. section 4.4.3

Start by checking whether the transcript faithfully represents what callers said. If possible, train the speech models first. When an important domain word is still consistently mistranscribed, retain the mistaken version in tests and consider adding it to chatbot training data. For an electric utility, “residential” repeatedly became “presidential”; adding the mistaken word as a synonym provided an immediate workaround while speech-model changes took longer. In another case, “VIN” became “BIN,” so both versions were included in training and testing. section 4.4.3

A better transcript is not the only safeguard. Validate transcription accuracy to catch serious misunderstandings and protect the usefulness of topic trends drawn from callers’ words. Keep spoken questions direct and concise, put the question at the end of the assistant’s message, and be ready to repeat it. Accept a range of valid responses and clarify when needed rather than forcing callers through avoidable retries. section 11.3.3

Ask for the ID, not a recital of its rules

An insurance assistant asks, “What’s your member ID?” rather than first explaining every possible length and letter prefix. Callers may speak the ID or enter its digits on a dial pad. The dialogue can attempt a lookup when it has enough digits, instead of rejecting a usable response because the caller omitted a trivial prefix. section 11.3.3

How Effective Conversational AI covers it

How deep it goes
Explains transcription failures, accuracy checks, and practical workarounds, but does not describe speech-recognition model internals.
Examples
Uses “residential” becoming “presidential,” “VIN” becoming “BIN,” and callers speaking or keying in member IDs.
What it assumes
Assumes a voice solution feeding a text-driven chatbot classifier and defines speech-to-text without requiring speech-model implementation knowledge.
What you can do after
Diagnose/debug with it by checking transcription accuracy, preserving recurring errors in tests, and accommodating valid caller responses.
How it connects
Links speech-to-text with chatbot classification, training data, test sets, dialogue design, and topic-trend analysis.

Also explained in

Compare how 6 books explain speech recognition →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Effective Conversational AI. The section links point to the parts of the book it draws on.