liveBook · Manning

Speech mistranscription

As explained in Effective Conversational AI

A speech mistranscription is an incorrectly recognized word or phrase produced when spoken language is converted into text.

A speech mistranscription is an unexpected word or phrase produced when speech-to-text converts spoken language into text. It can distort a domain-specific request before the chatbot’s text classifier interprets it. section 4.4.3

When one word changes the request

An electric utility repeatedly received “presidential” where callers meant “residential.” Because the term affected call containment, the recurring error belonged in evaluation and training data while speech-model changes were pending. section 4.4.3

Handle suspected mistranscriptions by separating recognizable errors from unusable inputs:

  • Train the speech models first when that capability is available, aiming for the most faithful utterance before text classification. section 4.4.3
  • Add recurring, domain-significant mistranscriptions to the test set and eventually supplement the training data. section 4.4.3
  • Set unintelligible transcriptions aside from blind testing and forward recognizable speech problems for further evaluation or to the appropriate team. section 4.4.2

How Effective Conversational AI covers it

How deep it goes
Defines the failure, identifies causes, and recommends model training, test-set inclusion, and training-data supplementation without implementation detail.
Examples
Uses “residential” recognized as “presidential” and unintelligible voice input such as “does it school.”
What it assumes
Assumes a speech-to-text pipeline and classifier while distinguishing mistranscription from typos, background noise, and unrelated inputs.
What you can do after
Diagnose recurring mistranscriptions, preserve recognizable cases for evaluation, and improve speech-model or classifier training data.
How it connects
Links speech-to-text, automated speech recognition, text classifiers, test sets, and training data.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Effective Conversational AI. The section links point to the parts of the book it draws on.