Speech recognition
Speech recognition is the computational task of converting spoken language in an audio signal into a machine-readable representation, typically text.
Effective Conversational AI
Speech-to-text, or automatic speech recognition, converts spoken audio into written text.
- How it is used
- Converts callers’ speech into text for a chatbot classifier to interpret during voice interactions.
- How deep it goes
- Explains transcription failures, accuracy checks, and practical workarounds, but does not describe speech-recognition model internals.
- Examples
- Uses “residential” becoming “presidential,” “VIN” becoming “BIN,” and callers speaking or keying in member IDs.
- What you can do after
- Diagnose/debug with it by checking transcription accuracy, preserving recurring errors in tests, and accommodating valid caller responses.
Read how Effective Conversational AI explains speech recognition →
AI for Everyday IT
Meeting transcription is the conversion of spoken meeting audio into a written record of the discussion.
- How it is used
- Uses meeting transcription to support workplace recaps and management follow-up.
- How deep it goes
- Describes how to start transcription and obtain recaps, without explaining speech-recognition internals.
- Examples
- Illustrates transcription with Microsoft Teams and Krisp, including follow-up questions about recap points.
- What you can do after
- Apply it via Microsoft Teams or Krisp to obtain transcripts and meeting recaps.
The Complete Obsolete Guide to Generative AI
Speech recognition is the conversion of spoken audio into a machine-readable representation of language.
- How it is used
- Uses speech recognition to turn recordings into searchable transcripts for summaries and targeted questions.
- How deep it goes
- Demonstrates a service workflow and a runnable Whisper transcription call, without detailing recognition-model internals.
- Examples
- Uses missed video conferences, a YouTube-video summary, generated narration, and a MyAudio.flac transcription script.
- What you can do after
- Apply it via OpenAI Whisper or transcription services to create text transcripts and feed them into summary workflows.
Read how The Complete Obsolete Guide to Generative AI explains speech recognition →
Microsoft Azure in Action
Speech to text is the automatic conversion of spoken language in an audio signal into written text.
- How it is used
- Turns recorded interviews and calls into searchable transcripts for archives, accessibility, quality assurance, and reuse.
- How deep it goes
- Explains resource provisioning and an asynchronous batch workflow through submission, timestamps, status checks, and output retrieval; does not detail recognition internals.
- Examples
- Uses recorded author interviews, an Azure CLI resource-creation command, and REST requests for batch submission and status checks.
- What you can do after
- Operate/configure it by provisioning Azure Speech and submitting and checking a batch transcription job for recorded audio.
Read how Microsoft Azure in Action explains speech recognition →
Architecting Accessibility
Automated speech recognition is technology that converts spoken language into text without requiring a human transcriber to produce each word.
- How it is used
- Provides real-time captions or transcripts for accessible live events.
- How deep it goes
- Explains real-time AI transcription and its efficiency–accuracy trade-off, but does not detail how to build an ASR engine.
- Examples
- Uses live video streams and live audio-only events as settings for real-time speech-to-text.
- What you can do after
- Evaluate whether ASR’s efficiency suits a live event and whether monitoring or human review is needed.
Read how Architecting Accessibility explains speech recognition →
Data Analysis with LLMs
Speech recognition is the automatic conversion of spoken language into a machine-readable representation, commonly text.
- How it is used
- Turns recorded speech into searchable text and supports voice-driven applications.
- How deep it goes
- Explains Whisper’s transcription endpoint, file handling, and returned text, without detailing recognition internals.
- Examples
- Uses recorded employee meetings and a short sample audio clip to demonstrate searchable and transcribed speech.
- What you can do after
- Apply transcription through OpenAI’s Python library to turn an audio-file path into printed text.
Read how Data Analysis with LLMs explains speech recognition →
Build Applications with Local AI Models on a Mac
The conversion of spoken audio into written text.
- How it is used
- Adds a voice-to-text stage between microphone capture and language-model inference in a local chat application.
- How deep it goes
- Explains recognition challenges and Whisper’s encoder-decoder flow, then outlines recording, transcription, audio formats, and model selection.
- Examples
- Uses a microphone transcription script and a browser-based voice chat application to demonstrate speech-to-text workflows.
- What you can do after
- Apply it via MLX Whisper to transcribe microphone audio and supply text to a local chat application.
Read how Build Applications with Local AI Models on a Mac explains speech recognition →
Data Without Labels
Speech recognition is the computational conversion or identification of spoken language from an audio signal.
- How it is used
- Turns voice commands and recorded customer calls into text data for analysis and service improvement.
- How deep it goes
- Connects automatic speech recognition to deep learning and outlines DBN pretraining and fine-tuning, but omits implementation details.
- Examples
- Uses Alexa, Siri, Translator, Baidu, and transcribed call-center recordings as concrete speech-related applications.
- What you can do after
- Evaluate speech recognition as a deep-learning application and identify recorded calls as a source of text data.
Also covered in
- Natural Language Processing in Action, Second Edition
- How Large Language Models Work
- Spring AI in Action
- Build AI-Enhanced Web Apps
- Sutskever's List
- Writing for Developers: Blogs that get read
- Transfer Learning for Natural Language Processing
- Software Security for Developers
- AI Agents in Action
What to know first
- language modelA language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- conversational aiConversational AI is artificial intelligence that enables software systems to interpret user input and interact with users through natural-language dialogue.
- machine learningMachine learning is a field of computational methods in which systems learn patterns or relationships from data to make predictions, decisions, or other outputs.
- convolutional neural networkA convolutional neural network is a neural-network architecture that processes structured inputs with convolutional operations, typically using learned local filters to capture patterns.
Related concepts
- MLX Whisperimplemented by · MLX Whisper is a speech-recognition implementation that packages the Whisper model in a format optimized for Apple's MLX framework.
- pipelinepart of · A pipeline is an ordered sequence of connected processing stages through which data or work flows, with each stage passing or transforming its output for subsequent stages.
- Whisperimplemented by · Whisper is a family of OpenAI automatic speech-recognition models that transcribe and translate spoken audio, including multilingual audio.
- word error ratemeasured by · Word error rate is the ratio of word-level substitutions, deletions, and insertions required to transform a recognized transcription into a reference transcription.
- action itemproduces · An action item is a specific task or follow-up commitment identified or assigned for completion.
- active learningused by · Active learning is a machine-learning approach in which a learner selects informative data examples for labeling or feedback to improve a model.
Questions about speech recognition
What is speech recognition?
Speech recognition is the computational task of converting spoken language in an audio signal into a machine-readable representation, typically text.
Which Manning books explain speech recognition?
Effective Conversational AI, AI for Everyday IT, The Complete Obsolete Guide to Generative AI, Microsoft Azure in Action, Architecting Accessibility, Data Analysis with LLMs, Build Applications with Local AI Models on a Mac and Data Without Labels.
What should I know before learning speech recognition?
Manning books that teach speech recognition usually introduce language model, conversational ai, machine learning and convolutional neural network first.
What is speech recognition part of?
Speech recognition is part of pipeline. A pipeline is an ordered sequence of connected processing stages through which data or work flows, with each stage passing or transforming its output for subsequent stages.
What is speech recognition also called?
Speech recognition is also called speech-to-text, transcription, ASR or voice recognition.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.







