liveBook · Manning

Audio

As explained in AI-Powered Search

Audio is recorded or transmitted sound data, including speech, music, and non-language sounds.

Audio is recorded or transmitted sound data. In search systems, it is a form of unstructured data that may encode spoken language, music, and non-language sounds. section 2.1.1

Audio resembles text when it encodes words and sentences, but it can also preserve emotion, tone of voice, and overlapping communication. This makes audio broader than speech transcription alone. section 2.1.1

Search-oriented distinctions include:

  • Spoken words and sentences, which make audio comparable to text content. section 2.1.1
  • Music and non-language sounds, which extend audio beyond natural-language content. section 2.1.1
  • Emotion, tone of voice, and simultaneous overlapping communication, which audio can encode more effectively than text. section 2.1.1
  • A modality in multimodal search alongside natural language, images, and video. section 15.3.1
Figure 2.2 Multiple types of unstructured data. In addition to the text from the last figure, we now see images, audio, and video, which are other forms of unstructured data.
figure

Figure 2.2 places audio beside text, images, and video as a major type of unstructured data handled by search engines. section 2.1.1

How AI-Powered Search covers it

How deep it goes
Defines audio and compares its information content with text, but stops short of explaining audio indexing or retrieval implementation.
Examples
Uses spoken words, music, non-language sounds, emotion, tone of voice, overlapping communication, and a modality figure.
What you can do after
Evaluate audio as a search modality and distinguish speech content from broader acoustic information.
How it connects
Connects audio with unstructured data, natural language, images, video, and multimodal search.

Also explained in

Compare how 3 books explain audio →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of AI-Powered Search. The section links point to the parts of the book it draws on.