A numerical modality represents data as numeric values that computational models can accept as input. Although raw data may arrive as text, images, video, or audio, an AI model ultimately requires a numeric form. section 3.1.1
This transformation matters when mapping an AI solution: different raw modalities call for different techniques, while multimodal systems combine several modalities before or during model processing. section 3.1.1
Common relationships include:
- Textual data can support language tasks such as sentiment analysis, translation, summarization, and question answering. section 3.1.1
- Visual data can support image classification, object detection, and image generation through computer vision. section 3.1.1
- One-hot encoding provides a simple algebraic representation of words as numeric data. section 3.1.1
Figure 3.4 One-hot encoding provides a simple numerical (algebraic) representation of words.
Use the figure to see how one-hot encoding turns words into a simple numerical representation. section 3.1.1
