liveBook · Manning

Unstructured data

As explained in Machine Learning System Design

Data that lacks a fixed machine-readable schema for its content, such as free text or images.

Unstructured data includes text, images, and audio that do not arrive as ordinary tabular features. In an online marketplace, item images, descriptions, and reviews may complement sales and click histories. A common bridge is to extract embeddings with pretrained neural networks and use those embeddings as features. section 11.4.1

Use unstructured data deliberately in the ML system:

  • Treat pure deep-learning workloads with one or two unstructured sources as less natural candidates for a feature store than tabular workloads. section 11.4.1
  • Store extracted embeddings when shared access, processing savings, or training-serving consistency justify centralization. section 11.4.1
  • Monitor derived signals rather than relying on simple tabular range checks: use image brightness or color temperature, text length, and audio-frequency distributions. section 14.3.6
  • Validate inputs and outputs at each pipeline stage so corrupted transformations can be located without retracing the entire workflow. section 14.3.6

Marketplace recommendations

A recommendation system can combine sales and click histories with image, description, and review embeddings. A vector database can retrieve similar items quickly for downstream models, while monitoring checks detect unusual image, text, or audio-derived statistics. section 11.4.1 section 14.3.6

Figure 11.12 A landscape of ML problems with various needs for a feature store
figure

Use the landscape to compare how different ML problem types benefit from centralized feature storage. section 11.4.1

How Machine Learning System Design covers it

How deep it goes
Explains embeddings, centralized storage, derived monitoring signals, and staged validation, without detailing model internals.
Examples
Uses marketplace images, descriptions, reviews, image brightness, text length, and audio-frequency distributions as concrete cases.
What you can do after
Diagnose unstructured-data failures with derived statistics and incorporate embeddings into shared ML pipelines when justified.
How it connects
Connects unstructured data with feature stores, deep learning, embeddings, vector databases, data quality monitoring, and anomaly detection.

Also explained in

Compare how 11 books explain unstructured data →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machine Learning System Design. The section links point to the parts of the book it draws on.