liveBook · Manning

Synthetic data

As explained in Machine Learning Platform Engineering

Synthetic data is artificially generated data designed to resemble observations from a target domain.

Synthetic data is artificially generated data designed to resemble observations from a target domain. It helps teams obtain training and evaluation data when real examples are difficult to collect, then organize the results into reproducible ML datasets. section 1.1.1

Use synthetic data when production data is scarce or expensive to label:

  • Generate images and labels procedurally for computer-vision training, avoiding manual annotation of every example. section 2.1.1
  • Work with domain experts to create synthetic fraud examples when identifying fraudulent transactions in existing data is laborious. section 1.1.1
  • Treat generated data as part of the dataset lifecycle, including organization into training, validation, and test sets and versioning for reproducibility. section 1.1.1

Identity-document detection

An identity-document detector can use procedurally generated images whose labels are generated alongside the images. This supplies labeled visual data without annotating the entire dataset manually. section 2.1.1

How Machine Learning Platform Engineering covers it

How deep it goes
Defines procedural generation and labeling benefits but stops short of explaining generation algorithms or fidelity evaluation.
Examples
Uses identity-document images and potential fraud examples as concrete synthetic-data applications.
What it assumes
Assumes a defined ML problem and target domain, while treating data collection and labeling as explicit workflow steps.
What you can do after
Build labeled computer-vision datasets from procedurally generated images while reducing manual annotation.
How it connects
Links data collection, data labeling, computer vision, dataset versioning, and training, validation, and test datasets.

Also explained in

Compare how 15 books explain synthetic data →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machine Learning Platform Engineering. The section links point to the parts of the book it draws on.