liveBook · Manning

Synthetic data

Also called synthetic dataset, simulated data

Synthetic data is artificially generated data designed to represent selected characteristics, scenarios, or distributions of a target domain or process.

How 24 Manning books explain it

Outlier Detection in Python

Artificially generated data designed to have controlled properties rather than being collected from real-world observations.

How it is used
Uses generated records to understand outlier detectors, tune and test them, or train detectors that distinguish real from synthetic data.
How deep it goes
Works through feature-wise generation, joint-pattern modeling, doping, and evaluation, while noting that simulations require more setup.
Examples
Uses two-dimensional clusters, breast-cancer records, and baseball features to demonstrate detector scores, real-versus-fake classification, and lost feature relationships.
What you can do after
Build it from scratch with feature-wise sampling, then evaluate whether generated cases receive higher outlier scores than real records.

Read how Outlier Detection in Python explains synthetic data →

Causal Inference for Data Science

Synthetic data are artificially generated observations produced from a specified model rather than collected from real-world events.

How it is used
Tests causal methods against known data-generating processes before applying them to real-world datasets.
How deep it goes
Works through variable-generation equations, noise, potential outcomes, and comparisons between naive and causal estimates.
Examples
Uses population-driven arcade revenue and doctorates, hotel pricing, game levels, instruments, and a movie-release time series.
What you can do after
Evaluate/understand whether an estimator recovers a known causal effect and how confounding can bias naive analysis.

Read how Causal Inference for Data Science explains synthetic data →

Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI

A generated data example derived from existing data rather than directly collected from a real-world instance.

How it is used
Fills training and evaluation gaps when suitable examples are rare, unavailable, costly, or sensitive.
How deep it goes
Explains when synthetic data is useful and outlines human and automated generation workflows, including realism checks and diversity limitations.
Examples
Uses credit-card scanning, translated sentences, medical speech, and synthetic place-name sentences to illustrate different data needs.
What you can do after
Evaluate when to generate examples, choose a suitable approach, and review generated data for coverage and realism.

Read how Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI explains synthetic data →

AI Governance

Artificially generated data designed to resemble real data without directly representing actual individuals.

How it is used
Uses synthetic data as a privacy-conscious substitute for personal records in model training.
How deep it goes
Explains generation risks and calls for privacy testing, without detailing a generation procedure or specific tests.
Examples
Names SDV and NVIDIA’s Gretel as tools for generating synthetic datasets from real data.
What you can do after
Evaluate synthetic datasets for training utility and re-identification risk, and identify tools for generating them.

Read how AI Governance explains synthetic data →

LLM Customization and Fine-Tuning

Artificially generated examples used for training or evaluation.

How it is used
Fills rare-category and scenario gaps in model-adaptation training data while complementing real examples.
How deep it goes
Details seed loading, category-anchored prompting, quality gating, distribution checks, and mixing limits in a six-step pipeline.
Examples
Uses Financial PhraseBank sentiment seeds and IT-support ticket categories to illustrate generation and task-specific verification.
What you can do after
Apply it via a teacher LLM to expand category-matched seeds, verify generated examples, and mix them with real data.

Read how LLM Customization and Fine-Tuning explains synthetic data →

Building Specialized AI Systems

Synthetic data is artificially generated data designed to resemble or cover examples from a target application domain.

How it is used
Accelerates creation of fine-tuning labels and specialized training examples while retaining expert review for high-stakes quality.
How deep it goes
Explains prompt-based label generation, generation controls, scaling across a dataset, and human validation; it defers model-training internals.
Examples
Uses cleaned financial analyst reports paired with generated summaries, plus customer inquiries, legal documents, and technical explanations reviewed by experts.
What you can do after
Apply it via a language-model API to generate draft labels, then validate and format them for fine-tuning.

Read how Building Specialized AI Systems explains synthetic data →

Retrieval Augmented Generation, The Foundational Ideas

Synthetic data is artificially generated data produced to resemble or serve the role of real data.

How it is used
Uses generated examples to train RAG evaluators or adapt retrieval models when domain-specific labels are limited.
How deep it goes
Explains generation, positive and negative construction, retrieval-based filtering, and downstream fine-tuning, but not generator internals.
Examples
Uses query-passage-answer triples, contradictory answers, generated QA pairs, and top-k retrieval checks as concrete artifacts.
What you can do after
Build synthetic training sets, filter them with retrieval consistency, and apply them to judge training or domain fine-tuning.

Read how Retrieval Augmented Generation, The Foundational Ideas explains synthetic data →

Data for All

Simulated data is data generated by modeling or simulating conditions, processes, or outcomes rather than directly observing them.

How it is used
Uses generated data to explore activities and future decisions when direct measurements are unavailable.
How deep it goes
Defines synthetic data and walks through a planning scenario, without detailing an algorithm or implementation.
Examples
Uses a retailer's proposed expansion to illustrate generated store estimates and simulations of competing growth objectives.
What you can do after
Evaluate generated estimates and scenarios as decision aids while recognizing that manufactured data can also mislead.

Read how Data for All explains synthetic data →

Evaluating AI Systems

Artificially generated data designed to represent selected characteristics or scenarios rather than collected directly from real-world events.

How it is used
Uses generated cases to expand controlled and rare-scenario coverage when real evaluation data is scarce, sensitive, or inaccessible.
How deep it goes
Explains template-based and LLM-based generation, then gives checks for realism, failure-mode alignment, and difficulty against real data.
Examples
Uses medical chatbot questions, templated reasoning probes, and simulated obstacles to illustrate evaluation cases.
What you can do after
Apply it through templates or large language models to create controlled evaluation cases, and assess them against real examples.

Read how Evaluating AI Systems explains synthetic data →

Introduction to Generative AI, Second Edition

A synthetic dataset is a dataset whose records are artificially generated rather than directly collected from real-world subjects or events.

How it is used
Supports privacy-preserving research, dataset augmentation, rare-scenario simulation, and scalable evaluation.
How deep it goes
Explains benefits and limitations through applications, but stops short of generation methods or technical implementation.
Examples
Uses synthetic genome data for healthcare and generated prompts for large language model evaluation.
What you can do after
Evaluate/understand when synthetic data can extend authentic datasets and where realism, distribution, privacy, or coverage may fail.

Read how Introduction to Generative AI, Second Edition explains synthetic data →

Data Without Labels

Synthetic data is artificially generated data designed to reproduce selected characteristics or distributions of real data.

How it is used
Augments scarce or small datasets for machine-learning training and supports generative applications across healthcare and other business domains.
How deep it goes
Explains dataset augmentation, GAN components, adversarial losses, and autoencoder generation, while stopping short of implementation code.
Examples
Uses healthcare data augmentation, random-noise generation, GAN real-versus-synthetic classification, and autoencoder reconstruction.
What you can do after
Apply it via GANs or autoencoders to expand training data and reduce overfitting risk.

Read how Data Without Labels explains synthetic data →

Software Testing with Generative AI

Synthetic data is artificially generated data designed to reproduce relevant characteristics of data from a real-world domain.

How it is used
Supports AI training, fine-tuning, and rapid test-data generation when suitable real data is difficult to prepare.
How deep it goes
Defines the technique, contrasts it with real data, and identifies cost and quality risks without detailing generation algorithms.
Examples
Uses Alpaca’s synthetic instruction records and generated test-data examples to illustrate practical dataset construction.
What you can do after
Apply synthetic data to supply training, fine-tuning, or testing examples while checking generation cost and realism.

Read how Software Testing with Generative AI explains synthetic data →

Learn AI-Assisted Python Programming, Second Edition

How it is used
Uses controllable datasets to test functions against known answers and difficult cases without relying on rare real examples.
How deep it goes
Explains dataset design and expected outputs, but stops short of describing generation algorithms or statistical fidelity.
Examples
Uses an artificial NFL statistics file containing repeated players, non-quarterbacks, zero values, and negative passing yards.
What you can do after
Diagnose/debug functions by testing known outputs against realistic records and intentionally included edge cases.

Read how Learn AI-Assisted Python Programming, Second Edition explains synthetic data →

Build an Advanced RAG Application (From Scratch)

Synthetic data generation produces artificial evaluation data, such as questions and curated answers, from source documents.

How it is used
Builds evaluation datasets for measuring and improving retrieval-augmented generation systems.
How deep it goes
Defines document-to-question-and-answer generation and human adaptation, but does not detail prompts or generation internals.
Examples
Generates diverse artificial questions and curated answers from a dataset of documents.
What you can do after
Apply it via RAGAS to create reusable evaluation pairs and compare system changes against a baseline.

Read how Build an Advanced RAG Application (From Scratch) explains synthetic data →

Reinforcement Learning from Human Feedback

Synthetic data is data generated by an algorithmic or model-based process rather than directly collected from the target phenomenon.

How it is used
Uses model-generated prompts, completions, feedback, and filters to expand or replace human-data inputs across post-training.
How deep it goes
Formalizes Constitutional AI’s critique-and-revision loop and preference construction, while surveying other synthetic-data methods only cursory.
Examples
Names Constitutional AI, UltraFeedback, Stanford Alpaca, and Tülu 3 as examples of synthetic-data methods or datasets.
What you can do after
Understand how model-generated prompts, completions, critiques, and preferences enter post-training pipelines.

Read how Reinforcement Learning from Human Feedback explains synthetic data →

Machine Learning System Design

Artificially generated data designed to approximate the characteristics of data from a real-world domain.

How it is used
Uses generated examples to bootstrap ML projects when suitable real-world data is scarce.
How deep it goes
Defines major sources and explains realism tradeoffs, but stops short of generation algorithms or implementation details.
Examples
Uses scientific simulators, rendered environments, generative AI, and augmented-reality recordings with estimated lighting.
What you can do after
Evaluate whether generated data is realistic and domain-relevant enough to bootstrap model development.

Read how Machine Learning System Design explains synthetic data →

Vibe Engineering

Synthetic data is data generated algorithmically rather than directly collected from the underlying real-world process.

How it is used
Supports prototyping, demonstrations, workflow testing, and algorithm education when real-world meaning is not the primary requirement.
How deep it goes
Compares generated and real datasets through cleanliness, semantics, distributions, ground truth, and analytical suitability, without explaining generation mechanics.
Examples
Uses a 50,000-record synthetic medicine dataset contrasted with a roughly 253,973-record scraped Indian medicine dataset.
What you can do after
Evaluate dataset suitability for prototyping, demonstrations, workflow testing, or domain-grounded analysis.

Read how Vibe Engineering explains synthetic data →

Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI

Synthetic data is artificially generated data designed to resemble the characteristics or distribution of real data without representing actual observations.

How it is used
Expands existing tabular datasets for machine-learning and deep-learning workflows.
How deep it goes
Explains benefits and introduces GANs, VAEs, TVAE generation, and adversarial validation without deriving model internals.
Examples
Uses German credit data, SDV metadata, a TVAE synthesizer, and random-forest adversarial validation.
What you can do after
Build synthetic tabular data with SDV and evaluate distinguishability through adversarial validation.

Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains synthetic data →

The AI Pocket Book

Artificially generated training data used as a substitute for or augmentation to real data.

How it is used
Frames synthetic data as a possible alternative to painstaking collection and manual labeling, with narrow practical successes.
How deep it goes
Explains the labeling requirement and contrasts open-ended tasks with self-play, but stops short of a broader generation workflow.
Examples
Uses AlphaZero’s self-played Go games, LLM next-token prediction, and image-category labeling as contrasting examples.
What you can do after
Evaluate when simulation can produce useful labeled training data and recognize why it fails for many open-ended applications.

Read how The AI Pocket Book explains synthetic data →

AI-Powered Search

Synthetic training data is artificially generated data created to support the training or evaluation of machine-learning models.

How it is used
Generates synthetic queries and relevance signals to support search ranking, click modeling, and other data-hungry relevance techniques.
How deep it goes
Demonstrates prompting, multi-document context, generated judgments, and parsing, but does not detail foundation-model training internals.
Examples
Uses an outdoors collection, minimalist-shoe queries, retrieved result sets, relevance indexes, and parsed query-document records.
What you can do after
Apply it via an LLM prompt and parser to create synthetic query-document relevance pairs for search training.

Read how AI-Powered Search explains synthetic data →

AI Model Evaluation

Artificially generated data designed to represent properties or scenarios of real-world data.

How it is used
Expands offline evaluation coverage when real-world data is limited, sensitive, imbalanced, or missing important edge cases.
How deep it goes
Defines practical uses and cautions against substitution, but stops short of describing generation or validation procedures.
Examples
Uses rare failure modes, new product experiences, and pre-production LLM or agent interactions as evaluation scenarios.
What you can do after
Evaluate models and product experiences across scenarios unavailable in existing real-world interaction data.

Read how AI Model Evaluation explains synthetic data →

Building LLM Applications with DSPy

Artificially generated data designed to resemble data from a real domain or process.

How it is used
Builds or expands evaluation sets for LM-based classifiers when labeled real-world examples are scarce or incomplete.
How deep it goes
Explains two generation workflows and review concerns, while warning that generated examples may be unrealistic or unusable.
Examples
Generates five intent-specific queries or two alternative phrasings per labeled example.
What you can do after
Apply DSPy’s Predict module to generate intent examples or label-preserving variations for an evaluation set.

Read how Building LLM Applications with DSPy explains synthetic data →

Machine Learning Platform Engineering

Synthetic data is artificially generated data designed to resemble observations from a target domain.

How it is used
Supports ML data collection when real examples are difficult to obtain or expensive to label.
How deep it goes
Defines procedural generation and labeling benefits but stops short of explaining generation algorithms or fidelity evaluation.
Examples
Uses identity-document images and potential fraud examples as concrete synthetic-data applications.
What you can do after
Build labeled computer-vision datasets from procedurally generated images while reducing manual annotation.

Read how Machine Learning Platform Engineering explains synthetic data →

Financial AI in Practice

The creation of artificial data that reproduces selected properties of real data without directly using the original records.

How it is used
Supports testing credit-risk systems in non-production environments subject to regulatory constraints.
How deep it goes
Flags synthetic data generation as necessary but does not describe generation methods or validation.
Examples
Warns that randomly generated Luhn-compliant credit card numbers can still cause regulatory violations.

Read how Financial AI in Practice explains synthetic data →

Also covered in

What to know first

Related concepts

Questions about synthetic data

What is synthetic data?

Synthetic data is artificially generated data designed to represent selected characteristics, scenarios, or distributions of a target domain or process.

Which Manning books explain synthetic data?

Outlier Detection in Python, Causal Inference for Data Science, Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI, AI Governance, LLM Customization and Fine-Tuning, Building Specialized AI Systems, Retrieval Augmented Generation, The Foundational Ideas, Data for All and 16 more.

What should I know before learning synthetic data?

Manning books that teach synthetic data usually introduce language model, fine-tuning, compliance and machine learning first.

What is the difference between synthetic data and real data?

Synthetic data is artificially generated data designed to represent selected characteristics, scenarios, or distributions of a target domain or process. Data originating from or collected in actual real-world activities, systems, or environments rather than being artificially generated solely for testing or simulation.

What is synthetic data a kind of?

Synthetic data is a kind of dataset. A dataset is an organized collection of related data items, records, observations, or examples treated as a unit for storage, processing, or analysis.

What is synthetic data also called?

Synthetic data is also called synthetic dataset or simulated data.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.