Synthetic data
Synthetic data is artificially generated data designed to represent selected characteristics, scenarios, or distributions of a target domain or process.
Outlier Detection in Python
Artificially generated data designed to have controlled properties rather than being collected from real-world observations.
- How it is used
- Uses generated records to understand outlier detectors, tune and test them, or train detectors that distinguish real from synthetic data.
- How deep it goes
- Works through feature-wise generation, joint-pattern modeling, doping, and evaluation, while noting that simulations require more setup.
- Examples
- Uses two-dimensional clusters, breast-cancer records, and baseball features to demonstrate detector scores, real-versus-fake classification, and lost feature relationships.
- What you can do after
- Build it from scratch with feature-wise sampling, then evaluate whether generated cases receive higher outlier scores than real records.
Read how Outlier Detection in Python explains synthetic data →
Causal Inference for Data Science
Synthetic data are artificially generated observations produced from a specified model rather than collected from real-world events.
- How it is used
- Tests causal methods against known data-generating processes before applying them to real-world datasets.
- How deep it goes
- Works through variable-generation equations, noise, potential outcomes, and comparisons between naive and causal estimates.
- Examples
- Uses population-driven arcade revenue and doctorates, hotel pricing, game levels, instruments, and a movie-release time series.
- What you can do after
- Evaluate/understand whether an estimator recovers a known causal effect and how confounding can bias naive analysis.
Read how Causal Inference for Data Science explains synthetic data →
Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI
A generated data example derived from existing data rather than directly collected from a real-world instance.
- How it is used
- Fills training and evaluation gaps when suitable examples are rare, unavailable, costly, or sensitive.
- How deep it goes
- Explains when synthetic data is useful and outlines human and automated generation workflows, including realism checks and diversity limitations.
- Examples
- Uses credit-card scanning, translated sentences, medical speech, and synthetic place-name sentences to illustrate different data needs.
- What you can do after
- Evaluate when to generate examples, choose a suitable approach, and review generated data for coverage and realism.
AI Governance
Artificially generated data designed to resemble real data without directly representing actual individuals.
- How it is used
- Uses synthetic data as a privacy-conscious substitute for personal records in model training.
- How deep it goes
- Explains generation risks and calls for privacy testing, without detailing a generation procedure or specific tests.
- Examples
- Names SDV and NVIDIA’s Gretel as tools for generating synthetic datasets from real data.
- What you can do after
- Evaluate synthetic datasets for training utility and re-identification risk, and identify tools for generating them.
LLM Customization and Fine-Tuning
Artificially generated examples used for training or evaluation.
- How it is used
- Fills rare-category and scenario gaps in model-adaptation training data while complementing real examples.
- How deep it goes
- Details seed loading, category-anchored prompting, quality gating, distribution checks, and mixing limits in a six-step pipeline.
- Examples
- Uses Financial PhraseBank sentiment seeds and IT-support ticket categories to illustrate generation and task-specific verification.
- What you can do after
- Apply it via a teacher LLM to expand category-matched seeds, verify generated examples, and mix them with real data.
Read how LLM Customization and Fine-Tuning explains synthetic data →
Building Specialized AI Systems
Synthetic data is artificially generated data designed to resemble or cover examples from a target application domain.
- How it is used
- Accelerates creation of fine-tuning labels and specialized training examples while retaining expert review for high-stakes quality.
- How deep it goes
- Explains prompt-based label generation, generation controls, scaling across a dataset, and human validation; it defers model-training internals.
- Examples
- Uses cleaned financial analyst reports paired with generated summaries, plus customer inquiries, legal documents, and technical explanations reviewed by experts.
- What you can do after
- Apply it via a language-model API to generate draft labels, then validate and format them for fine-tuning.
Read how Building Specialized AI Systems explains synthetic data →
Retrieval Augmented Generation, The Foundational Ideas
Synthetic data is artificially generated data produced to resemble or serve the role of real data.
- How it is used
- Uses generated examples to train RAG evaluators or adapt retrieval models when domain-specific labels are limited.
- How deep it goes
- Explains generation, positive and negative construction, retrieval-based filtering, and downstream fine-tuning, but not generator internals.
- Examples
- Uses query-passage-answer triples, contradictory answers, generated QA pairs, and top-k retrieval checks as concrete artifacts.
- What you can do after
- Build synthetic training sets, filter them with retrieval consistency, and apply them to judge training or domain fine-tuning.
Read how Retrieval Augmented Generation, The Foundational Ideas explains synthetic data →
Data for All
Simulated data is data generated by modeling or simulating conditions, processes, or outcomes rather than directly observing them.
- How it is used
- Uses generated data to explore activities and future decisions when direct measurements are unavailable.
- How deep it goes
- Defines synthetic data and walks through a planning scenario, without detailing an algorithm or implementation.
- Examples
- Uses a retailer's proposed expansion to illustrate generated store estimates and simulations of competing growth objectives.
- What you can do after
- Evaluate generated estimates and scenarios as decision aids while recognizing that manufactured data can also mislead.
Evaluating AI Systems
Artificially generated data designed to represent selected characteristics or scenarios rather than collected directly from real-world events.
- How it is used
- Uses generated cases to expand controlled and rare-scenario coverage when real evaluation data is scarce, sensitive, or inaccessible.
- How deep it goes
- Explains template-based and LLM-based generation, then gives checks for realism, failure-mode alignment, and difficulty against real data.
- Examples
- Uses medical chatbot questions, templated reasoning probes, and simulated obstacles to illustrate evaluation cases.
- What you can do after
- Apply it through templates or large language models to create controlled evaluation cases, and assess them against real examples.
Introduction to Generative AI, Second Edition
A synthetic dataset is a dataset whose records are artificially generated rather than directly collected from real-world subjects or events.
- How it is used
- Supports privacy-preserving research, dataset augmentation, rare-scenario simulation, and scalable evaluation.
- How deep it goes
- Explains benefits and limitations through applications, but stops short of generation methods or technical implementation.
- Examples
- Uses synthetic genome data for healthcare and generated prompts for large language model evaluation.
- What you can do after
- Evaluate/understand when synthetic data can extend authentic datasets and where realism, distribution, privacy, or coverage may fail.
Read how Introduction to Generative AI, Second Edition explains synthetic data →
Data Without Labels
Synthetic data is artificially generated data designed to reproduce selected characteristics or distributions of real data.
- How it is used
- Augments scarce or small datasets for machine-learning training and supports generative applications across healthcare and other business domains.
- How deep it goes
- Explains dataset augmentation, GAN components, adversarial losses, and autoencoder generation, while stopping short of implementation code.
- Examples
- Uses healthcare data augmentation, random-noise generation, GAN real-versus-synthetic classification, and autoencoder reconstruction.
- What you can do after
- Apply it via GANs or autoencoders to expand training data and reduce overfitting risk.
Software Testing with Generative AI
Synthetic data is artificially generated data designed to reproduce relevant characteristics of data from a real-world domain.
- How it is used
- Supports AI training, fine-tuning, and rapid test-data generation when suitable real data is difficult to prepare.
- How deep it goes
- Defines the technique, contrasts it with real data, and identifies cost and quality risks without detailing generation algorithms.
- Examples
- Uses Alpaca’s synthetic instruction records and generated test-data examples to illustrate practical dataset construction.
- What you can do after
- Apply synthetic data to supply training, fine-tuning, or testing examples while checking generation cost and realism.
Read how Software Testing with Generative AI explains synthetic data →
Learn AI-Assisted Python Programming, Second Edition
- How it is used
- Uses controllable datasets to test functions against known answers and difficult cases without relying on rare real examples.
- How deep it goes
- Explains dataset design and expected outputs, but stops short of describing generation algorithms or statistical fidelity.
- Examples
- Uses an artificial NFL statistics file containing repeated players, non-quarterbacks, zero values, and negative passing yards.
- What you can do after
- Diagnose/debug functions by testing known outputs against realistic records and intentionally included edge cases.
Read how Learn AI-Assisted Python Programming, Second Edition explains synthetic data →
Build an Advanced RAG Application (From Scratch)
Synthetic data generation produces artificial evaluation data, such as questions and curated answers, from source documents.
- How it is used
- Builds evaluation datasets for measuring and improving retrieval-augmented generation systems.
- How deep it goes
- Defines document-to-question-and-answer generation and human adaptation, but does not detail prompts or generation internals.
- Examples
- Generates diverse artificial questions and curated answers from a dataset of documents.
- What you can do after
- Apply it via RAGAS to create reusable evaluation pairs and compare system changes against a baseline.
Read how Build an Advanced RAG Application (From Scratch) explains synthetic data →
Reinforcement Learning from Human Feedback
Synthetic data is data generated by an algorithmic or model-based process rather than directly collected from the target phenomenon.
- How it is used
- Uses model-generated prompts, completions, feedback, and filters to expand or replace human-data inputs across post-training.
- How deep it goes
- Formalizes Constitutional AI’s critique-and-revision loop and preference construction, while surveying other synthetic-data methods only cursory.
- Examples
- Names Constitutional AI, UltraFeedback, Stanford Alpaca, and Tülu 3 as examples of synthetic-data methods or datasets.
- What you can do after
- Understand how model-generated prompts, completions, critiques, and preferences enter post-training pipelines.
Read how Reinforcement Learning from Human Feedback explains synthetic data →
Machine Learning System Design
Artificially generated data designed to approximate the characteristics of data from a real-world domain.
- How it is used
- Uses generated examples to bootstrap ML projects when suitable real-world data is scarce.
- How deep it goes
- Defines major sources and explains realism tradeoffs, but stops short of generation algorithms or implementation details.
- Examples
- Uses scientific simulators, rendered environments, generative AI, and augmented-reality recordings with estimated lighting.
- What you can do after
- Evaluate whether generated data is realistic and domain-relevant enough to bootstrap model development.
Read how Machine Learning System Design explains synthetic data →
Vibe Engineering
Synthetic data is data generated algorithmically rather than directly collected from the underlying real-world process.
- How it is used
- Supports prototyping, demonstrations, workflow testing, and algorithm education when real-world meaning is not the primary requirement.
- How deep it goes
- Compares generated and real datasets through cleanliness, semantics, distributions, ground truth, and analytical suitability, without explaining generation mechanics.
- Examples
- Uses a 50,000-record synthetic medicine dataset contrasted with a roughly 253,973-record scraped Indian medicine dataset.
- What you can do after
- Evaluate dataset suitability for prototyping, demonstrations, workflow testing, or domain-grounded analysis.
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
Synthetic data is artificially generated data designed to resemble the characteristics or distribution of real data without representing actual observations.
- How it is used
- Expands existing tabular datasets for machine-learning and deep-learning workflows.
- How deep it goes
- Explains benefits and introduces GANs, VAEs, TVAE generation, and adversarial validation without deriving model internals.
- Examples
- Uses German credit data, SDV metadata, a TVAE synthesizer, and random-forest adversarial validation.
- What you can do after
- Build synthetic tabular data with SDV and evaluate distinguishability through adversarial validation.
Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains synthetic data →
The AI Pocket Book
Artificially generated training data used as a substitute for or augmentation to real data.
- How it is used
- Frames synthetic data as a possible alternative to painstaking collection and manual labeling, with narrow practical successes.
- How deep it goes
- Explains the labeling requirement and contrasts open-ended tasks with self-play, but stops short of a broader generation workflow.
- Examples
- Uses AlphaZero’s self-played Go games, LLM next-token prediction, and image-category labeling as contrasting examples.
- What you can do after
- Evaluate when simulation can produce useful labeled training data and recognize why it fails for many open-ended applications.
AI-Powered Search
Synthetic training data is artificially generated data created to support the training or evaluation of machine-learning models.
- How it is used
- Generates synthetic queries and relevance signals to support search ranking, click modeling, and other data-hungry relevance techniques.
- How deep it goes
- Demonstrates prompting, multi-document context, generated judgments, and parsing, but does not detail foundation-model training internals.
- Examples
- Uses an outdoors collection, minimalist-shoe queries, retrieved result sets, relevance indexes, and parsed query-document records.
- What you can do after
- Apply it via an LLM prompt and parser to create synthetic query-document relevance pairs for search training.
AI Model Evaluation
Artificially generated data designed to represent properties or scenarios of real-world data.
- How it is used
- Expands offline evaluation coverage when real-world data is limited, sensitive, imbalanced, or missing important edge cases.
- How deep it goes
- Defines practical uses and cautions against substitution, but stops short of describing generation or validation procedures.
- Examples
- Uses rare failure modes, new product experiences, and pre-production LLM or agent interactions as evaluation scenarios.
- What you can do after
- Evaluate models and product experiences across scenarios unavailable in existing real-world interaction data.
Building LLM Applications with DSPy
Artificially generated data designed to resemble data from a real domain or process.
- How it is used
- Builds or expands evaluation sets for LM-based classifiers when labeled real-world examples are scarce or incomplete.
- How deep it goes
- Explains two generation workflows and review concerns, while warning that generated examples may be unrealistic or unusable.
- Examples
- Generates five intent-specific queries or two alternative phrasings per labeled example.
- What you can do after
- Apply DSPy’s Predict module to generate intent examples or label-preserving variations for an evaluation set.
Read how Building LLM Applications with DSPy explains synthetic data →
Machine Learning Platform Engineering
Synthetic data is artificially generated data designed to resemble observations from a target domain.
- How it is used
- Supports ML data collection when real examples are difficult to obtain or expensive to label.
- How deep it goes
- Defines procedural generation and labeling benefits but stops short of explaining generation algorithms or fidelity evaluation.
- Examples
- Uses identity-document images and potential fraud examples as concrete synthetic-data applications.
- What you can do after
- Build labeled computer-vision datasets from procedurally generated images while reducing manual annotation.
Read how Machine Learning Platform Engineering explains synthetic data →
Financial AI in Practice
The creation of artificial data that reproduces selected properties of real data without directly using the original records.
- How it is used
- Supports testing credit-risk systems in non-production environments subject to regulatory constraints.
- How deep it goes
- Flags synthetic data generation as necessary but does not describe generation methods or validation.
- Examples
- Warns that randomly generated Luhn-compliant credit card numbers can still cause regulatory violations.
Also covered in
- Privacy-Preserving Machine Learning
- Delivering Machine Learning Projects: From design to deployment
- Rearchitecting LLMsIn early access (MEAP)
- Digital Twins in Action
- LLM Evaluation and Alignment, The Foundational IdeasIn early access (MEAP)
- Data-Driven Cybersecurity
- Grokking Statistics
- Learn AI Data EngineeringIn early access (MEAP)
- Designing AI AgentsIn early access (MEAP)
- Build a DeepSeek Model (From Scratch)In early access (MEAP)
- Time Series Forecasting Using Foundation Models
- Graph Neural Networks in Action
What to know first
- language modelA language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- fine-tuningFine-tuning is the continued training of a pretrained model on targeted data or objectives to adapt its parameters or behavior to a task, domain, or use.
- complianceCompliance is conformity with applicable legal, regulatory, contractual, policy, or other governing requirements.
- machine learningMachine learning is a field of computational methods in which systems learn patterns or relationships from data to make predictions, decisions, or other outputs.
Related concepts
- generative modelingproduced by · Generative modeling is a machine-learning approach that learns patterns or a data distribution to generate new samples resembling the data.
- language modelproduced by · A language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- real datacontrasts with · Data originating from or collected in actual real-world activities, systems, or environments rather than being artificially generated solely for testing or simulation.
- datasetkind of · A dataset is an organized collection of related data items, records, observations, or examples treated as a unit for storage, processing, or analysis.
Questions about synthetic data
What is synthetic data?
Synthetic data is artificially generated data designed to represent selected characteristics, scenarios, or distributions of a target domain or process.
Which Manning books explain synthetic data?
Outlier Detection in Python, Causal Inference for Data Science, Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI, AI Governance, LLM Customization and Fine-Tuning, Building Specialized AI Systems, Retrieval Augmented Generation, The Foundational Ideas, Data for All and 16 more.
What should I know before learning synthetic data?
Manning books that teach synthetic data usually introduce language model, fine-tuning, compliance and machine learning first.
What is the difference between synthetic data and real data?
Synthetic data is artificially generated data designed to represent selected characteristics, scenarios, or distributions of a target domain or process. Data originating from or collected in actual real-world activities, systems, or environments rather than being artificially generated solely for testing or simulation.
What is synthetic data a kind of?
Synthetic data is a kind of dataset. A dataset is an organized collection of related data items, records, observations, or examples treated as a unit for storage, processing, or analysis.
What is synthetic data also called?
Synthetic data is also called synthetic dataset or simulated data.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.























