Training dataset
A collection of examples or observations supplied to a learning procedure to fit or adapt a model or learn its patterns or parameters.
Learn Generative AI with PyTorch
The source text examples used for model training, viewed here as material whose length and variation affect generation quality.
- How it is used
- Supplies examples that shape generated content and style, and provides inputs and targets for model training.
- How deep it goes
- Works through dataset selection and next-token preparation, including variety, sequence length, and training-cost tradeoffs.
- Examples
- Uses three novels for writing-style generation, clothing images for validation splitting, and MIDI performances for music-token training.
- What you can do after
- Practice/perform selection and numerical preparation of text examples for training a GPT-style generator.
Read how Learn Generative AI with PyTorch explains training dataset →
Math and Architectures of Deep Learning
A set of input examples collected from a distribution, which may or may not have corresponding labels or outputs.
- How it is used
- Supports estimating model parameters for supervised prediction or unlabeled distribution fitting.
- How deep it goes
- Defines labeled and unlabeled datasets, then develops iterative fitting, loss, and maximum-likelihood uses.
- Examples
- Uses hardness-sharpness threat pairs, labeled car images, and height-weight point clouds.
- What you can do after
- Evaluate/understand how labeled pairs or unlabeled samples supply evidence for model parameter estimation.
Read how Math and Architectures of Deep Learning explains training dataset →
Effective Conversational AI
Training data, or a training dataset, is a collection of examples used to fit a machine-learning model.
- How it is used
- Fits a chatbot’s intent classifier so it can map varied user utterances to the requests they express.
- How deep it goes
- Works through example selection, balance, blind testing, and log-driven revisions without detailing classifier algorithms.
- Examples
- Contrasts password-related utterance sets and tracks login-intent improvements after adding representative requests.
- What you can do after
- Practice/perform dataset audits, add varied examples or new intents, and check changes against separate blind tests.
Read how Effective Conversational AI explains training dataset →
Deep Learning with R, Third Edition
Training data is the collection of examples from which a machine-learning model learns its parameters or representations.
- How it is used
- Supplies the examples used to fit a model before validation guides changes and a separate test set checks performance.
- How deep it goes
- Shows paired image–label arrays, preprocessing, fitting, and dataset splitting; does not derive how the model updates its weights.
- Examples
- Uses MNIST digit arrays and a balanced dogs-versus-cats image subset with distinct training, validation, and test splits.
- What you can do after
- Apply it via Keras `fit()` after preparing labeled examples, while reserving separate data for validation and final testing.
Read how Deep Learning with R, Third Edition explains training dataset →
AI-Powered Search
A training set is the subset of examples supplied to a model during parameter fitting or adaptation.
- How it is used
- Supplies labeled examples for fitting search-ranking and question-answering models.
- How deep it goes
- Works through click-derived judgments, feature preparation, dataset splits, and question-answer formatting; treats model-training internals as a separate step.
- Examples
- Uses query–document click counts, missing search-feature combinations, and labeled question–answer pairs as concrete examples.
- What you can do after
- Build it from scratch by turning sessions into ranking judgments or corrected question–answer pairs into split datasets.
Natural Language Processing in Action, Second Edition
Training data is the collection of examples used to fit the parameters of a machine-learning model.
- How it is used
- Supplies labeled toxic comments for fitting classifiers while a separate portion checks performance on unseen examples.
- How deep it goes
- Works through inspection, splitting, formatting, fitting, and evaluation, but does not detail how the comments were originally labeled.
- Examples
- Uses labeled toxic comments, a classifier’s 0.999 versus 0.554 training and held-out scores, and text–label pairs for BERT.
- What you can do after
- Apply it via scikit-learn splits and Simple Transformers to prepare labeled comments, fit a classifier, and evaluate it separately.
Read how Natural Language Processing in Action, Second Edition explains training dataset →
Grokking Machine Learning
The portion of a dataset used to fit a machine-learning model.
- How it is used
- Separates examples used to fit models from data reserved for validation and final testing.
- How deep it goes
- Explains dataset splitting, generalization, validation, and practical Scikit-Learn and Turi Create workflows, stopping short of split theory.
- Examples
- Uses an exam analogy, polynomial regression points, and a preprocessed Titanic dataset split into training, validation, and testing tables.
- What you can do after
- Apply it via Scikit-Learn or Turi Create by splitting data, fitting models on training data, and evaluating reserved data.
Read how Grokking Machine Learning explains training dataset →
The Art of AI Product Development
The collection of examples used to fit the parameters of a machine-learning model.
- How it is used
- Supplies examples for model learning while determining whether outputs fit real user needs.
- How deep it goes
- Explains input–label pairing, collection options, coverage risks, and bias checks; stops short of training algorithms or mathematical derivations.
- Examples
- Uses question-to-SQL pairs, labeled customer segments, language coverage gaps, and historical hiring data.
- What you can do after
- Evaluate/understand whether training examples represent intended users and where labeling, coverage, or bias may undermine a product.
Read how The Art of AI Product Development explains training dataset →
Outlier Detection in Python
Data supplied to a machine-learning model or algorithm for fitting its parameters or learning patterns.
- How it is used
- Establishes the learned normality used to assess collected and subsequent records for outliers.
- How deep it goes
- Explains fitting across detector types and gives a repeated-sampling procedure for assessing training size without ground truth.
- Examples
- Uses synthetic two-cluster data for a decision boundary and KDD Cup samples for a CBLOF stability test.
- What you can do after
- Evaluate/understand training-data choices by testing prediction stability and checking whether the reference period remains representative.
Read how Outlier Detection in Python explains training dataset →
Introduction to Generative AI, Second Edition
Training data, or a training dataset or training set, is the collection of examples used to train a machine-learning model and fit its parameters.
- How it is used
- Supplies the examples from which large language models learn language patterns and generate responses.
- How deep it goes
- Explains dataset sources and their quality, bias, and privacy trade-offs without detailing training algorithms.
- Examples
- Compares Wikipedia, public-domain books, and Reddit, then considers a confidential contract entered into a dialogue agent.
- What you can do after
- Evaluate/understand how dataset selection can affect model outputs, representation, and privacy risk.
Read how Introduction to Generative AI, Second Edition explains training dataset →
Generative AI in Action
Training data is the collection of examples or information from which a machine-learning model learns its patterns or parameters.
- How it is used
- Supplies examples from which models learn, especially when fine-tuning an LLM for a defined task.
- How deep it goes
- Defines training against validation and test data, then gives curation and format checks without deriving training mathematics.
- Examples
- Uses an emoji-response chatbot and JSONL chat conversations with desired assistant outputs.
- What you can do after
- Build it from scratch: curate and check task-specific training examples, then evaluate fine-tuning against a base model and baseline.
Read how Generative AI in Action explains training dataset →
Build a Text-to-Image Generator (from Scratch)
A training subset is the portion of a dataset supplied to a model for learning its parameters or representations.
- How it is used
- Prepares examples, targets, transformations, and batches before models learn from them.
- How deep it goes
- Explains preparation through transformations, splits, batching, target construction, and training loops, but defers dataset governance and collection methods.
- Examples
- Uses translation pairs, Flickr 8k captions, FashionMNIST clothing images, denoising batches, and large-scale text–image pairs.
- What you can do after
- Build it from scratch by transforming raw examples, creating targets, splitting evaluation data, batching inputs, and feeding a training loop.
Read how Build a Text-to-Image Generator (from Scratch) explains training dataset →
Designing Deep Learning Systems: A guide for software engineers
Training data is the set of examples from which a machine learning model learns its parameters or behavior.
- How it is used
- Connects data collection and labeling with repeatable model training and experimental-model tracking.
- How deep it goes
- Explains ingestion, commits, preparation, readiness, and versioned fetching rather than model-learning internals.
- Examples
- Demonstrates a language-intent dataset with committed updates, tags, version hashes, and examples.csv and labels.csv outputs.
- What you can do after
- Operate/configure it through APIs to create, update, prepare, inspect, and fetch versioned training data.
Read how Designing Deep Learning Systems: A guide for software engineers explains training dataset →
How Large Language Models Work
Training data is the collection of examples used to build or optimize a machine-learning model.
- How it is used
- Explains how examples shape language-model behavior, capabilities, errors, and ethical risks.
- How deep it goes
- Defines datasets and their effects at a high level, stopping short of the detail needed to build an LLM from scratch.
- Examples
- Uses internet text, false common knowledge, stereotypes, buggy code, books, news, research papers, and government reports as examples.
- What you can do after
- Evaluate/understand it by separating fluent pattern matching from truth, quality, provenance, and permission to reuse data.
Read how How Large Language Models Work explains training dataset →
Build a Large Language Model (From Scratch)
The subset of data used to fit model parameters during development.
- How it is used
- Supplies token sequences for GPT-style pretraining, batching, parameter fitting, and training-versus-validation loss evaluation.
- How deep it goes
- Descends from corpus composition to tokenization, shifted targets, sliding windows, tensor batches, dataset splits, and cross-entropy measurement.
- Examples
- Uses GPT-3 corpus statistics, The Verdict story, four-token windows, shifted tensors, and batched PyTorch loader outputs.
- What you can do after
- Build it from scratch with a tokenizer, GPTDatasetV1, PyTorch DataLoader, sliding windows, and training-validation loss functions.
Read how Build a Large Language Model (From Scratch) explains training dataset →
Effective Data Analysis
A training set is the portion of data used to fit the parameters of a machine learning model.
- How it is used
- Fits predictive models while reserving unseen data for evaluating generalization.
- How deep it goes
- Explains dataset splitting, training-only fitting, prediction, and metric comparison, but does not detail parameter optimization internals.
- Examples
- Uses a rat-sighting regression dataset and an applicant-resume dataset to illustrate evaluation and dataset bias.
- What you can do after
- Apply it via scikit-learn by splitting data, fitting on the training subset, predicting on test data, and comparing performance.
Read how Effective Data Analysis explains training dataset →
Deep Learning with PyTorch, Second Edition
The subset of data used to fit a model.
- How it is used
- Fits model parameters on one subset while reserving independent data to check generalization.
- How deep it goes
- Works through randomized splitting and loss monitoring, then constructs padded next-character training pairs.
- Examples
- Uses temperature-conversion splits, next-character name pairs, and CT-nodule dataset selection.
- What you can do after
- Build it from scratch with `torch.randperm` and tensor indexing, then compare training and validation losses without fitting validation samples.
Read how Deep Learning with PyTorch, Second Edition explains training dataset →
Data Without Labels
Training data is data provided to a machine-learning algorithm during model development so it can learn patterns or parameters.
- How it is used
- Supplies labeled historical examples from which supervised models learn patterns for predicting unseen data.
- How deep it goes
- Defines examples as inputs paired with targets and illustrates their use, but does not detail dataset preparation or splitting.
- Examples
- Uses telecom churn records, height-and-weight prediction, and face images paired with names.
- What you can do after
- Evaluate/understand which fields in a supervised example are prediction inputs and which field is the label.
Causal Inference for Data Science
A training dataset is the subset of observations used to fit a predictive or statistical model.
- How it is used
- Uses selected observations to fit predictive models and construct counterfactual forecasts before evaluating them on held-out periods.
- How deep it goes
- Explains splitting, temporal endpoint selection, anticipation effects, sample-size tradeoffs, and cross-validation, but does not develop fitting algorithms.
- Examples
- Uses exam revision and testing, train-test prediction, and movie-viewership data around a release event.
- What you can do after
- Apply it by separating fitting data from evaluation data and selecting temporal boundaries with cross-validation.
Read how Causal Inference for Data Science explains training dataset →
Statistics Every Programmer Needs
A training set is the subset of observations used to estimate or fit a predictive model.
- How it is used
- Uses a subset of observations to fit predictive models while reserving unseen data for evaluation.
- How deep it goes
- Explains feature-target preparation, reproducible splitting, dimensions, and fitting scope, but defers algorithmic internals.
- Examples
- Demonstrates football conversion classification with a 70/30 split and stock-price forecasting with six months for training.
- What you can do after
- Apply scikit-learn to create reproducible training and test subsets before fitting and evaluating a model.
Read how Statistics Every Programmer Needs explains training dataset →
LLMs in Production
Training data is the collection of examples from which a machine-learning model learns its parameters or behavior.
- How it is used
- Guides dataset preparation, model training, fine-tuning, and prompt design for large language and image models.
- How deep it goes
- Explains acquisition, cleaning, curation, quality, labeling, and risks, but does not detail dataset evaluation methodologies.
- Examples
- Uses an uncured image dataset, caption vocabulary, and four puppy images supporting DreamBooth fine-tuning.
- What you can do after
- Diagnose data-driven model behavior and apply dataset preparation or prompt wording that better matches learned associations.
Building LLM Applications with DSPy
The portion of a dataset used to fit or configure a machine-learning model or application.
- How it is used
- Supplies candidate prompt demonstrations for DSPy optimization, while validation data guides prompt selection.
- How deep it goes
- Explains dataset roles, demonstration selection, and sizing trade-offs, but defers adding demonstrations in the ATIS baseline.
- Examples
- Contrasts a zero-shot ATIS intent-classification baseline with selecting roughly five demonstrations from 30 or more training examples.
- What you can do after
- Apply it via DSPy optimizers to select prompt demonstrations while keeping validation and test data available for their separate purposes.
Read how Building LLM Applications with DSPy explains training dataset →
Building Reliable AI Systems
Training data is the data used to fit a machine-learning model's parameters.
- How it is used
- Supplies task-specific examples for LLM fine-tuning, where data quality and preparation strongly influence results.
- How deep it goes
- Details sourcing, labeling, cleaning, coverage, and prompt/completion examples; does not specify a training algorithm.
- Examples
- Uses support conversations, FAQs, legal documents, and customer-issue prompt/completion records as candidate data.
- What you can do after
- Practice/perform dataset curation by selecting relevant examples, checking rights, adding labels, cleaning content, and assessing coverage.
Read how Building Reliable AI Systems explains training dataset →
Coding with AI
Training data is the collection of examples analyzed by a machine-learning model during training.
- How it is used
- Explains how machine-learning and coding models learn patterns that support generated text and code.
- How deep it goes
- Describes statistical learning, prediction, data-quality effects, and feedback, but does not detail model architecture or algorithms.
- Examples
- Uses source code, public GitHub repositories, incorrect examples, and outdated Python patterns as training-data examples.
- What you can do after
- Evaluate AI-generated code by checking suggestions against project standards, edge cases, correctness, and current Python practices.
Data Analysis with LLMs
Task-specific training data is a dataset of examples tailored to the task for which a model is being adapted.
- How it is used
- Prepares labeled task examples for fine-tuning an existing language model.
- How deep it goes
- Defines examples, specifies message and JSONL formats, and demonstrates CSV conversion, stopping short of dataset quality evaluation.
- Examples
- Uses movie reviews paired with neg labels, train_reviews.csv, a Python conversion script, and train_reviews.jsonl.
- What you can do after
- Operate/configure a fine-tuning workflow by converting labeled CSV rows into JSONL and submitting the resulting file.
Read how Data Analysis with LLMs explains training dataset →
Grokking AI Algorithms, Second Edition
Training data is the collection of examples provided to a learning method for fitting a model, optionally including known outcome labels.
- How it is used
- Supports fitting models, testing predictions, and defining the knowledge or visual world a model can learn.
- How deep it goes
- Explains selection, collection, cleaning, preprocessing, quality, diversity, and licensing, then stops short of detailed dataset construction code.
- Examples
- Uses apartment-price tables, labeled fruit examples, curated language sources, and captioned images with progressively added noise.
- What you can do after
- Evaluate/understand how data quality, labels, preparation, diversity, and legality shape what a trained model can predict or generate.
Read how Grokking AI Algorithms, Second Edition explains training dataset →
Cyber Threat Hunting
A training set is a dataset of examples, typically with target labels, used to train a machine-learning model.
- How it is used
- Supports supervised threat hunting by supplying labeled DNS records for detecting DNS tunneling.
- How deep it goes
- Defines labels and ground truth, then demonstrates splitting, balance checks, scaling, and PCA preparation.
- Examples
- Uses labeled DNS tunneling versus normal traffic and an 80–20 split of 20,001 data points.
- What you can do after
- Apply it via scikit-learn train_test_split to create training and test subsets and check class balance.
Learn AI-Assisted Python Programming, Second Edition
Training data is the collection of examples used to fit a machine-learning model and establish the statistical patterns it predicts.
- How it is used
- Uses labeled books to train a supervised-learning system that predicts unknown authors.
- How deep it goes
- Explains objects, labels, features, training, and prediction without descending into model internals.
- Examples
- Uses books, authors, average word length, and average words per sentence as examples of data, labels, and features.
- What you can do after
- Apply supervised learning by extracting features from known books and predicting the author of a mystery book.
Read how Learn AI-Assisted Python Programming, Second Edition explains training dataset →
Software Testing with Generative AI
Data supplied during model training so that the model can learn patterns or relationships.
- How it is used
- Evaluates how data choices affect large language model quality and informs fine-tuning for defined goals.
- How deep it goes
- Explains dataset quality, relevance, formatting, tokenization, and context limits, but does not detail data-collection methods or model internals.
- Examples
- Uses the r/counting subreddit as a hallucination example and discusses formatted domain data for fine-tuning.
- What you can do after
- Evaluate model value by considering training-data quantity, quality, relevance, and formatting rather than quantity alone.
Read how Software Testing with Generative AI explains training dataset →
Investing for Programmers
Training data is the portion of a labeled dataset used to fit a predictive model.
- How it is used
- Fits supervised-learning models for financial prediction before testing inference on held-out observations.
- How deep it goes
- Explains dataset splitting, feature-label fitting, inference, and test comparison, without developing model internals.
- Examples
- Uses historical stock prices, engineered next-day targets, feature columns, chronological splits, RMSE, and actual-versus-forecast plots.
- What you can do after
- Build it from scratch by preparing labeled financial data, fitting a model, generating predictions, and measuring test-set accuracy.
Read how Investing for Programmers explains training dataset →
Machine Learning Platform Engineering
Data used to fit the parameters of a machine learning model.
- How it is used
- Supports iterative model experimentation and automated training pipelines.
- How deep it goes
- Explains quality, access, lineage, reproducibility, and observability, but stops short of dataset construction procedures or statistical theory.
- Examples
- Uses Kubeflow downloads, pipeline data passing, dashboard metrics, and model-output sanity tests as operational examples.
- What you can do after
- Operate training-data flows that are versioned, lineage-aware, pipeline-compatible, observable, and easier to debug.
Read how Machine Learning Platform Engineering explains training dataset →
Classic Computer Science Problems in Swift: Essential techniques for practicing programmers
- How it is used
- Supplies paired inputs and expected outputs to train a neural network by adjusting its weights.
- How deep it goes
- Defines paired examples and details forward passes, backpropagation, and weight updates; treats validation separately.
- Examples
- Uses arrays of input vectors and expected-output vectors, with optional per-run error reporting.
- What you can do after
- Apply it through train() to update network weights from input and expected-output arrays.
Deep Learning with Python, Third Edition
The subset of data used to fit a model's parameters from examples, here emphasized as being small in size.
- How it is used
- Uses labeled examples to fit model weights through repeated prediction, loss evaluation, and optimization.
- How deep it goes
- Explains batching, epochs, preprocessing, leakage prevention, and validation roles, but does not derive dataset-size selection.
- Examples
- Uses MNIST images and IMDb reviews, including their preprocessing, labels, dataset sizes, and Keras loading examples.
- What you can do after
- Apply it via Keras by preprocessing examples, separating evaluation data, and fitting a model with mini-batch training.
Read how Deep Learning with Python, Third Edition explains training dataset →
Starting Data Analytics with Generative AI and Python
A training dataset is a collection of examples used to fit the parameters of a machine-learning model.
- How it is used
- Supports fitting model parameters and determining which patterns a model carries into predictions.
- How deep it goes
- Explains dataset influence through a worked underwriting example, but stops short of describing dataset construction or sampling procedures.
- Examples
- Uses historical loan outcomes from an economic downturn as an example of skewed training data.
- What you can do after
- Evaluate whether training data may distort model outputs and identify when transparent mitigation or reevaluation is needed.
Read how Starting Data Analytics with Generative AI and Python explains training dataset →
Deep Learning with JAX
The dataset used to compute gradients and update model parameters during training.
- How it is used
- Uses labeled examples to provide supervision for classification and regression, then drives neural-network training.
- How deep it goes
- Explains labels, dataset splits, batches, gradients, and stopping criteria, but defers detailed framework comparisons.
- Examples
- Uses labeled handwritten-digit images, unseen test images, and batches processed during gradient descent.
- What you can do after
- Apply it via mini-batch gradient descent to calculate loss gradients and update neural-network weights.
Build an AI Agent (From Scratch)
Training data is the collection of examples used to fit a machine-learning model's parameters and learned patterns.
- How it is used
- Supports model fitting and teaches LLMs to recognize tool needs, select tools, extract arguments, and emit structured calls.
- How deep it goes
- Explains dataset examples and learned behaviors, then stops short of detailing optimization or parameter-fitting internals.
- Examples
- Uses tool definitions, blind-control calls, web content, Wikipedia, reference materials, and the hermes-function-calling-v1 dataset.
- What you can do after
- Evaluate when learned knowledge may suffice and when tool calls are needed, while recognizing that recalled facts may be outdated or confabulated.
Read how Build an AI Agent (From Scratch) explains training dataset →
Related concepts
- objective functionmeasured by · An objective function assigns values to candidate solutions, predictions, or parameter settings according to a criterion to be minimized or maximized.
- GEPAused by · GEPA (Genetic-Pareto) is a reflective evolutionary optimization method that generates and evaluates candidate prompts using task information and feedback.
- KNN optimizerused by · A DSPy optimizer that selects demonstrations dynamically by retrieving the k training examples most similar to each language-model call's inputs.
- best-of-Nproduced by · Best-of-N is a technique that generates or evaluates multiple candidates and selects one according to a scoring or quality criterion.
- language modelused by · A language model is a computational model that represents patterns in linguistic tokens to estimate sequence probabilities and predict or generate language from context.
- evaluation datasetcontrasts with · An evaluation dataset is a collection of examples or test cases, often with expected or judged outcomes, designated to assess a model or system against defined criteria.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.