liveBook · Manning

Training dataset

As explained in Vibe Engineering

Training data is the collection of examples used to fit or adapt a machine-learning model.

A training dataset is the portion of labeled examples used to fit a machine-learning model. Keep it separate from evaluation data: measuring accuracy on examples the model trained on cannot show how it handles unseen cases. section 4.5.2 section 4.5.3

Prepare a training dataset by making its boundaries and contents explicit:

  • Shuffle before splitting when the source has hidden order, such as dates, categories, or alphabetical ranges. section 4.5.2
  • Separate features from labels: X contains input variables, while y contains the target values used during training. section 4.5.2 section 4.5.3
  • Reserve a test dataset for accuracy checks, using inputs the trained model has not seen. section 4.5.3

Drug-price prediction

A dataset of 250,000 medicine records can be divided into 200,000 training rows and 50,000 test rows. The model fits on dosage and other X-training features with prices as y-training labels, then predicts prices from X-test features and compares them with y-test values. section 4.5.2 section 4.5.3

Figure 4.6 The full prediction of the price ML pipeline.

Trace how the training dataset fits into a complete supervised-learning pipeline, from records and feature/label splits through prediction and accuracy calculation. section 4.5.3

How Vibe Engineering covers it

How deep it goes
Explains shuffling, train/test proportions, X/y roles, and unseen-data validation, but does not detail optimization internals.
Examples
Demonstrates medicine records for price prediction and medicine descriptions classified as high or low risk.
What you can do after
Apply it via a shuffled train/test split that fits on X and y training data and evaluates predictions on held-out data.
How it connects
Connects training datasets to train/test splits, supervised learning, features, labels, model validation, and prediction.

Also explained in

Compare how 50 books explain training dataset →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Vibe Engineering. The section links point to the parts of the book it draws on.