liveBook · Manning

Evaluation dataset

Also called test set, test data, test dataset, testing set, evaluation set

An evaluation dataset is a collection of data or test cases used to assess a model or system against specified outcomes or criteria.

How 41 Manning books explain it

Effective Conversational AI

A test set, or test data, is a collection of evaluation inputs used to measure a model or system's behavior on cases separate from its training examples.

How it is used
Measures chatbot understanding against held-out user requests and provides a baseline for comparing changes.
How deep it goes
Walks through sampling logs, screening, scrubbing, annotation, testing, and refresh; does not specify a universal dataset size.
Examples
Uses annotated utterance–intent and utterance–answer pairs, then compares login-intent results before and after added training examples.
What you can do after
Build it from scratch using screened production logs, then rerun it to assess changes and refresh it as coverage evolves.

Read how Effective Conversational AI explains evaluation dataset →

LLM Customization and Fine-Tuning

A subset of examples reserved for evaluating a model rather than updating its parameters.

How it is used
Supports baseline measurement and release decisions across prompting and model-adaptation techniques using representative held-out cases.
How deep it goes
Details sourcing, annotation, versioning, leakage controls, sample-size tradeoffs, and separate safety evaluation.
Examples
Uses clinical validation and temporal test splits, plus a shared distillation test comparing base, teacher, and student models.
What you can do after
Practice building and versioning a golden set, sizing it for a decision, and comparing models without confusing lexical scores with behavior.

Read how LLM Customization and Fine-Tuning explains evaluation dataset →

Natural Language Processing in Action, Second Edition

A validation set is a held-out portion of data used to compare model configurations during development.

How it is used
Uses held-out examples to assess generalization and monitor model development.
How deep it goes
Walks through splitting, evaluation metrics, and validation during training, including early stopping.
Examples
Compares toxicity-classifier training and test scores and interprets a name-nationality RNN’s validation accuracy.
What you can do after
Apply it via scikit-learn and Simple Transformers to split data, evaluate a classifier, and monitor training.

Read how Natural Language Processing in Action, Second Edition explains evaluation dataset →

Grokking Machine Learning, Second Edition

A held-out subset of data used to evaluate models or choose training settings without fitting those settings to the evaluation examples.

How it is used
Supports model and hyperparameter choices while protecting the testing set from decision-making.
How deep it goes
Explains three-way data splitting, model selection, and typical proportions, but does not detail implementation procedures.
Examples
Uses polynomial models of degrees 1, 2, and 10, plus candidate regularization values and 60-20-20 or 80-10-10 splits.
What you can do after
Evaluate models and choose complexity or regularization settings without consuming the testing set.

Read how Grokking Machine Learning, Second Edition explains evaluation dataset →

Build AI Drug Discovery Pipelines

A validation set is a held-out collection of examples used during development to assess model performance and guide configuration choices.

How it is used
Uses held-out examples to compare model candidates and guide training choices while reserving test data for final evaluation.
How deep it goes
Explains validation splits, k-fold cross-validation, and epoch-level validation, while deferring detailed splitting-strategy selection.
Examples
Illustrates five-fold classifier accuracy and neural-network training and validation losses across 50 epochs.
What you can do after
Applies validation with scikit-learn cross-validation and a PyTorch neural-network training loop.

Read how Build AI Drug Discovery Pipelines explains evaluation dataset →

Grokking Machine Learning

A held-out subset of labeled data used to compare models or training configurations during development.

How it is used
Separates model selection from final evaluation by using validation data for choices and test data for a final check.
How deep it goes
Explains the three-way split, common proportions, and test-set leakage risk, without detailing split strategy.
Examples
Compares polynomial models by validation error and evaluates candidate classifiers on preprocessed Titanic data.
What you can do after
Apply it via Scikit-Learn’s train_test_split to compare models on validation data and reserve test data for final evaluation.

Read how Grokking Machine Learning explains evaluation dataset →

Building LLM Applications with DSPy

Inputs and associated evaluation information used to assess a prompt or language-model system.

How it is used
Uses evaluation datasets to compare prompts consistently and estimate language-model application performance.
How deep it goes
Details dataset coverage, labeling, size trade-offs, and split roles, including a four-set workflow.
Examples
Uses ATIS airline messages and intent labels to prepare a zero-shot classifier baseline.
What you can do after
Apply it via DSPy to compare candidate prompts and reserve separate data for development and final assessment.

Read how Building LLM Applications with DSPy explains evaluation dataset →

Deep Learning with R, Third Edition

Validation data is a reserved subset of examples used to assess a model during or after training without updating its parameters.

How it is used
Uses validation data to monitor model performance and guide development while reserving test data for final evaluation.
How deep it goes
Explains hold-out and K-fold procedures, metric monitoring, and validation-set overfitting through repeated tuning.
Examples
Uses IMDb movie reviews and balanced dogs-versus-cats image splits to illustrate held-out validation data.
What you can do after
Apply it via Keras by passing held-out inputs and targets to fit() and computing loss and metrics with evaluate().

Read how Deep Learning with R, Third Edition explains evaluation dataset →

AI-Powered Search

A validation set is a held-out dataset used to assess and tune a model during development, separately from training data and a final test set.

How it is used
Uses held-out labeled data to assess search ranking and question-answering models beyond their training examples.
How deep it goes
Works through dataset preparation, splitting, metric calculation, and holdout evaluation, while noting that offline performance may differ from live results.
Examples
Uses held-out movie-search queries and a labeled outdoors question-answering dataset, including a 10-example final holdout.
What you can do after
Apply evaluation through Python and a trainer to compare held-out rankings or question-answering loss and inspect errors.

Read how AI-Powered Search explains evaluation dataset →

Evaluating AI Systems

Data on which an AI system is assessed and from which evaluation measures are computed.

How it is used
Supplies test cases and reference information for computing measures aligned with an AI evaluation decision.
How deep it goes
Explains source selection, sampling, task fitness, and data-quality checks, with attention to deployment mismatches and misleading results.
Examples
Contrasts medical chatbot benchmarks, pilot logs, and synthetic cases, and describes labeled images and question-answering data.
What you can do after
Evaluate/understand whether evaluation data fits a task, covers relevant risks, and supports the intended decision.

Read how Evaluating AI Systems explains evaluation dataset →

Inside Deep Learning: Math, Algorithms, Models

A held-out dataset split used to evaluate or tune a model without using it for parameter learning.

How it is used
Checks performance beyond training examples and supplies scores for monitoring or selecting model settings.
How deep it goes
Walks through splitting data, scoring each epoch without weight updates, and reserving data during hyperparameter search.
Examples
Uses an 80/20 randomized split, separate moons datasets, and per-epoch training and evaluation metrics.
What you can do after
Operate/configure held-out scoring in a PyTorch training loop and reserve separate data for assessing hyperparameter search.

Read how Inside Deep Learning: Math, Algorithms, Models explains evaluation dataset →

Retrieval Augmented Generation, The Foundational Ideas

An evaluation set is a collection of examples used to measure system performance under specified evaluation conditions.

How it is used
Supplies test cases for scoring RAG responses, comparing designs, and checking changes before deployment.
How deep it goes
Details benchmark selection, corpus-grounded generation, question-type coverage, recurring tests, and passage-grouped uncertainty estimates.
Examples
Uses QA benchmarks, generated query-context-answer triples, and a 300-case mortgage compliance evaluation.
What you can do after
Build it from scratch using corpus passages, then apply it to diagnose RAG changes and maintain deployment checks.

Read how Retrieval Augmented Generation, The Foundational Ideas explains evaluation dataset →

Machine Learning System Design

A designated partition of data reserved for evaluating or tuning a machine learning model during development.

How it is used
Supports model comparison and tuning during development while reserving a separate test set for final metrics.
How deep it goes
Details split selection, leakage prevention, and update procedures, including tradeoffs between recent data and stable benchmarks.
Examples
Uses rolling two-week validation, a retail benchmark, and user-grouped search-query splits to illustrate evaluation choices.
What you can do after
Evaluate and design data splits and update procedures for model tuning and final evaluation.

Read how Machine Learning System Design explains evaluation dataset →

Generative AI in Action

A validation set is a dataset reserved for assessing or guiding model performance during development rather than fitting the model parameters.

How it is used
Guides fine-tuning decisions with validation data and assesses final performance with a separate test set.
How deep it goes
Defines dataset roles and explains validation-loss monitoring and hyperparameter adjustment without a detailed metric derivation.
Examples
Illustrates JSONL task examples with an emoji-only chatbot and describes training-loss results for GPT-3.5 Turbo.
What you can do after
Evaluate model progress by comparing training and validation loss and adjusting fine-tuning hyperparameters.

Read how Generative AI in Action explains evaluation dataset →

Learn Generative AI with PyTorch

A held-out subset of data used to monitor training and tune model decisions without directly fitting parameters.

How it is used
Uses held-out data to guide hyperparameter choices and stopping decisions during training.
How deep it goes
Explains splitting and batching data, computing validation loss each epoch, and tracking patience for early stopping.
Examples
Uses Fashion-MNIST clothing classification and MAESTRO piano performances to illustrate validation splits.
What you can do after
Apply it via PyTorch to split data, monitor validation loss, and stop training when improvement stalls.

Read how Learn Generative AI with PyTorch explains evaluation dataset →

Deep Learning with Python, Third Edition

A held-out subset of the training data used during training to monitor performance and tune choices without touching the final test set.

How it is used
Guides model-development decisions using held-out performance while preserving a separate test set for final evaluation.
How deep it goes
Explains holdout construction and monitoring, then compares it with K-fold validation when small samples make a single split unreliable.
Examples
Uses IMDb review splits, a 46-class classifier's validation curves, and K-fold validation of a house-price model.
What you can do after
Apply it via Keras to monitor loss and accuracy, select training duration, and evaluate a final model on test data.

Read how Deep Learning with Python, Third Edition explains evaluation dataset →

LLM Evaluation and Alignment, The Foundational Ideas

A validation set is a dataset used to assess and tune a model or decision procedure during development.

How it is used
Supports comparing generated outputs, calibrating detection thresholds, and measuring retrieval relevance during evaluation.
How deep it goes
Defines reference collections and retrieval labels, and gives detector-calibration steps with periodic recalibration.
Examples
Uses human reference answers for translation, annotated hallucination responses, and query-document relevance judgments.
What you can do after
Apply it by annotating detector responses, selecting thresholds from precision-recall curves, or labeling query-document relevance.

Read how LLM Evaluation and Alignment, The Foundational Ideas explains evaluation dataset →

Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI

Data used to measure a machine learning model's performance.

How it is used
Tracks model performance across active learning iterations using data kept separate from training and sampling.
How deep it goes
Explains when to select and reuse test data, how sampling biases arise, and how to compare a sampling strategy with a random baseline.
Examples
Evaluates a disaster-related headline classifier on held-out labels using F-score and AUC.
What you can do after
Evaluate and understand model accuracy by selecting a held-out random sample before active learning and keeping it separate throughout iterations.

Read how Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI explains evaluation dataset →

Statistics Every Programmer Needs

A testing set is a subset of observations reserved for evaluating a model on data not used for fitting.

How it is used
Uses held-out observations to evaluate model generalization, detect overfitting, and assess predictive reliability.
How deep it goes
Explains random and chronological partitioning, reproducibility, prediction, accuracy, and confusion matrices; it stops short of cross-validation.
Examples
Uses fourth-down conversion classification and Apple closing-price forecasting with 70/30 and chronological train-test partitions.
What you can do after
Apply it via scikit-learn to split data, generate held-out predictions, and interpret accuracy and confusion-matrix results.

Read how Statistics Every Programmer Needs explains evaluation dataset →

Deep Learning with PyTorch, Second Edition

Held-out data used to assess generalization during model development.

How it is used
Uses held-out validation data to assess generalization during model development and a separate test set for final evaluation.
How deep it goes
Explains splitting and loss comparisons with implementation examples, and discusses test-set use without implementing a final test evaluation.
Examples
Uses a temperature-conversion model and a nodule classifier whose high overall accuracy hides failure on positive samples.
What you can do after
Diagnose overfitting with training and validation losses and assess classification results by class.

Read how Deep Learning with PyTorch, Second Edition explains evaluation dataset →

Machine Learning Platform Engineering

A validation dataset is a held-out dataset used to assess or tune a model during development.

How it is used
Supports model development by tuning and assessing models on held-out data before production deployment.
How deep it goes
Explains dataset splits, automated evaluation, leakage prevention, error analysis, and lineage, but not dataset-splitting algorithms.
Examples
Uses OCR bounding-box annotations, fraud labels and synthetic data, misclassified samples, edge cases, and production-like holdout data.
What you can do after
Diagnose model errors, compare development runs, and trigger reproducible reevaluation when data or splits change.

Read how Machine Learning Platform Engineering explains evaluation dataset →

Building Specialized AI Systems

A dataset withheld from training and used to evaluate generalization on unseen examples.

How it is used
Tests whether a fine-tuned specialized model generalizes to unseen examples instead of memorizing training data.
How deep it goes
Explains held-out testing and task-specific metrics, while deferring dataset construction and split procedures.
Examples
Uses classification accuracy, precision, recall, and F1-score, plus BLEU, ROUGE, METEOR, BERTScore, and domain-expert review.
What you can do after
Evaluate/understand whether specialized-model outputs meet performance thresholds and professional requirements on unseen data.

Read how Building Specialized AI Systems explains evaluation dataset →

AI Model Evaluation

Data kept separate from training and tuning for a relatively independent assessment of a finalized or mostly finalized model.

How it is used
Supports offline assessment of a mostly finalized model using data kept separate from training and tuning.
How deep it goes
Defines dataset splits and their purposes, then illustrates holdout-based ranking evaluation and its limitations.
Examples
Uses movie interaction histories and ratings to evaluate ranked recommendations, including a per-user Precision@K calculation.
What you can do after
Evaluate and understand a model using a holdout while recognizing representativeness and metric limitations.

Read how AI Model Evaluation explains evaluation dataset →

Delivering Machine Learning Projects: From design to deployment

A validation set is a held-out subset of data used during model development to assess or tune model performance.

How it is used
Uses held-out data to assess or tune model performance during development.
How deep it goes
Distinguishes validation data from training and final test data, and relates validation size to dataset variance.
Examples
Contrasts a validation hold-out drawn from training data with final testing on data unavailable during modeling.
What you can do after
Evaluate model performance during development by checking validation data for representativeness and sizing it against dataset variance.

Read how Delivering Machine Learning Projects: From design to deployment explains evaluation dataset →

Introduction to Generative AI, Second Edition

An evaluation dataset is a collection of task inputs paired with expected or verifiable outputs for measuring a model's performance.

How it is used
Measures model behavior, prompt quality, and changes across iterations through repeatable checks or judgments.
How deep it goes
Explains dataset assembly, unit tests, scoring choices, and collection methods, but stops short of implementation details.
Examples
Uses real-estate listing prompts, bedroom-count checks, expert-reviewed descriptions, and production logs as evaluation artifacts.
What you can do after
Build it from scratch by assembling prompts, defining checks, selecting scorers, and tracking pass rates across iterations.

Read how Introduction to Generative AI, Second Edition explains evaluation dataset →

Building Reliable AI Systems

A collection of examples used to assess a model or system's behavior against defined criteria.

How it is used
Uses evaluation datasets to assess RAG hallucinations and monitor LLM support systems for quality regressions.
How deep it goes
Details query coverage, authoritative references, response criteria, and recurring tests, with a Python golden-test sketch.
Examples
Uses telecom support questions and e-commerce password-reset and refund tests to illustrate dataset records.
What you can do after
Evaluate system responses against factual references or quality criteria and track regressions over time.

Read how Building Reliable AI Systems explains evaluation dataset →

Build a Text-to-Image Generator (from Scratch)

A validation set is a held-out dataset split used to assess model performance during training and select configurations or checkpoints.

How it is used
Uses held-out examples to monitor generalization and guide when training should stop.
How deep it goes
Implements batch evaluation, average-loss tracking, and early stopping, but does not detail validation-set construction.
Examples
Evaluates a fine-tuned ResNet50 classifier on validation data and stops after three unimproved epochs.
What you can do after
Operate an early-stopping loop using validation loss and a patience of three epochs.

Read how Build a Text-to-Image Generator (from Scratch) explains evaluation dataset →

Effective Data Analysis

A validation set is a dataset reserved for assessing or tuning a model after training and before final evaluation or deployment.

How it is used
Uses held-out data to assess predictive performance on observations the model did not use for fitting.
How deep it goes
Works through an 80/20 split, fitting, prediction, and metric comparison, without describing a separate tuning set.
Examples
Uses weather predictors to estimate rat-sighting complaints and compares training and test metrics.
What you can do after
Evaluate predictive performance on unseen data by comparing predictions with actual values and training-set results.

Read how Effective Data Analysis explains evaluation dataset →

Build an AI Agent (From Scratch)

A collection of evaluation examples reserved for measuring a system's performance after development or tuning.

How it is used
Provides repeatable, representative requests for evaluating agent outputs, components, and trajectories.
How deep it goes
Describes dataset sources, their trade-offs, deployment-stage checks, and continuous updates.
Examples
Names GAIA, SWE-bench, and HotpotQA as public benchmarks and suggests starting custom datasets with core scenarios.
What you can do after
Evaluate/understand agent performance by selecting dataset sources and incorporating test sets into deployment checks.

Read how Build an AI Agent (From Scratch) explains evaluation dataset →

Timeless Algorithms, The Foundational Ideas

A test set is data kept separate from model fitting and selection for estimating the performance of a completed model.

How it is used
Estimates how well a completed model generalizes after training and model-selection decisions are fixed.
How deep it goes
Distinguishes fitting, validation-based selection, and final testing, but does not establish performance under unrepresented conditions.
Examples
Uses an SVM after penalty selection and a neural network after architecture selection as test-set examples.
What you can do after
Evaluate a completed model once on untouched observations without using them to choose its settings.

Read how Timeless Algorithms, The Foundational Ideas explains evaluation dataset →

Grokking AI Algorithms, Second Edition

A validation set is a held-out dataset used to assess a model during development without using it to fit the model's learned parameters.

How it is used
Guides development by measuring generalization on data excluded from parameter fitting.
How deep it goes
Explains held-out evaluation, loss trends, overfitting, early stopping, and patience without detailing implementation internals.
Examples
Uses diamond-price regression, diamond-cut classification, confusion matrices, validation loss, FID scores, and saved model checkpoints.
What you can do after
Diagnose overfitting and choose when to stop training using validation loss and patience.

Read how Grokking AI Algorithms, Second Edition explains evaluation dataset →

Machine Learning Algorithms in Depth

A validation dataset is a dataset used to evaluate candidate model configurations during model development and selection.

How it is used
Guides model selection by comparing hyperparameter configurations on a validation dataset.
How deep it goes
Explains grid and random search strategies and their tradeoffs, but does not specify a full validation procedure.
Examples
Uses SVM kernels and regularization constants, logarithmically spaced grid values, and sampling a cluster count from a distribution.
What you can do after
Practice/perform model selection by comparing candidate configurations using validation performance.

Read how Machine Learning Algorithms in Depth explains evaluation dataset →

Vibe Engineering

A held-out portion of data used to evaluate a trained machine-learning model on previously unseen inputs and targets.

How it is used
Evaluates trained supervised-learning models on unseen inputs and known targets.
How deep it goes
Explains shuffling, split proportions, feature-label separation, prediction, accuracy comparison, and prompt contamination safeguards.
Examples
Uses drug-price prediction, medicine-risk classification, and SQL generation with frozen example queries.
What you can do after
Evaluate trained models, calculate prediction error, and detect contamination that would make test results artificially optimistic.

Read how Vibe Engineering explains evaluation dataset →

Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI

A validation dataset is a portion of data reserved for evaluating and tuning a model during development rather than fitting its parameters.

How it is used
Uses held-out training data to monitor generalization and control overfitting during iterative model development.
How deep it goes
Explains data reservation, repeated evaluation, patience, stopping, and best-iteration selection, without deriving optimization internals.
Examples
Demonstrates validation_fraction, n_iter_no_change, eval_set, eval_metric, and train-validation-test splitting.
What you can do after
Apply it via Scikit-learn or XGBoost to monitor validation performance and stop training before validation error worsens.

Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains evaluation dataset →

Build a DeepSeek Model (From Scratch)

A validation set is a held-out subset of data used to measure how well a model generalizes during development.

How it is used
Measures generalization to unseen data during training and guides model evaluation and checkpoint selection.
How deep it goes
Explains splitting, tokenization, binary storage, periodic loss evaluation, and checkpointing, without detailing statistical confidence or cross-validation.
Examples
Uses a five-percent TinyStories split, GPT-2 tokenization, val.bin storage, validation loss, and best-checkpoint selection.
What you can do after
Operate/configure a validation pipeline that splits, tokenizes, stores, evaluates, and checkpoints a language-model dataset.

Read how Build a DeepSeek Model (From Scratch) explains evaluation dataset →

The AI Pocket Book

A held-out dataset used to tune or select among models during development, separate from the final evaluation data.

How it is used
Uses held-out data to compare and select models during development.
How deep it goes
Explains selection, business-aligned measures, data separation, and test-set leakage, but does not detail dataset construction procedures.
Examples
Uses GPT-4o versus Llama 3 coding comparisons and crossword clues that may already have publicly available answers.
What you can do after
Apply it to select models with task-relevant measures before conducting a separate final test.

Read how The AI Pocket Book explains evaluation dataset →

LLMs in Production

A validation dataset is a held-out collection of examples used to assess and tune a model during development.

How it is used
Uses held-out examples to assess language-model generalization and guide development decisions.
How deep it goes
Explains evaluation and iterative tuning after training without detailing validation metrics or dataset-construction procedures.
Examples
Uses a language model trained from scratch and repeated parameter or architecture adjustments as examples.
What you can do after
Evaluate a trained model on unseen data and use results to guide fine-tuning or architecture changes.

Read how LLMs in Production explains evaluation dataset →

Designing AI Systems

An evaluation dataset is a collection of test cases containing inputs, expected outputs, and metadata for assessing an AI system or change.

How it is used
Compares prompt alternatives against a shared benchmark to support systematic improvement before deployment.
How deep it goes
Defines test-case fields and describes curated-case creation, production-trace selection, and human review.
Examples
Uses a patient document-request case and production traces with low helpfulness scores or guardrail triggers.
What you can do after
Evaluate prompt versions against the same test cases and augment the benchmark with reviewed production examples.

Read how Designing AI Systems explains evaluation dataset →

Context Engineering

An evaluation set is a collection of test cases and expected or judged outcomes used to assess a system's performance.

How it is used
Measures performance, safety, and accuracy across context-aware AI tasks.
How deep it goes
Defines dataset criteria and sources, then gives operational checks for retrieval and prompt changes.
Examples
Uses stale memory, poisoned instructions, and missing information as negative cases.
What you can do after
Evaluate and understand dataset coverage, source trade-offs, and regression checks for AI systems.

Read how Context Engineering explains evaluation dataset →

Financial AI in Practice

A portion of data kept separate from model training for evaluation.

How it is used
Separates model fitting from performance assessment on unseen data in fraud, credit-scoring, and market-prediction workflows.
How deep it goes
Explains stratified train-test splitting, fold-based validation, and hold-out safeguards, without detailing a general evaluation protocol.
Examples
Uses a stratified 70/30 fraud split, credit-model folds and hold-outs, and embargoed time-series folds.
What you can do after
Apply via scikit-learn to split labeled data and preserve class proportions for evaluation.

Read how Financial AI in Practice explains evaluation dataset →

Grokking Statistics

A held-out dataset used to evaluate a trained model on observations not used for fitting it.

How it is used
Evaluates predictive models on labeled data they have never seen.
How deep it goes
Defines the evaluation role but does not detail dataset splitting, metrics, or implementation.
What you can do after
Evaluate a trained model against labeled observations excluded from its training process.

Read how Grokking Statistics explains evaluation dataset →

Also covered in

What to know first

Related concepts

Questions about evaluation dataset

What is evaluation dataset?

An evaluation dataset is a collection of data or test cases used to assess a model or system against specified outcomes or criteria.

Which Manning books explain evaluation dataset?

Effective Conversational AI, LLM Customization and Fine-Tuning, Natural Language Processing in Action, Second Edition, Grokking Machine Learning, Second Edition, Build AI Drug Discovery Pipelines, Grokking Machine Learning, Building LLM Applications with DSPy, Deep Learning with R, Third Edition and 33 more.

What should I know before learning evaluation dataset?

Manning books that teach evaluation dataset usually introduce language model, accuracy, overfitting and objective function first.

What is the difference between evaluation dataset and training dataset?

An evaluation dataset is a collection of data or test cases used to assess a model or system against specified outcomes or criteria. A training dataset is a collection of examples supplied to a learning procedure to fit or adapt a model’s parameters or behavior.

What is evaluation dataset also called?

Evaluation dataset is also called test set, test data, test dataset, testing set or evaluation set.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.