Time-series validation
Time-series validation evaluates a predictive model using training and evaluation data split in temporal order, with training observations preceding evaluation observations.
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
Time-based validation evaluates a model using temporally ordered training and validation data that respect the direction of time.
- How it is used
- Uses time-based validation when time determines model results.
- How deep it goes
- Recommends time-aware validation and temporal features but does not specify split schedules or implementation details.
- Examples
- Contrasts IID and non-IID data sequences and recommends lags or moving averages as temporal representations.
- What you can do after
- Apply it by choosing time-based validation when temporal order affects model results.
Machine Learning System Design
A validation procedure that separates training and evaluation data according to their temporal order.
- How it is used
- Evaluates models on time-sensitive data without randomly mixing past and future observations.
- How deep it goes
- Specifies timestamp-ordered splitting and choices for test windows, training history, seasonality, and gaps.
- Examples
- Uses neighboring-day sales, later user actions, yearly patterns, and whole-week test folds as examples.
- What you can do after
- Evaluate models with timestamp-ordered splits sized for the forecast horizon, retraining cadence, and seasonal patterns.
Read how Machine Learning System Design explains time-series validation →
Related concepts
- cross-validationcontrasts with · Cross-validation is a resampling technique that evaluates a model by repeatedly fitting it on some portions of available data and assessing it on held-out portions.
- validationkind of · The process of checking data, behavior, systems, models, or results against defined criteria to assess their correctness, suitability, or acceptability.
- random forestmeasures · A random forest is an ensemble model that combines predictions from multiple decision trees built with randomized data samples, feature selections, or both.
- seasonality effectconfigured by · A seasonality effect is a recurring pattern of variation in data associated with regular temporal, calendar, or time-of-year cycles.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.