liveBook · Manning

Pretrained model

As explained in Time Series Forecasting Using Foundation Models

A pretrained model is a model whose parameters were learned on earlier data before its application to a new task or dataset.

A pretrained model has learned general patterns from earlier data and can be applied to a new task or dataset through transfer learning. section 2.11 section 2.3

Apply a pretrained model in two main ways:

  • Generate zero-shot predictions without training on the new dataset. section 2.11
  • Fine-tune it for a few steps so it specializes in the target task. section 2.11
  • Use it when the target dataset is too small to support training a model from scratch. section 2.3

Forecasting a new product

A pretrained forecasting model can predict sales for a new product before enough historical observations exist to train a product-specific model. section 2.3

How Time Series Forecasting Using Foundation Models covers it

How deep it goes
Explains pretraining, zero-shot prediction, and fine-tuning, but does not detail parameter updates or optimization mechanics.
Examples
Uses translation, new-product sales forecasting, monthly time series, and an N-BEATS transfer-learning workflow.
What it assumes
Assumes a target task and dataset, while defining pretraining and transfer learning before application.
What you can do after
Apply a pretrained model through zero-shot prediction or fine-tuning on a new dataset.
How it connects
Connects pretrained models with transfer learning, foundation models, zero-shot prediction, fine-tuning, and forecasting.

Also explained in

Compare how 7 books explain pretrained model →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Time Series Forecasting Using Foundation Models. The section links point to the parts of the book it draws on.