liveBook · Manning

Probabilistic model

As explained in Time Series Forecasting Using Foundation Models

A probabilistic model represents uncertainty by assigning probability distributions to possible data or prediction outcomes.

A probabilistic model represents uncertainty by assigning a conditional distribution to possible outcomes. In forecasting, it maps an input sequence to a distribution of future values rather than one fixed prediction. section 4.1 section 6.1

The distribution supports prediction intervals: choose a desired interval after obtaining possible future values. A deterministic model instead returns a single value for each forecast step. section 4.1

Forecasting models condition their output on past observations and may use exogenous features. Those features must be known, or separately forecast, across the future horizon. section 3.2

(3.1)
A diagram of a machine

Description automatically generated

Use the conditional-probability formulation to trace how past values and future exogenous features determine a future sequence distribution. section 3.2

Implementations vary. Lag-Llama assumes a Student’s t-distribution and generates intervals from sampled predictions. Chronos scales and quantizes continuous series into tokens, applies a language model, then reverses the transformation. section 4.1.2 section 5.2

Figure 5.2 Overview of the Chronos framework, which adapts a language model for time-series forecasting. First, the time series is tokenized, which involves mean scaling and quantization. Then the output can be used to train the language model.
A diagram of a process

Description automatically generated

Follow the tokenization pipeline from mean scaling and quantization to language-model prediction and the reversal that recovers forecast values. section 5.2

Reducing a distribution to a point forecast

Moirai produces forecast samples for each time step. When a scenario requires point forecasts, stack the samples and use their median; retain the distribution when uncertainty matters. section 10.2.6

How Time Series Forecasting Using Foundation Models covers it

How deep it goes
Defines distributions, intervals, sampling, and tokenization, but defers detailed probability theory and formal training mathematics.
Examples
Demonstrates TimeGPT, Lag-Llama, Chronos, and Moirai, including Student’s t-distributions, tokenization, samples, and median forecasts.
What it assumes
Assumes familiarity with input sequences and forecast horizons while defining the distinction from deterministic forecasting.
What you can do after
Apply it via forecasting models to obtain prediction intervals or derive point forecasts such as medians from predictive samples.
How it connects
Connects probabilistic forecasting with deterministic forecasting, prediction intervals, exogenous features, language models, and transformers.

Also explained in

Compare how 5 books explain probabilistic model →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Time Series Forecasting Using Foundation Models. The section links point to the parts of the book it draws on.