liveBook · Manning

Pretrained model

Also called pre-trained model

A pretrained model is a machine-learning model whose parameters were learned through prior training before it is used for inference or adapted to a later task.

How 8 Manning books explain it

Starting Data Analytics with Generative AI and Python

A generative AI model that has undergone initial training before being adapted or used for a task.

How it is used
Uses pretrained models for customer-review sentiment analysis and text summarization without requiring users to build models.
How deep it goes
Compares model options and output risks while leaving model development and training outside scope.
Examples
Compares classifications of 500 customer reviews using multilingual, zero-shot, translated-input, keyword, and ChatGPT 4 approaches.
What you can do after
Evaluate and understand candidate models by comparing sensitivity, specificity, and cost on task data.

Read how Starting Data Analytics with Generative AI and Python explains pretrained model →

Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI

A pretrained model is a machine-learning model trained on data before being adapted to a particular task.

How it is used
Uses pretrained models to transfer information into new tasks and reduce the need for costly task-specific annotation.
How deep it goes
Explains partial retraining, representation features, prediction features, and intermediate task training, with practical choices for domain adaptation.
Examples
Illustrates location sequence labeling with contextual models and reuse of a classification model’s neurons as features for another classifier.
What you can do after
Evaluate and understand when to adapt a pretrained model, use its features, or tune it to a target domain.

Read how Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI explains pretrained model →

Grokking AI Applications

A pretrained model is a model whose parameters have already been learned from an initial training corpus before later application or specialization.

How it is used
Separates the costly initial learning phase from later prompt-based inference and specialization.
How deep it goes
Explains parameter adjustment, backpropagation, training data, and inference, but stops short of detailed neural-network mathematics.
Examples
Uses GPT, GPT-3, sentence completion, a Rome prediction, and a 45-terabyte text dataset as concrete examples.
What you can do after
Evaluate/understand how learned parameters support inference and why later specialization can begin from an existing model.

Read how Grokking AI Applications explains pretrained model →

Build a Text-to-Image Generator (from Scratch)

Pretrained weights are model parameter values learned previously on another task or dataset and reused for later adaptation.

How it is used
Uses previously learned parameters to perform inference immediately or adapt a model to a specialized task with less data and computation.
How deep it goes
Explains checkpoint loading, evaluation, preprocessing, inference, and output-head replacement, while stopping short of full training implementation.
Examples
Demonstrates ResNet50 image classification, Stable Diffusion prompt generation, latent image modification, and VAE checkpoint loading.
What you can do after
Apply it via torchvision or diffusers to load checkpoints, run predictions or generation, and plan targeted fine-tuning.

Read how Build a Text-to-Image Generator (from Scratch) explains pretrained model →

Deep Learning with R, Third Edition

A pretrained model is a machine-learning model whose parameters have already been learned from prior training data.

How it is used
Repurposes models trained on broad datasets for new tasks, especially when labeled data or computational resources are limited.
How deep it goes
Defines feature reuse and explains feature extraction versus fine-tuning, while deferring detailed architecture treatment.
Examples
Uses ImageNet and Xception, SAM segmentation, IMDb Transformer classification, and Gemma language generation as concrete examples.
What you can do after
Apply it via Xception, SAM, a pretrained Transformer, or Gemma instead of training an equivalent large model from scratch.

Read how Deep Learning with R, Third Edition explains pretrained model →

Optimization Algorithms: AI techniques for design, planning, and control problems

A pretrained model is a machine-learning model whose parameters were learned previously on a dataset or task before subsequent use.

How it is used
Applies an already trained ML model to generate candidate solutions for different TSP instances.
How deep it goes
Explains loading, device selection, decoding, evaluation, and configuration, but not parameter-training internals.
Examples
Uses a pretrained GNN model, TSP datasets, greedy decoding, CUDA configuration, and a plotted TSP50 solution.
What you can do after
Operate/configure a pretrained model to evaluate TSP instances without rebuilding the complete training pipeline.

Read how Optimization Algorithms: AI techniques for design, planning, and control problems explains pretrained model →

Time Series Forecasting Using Foundation Models

A pretrained model is a model whose parameters were learned on earlier data before its application to a new task or dataset.

How it is used
Supports transfer learning when a new task lacks enough data for training from scratch.
How deep it goes
Explains pretraining, zero-shot prediction, and fine-tuning, but does not detail parameter updates or optimization mechanics.
Examples
Uses translation, new-product sales forecasting, monthly time series, and an N-BEATS transfer-learning workflow.
What you can do after
Apply a pretrained model through zero-shot prediction or fine-tuning on a new dataset.

Read how Time Series Forecasting Using Foundation Models explains pretrained model →

Build AI-Enhanced Web Apps

A pretrained model is a machine-learning model whose parameters have already been learned from training data before being adapted or used for an application.

How it is used
Provides practical language capabilities for web applications without requiring teams to build or host models themselves.
How deep it goes
Compares hosted convenience with self-hosted control, but stops short of explaining model internals or training procedures.
Examples
Demonstrates Astra answering a dad-joke request through OpenAI or Gemini-backed conversational interfaces.
What you can do after
Apply it via OpenAI REST APIs to add natural-language responses to a React, Express.js, or Next.js application.

Read how Build AI-Enhanced Web Apps explains pretrained model →

Also covered in

What to know first

Related concepts

Questions about pretrained model

What is pretrained model?

A pretrained model is a machine-learning model whose parameters were learned through prior training before it is used for inference or adapted to a later task.

Which Manning books explain pretrained model?

Starting Data Analytics with Generative AI and Python, Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI, Grokking AI Applications, Build a Text-to-Image Generator (from Scratch), Deep Learning with R, Third Edition, Optimization Algorithms: AI techniques for design, planning, and control problems, Time Series Forecasting Using Foundation Models and Build AI-Enhanced Web Apps.

What should I know before learning pretrained model?

Manning books that teach pretrained model usually introduce language model, natural language processing, computer vision and fine-tuning first.

What kinds of pretrained model are there?

Kinds of pretrained model include foundation model, SAM and language model.

What is pretrained model also called?

Pretrained model is also called pre-trained model.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.