liveBook · Manning

GPT model

Also called Generative Pretrained Transformer, Generative Pre-Trained Transformer, GPT family, OpenAI GPT

A GPT model is a generative, autoregressive Transformer language model in the family developed by OpenAI.

How 20 Manning books explain it

WordPress Power Toolkit: Harness AI to build next-level websites

GPT is a family of generative transformer language models developed by OpenAI for text, reasoning, programming, and multimodal tasks.

How it is used
Supports website writing, design decisions, comment review, and small CSS tasks through conversational requests.
How deep it goes
Demonstrates prompts, responses, follow-up questions, and WordPress actions; does not explain model architecture or training.
Examples
Uses a recipe-site introduction rewrite, home-page design comparisons, pending comments, and a hover-animation request.
What you can do after
Apply it via the GPT chatbot to request website changes, refine suggestions, and test generated effects.

Read how WordPress Power Toolkit: Harness AI to build next-level websites explains GPT model →

Grokking AI Applications

GPT is a generative pretrained transformer language model that predicts likely continuations of text.

How it is used
Explains how a GPT model contributes to language generation and how further training supports conversational use.
How deep it goes
Works from a simplified completion example to GPT-3 embeddings, context, and next-word calculations without requiring mastery of every detail.
Examples
Compares an eight-token toy vocabulary with GPT-3’s 50,000-token vocabulary and illustrates sentence completion.
What you can do after
Understand how next-word prediction underlies text generation and how later refinement supports conversation.

Read how Grokking AI Applications explains GPT model →

The Complete Obsolete Guide to Generative AI

A family of generative language models based on the Generative Pre-trained Transformer architecture.

How it is used
Applies GPT models to chat, automation, summarization, data questions, and sentiment classification.
How deep it goes
Explains model variants, token limits, configuration, and runnable API calls while deliberately minimizing underlying theory.
Examples
Demonstrates transcript summarization, dataset querying, and sentiment labels for 1,000 product-review posts.
What you can do after
Apply it via the OpenAI API to classify text and query indexed documents with constrained prompts.

Read how The Complete Obsolete Guide to Generative AI explains GPT model →

Sutskever's List

The GPT family is a series of transformer-based autoregressive language models.

How it is used
Uses GPT-2 and GPT-3 to examine what model scaling achieved and what it cost.
How deep it goes
Explains scale, observed capabilities, and training-data trade-offs without detailing transformer internals.
Examples
Contrasts GPT-2’s cherry-picked “Ovid’s Unicorn” with GPT-3’s scale and Chinchilla’s token-to-parameter comparison.
What you can do after
Evaluate/understand why GPT-3’s gains did not make its allocation of parameters and training data optimal.

Read how Sutskever's List explains GPT model →

Build a Large Language Model (From Scratch)

A family of decoder-only generative pretrained transformer language models.

How it is used
Deploys decoder-only generation for text completion, translation, summarization, coding, classification, and zero-shot or few-shot tasks.
How deep it goes
Decomposes GPT into embeddings, transformer blocks, attention, normalization, and output logits, while deferring full training and fine-tuning workflows.
Examples
Uses GPT-2 configuration values, tokenized four-token batches, architecture diagrams, and logits with shape [2, 4, 50257].
What you can do after
Build it from scratch by assembling a GPT-like architecture, preparing token batches, running forward passes, and progressing toward pretraining and fine-tuning.

Read how Build a Large Language Model (From Scratch) explains GPT model →

Fight Fraud with Machine Learning

GPT is a family of generative pretrained transformer language models trained to model and generate text.

How it is used
Supports phishing detection by powering ChatGPT-based classification, decision interpretation, and instruction-driven improvement.
How deep it goes
Defines next-word language modeling and illustrates autoregressive generation, while directing from-scratch LLM construction elsewhere.
Examples
Illustrates next-word choices for “French is a beautiful …” and “It will,” plus a ChatGPT fraud conversation.
What you can do after
Apply it via ChatGPT to detect phishing emails, request decision interpretations, and instruct improved detection.

Read how Fight Fraud with Machine Learning explains GPT model →

Learn Generative AI with PyTorch

A family of generative pretrained Transformer language models referenced here as the host family that Codex is integrated into.

How it is used
Uses decoder-only Transformers to generate text or music from domain-specific token sequences.
How deep it goes
Explains configuration, token preparation, decoder internals, training flow, and generation through a small working architecture.
Examples
Demonstrates Hemingway-style generation from three novels and adapts the architecture for music generation.
What you can do after
Build it from scratch, train it on tokenized domain text, and generate continuations from prompts.

Read how Learn Generative AI with PyTorch explains GPT model →

Transfer Learning for Natural Language Processing

GPT is a family of autoregressive transformer language models developed by OpenAI.

How it is used
Uses GPT for text generation and as a pretrained model for downstream language-understanding tasks.
How deep it goes
Explains decoder stacks, causal masking, and task input transformations, including a comparison with BERT.
Examples
Illustrates task adaptation with textual entailment and compares the parameter counts of GPT-2 and GPT-3.
What you can do after
Evaluate and understand how causal masking supports generation and how task inputs can adapt GPT to classification.

Read how Transfer Learning for Natural Language Processing explains GPT model →

LLMs in Production

A GPT model is a generative pretrained transformer language model that produces text from an input context.

How it is used
Frames GPT as a practical decoder-only architecture for natural language generation, conversational systems, and streamed text output.
How deep it goes
Explains decoder behavior, model lineage, and tokenization consequences, but stops short of detailed training or transformer internals.
Examples
Uses decoder diagrams, GPT-1 through GPT-3, ChatGPT, GPT-J, and arithmetic comparisons involving GPT-4 and GOAT 7B.
What you can do after
Evaluate GPT systems by generation behavior, failure modes, model lineage, and tokenization fit for the intended task.

Read how LLMs in Production explains GPT model →

Generative AI in Action

A family of generative pretrained transformer language models developed by OpenAI.

How it is used
Uses GPT for general language tasks, developer assistance, and task-specific adaptation through fine-tuning.
How deep it goes
Defines the GPT family and its capabilities, then demonstrates API use and outlines a fine-tuning evaluation workflow.
Examples
Demonstrates Python text generation and French translation, plus fine-tuning for Microsoft Teams-style emoji responses.
What you can do after
Evaluate/understand GPT capabilities and compare a fine-tuned model with its base model and task baseline.

Read how Generative AI in Action explains GPT model →

How Large Language Models Work

GPT is a family of generative pretrained transformer-based language models developed by OpenAI.

How it is used
Frames GPT as a practical generative language system for understanding, using, and evaluating tools such as ChatGPT.
How deep it goes
Defines generation, pretraining, and transformers at a high level, while stopping short of coding an LLM from scratch.
Examples
Uses a snow-and-pines haiku prompt and an input-output diagram covering text, images, and numbers.
What you can do after
Evaluate GPT-based tools more effectively by distinguishing generated fluency from accuracy, capability, limitation, and risk.

Read how How Large Language Models Work explains GPT model →

Deep Learning with R, Third Edition

GPT is a family of autoregressive Transformer language models that generate text by predicting successive tokens from preceding context.

How it is used
Frames next-token prediction as a general pretraining setup for text generation, question answering, and text classification.
How deep it goes
Explains decoder-only structure, information flow, embeddings, dropout, and a stacked mini-GPT implementation, but not training procedures.
Examples
Uses GPT-1 through GPT-3 scaling, question answering, text classification, and a runnable mini-GPT architecture.
What you can do after
Build it from scratch as a decoder-only R/Keras model with positional embeddings, repeated Transformer blocks, and token prediction outputs.

Read how Deep Learning with R, Third Edition explains GPT model →

Introduction to Generative AI, Second Edition

GPT is a family of autoregressive transformer language models developed by OpenAI and pretrained on large text corpora.

How it is used
Provides a general-purpose foundation for text generation, question answering, chatbots, and task-specific language applications.
How deep it goes
Explains transformer attention, pretraining, fine-tuning, applications, and risks without descending into implementation details.
Examples
Uses GPT-3.5 in Bing, GPT-3 word invention, summarization, translation, grammar correction, and conversational assistants as examples.
What you can do after
Evaluate GPT applications by recognizing their flexible capabilities alongside hallucination, bias, deployment, and environmental risks.

Read how Introduction to Generative AI, Second Edition explains GPT model →

Deep Learning with Python, Third Edition

A decoder-only transformer language model that generates text by predicting the next token from left-context only.

How it is used
Uses left-to-right text modeling to generate continuations and handle sequence-to-sequence tasks such as question-answering.
How deep it goes
Explains decoder-only information flow and gives Keras construction details, but does not develop training data preparation or generation procedures.
Examples
Uses a capital-of-France question-answer sequence and a Keras mini-GPT assembled from stacked decoder blocks.
What you can do after
Build it from scratch as a Keras mini-GPT using stacked decoder blocks, positional embeddings, and vocabulary projection.

Read how Deep Learning with Python, Third Edition explains GPT model →

Build a Website with ChatGPT

GPT is a family of generative pretrained transformer language models that generate text from input context.

How it is used
Supports plain-English creation of static web pages and research assistance through conversational applications.
How deep it goes
Defines the acronym, next-word prediction, and prompt workflow but stops short of detailed model internals.
Examples
Uses generated web-page code, a prompt-copy-save-deploy cycle, and a coffee-history research prompt with source links.
What you can do after
Build static web pages from plain-English prompts and practice researching topics with source-linked GPT responses.

Read how Build a Website with ChatGPT explains GPT model →

Elasticsearch in Action, Second Edition

A generative pretrained transformer is a transformer-based neural-network architecture pretrained to generate or understand text.

How it is used
Supports conversational agents and generative-AI applications that respond to prompts with relevant human-like text.
How deep it goes
Explains the transformer label, next-word prediction, broad training data, learned language patterns, and fine-tuning, without architectural internals.
Examples
Uses travel itineraries, legal summaries, self-help plans, code analysis, application data modeling, and technology comparisons as examples.
What you can do after
Evaluate how GPT-powered tools generate text, support conversation, and adapt to specialized tasks through fine-tuning.

Read how Elasticsearch in Action, Second Edition explains GPT model →

Inside AI

GPT-3 is a generative language model developed by OpenAI for processing and generating human-language text.

How it is used
Supports natural-language tasks such as translation, question answering, summarization, coding assistance, and conversation.
How deep it goes
Describes GPT-3's parameter count, training data, task range, and variants without detailing model implementation.
Examples
Uses Python code generation, document summarization, translation, question answering, and three-digit arithmetic as examples.
What you can do after
Evaluate GPT-3 variants for language tasks by weighing their stated capabilities against differences in speed and resource demands.

Read how Inside AI explains GPT model →

Deep Learning with PyTorch, Second Edition

A decoder-only transformer architecture used for autoregressive text generation without a separate encoder stack.

How it is used
Generates contextually relevant and coherent text from input sequences using a decoder-only architecture.
How deep it goes
Builds a small PyTorch decoder from attention blocks, embeddings, normalization, residual connections, and output projection.
Examples
Demonstrates a character-level names model that generates short invented names after training.
What you can do after
Build it from scratch in PyTorch and generate character-level samples with a compact transformer decoder.

Read how Deep Learning with PyTorch, Second Edition explains GPT model →

Machine Learning Algorithms in Depth

GPT-3 is a large autoregressive transformer language model that generates text from preceding context.

How it is used
Positions GPT-3 in natural language processing for text completion, code completion, and zero-shot or few-shot learning.
How deep it goes
Defines GPT-3 as a large Transformer language model but does not detail training, architecture, or inference mechanics.
Examples
Uses text completion, code completion, and Codex turning comments into code or completing functions in context.
What you can do after
Evaluate/understand GPT-3 as a general language model supporting contextual text and code completion.

Read how Machine Learning Algorithms in Depth explains GPT model →

Build Python Web Apps with Streamlit

GPT-5.1 is an OpenAI large language model in the GPT-5 family that supports configurable reasoning behavior.

How it is used
Uses a GPT model to generate text responses for AI-powered Python applications.
How deep it goes
Explains messages, endpoint selection, reasoning configuration, and returned content, but stops short of model internals.
Examples
Demonstrates a programming assistant explaining Streamlit in ten words or fewer through a Python API call.
What you can do after
Apply it via the OpenAI Python library to send a conversation and extract generated text from the completion response.

Read how Build Python Web Apps with Streamlit explains GPT model →

Also covered in

What to know first

Related concepts

Questions about GPT model

What is GPT model?

A GPT model is a generative, autoregressive Transformer language model in the family developed by OpenAI.

Which Manning books explain GPT model?

WordPress Power Toolkit: Harness AI to build next-level websites, Grokking AI Applications, The Complete Obsolete Guide to Generative AI, Sutskever's List, Build a Large Language Model (From Scratch), Fight Fraud with Machine Learning, Learn Generative AI with PyTorch, Transfer Learning for Natural Language Processing and 12 more.

What should I know before learning GPT model?

Manning books that teach GPT model usually introduce language model, ChatGPT, natural language processing and transformer architecture first.

What is GPT model a kind of?

GPT model is a kind of decoder-only transformer. A decoder-only transformer is a Transformer language model with decoder layers and no separate encoder, generating sequence elements autoregressively from preceding context.

What is GPT model also called?

GPT model is also called Generative Pretrained Transformer, Generative Pre-Trained Transformer, GPT family or OpenAI GPT.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.