Language model

As explained in Machine Learning System Design

A large language model is a machine learning model trained on large text corpora to generate or transform language and perform related language tasks.

A language model used for dialogue can make monitoring harder than a system expected to return one fixed answer. Repeated prompts to ChatGPT produced different but similar replies; earlier observations also found answers that contradicted one another. The practical question is not whether every reply matches, but which replies are acceptable. section 14.1.2

Treat model changes and output checks as separate operational decisions:

• When a model is retrained or updated, the same input may produce a different output. Check whether the change was needed and whether its effects are acceptable. section 14.1.2
• Do not assume that collecting more training examples is enough. New samples help when they add information relevant to the problem; near-duplicates and extreme noise may not. section 6.4
• Choose serving effort to fit the workload. A time-sensitive request and a scheduled batch job have different latency and cost constraints. section 15.0

Figure 14.2 Annoying ChatGPT to ensure it is a fairly nondeterministic model. Although responses are similar, they are not identical.

Four replies to the same ChatGPT prompt illustrate why identical-output checks are a poor fit for this dialogue example. section 14.1.2

How Machine Learning System Design covers it

How deep it goes

Illustrates response variability and the effects of model updates, but does not explain language-model architecture or training internals.

Examples

Shows four different ChatGPT replies to the same input.

What you can do after

Evaluate/understand it by judging whether varying dialogue responses are acceptable rather than expecting identical replies.

How it connects

Connects variable responses to probabilistic generation, model monitoring, online training, and scheduled retraining.

liveBookmanning.com

Read Machine Learning System Design on liveBook Get the book at manning.com

Also explained in

• 

  liveBookmanning.com
  Software Testing with Generative AIA large language model is a machine-learning model trained on extensive text data to generate and transform language from an input prompt.
• 

  liveBookmanning.com
  LLMs in ProductionA large language model is an artificial intelligence model trained on large text collections to predict and generate human language.
• 

  liveBookmanning.com
  How Large Language Models WorkA machine-learning model trained on very large text collections to understand and generate human language or other sequential content such as source code.
• 

  liveBookmanning.com
  Natural Language Processing in Action, Second EditionA large language model is a neural language model trained on very large text corpora to model and generate language.
• 

  liveBookmanning.com
  Introduction to Generative AI, Second EditionA large language model is a language model trained on very large amounts of data with many parameters to understand and generate natural language across tasks.
• 

  liveBookmanning.com
  Deep Learning with R, Third EditionA large language model is a machine-learning model trained on large text corpora to understand and generate natural-language text.
• 

  liveBookmanning.com
  Grokking AI Algorithms, Second EditionA large language model is a neural language model trained on large text corpora to process and generate human language.
• 

  liveBookmanning.com
  The Art of AI Product DevelopmentA machine-learning model trained on large text corpora to understand and generate natural language.
• 

  liveBookmanning.com
  Deep Learning with Python, Third EditionA language model trained on large text corpora that can generate human-sounding responses, mentioned here as an example of a system that may be modular but still lacks recombination ability.
• 

  liveBookmanning.com
  Grokking AI ApplicationsA large language model is a machine-learning model trained on large text collections to predict and generate sequences of natural-language tokens.
• 

  liveBookmanning.com
  Generative AI in ActionA large language model is a neural model trained on large text corpora to understand and generate natural language, including source code in code-focused variants.
• 

  liveBookmanning.com
  Investing for ProgrammersA large language model is an artificial-intelligence model trained on extensive text data to understand and generate human language.
• 

  liveBookmanning.com
  Effective Conversational AIA large language model is a machine learning model trained on very large text datasets to model and generate sequences of language.
• 

  liveBookmanning.com
  Knowledge Graphs and LLMs in ActionA large language model is a neural language model trained on very large text corpora to understand and generate natural-language content.
• 

  liveBookmanning.com
  Sutskever's ListA language model assigns probabilities to sequences of linguistic tokens and can generate or evaluate text.
• 

  liveBookmanning.com
  The Complete Obsolete Guide to Generative AIA machine-learning model trained on large text corpora to process and generate natural-language text.
• 

  liveBookmanning.com
  Deep Learning with PyTorch, Second EditionA language model with enough scale to generate and answer with fluent text from prompts.
• 

  liveBookmanning.com
  Inside AIA large language model is a machine-learning model trained on large text corpora to process and generate human-language text.
• 

  liveBookmanning.com
  Starting Data Analytics with Generative AI and PythonA machine-learning model trained on large text collections to understand and generate natural language.
• 

  liveBookmanning.com
  AI-Powered SearchA large language model is a neural language model trained on large text corpora to predict and generate language and perform related language-understanding tasks.
• 

  liveBookmanning.com
  Learn Generative AI with PyTorchA large language model trained beforehand on broad textual data and reused for downstream tasks.
• 

  liveBookmanning.com
  Machine Learning Platform EngineeringA large language model is a neural language model trained on extensive text data to generate or transform natural-language content.
• 

  liveBookmanning.com
  Data Analysis with LLMsA language model with a very large number of learned parameters, trained on broad text data for general-purpose language tasks.
• 

  liveBookmanning.com
  Build AI-Enhanced Web AppsA large language model is a machine-learning model trained on large amounts of text to understand and generate natural-language content.
• 

  liveBookmanning.com
  Effective Data AnalysisA large language model is a machine-learning model trained on extensive text data to process and generate human language.
• 

  liveBookmanning.com
  Build Python Web Apps with StreamlitAn LLM is a large language model that generates or transforms text from input sequences.
• 

  liveBookmanning.com
  AI Agents and ApplicationsA large language model is a neural language model trained on extensive text data to understand and generate language and perform text-based reasoning.
• 

  liveBookmanning.com
  Causal AIA large language model is a deep neural language model with billions of parameters trained on vast amounts of text and other data.
• 

  liveBookmanning.com
  Coding with AIA large language model is a neural language model trained on extensive data to understand and generate language, including programming-language text.
• 

  liveBookmanning.com
  Time Series Forecasting Using Foundation ModelsA large language model is a neural-network model trained on large text corpora to perform language understanding and generation tasks.
• 

  liveBookmanning.com
  The AI Pocket BookA neural language model trained on large text corpora to predict and generate natural language.
• 

  liveBookmanning.com
  Deep Learning with JAXA large neural language model used for language-modeling tasks such as generation, training, fine-tuning, and serving.
• 

  liveBookmanning.com
  Build a Reasoning Model (From Scratch)A neural language model trained on large text corpora to predict and generate text.
• 

  liveBookmanning.com
  Learn AI-Assisted Python Programming, Second EditionA large language model is a machine-learning model that represents statistical relationships among language elements and predicts sequences of text from context.
• 

  liveBookmanning.com
  Data Without LabelsA large language model is a machine-learning model trained on very large text collections to understand and generate language.
• 

  liveBookmanning.com
  Essential GraphRAGA large language model is a neural language model trained on extensive text data to generate human-like text by predicting token sequences.
• 

  liveBookmanning.com
  Outlier Detection in PythonA large language model is a neural model trained on very large text corpora to process and generate natural language.
• 

  liveBookmanning.com
  Build an AI Agent (From Scratch)A large language model is a neural language model trained on extensive text data that generates and interprets language.
• 

  liveBookmanning.com
  Build a Large Language Model (From Scratch)A large neural language model trained on text to understand and generate language, typically using transformer self-attention.
• 

  liveBookmanning.com
  Digital Twins in ActionA large language model is a machine-learning model trained on large text corpora to process and generate natural language, optionally incorporating visual inputs.
• 

  liveBookmanning.com
  Hugging Face in ActionA large language model is a high-capacity neural model trained on large text corpora to process and generate language.
• 

  liveBookmanning.com
  A Pythonic Adventure: From Python basics to a working web appA language model is a computational model trained on text or other language data to represent patterns and relationships in language.
• 

  liveBookmanning.com
  Snowflake Data EngineeringA large language model is a model trained to process, generate, and transform human language.
• 

  liveBookmanning.com
  AI-Powered Developer: Build software with ChatGPT and CopilotA large language model is a deep learning model trained to process and generate human language and other text-like sequences.
• 

  liveBookmanning.com
  Data-Driven CybersecurityA neural model trained on extensive text data to predict and generate language.
• 

  liveBookmanning.com
  Microsoft Azure in ActionA large language model is a machine-learning model trained on large text corpora to generate or transform natural-language content.
• 

  liveBookmanning.com
  Domain-Specific Small Language ModelsA very large neural language model trained on broad text corpora to predict or generate language, used here for code generation and assistance.
• 

  liveBookmanning.com
  Writing for Developers: Blogs that get readA machine-learning model trained on large text corpora to predict and generate natural-language sequences.
• 

  liveBookmanning.com
  AI Agents in Action, Second EditionA large language model is a machine-learning model that generates and interprets language using patterns learned from extensive text data.
• 

  liveBookmanning.com
  Machine Learning for Tabular Data: XGBoost, Deep Learning, and AIA large language model is a machine-learning model trained on large text corpora to understand and generate language sequences.
• 

  liveBookmanning.com
  Spring AI in ActionA large language model is a machine-learning model trained on extensive text data to understand and generate natural-language content.
• 

  liveBookmanning.com
  Data Pipelines with Apache Airflow, Second EditionA large language model is a machine learning model trained on extensive text data to understand and generate natural-language text.
• 

  liveBookmanning.com
  Transformers in ActionA large language model is a neural language model trained on large text corpora to predict and generate natural-language sequences.
• 

  liveBookmanning.com
  Data Storytelling with Altair and AIA large language model is a neural language model with many learned parameters that generates or transforms text based on input context.
• 

  liveBookmanning.com
  AI Agents in ActionA large language model is a neural language model trained on extensive text data to generate and transform natural-language content.
• 

  liveBookmanning.com
  Automating API DeliveryA large language model is a machine-learning model trained on extensive text data to generate and transform natural-language or code-based content.
• 

  liveBookmanning.com
  MongoDB 8.0 in Action, Third EditionA large language model is a machine learning model with many parameters trained to process and generate natural language.
• 

  liveBookmanning.com
  Just Use Postgres!An LLM is a large language model trained to understand and generate natural-language text.
• 

  liveBookmanning.com
  Build a Text-to-Image Generator (from Scratch)A language model is a model that processes or generates human language, typically as sequences of text.
• 

  liveBookmanning.com
  Everyday Data VisualizationA large language model is a machine-learning model trained on extensive text data to process and generate human language.
• 

  liveBookmanning.com
  Build a Website with ChatGPTA large language model is a machine-learning model trained on extensive text data to generate and transform natural-language content.
• 

  liveBookmanning.com
  Authorization in ActionA large language model is a machine-learning model trained on extensive text data to process and generate language.
• 

  liveBookmanning.com
  Kafka for ArchitectsInference is the generation of model predictions from input data using a trained machine-learning model.
• 

  liveBookmanning.com
  Statistics Every Programmer NeedsA mathematical model represents relationships in a system using mathematical structures to analyze or predict its behavior.
• 

  liveBookmanning.com
  Building Reliable AI SystemsA model that represents patterns in language to predict or generate sequences of text.
• 

  liveBookmanning.com
  Building LLM Applications with DSPyA language model is a machine-learning model that generates or evaluates language based on textual context.

Compare how 67 books explain language model →

Related concepts

• retrieval-augmented generationused by · Retrieval-augmented generation is a technique that retrieves relevant information from external sources and supplies it as context to a generative model when producing an output.
• promptused by · An input, typically containing instructions or context, supplied to an artificial-intelligence model to guide or elicit its output.
• AI agentused by · An AI agent is a computational system that uses artificial intelligence to interpret information, select actions, and pursue goals through interaction with an environment.
• generationproduces · Generation is the computational production of outputs from supplied inputs or context, often by applying a model to produce predictions or new content.
• ChatGPTincludes · ChatGPT is OpenAI’s conversational AI service, which lets users interact with generative AI models and related tools through natural-language prompts.
• machine learningkind of · Machine learning is a field of computational methods in which systems learn patterns or relationships from data to make predictions, decisions, or other outputs.

This explainer was generated by Manning's knowledge graph from the text of Machine Learning System Design. The section links point to the parts of the book it draws on.