liveBook · Manning

ChatGPT

As explained in How Large Language Models Work

A conversational artificial-intelligence service developed by OpenAI that generates responses to natural-language prompts.

ChatGPT is a conversational generative-AI service from OpenAI. It accepts natural-language prompts and generates new responses, primarily text. GPT means Generative Pretrained Transformer. section 1.0 section 1.1

At a high level, ChatGPT uses patterns in previously observed data to create output shaped by the prompt and by expectations of pleasing, accurate results. Its fluent responses should not be mistaken for unlimited capability or guaranteed accuracy. section 1.0 section 1.1

ChatGPT fits several overlapping descriptions:

  • Generative AI: software that creates new media from observed data. section 1.1
  • Language model: a model concerned with human language. section 1.1
  • NLP system: technology for computers to understand, manipulate, and create human language. section 1.1

A creative prompt

Given “Write a haiku about snow falling on pines,” ChatGPT draws on patterns associated with haikus, snow, pines, and poetry to produce a novel haiku. section 1.1

Figure 1.2 Generative AI takes some input (numbers, text, images) and produces a new output (usually text or images). Any combination of input or output options is possible, and the nature of the output depends on what the algorithm was trained for. It could be to add detail, rewrite something to be shorter, extrapolate missing portions, and more.
figure

Shows how generative AI maps inputs such as numbers, text, or images to new outputs, with the result shaped by training. section 1.1

How How Large Language Models Work covers it

How deep it goes
Defines ChatGPT and its surrounding terms in plain language, while deferring detailed treatment of pretraining and transformers.
Examples
Uses a haiku prompt and input-output examples spanning text, images, audio, and numbers.
What you can do after
Understand what ChatGPT is, what it can and cannot do, and when related systems may be unsuitable.
How it connects
Connects ChatGPT with generative AI, machine learning, language models, natural language processing, and transformers.

Also explained in

Compare how 20 books explain ChatGPT →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of How Large Language Models Work. The section links point to the parts of the book it draws on.