liveBook · Manning

Question answering

As explained in Introduction to Generative AI, Second Edition

Question answering is the task of producing answers to questions posed in natural language.

Question answering is the task of producing answers to questions posed in natural language. It appears in multiple-choice settings, where a system selects from provided options, and open-domain settings, where it answers without choices. section 1.6

The main variations differ in how they use context. Extractive question answering selects an answer from supplied text or a table. Open-book generative question answering uses supplied context to produce an answer in its own words. Closed-book generative question answering receives only the question and generates an answer from information learned during training. section 1.6

Question answering depends on several capabilities and exposes important limitations:

  • The system must represent the question and its context, parse what is being asked, and generate or select a response. section 2.2
  • Closed-book answers draw on patterns and information acquired from large text collections during pretraining, while open-book answers can use supplied supporting information. section 2.2
  • Obscure information, underspecified questions, and uneven web coverage can produce incorrect or made-up answers; assumptions may also reflect the dominance of English and Western sources online. section 2.2

From a fact question to reading comprehension

A system might answer “Which politician won the Nobel Peace Prize in 2009?” or “What music did Beethoven compose?” Question answering also includes reading comprehension: the system receives several sentences or paragraphs and answers a specific question, sometimes in multiple-choice, dialogue, or abstractive formats. section 1.6

How Introduction to Generative AI, Second Edition covers it

How deep it goes
Distinguishes task formats and answer-generation modes, then explains representation, parsing, pretraining, and uncertainty without implementation details.
Examples
Uses Nobel Prize, Beethoven, and first-president questions alongside text passages, tables, multiple-choice items, and conversational datasets.
What it assumes
Assumes only familiarity with natural-language questions while teaching the distinctions among context, pretraining, and answer-generation modes.
What you can do after
Evaluate question-answering systems by distinguishing answer formats, context use, reading-comprehension settings, and risks of unsupported responses.
How it connects
Connects question answering with reading comprehension, pretraining, large language models, natural-language processing, and open-web data.

Also explained in

Compare how 4 books explain question answering →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Introduction to Generative AI, Second Edition. The section links point to the parts of the book it draws on.