liveBook · Manning

Training dataset

As explained in Build an AI Agent (From Scratch)

Training data is the collection of examples used to fit a machine-learning model's parameters and learned patterns.

A training dataset is a collection of examples used to fit a model’s parameters and learned patterns. For large language models, examples can include tool definitions paired with the calls and arguments that correctly answer a request. section 3.2.2

Tool-use training examples teach a model to:

  • Recognize when a request requires a tool. section 3.2.2
  • Select an appropriate tool from the available options. section 3.2.2
  • Extract parameter values and format a structured function call. section 3.2.2

Tool-call example

For “Please set the living room blinds to 75% openness,” a training example pairs the request with set_blind_openness(room='living room', openness_percentage=75). Repeated patterns support recognition, selection, argument extraction, and formatting. section 3.2.2

Training data can also supply factual knowledge: web content such as Wikipedia and reference materials may let a model answer documented questions without external tools. That knowledge remains unreliable for current or precise information because the model cannot reliably distinguish accurate recall from confabulation. section 2.4.3

How Build an AI Agent (From Scratch) covers it

How deep it goes
Explains dataset examples and learned behaviors, then stops short of detailing optimization or parameter-fitting internals.
Examples
Uses tool definitions, blind-control calls, web content, Wikipedia, reference materials, and the hermes-function-calling-v1 dataset.
What you can do after
Evaluate when learned knowledge may suffice and when tool calls are needed, while recognizing that recalled facts may be outdated or confabulated.
How it connects
Connects training datasets with large language models, tool use, function calling, external tools, and confabulation.

Also explained in

Compare how 36 books explain training dataset →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Build an AI Agent (From Scratch). The section links point to the parts of the book it draws on.