liveBook · Manning

Data

As explained in Understanding AI

Data is recorded information from which computational systems can detect patterns or learn behavior.

Data is recorded information from which computational systems detect patterns or learn behavior. More examples can help a model learn, but data alone does not make an AI system effective. section 1.2.1

Why quality matters

Imagine training a system on outdated medical advice. It may produce fluent, confident answers while repeating obsolete or incorrect patterns. The issue is not simply how the model learns; noisy, biased, or wrong data shapes what it learns. section 1.2.1

Useful data must work alongside other conditions:

  • More data increases processing, storage, and training demands, turning a data problem into a compute problem. section 1.2.1
  • Data can become outdated as language, facts, and knowledge change, causing predictions to reflect an earlier reality. section 1.2.1
  • Progress accelerates when data, computational power, and algorithms improve together; lacking any one limits the others. section 1.4
Figure 1.6 A high-level timeline of language models and AI systems (1950s–present), showing the progression from early rule-based systems and chatbots to neural networks, sequence models, and modern large language and multimodal systems, along with recurring cycles of progress and setbacks known as AI winters.

A timeline places data alongside changing algorithms and hardware, showing why familiar ideas became practical only when surrounding conditions aligned. section 1.4

How Understanding AI covers it

How deep it goes
Defines data, then examines scale, quality, staleness, compute demands, and alignment with algorithms without detailing collection methods.
Examples
Uses large text datasets, outdated medical advice, garbage-in-garbage-out, and an AI-development timeline.
What you can do after
Evaluate how data quality, freshness, scale, compute, and algorithms affect whether AI systems learn useful patterns.
How it connects
Connects data with machine learning, neural networks, attention, computational power, algorithms, and rule-based systems.

Also explained in

Compare how 10 books explain data →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Understanding AI. The section links point to the parts of the book it draws on.