liveBook · Manning

Deep learning

As explained in Introduction to Generative AI, Second Edition

Deep learning is a machine-learning subfield based on neural networks with multiple hidden layers.

Deep learning is a machine-learning approach built from neural networks with multiple hidden layers. Each layer transforms inputs through connected nodes, while training adjusts connection weights and bias terms to improve a defined objective. section 1.1

Its strength comes from learning complex patterns in very large datasets. This makes it useful for natural language processing, while its complexity depends partly on the number of learned parameters. section 1.1

Deep learning systems involve:

  • Data, such as text for natural language tasks. section 1.1
  • An objective function that defines what the model should improve. section 1.1
  • Training that iteratively updates weights and biases. section 1.1

How Introduction to Generative AI, Second Edition covers it

How deep it goes
Defines layers, nodes, weights, biases, objectives, and parameters, but defers the precise training mathematics.
Examples
Uses text-based natural language tasks and large language models as examples of neural-network applications.
What you can do after
Understand how layered neural networks learn representations for data-rich tasks and why parameter count signals model complexity.
How it connects
Connects neural networks with machine learning, objective functions, natural language processing, parameters, and reinforcement learning.

Also explained in

Compare how 11 books explain deep learning →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Introduction to Generative AI, Second Edition. The section links point to the parts of the book it draws on.