liveBook · Manning

Deep learning

As explained in Data Without Labels

A deep learning model is a machine-learning model composed of multiple layers of learned representations.

Deep learning is machine learning based on neural networks. It is particularly useful for unstructured data such as images, text, audio, and video, where conventional machine-learning methods may be less effective. It can also be used with structured data. The goal is to learn patterns from data for tasks such as recognition, prediction, or grouping. section 8.1.1 section 8.13

A neural network learns through connected components and a training process:

  • Artificial neurons use weights and biases; input, hidden, and output layers organize the network. Hidden layers learn features used in decisions, while activation functions affect its outputs. section 8.13
  • With labeled data, training seeks useful weights and biases through feed-forward propagation, loss calculation, and backpropagation. section 8.13 section 8.3
  • With unlabeled data, a network can instead learn structure such as groupings or distributions. Unsupervised approaches include the Boltzmann learning rule and deep belief networks. section 8.5

Recognizing faces

To identify people in images, train a network on face images paired with names. It begins without knowing which image attributes identify a person and learns distinguishing characteristics from the labeled examples. An unlabeled image task would differ: it might group similar pictures without assigning supplied names. section 8.2.1 section 8.5

Architecture should fit the data: convolutional neural networks are used for image and video patterns, while recurrent neural networks handle sequences such as language and time series. Before choosing a complex model, check whether representative, good-quality data and enough training capacity are available. Deep learning is not a solution to every business problem. section 8.13 section 8.11

How Data Without Labels covers it

How deep it goes
Explains network components and supervised training through loss and backpropagation, then introduces unlabeled training methods.
Examples
Uses labeled face identification and contrasts supervised image classification with unsupervised image grouping.
What it assumes
Builds on supervised-learning basics while introducing neurons, activation functions, weights, and biases before describing training.
What you can do after
Evaluate/understand it by matching network approaches to data and checking data quality and processing capacity before use.
How it connects
Connects neural networks with supervised learning, unsupervised learning, convolutional neural networks, recurrent neural networks, and deep belief networks.

Also explained in

Compare how 11 books explain deep learning →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Data Without Labels. The section links point to the parts of the book it draws on.