liveBook · Manning

Deep learning

As explained in Delivering Machine Learning Projects: From design to deployment

A deep neural network is a neural-network model composed of multiple computational layers that learn hierarchical representations from data.

Deep learning uses multi-layer neural-network architectures to learn hierarchical representations, especially when inputs are complex and unstructured, such as images, sound, or natural language. section 7.3.3 section 7.3.4

Treat deep learning as a model-selection decision with explicit delivery checks:

  • Benchmark a familiar algorithm before adopting a novel deep architecture; retain the simpler option when it meets the required output. section 7.3.3
  • Match the architecture’s inductive bias to the data: convolutional networks capture image localities, while recurrent, graph, and attention-based networks target other structures. section 7.3.4
  • Check transparency, training expense, inference latency, production cost, and environmental impact before treating functional performance as sufficient. section 7.3.3

Why architecture matters for images

A basic perceptron receives image pixels in sequence and loses their spatial relationships, making object recognition difficult. A convolutional network instead propagates information locally with learned sliding-window filters. section 7.3.4

Figure 7.6 Inductive bias in ML algorithms (adapted from Jumper, Evans, et. al. [6]. The sequence (a) through (e) is determined by the order in which these biases gained popularity in the ML community. The arrows indicate the propagation of signal across a network or in a graph.

Compare the inductive biases of multi-layer perceptrons, grid-based vision networks, recurrent networks, graph networks, and attention-based transformers. section 7.3.4

How Delivering Machine Learning Projects: From design to deployment covers it

How deep it goes
Explains architecture-specific inductive bias and operational trade-offs, but stops short of detailed training algorithms or mathematics.
Examples
Uses pixel-order limitations, convolutional localities, learned filters, and comparisons among five hierarchical network families.
What you can do after
Evaluate deep-network choices against data structure, benchmark performance, transparency, training cost, inference latency, and production expense.
How it connects
Connects deep learning to inductive bias, convolutional networks, recurrent networks, graph networks, transformers, explainability, and model benchmarking.

Also explained in

Compare how 11 books explain deep learning →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Delivering Machine Learning Projects: From design to deployment. The section links point to the parts of the book it draws on.