liveBook · Manning

Neuron

As explained in Math and Architectures of Deep Learning

A biological nerve cell used as an analogy for a neural-network building block.

A neuron is the basic building block of a neural network: a relatively simple function whose weighted connections can participate in modeling complicated, unknown target functions. A network gains expressive power by combining many neurons, connections, and parameter values. section 7.1 section 7.3

The useful analogy is structural rather than mystical: connection weights play a role similar to synaptic strengths, while training iteratively tunes parameters so outputs better match desired outcomes. The neuron is therefore the small computational unit beneath a model that can generalize beyond its training inputs. section 1.1 section 7.1

y(hardness, sharpness) = w0 × hardness + w1 × sharpness + b

A compact weighted-sum expression makes the neuron analogy concrete: inputs such as hardness and sharpness contribute through weights and a bias to produce a score. section 1.1

From features to a threat decision

For hardness = 0.01 and sharpness = 0.02, the model produces threat = −0.90 and chooses “approach and purr.” At hardness = 0.99 and sharpness = 0.97, it produces threat = 0.90 and chooses “run away.” section 1.1

How Math and Architectures of Deep Learning covers it

How deep it goes
Defines the neuron as a simple function and connects it to weights, architecture, and expressive power, without detailing learning internals.
Examples
Uses hardness and sharpness inputs, a weighted-sum equation, threat scores, and approach, ignore, or run-away decisions.
What it assumes
Uses sample input-output pairs without requiring the target function to be known in closed form.
What you can do after
Evaluate/understand how simple neurons combine through connections and tuned weights to model complex functions.
How it connects
Connects neurons to neural networks, perceptrons, weighted connections, architecture, expressive power, training, and inferencing.

Also explained in

Compare how 2 books explain neuron →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Math and Architectures of Deep Learning. The section links point to the parts of the book it draws on.