A pre-activation value is a node’s linear response before an activation function transforms it. For a hidden node, the value combines its input with its weight and bias. section 11.3.2
The node computes its pre-activation by multiplying the input by its weight and adding its bias. section 11.3.2
Two hidden nodes, one input
With input 2.0, the example’s upper node computes z₁ = 1.1 and its lower node computes z₂ = 0.1. These values are not probabilities or the signals passed onward; the sigmoid first transforms them into hidden-node outputs. section 11.3.2
Pre-activation values also provide the points through which the backward pass traces loss. Applying the chain rule links each value to its activated output and, in turn, to the loss. section 11.3.4
