liveBook · Manning

Gradient

As explained in Applied Reinforcement Learning

A gradient is a vector of partial derivatives that indicates how a scalar function changes with respect to multiple variables.

A gradient is a vector of partial derivatives describing how a scalar function changes across multiple variables. In a deep network, gradients support learning; a chain-rule expression relates loss derivatives across network layers. section 8.2

∂ℒ/∂θ i = ∂ℒ/∂y ∂y/∂f l ∂f l/∂f l-1 ⋯ ∂f i/∂θ i

The equation expresses loss derivatives as a chain through network layers. section 8.2

How Applied Reinforcement Learning covers it

How deep it goes
Connects gradients to stable learning and displays a chain-rule loss-derivative expression across network layers.
How it connects
Links gradients with neural networks, activation functions, and loss derivatives.

Also explained in

Compare how 27 books explain gradient →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Applied Reinforcement Learning. The section links point to the parts of the book it draws on.