liveBook · Manning

Score function

A score function is a function of data and parameters whose value or equation quantifies sensitivity to parameter changes and can characterize or estimate those parameters.

How 2 Manning books explain it

Applied Reinforcement Learning

The gradient of the log probability of an action, indicating how parameter changes affect that action's likelihood.

How it is used
Uses action log-probability gradients to update policies toward actions from high-return trajectories.
How deep it goes
Defines the gradient and explains its direction, log-probability motivation, and cancellation of environment-dynamics terms.
Examples
Illustrates the calculation with a 30% probability of choosing fan speed 0.82.
What you can do after
Apply score-function directions to reinforce actions from positive-return trajectories and suppress actions from negative-return trajectories.

Read how Applied Reinforcement Learning explains score function →

Causal Inference for Data Science

A score function is a function of data and parameters whose equation or expectation characterizes an estimator or causal parameter.

How it is used
Connects orthogonalized causal-effect estimation to an equation used by DoubleML.
How deep it goes
Defines the score function through causal equations and a loss-function analogy, but defers detailed understanding for routine DoubleML use.
Examples
Uses the loss-function analogy and the propensity score as a nuisance-function example.
What you can do after
Operate DoubleML without fully deriving score functions, while recognizing their role in causal-parameter estimation.

Read how Causal Inference for Data Science explains score function →

Related concepts

Questions about score function

What is score function?

A score function is a function of data and parameters whose value or equation quantifies sensitivity to parameter changes and can characterize or estimate those parameters.

Which Manning books explain score function?

Applied Reinforcement Learning and Causal Inference for Data Science.

What is score function part of?

Score function is part of policy gradient theorem. A theorem expressing the gradient of expected policy return using policy score functions and action values without requiring differentiation of the environment dynamics.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.