liveBook · Manning

Power-law relationship

A power-law relationship is a mathematical relationship in which one quantity is proportional to another quantity raised to a fixed exponent.

How 2 Manning books explain it

Timeless Algorithms, The Foundational Ideas

A power-law relationship is one in which a quantity varies as a power of another quantity.

How it is used
Summarizes how language-model loss changes with parameters, training data, and compute, supporting estimates for larger training runs.
How deep it goes
Derives the effect of proportional resource increases from a simplified equation and interprets log-log plots, while warning that apparent straightness is inconclusive.
Examples
Uses word frequencies to contrast distributions with scaling and calculates loss at four resource levels under an exponent of −0.1.
What you can do after
Evaluate power-law scaling claims by interpreting proportional changes, resource constraints, and the limits of log-log evidence.

Read how Timeless Algorithms, The Foundational Ideas explains power-law relationship →

Statistics Slam Dunk

A power law is a mathematical relationship in which one quantity varies as a constant power of another quantity.

How it is used
Frames uneven NBA outcomes and apparent success streaks as questions about nonlinear relationships, concentration, randomness, and causality.
How deep it goes
Defines proportional power relationships and applies them to Pareto distributions, stopping short of formal derivation.
Examples
Uses NBA franchise longevity, games played and won, and the hot-hand success sequence as concrete applications.
What you can do after
Evaluate/understand right-skewed outcomes, Pareto concentration, and claims that streaks reflect causality rather than randomness.

Read how Statistics Slam Dunk explains power-law relationship →

Related concepts

Questions about power-law relationship

What is power-law relationship?

A power-law relationship is a mathematical relationship in which one quantity is proportional to another quantity raised to a fixed exponent.

Which Manning books explain power-law relationship?

Timeless Algorithms, The Foundational Ideas and Statistics Slam Dunk.

What is the difference between power-law relationship and linearity?

A power-law relationship is a mathematical relationship in which one quantity is proportional to another quantity raised to a fixed exponent. Linearity is the property of a relationship, function, or transformation being governed by a linear rule, such as proportional change or preservation of linear structure.

What kinds of power-law relationship are there?

Kinds of power-law relationship include Pareto distribution.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.