How deeply does Grokking Statistics cover diminishing returns?

Explains the pattern through an S-curve, inflection point, coverage targets, and rescoping.

Diminishing returns

Diminishing returns is a pattern in which each additional input produces a progressively smaller increase in output.

Diminishing returns appear when each additional expense produces a smaller capability gain. System development may look exponential at first, then reach an inflection point where capability levels off. section 9.10

The pattern resembles an S-curve: data collection and modeling can approach high coverage, but an overly broad operating domain may level off far below 100%. section 9.10

When a system tries to do too much

A few photographs may help determine whether a father is good at golf. Determining an entire family’s life story requires much broader, potentially endless data coverage. When scope becomes too broad, narrowing the system’s viable capabilities can restore a realistic target. section 9.10

How Grokking Statistics covers it

liveBook manning.com

Read Grokking Statistics on liveBook Get the book at manning.com

Also explained in

liveBook manning.com

How Large Language Models WorkDiminishing returns is the pattern in which additional investment or effort produces progressively smaller gains in an outcome.

Compare how 2 books explain diminishing returns →

Related concepts

parallelismproduced by · Parallelism is the concurrent execution of multiple computational operations, often across multiple processing resources.
scaling lawcontrasts with · A scaling law is an empirical relationship describing how a system’s properties change as its scale or resource levels vary.
fine-tuningaddressed by · Fine-tuning is adapting a pretrained machine-learning model by training it further on targeted data or objectives for a task, domain, or behavior.
accuracymeasures · Accuracy is the degree to which an output, prediction, or measurement agrees with a correct or reference outcome under a specified criterion.
power-law relationshipproduced by · A power-law relationship is a mathematical relationship in which one quantity is proportional to another quantity raised to a fixed exponent.

This explainer was generated by Manning's knowledge graph from the text of Grokking Statistics. The section links point to the parts of the book it draws on.