liveBook · Manning

Algorithmic randomness

As explained in Sutskever's List

Algorithmic randomness is a property of sequences that lack substantially shorter algorithmic descriptions than the sequences themselves.

Algorithmic randomness treats a sequence as random when no substantially shorter program can reproduce it. This compression-based view was developed by Andrei Kolmogorov and, independently, Ray Solomonoff. It differs from Shannon entropy, which measures average uncertainty across a probability distribution or source. section 8.2

Repeating patterns and coin flips

A repeating sequence is not algorithmically random because a short description can specify its pattern. A sufficiently long sequence of fair coin flips is typically incompressible: with high probability, no much shorter program outputs it. section 8.2

How Sutskever's List covers it

How deep it goes
Explains the shortest-program definition and illustrates it with repeating and coin-flip sequences.
Examples
Contrasts a repeating sequence, which is compressible, with a typical long sequence of fair coin flips.
What you can do after
Understand why randomness can be framed as the absence of a substantially shorter program that reproduces a sequence.
How it connects
Connects incompressibility to Kolmogorov complexity, compression, Shannon entropy, and Solomonoff’s independent formulation.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Sutskever's List. The section links point to the parts of the book it draws on.