liveBook · Manning

Intelligence explosion

As explained in Inside AI

An intelligence explosion is a hypothesized rapid increase in an artificial system’s intellectual capabilities driven by its ability to improve the design of increasingly capable systems.

An intelligence explosion is a hypothesized rapid increase in machine intelligence: an ultra-intelligent system improves the design of still more capable systems, potentially leaving human intelligence far behind. The idea comes with major uncertainty; confident predictions about artificial intelligence have repeatedly exceeded demonstrated results. section 9.1

A machine designing better machines

I. J. Good’s 1965 scenario imagines an ultra-intelligent machine that can improve its own successors because machine design is itself an intellectual activity. This proposed feedback loop could produce profound social change, but it depends on the system remaining controllable. section 9.1

The concept therefore belongs to speculation about technological singularity rather than a demonstrated account of inevitable progress. It is useful for examining possible capability gains alongside governance and control risks. section 9.1

How Inside AI covers it

How deep it goes
Defines recursive machine improvement through a historical thought experiment, but stops short of demonstrating that an explosion will occur.
Examples
Uses Good’s ultra-intelligent machine thought experiment and contrasting predictions from prominent AI figures.
What you can do after
Evaluate/understand claims about recursive intelligence gains without treating technological singularity as established or inevitable.
How it connects
Connects artificial intelligence with technological singularity, machine design, social change, and control.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Inside AI. The section links point to the parts of the book it draws on.