liveBook · Manning

Superalignment

As explained in Sutskever's List

Research aimed at ensuring that highly capable or superintelligent AI systems remain aligned with human intentions and values.

Superalignment is research aimed at steering potentially superintelligent AI toward human intentions and values, preventing systems from going rogue. Its urgency follows from the possibility that superintelligence could emerge this decade. section 1.1

A four-year safety challenge

OpenAI launched a Superalignment team co-led by Ilya Sutskever and Jan Leike. The team set itself four years to address how a potentially superintelligent system could be steered safely, turning alignment from a general aspiration into an organizational research priority. section 1.1

How Sutskever's List covers it

How deep it goes
Defines the research objective and its urgency but does not explain alignment methods, technical mechanisms, or evaluation procedures.
Examples
Uses OpenAI’s Superalignment team, its four-year goal, and a public warning that superintelligence could arrive this decade.
How it connects
Links alignment with artificial general intelligence, superintelligence, AI safety, and preventing rogue behavior.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Sutskever's List. The section links point to the parts of the book it draws on.