liveBook · Manning

Adversarial input

As explained in Sutskever's List

An adversarial example is an input deliberately perturbed in a way that is often imperceptible to humans but causes a model to make an incorrect prediction.

An adversarial example is an input perturbed slightly—often imperceptibly to people—that causes a model to make a confident, incorrect prediction. Such failures expose a gap between strong benchmark performance and robust visual understanding: residual connections and human-level ImageNet results do not guarantee that a CNN will generalize reliably. section 3.6

Synthetic perturbations and real-world brittleness

A subtle input change can fool a network even when people do not notice it. Separately, Google Photos mislabeled images of Black people as “gorillas”—an example of fragile generalization, not an adversarial example. section 3.6

How Sutskever's List covers it

How deep it goes
Defines the failure and its significance, but does not explain how perturbations are constructed.
Examples
Uses imperceptible input perturbations and a separate Google Photos mislabeling incident to illustrate brittleness.
What you can do after
Evaluate why benchmark performance alone does not establish robust visual understanding.
How it connects
Connects adversarial examples to convolutional neural networks, robustness, and generalization.

Also explained in

Compare how 5 books explain adversarial input →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Sutskever's List. The section links point to the parts of the book it draws on.