In attention, a value is a projected vector carrying content into the output. Attention scores determine how much each value contributes to the weighted sum. Values can differ from keys, which are used to score relevance. section 15.3.1
A search analogy
Imagine searching a photo database: the query matches photo tags (keys), and the matching scores weight the photos (values) returned. section 15.3.1
Figure 15.6 Retrieving images from a database: the query is compared to a set of keys, and the match scores are used to rank values (images).
The diagram illustrates queries matched against keys, with scores ranking the image values. section 15.3.1














