In attention, a value (V) vector carries a token’s semantic information. Query–key compatibility determines how much of each token’s value contributes to the current token’s enriched embedding. section 3.1.2
“Spring” in a sentence
For “Fresh water flows from the mountain spring daily,” the query for “spring” compares with the keys of other tokens. The resulting weights determine how much each token’s value contributes to “spring”’s context. section 3.1.2
Figure 3.4 Attention mechanism for the token "spring." The Query (Q) from "spring" compares with the Keys (K) of all tokens through dot product operations. The resulting scores, after softmax normalization, determine what fraction of each Value (V) contributes to create the enriched embedding.
Diagram of how query–key scores determine each value’s contribution. section 3.1.2

