An inner product compares a Query vector with a Key vector to score their alignment. In attention, those scores are softmax-normalized into weights that determine how much of each Value contributes to the updated token embedding. section 3.1.2
Figure 3.4 Attention mechanism for the token "spring." The Query (Q) from "spring" compares with the Keys (K) of all tokens through dot product operations. The resulting scores, after softmax normalization, determine what fraction of each Value (V) contributes to create the enriched embedding.
See how Query–Key dot products produce scores that softmax turns into Value weights. section 3.1.2


















