In attention, each input element contributes a value vector. After query-key scores become softmax weights, each element’s output is a weighted sum of the values, emphasizing information from relevant neighbors. section 9.5
Figure 9.6 The Attention Mechanism — Query, Key, Value.
The diagram shows how queries, keys, and values combine to produce attention outputs. section 9.5














