A query is a vector derived from a zone’s representation that expresses what information it seeks from other zones. Comparing it with other zones’ keys produces relevance scores; those scores weight the values used to form the zone’s output. section 9.5
Figure 9.6 The Attention Mechanism — Query, Key, Value.
See how queries, keys, and values combine in the attention mechanism. section 9.5













