Query misalignment occurs when a multi-token question produces competing attention focal points instead of one clear signal. Syntactic tokens may attend to grammatical anchors, while semantic tokens attend to topical content, blurring which context matters. section 13.3
From scattered query tokens to one focal token
A question such as “where is Daniel?” distributes attention across different context regions. An answer hint prefix—“Daniel is in the ___.”—places the answer at one blank token, giving attention a single target for identifying relevant context. section 13.3
Figure 13.2 The two obstacles to reading attention, and the answer hint prefix that resolves them. Long sequences dilute softmax mass; multi-token queries scatter focal points. Reformulating the query as a fill-in-the-blank prefix forces a single focal token whose attention concentrates on the context that informs the prediction.

The figure contrasts query misalignment with attention dilution and shows how an answer hint prefix concentrates attention on one blank-token prediction. section 13.3
