A 2D rotation turns each paired slice of a high-dimensional Query or Key vector through a position-dependent angle, injecting token position while preserving the pairwise geometric structure. section 3.11.2
RoPE applies the operation in three practical steps:
- Group dimensions into independent pairs: a 4D vector [x1, x2, x3, x4] becomes (x1, x2) and (x3, x4). section 3.11.2
- Rotate every pair by an angle θ determined by token position; different pairs may use different angles. section 3.11.2
- Reassemble the rotated pairs into the position-encoded Query or Key vector. section 3.11.2
Figure 3.24 The dimensions of a Query or Key vector are paired up for rotation.

Use the dimension-pairing figure to visualize how high-dimensional Query and Key vectors become independent 2D rotation planes. section 3.11.2
