Permutation invariance means reordering inputs reorders outputs in the same way, without changing their relationships. Attention treats inputs as a set rather than a sequence, so zone identity and spatial arrangement may need to be added explicitly. section 9.6
Swapping zones
Swap zones 2 and 5 in the input: the outputs swap correspondingly. To represent each zone’s location, add a unique positional signal to its representation before it enters the Transformer. section 9.6



