Positional embedding, called positional encoding here, adds position information to token embedding vectors. It gives a transformer a sense of sequence, so tokens are not treated as an unordered collection. section 5.2.1
Ordering a short sentence
For “let us fight fraud,” each word can first become a vector. Adding positional encoding then preserves the order: “let” is followed by “us,” and “us” by “fight.” section 5.2.1
The position-enriched vectors enter the transformer encoder, whose repeated blocks combine multi-head attention and dense layers. Sequence information therefore accompanies tokens before attention processes them. section 5.2.1



















