An embedding is a dense, learned vector representation of a token. It gives the model more than an integer ID: tokens appearing in similar contexts tend to develop related vectors, located near one another in a high-dimensional space. section 10.2
From token to vector
After “aspirin” is mapped to its vocabulary ID, the model looks up its learned vector. That vector joins the representations of the other tokens; position information is then combined with token embeddings before the sequence enters the transformer. section 10.2







































































