The L2 norm, or Euclidean norm, measures a vector’s length by taking the square root of the sum of its squared components. In embedding-based evaluation, that magnitude may reflect sentence length or word frequency rather than meaning, so cosine similarity often focuses on direction instead. section 3.2.3
Why magnitude can mislead
The sentences “the weather is freezing” and “it is cold today” can express similar meaning despite differing vector magnitudes. Euclidean distance treats the straight-line gap as important, while cosine similarity compares their directions. section 3.2.3
Figure 3.6 Geometric representation of two semantic vectors. Note that while the vectors have different lengths (magnitudes), they point in roughly the same direction, indicating a shared semantic topic.
Compare vectors with different lengths but similar directions to see why semantic similarity can depend more on orientation than magnitude. section 3.2.3






