liveBook · Manning

Embedding-dimension drift

As explained in LLM Customization and Fine-Tuning

The incompatibility that arises when an embedding model changes and old vectors can no longer be compared directly with new ones.

Changing an embedder can make existing vectors incompatible with new ones: old and new vectors are no longer comparable. Re-embed the corpus when changing embedders. section 4.5.3

Model change

A new sentence-transformer release or a different model family can trigger drift. Version the embedder and record its version with each chunk. section 4.5.3

How LLM Customization and Fine-Tuning covers it

How deep it goes
Defines the incompatibility and recommends re-embedding and version tracking, without detailing migration steps.
Examples
Uses a new sentence-transformer release or a different model family as triggers.
What you can do after
Operate embedder changes by re-embedding the corpus and recording embedder versions per chunk.
How it connects
Links embedding-dimension drift to embedders, vector indexes, and vector databases.

This explainer was generated by Manning's knowledge graph from the text of LLM Customization and Fine-Tuning. The section links point to the parts of the book it draws on.