liveBook · Manning

Versioning

As explained in Building Reliable AI Systems

A technique for associating entries with versions so entries from an outdated version can be invalidated.

Cache versioning helps prevent stale answers: tag cached entries with a version number or timestamp, then increment the version when the knowledge base or system prompts change. Requests encountering entries from an older version invalidate them. section 9.2.3

Changing policies

If a shipping policy changes, increment the cache version so answers cached under the previous policy are no longer served as current. section 9.2.3

How Building Reliable AI Systems covers it

How deep it goes
Describes version tags and invalidation, but not a storage-level implementation.
Examples
Uses a changing shipping policy to illustrate invalidating cached answers.
What you can do after
Operate a cache by incrementing its version after knowledge-base or system-prompt revisions.
How it connects
Connects cache versioning to semantic caching, knowledge-base revisions, and system-prompt changes.

Also explained in

Compare how 25 books explain versioning →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Building Reliable AI Systems. The section links point to the parts of the book it draws on.