Caching preloads reusable external context in an LLM system to reduce repeated retrieval and latency. Unlike query-time retrieval, it makes context available in advance; unlike direct injection, it focuses on reusable context rather than loading complete documents. section 3.0
Caching
The technique of storing information or computation results for reuse to reduce repeated processing or retrieval.
How Context Engineering covers it
- How deep it goes
- Defines caching through cache-augmented generation and defers detailed trade-offs and selection criteria.
- What you can do after
- Understand how preloading reusable context differs from query-time retrieval and direct injection.
- How it connects
- Connects caching with retrieval, retrieval-augmented generation, and direct injection of external knowledge.
Also explained in
-
Building Web APIs with ASP.NET CoreCaching is the temporary storage of reusable responses or data so subsequent requests can be served without repeating the original retrieval or computation.
-
Learn Go with Pocket-Sized ProjectsA cache is a data store that retains reusable results or data to reduce access time or computational cost.
-
Advanced Algorithms and Data StructuresCaching is the technique of storing retrieved data or computed results in faster storage for possible reuse.
-
Pro ASP.NET Core 7, Tenth EditionCaching is the technique of storing generated data or content so it can be reused without being regenerated for every request.
-
Amazon Web Services in Action, Third Edition: An in-depth guide to AWSA caching layer is a software layer that stores frequently accessed data in faster temporary storage to reduce access time and load on a primary data store.
-
LatencyCaching is a technique that stores temporary copies of data closer to where it is accessed to reduce data-retrieval delay.
-
Vibe EngineeringCaching is the storage of previously computed or retrieved results so that later equivalent requests can be served with less work or cost.
-
Java Persistence with Spring Data and Hibernate epubCaching is the retention of data in a faster-access storage layer so subsequent reads can reuse it.
-
Acing the Frontend InterviewDatabase caching uses database-internal cached data or query results to reduce repeated storage access and accelerate reads.
-
Generative AI in ActionCaching is the practice of storing reusable data or results in faster-access storage so they can be returned without repeating the original computation or request.
-
Build AI-Enhanced Web AppsThe technique of storing computed or retrieved data temporarily so that later requests can return it without repeating the original work.
-
React Hooks in Action: With Suspense and Concurrent ModeA cache is temporary storage of previously retrieved data kept for faster access and synchronization with its source.
-
The Art of CodeA cache is a storage layer that retains recently or frequently used results for faster retrieval and reduced dependency load.
-
ASP.NET Core in Action, 3eA cache is local storage of previously retrieved data that allows subsequent requests to reuse the stored response without contacting the origin server.
-
Fast by DefaultA cache is a storage layer containing reusable copies of data or computation results to avoid repeated retrieval or calculation.
-
Clojure: The Essential ReferenceA cache is a storage structure that retains previously computed results for retrieval by associated keys or repeated access.
-
The Design of Web APIs, Second EditionCaching is the temporary storage of data or responses so that subsequent requests can be served without repeating the original retrieval or computation.
-
Software Engineering for Data ScientistsA cache is a storage mechanism that temporarily retains computed or retrieved values for faster reuse.
-
Learn Docker in a Month of Lunches, Second EditionA cache is a temporary storage area containing previously retrieved data so that repeated requests can be served more quickly.
-
React in DepthA cache is a stored copy of retrieved or computed data that can be returned without obtaining or calculating it again.
-
Designing AI SystemsResponse caching is the storage and reuse of complete model responses for requests that match according to a defined request-matching rule.
-
Machine Learning System DesignA storage mechanism that keeps copies of data or results so repeated requests can be served without recomputation or retrieval from the original source.
-
Functional Programming in JavaScriptAn intermediary repository that stores previously computed or retrieved values for later reuse.
-
C# Concurrency: Asynchronous and multithreaded programmingA cache is a storage layer that retains previously obtained values so they can be returned more quickly on later requests.
-
Building Reliable AI SystemsStoring results so they can be reused instead of recomputed or retrieved again.
-
Architecting an Apache Iceberg LakehouseCaching is the technique of storing reusable data or computation results in a faster-access location to reduce subsequent processing or retrieval cost.
-
API Design PatternsA cache is a stored copy of data retained for faster or more convenient access than retrieving the original data again.
-
Grokking Software ArchitectureCaching is the technique of temporarily storing reusable data or results to reduce latency or repeated computation.
-
Modern C, Third EditionA cache is storage that retains previously computed values so they can be reused instead of recomputed.
-
Data Pipelines with Apache Airflow, Second EditionCaching is the technique of storing computed or retrieved objects so later requests can reuse them without repeating the original work.
-
Modern CA cache is a storage structure containing previously computed values for reuse.
-
Build Python Web Apps with StreamlitCaching is the storage of computed results or loaded data so they can be reused without repeating the underlying work.
-
Authorization in ActionA cache is a temporary data store that retains copies of information for faster retrieval or reduced dependence on an origin system.
-
GitHub Actions in Action: Continuous integration and delivery for DevOpsCaching is the practice of storing reusable data or outputs so they can be retrieved without repeating their computation or acquisition.
-
Spring Microservices in ActionA cache is a store of previously retrieved data that can be reused without querying its source again.
-
Machine Learning Platform EngineeringA caching strategy is a method for storing and reusing computational results to avoid repeating expensive processing.
-
Snowflake Data EngineeringData caching is the retention of previously accessed data in faster storage or memory so subsequent operations can retrieve it more efficiently.
-
The Quick Python Book, Fourth EditionA cache is stored data containing previously computed results so that later requests can reuse them without repeating the computation.
-
Microservices Patterns, Second EditionA caching pattern stores previously obtained data so that subsequent requests can be served without accessing the original provider.
-
Deep Learning with PyTorch, Second EditionThe practice of storing preprocessed data temporarily so it can be reused efficiently later instead of recomputing it.
-
LLMs in ProductionCaching is the technique of storing reusable computation results or data so later requests can be served without repeating the original work.
-
Retrieval Augmented Generation, The Foundational IdeasCaching stores reusable computation results or retrieved information to avoid repeating expensive operations.
-
AI Model EvaluationThe storage of previously computed or retrieved data so subsequent requests can be served more quickly.
-
Natural Language Processing in Action, Second EditionCaching is the practice of storing computed results so repeated requests can be served without recomputing them.
-
Financial AI in PracticeA cache is a storage layer that retains previously computed or retrieved results for faster reuse.
-
Building LLM Applications with DSPyCaching is the practice of storing a language model provider's response so repeated identical requests can be served without querying the provider.
Compare how 49 books explain caching →
Related concepts
- DSPyused by · DSPy is a Python framework for declaratively programming, composing, evaluating, and optimizing language-model applications and pipelines.
- eager cachingincludes · Eager caching populates a cache before its values are requested, typically during application initialization.
- intermediate cachingincludes · Intermediate caching is a caching technique in which a proxy or content-distribution service between a client and origin server stores and serves reusable responses.
This explainer was generated by Manning's knowledge graph from the text of Context Engineering. The section links point to the parts of the book it draws on.
















































