Short-term memory tracks the ongoing conversation within a session by keeping recent message history available for immediate reuse. section 14.3
It enriches prompts with prior interactions so a model can narrow queries, improve accuracy, and respond with more relevant context. section 14.3
Typical operational uses here include:
- Maintaining the latest exchanges in the current session. section 14.3
- Retrieving recent content to guide the next response. section 14.3
- Reducing API calls and generated tokens by reusing context. section 14.3
Session history buffer
A memory manager loads recent interactions, slices the last few turns, retrieves other relevant interactions, generates a response, then stores the new interaction with an embedding and extracted concepts. section 14.3
