liveBook · Manning

Spreading activation

As explained in Domain-Specific Small Language Models

A retrieval method that propagates activation from labeled source nodes through linked nodes in an associative network.

Spreading activation retrieves relevant items by labeling source nodes with activation weights, then iteratively propagating activation through linked nodes in an associative network. section 14.3

In LLM memory systems, a concept graph organizes past interactions so retrieval can follow relationships between extracted concepts rather than relying only on direct similarity. section 14.3 section 14.4

A practical retrieval flow combines spreading activation with other memory mechanisms:

  • Extract concepts and generate embeddings from user–model interactions. section 14.3
  • Represent interactions as a graph whose linked concepts support relevance-based retrieval. section 14.3
  • Combine retrieved long-term interactions with recent short-term history when generating a response. section 14.3
  • Reinforce frequently accessed memories and allow unused memories to decay. section 14.3 section 14.4

Memoripy memory retrieval

Memoripy builds a NetworkX-based concept graph from prompts and responses, then uses spreading activation to retrieve relevant interactions alongside recent conversation history. section 14.3

How Domain-Specific Small Language Models covers it

How deep it goes
Defines weighted activation and iterative propagation, then connects the method to graph-based memory retrieval without detailing its propagation algorithm.
Examples
Uses Memoripy’s graph of prompts, responses, extracted concepts, embeddings, access counts, and timestamps.
What you can do after
Apply it via Memoripy to retrieve relevant interactions from graph-organized conversational memory.
How it connects
Connects associative networks, semantic networks, information retrieval, embeddings, concept graphs, and memory management.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Domain-Specific Small Language Models. The section links point to the parts of the book it draws on.