Value
A value is data or a representation associated with a key or selection context and returned, stored, or aggregated as content.
Rearchitecting LLMs
A value is a vector containing the semantic information that attention aggregates from tokens selected by query-key compatibility.
- How it is used
- Contributes token information to an enriched embedding according to query–key compatibility.
- How deep it goes
- Defines the value’s semantic role and explains its weighting through query–key dot products and softmax scores.
- Examples
- Uses “spring” seeking context from “mountain” in a sentence about fresh water.
- What you can do after
- Understand how attention weights select value information to enrich a token embedding.
Machines that Think
A value is an attention representation carrying the content that a token can contribute to another token's representation.
- How it is used
- Supplies the information tokens can contribute to one another in self-attention and cross-attention.
- How deep it goes
- Defines values as learned projections and explains their combination into hidden states, without detailing projection mathematics.
- Examples
- Uses “The sun rises in the east” to illustrate token relevance and encoder information retrieved during prediction.
- What you can do after
- Understand how values carry information into context-enriched token representations.
Also covered in
- Julia as a Second Language
- Python Workout, Second Edition
- The Well-Grounded Rubyist, Fourth Edition
- Grokking Data Structures
- ScyllaDB in Action
- Rust in Action: Systems programming concepts and techniques
What to know first
- arrayAn array is an ordered collection of elements organized in one or more dimensions and accessible by position or index.
Related concepts
- Mapused by · A map is an associative data structure that stores key-value associations and supports retrieving values by key.
- qkv mechanismpart of · The QKV mechanism computes query, key, and value vectors so attention can score relationships and combine contextual information.
- key-value pairpart of · A key-value pair is a data association in which a key identifies or provides access to its corresponding value.
- bytespart of · Bytes are an ordered sequence of byte values, typically eight-bit units, used to represent binary data.
- hash keyconfigured by · An object used to retrieve a corresponding value from a hash.
Questions about value
What is value?
A value is data or a representation associated with a key or selection context and returned, stored, or aggregated as content.
Which Manning books explain value?
Rearchitecting LLMs and Machines that Think.
What should I know before learning value?
Manning books that teach value usually introduce array first.
What is value part of?
Value is part of qkv mechanism. The QKV mechanism computes query, key, and value vectors so attention can score relationships and combine contextual information.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

