liveBook · Manning

PagedAttention

PagedAttention is an attention-memory technique that stores key-value cache blocks in independently managed, potentially noncontiguous memory pages.

How 3 Manning books explain it

Transformers in Action

Paged attention is an attention-memory technique that partitions a key-value cache into blocks managed like virtual-memory pages instead of requiring one contiguous allocation.

How it is used
Uses PagedAttention to manage KV-cache memory for efficient LLM deployment, especially with long sequences and batched requests.
How deep it goes
Explains block-based cache management through a virtual-memory analogy, without detailing block mapping or implementation.
Examples
Demonstrates cached versus uncached generation and serves Gemma 3 through vLLM with a chat-completion request.
What you can do after
Apply it via vLLM by serving Gemma 3 and sending a chat-completion request.

Read how Transformers in Action explains PagedAttention →

Rearchitecting LLMs

PagedAttention is an attention-memory management technique that stores key-value cache blocks in pages to improve memory utilization during inference.

How it is used
Manages KV-cache memory during vLLM inference by preallocating VRAM for KV blocks.
How deep it goes
Explains preallocation and capacity effects, and notes uniform-page constraints, but leaves paging mechanics largely implicit.
Examples
Compares dynamic and preallocated cache strategies, then checks predicted cache savings after attention pruning.
What you can do after
Evaluate how weight or KV-cache quantization changes token capacity, and verify pruning savings on the target engine.

Read how Rearchitecting LLMs explains PagedAttention →

Domain-Specific Small Language Models

An attention algorithm that stores KV-cache blocks noncontiguously to reduce fragmentation and improve memory flexibility during LLM serving.

How it is used
Improves KV-cache memory management for LLM serving by reducing fragmentation.
How deep it goes
Explains noncontiguous KV-cache blocks and fragmentation, without detailing the algorithm’s implementation.
What you can do after
Understand how noncontiguous KV-cache storage can reduce fragmentation in LLM serving.

Read how Domain-Specific Small Language Models explains PagedAttention →

What to know first

Related concepts

Questions about PagedAttention

What is PagedAttention?

PagedAttention is an attention-memory technique that stores key-value cache blocks in independently managed, potentially noncontiguous memory pages.

Which Manning books explain PagedAttention?

Transformers in Action, Rearchitecting LLMs and Domain-Specific Small Language Models.

What should I know before learning PagedAttention?

Manning books that teach PagedAttention usually introduce key-value cache, throughput, attention and mean first.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.