liveBook · Manning

Data reuse

Data reuse is the use of a value in multiple computations without repeatedly fetching it from its original storage.

How 2 Manning books explain it

Grokking GPU Programming

Data reuse is the practice of retaining or sharing a value so that multiple computations can use it without repeatedly fetching it from its original storage.

How it is used
Reduces repeated global-memory requests by sharing loaded values among GPU computations.
How deep it goes
Works through tiled loading, synchronization, traffic counts, and resource tradeoffs; identifies stencil reuse without implementing it.
Examples
Compares naive and tiled matrix multiplication and identifies reuse in overlapping stencil neighborhoods.
What you can do after
Apply it using CUDA shared memory to cooperatively load and reuse matrix tiles while synchronizing block threads.

Read how Grokking GPU Programming explains data reuse →

CUDA for LLMs

Data reuse is the repeated use of a loaded value across multiple computations to reduce memory traffic.

How it is used
Uses data reuse to reduce global-memory pressure and raise arithmetic intensity in GEMM optimization.
How deep it goes
Traces reuse through shared-memory tiles and register-blocked outputs, with a numerical tile example and measured performance progression.
Examples
Compares GEMV with GEMM and estimates 8× reuse for 128-by-128 output tiles with a reduction tile of 8.
What you can do after
Apply data reuse through shared-memory tiling and register blocking when optimizing GEMM kernels.

Read how CUDA for LLMs explains data reuse →

Also covered in

What to know first

Related concepts

Questions about data reuse

What is data reuse?

Data reuse is the use of a value in multiple computations without repeatedly fetching it from its original storage.

Which Manning books explain data reuse?

Grokking GPU Programming and CUDA for LLMs.

What should I know before learning data reuse?

Manning books that teach data reuse usually introduce hardware register, compute-bound, inner product and GPU memory first.

What is the difference between data reuse and memory reuse?

Data reuse is the use of a value in multiple computations without repeatedly fetching it from its original storage. Memory reuse is the practice of serving new allocation requests from memory that has already been allocated and returned for reuse.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.