liveBook · Manning

L1 cache

An L1 cache is the smallest, lowest-latency level of a processor’s cache hierarchy, located closest to a processing core.

How 2 Manning books explain it

GPU Programming with Triton

An L1 cache is a small, hardware-managed cache close to the GPU compute units.

How it is used
Explains L1 as a hardware-managed layer that reduces repeated trips to slower GPU memory.
How deep it goes
Explains cache placement, reuse, latency, and the shared-memory partitioning trade-off without detailing cache policies.
Examples
Uses H100 unified storage and a memory-hierarchy ranking exercise to illustrate L1’s place in the GPU.
What you can do after
Evaluate how L1 reuse and shared-memory allocation can affect GPU memory performance.

Read how GPU Programming with Triton explains L1 cache →

Latency

An L1 cache is the smallest and fastest cache level located closest to a CPU core.

How it is used
Uses L1-cache locality to reason about low-latency execution and data placement on multicore CPUs.
How deep it goes
Explains hierarchy, approximate capacities, latency ranges, misses, and tail effects without detailing cache implementation internals.
Examples
Uses working-set overflow, instruction fetches, and one-, ten-, and hundred-nanosecond access cases.
What you can do after
Evaluate latency-sensitive code by relating working-set size and cache misses to access-time variance and tail latency.

Read how Latency explains L1 cache →

Also covered in

What to know first

Related concepts

Questions about L1 cache

What is L1 cache?

An L1 cache is the smallest, lowest-latency level of a processor’s cache hierarchy, located closest to a processing core.

Which Manning books explain L1 cache?

GPU Programming with Triton and Latency.

What should I know before learning L1 cache?

Manning books that teach L1 cache usually introduce thread, memory, CPU and hardware register first.

What is the difference between L1 cache and DRAM?

An L1 cache is the smallest, lowest-latency level of a processor’s cache hierarchy, located closest to a processing core. DRAM is volatile semiconductor memory that stores each bit in a capacitor-based cell and requires periodic refresh.

What is L1 cache a kind of?

L1 cache is a kind of CPU cache. A CPU cache is small, fast memory that stores copies of data or instructions for quicker access by a processor.

What is L1 cache part of?

L1 cache is part of memory hierarchy. A memory hierarchy is an arrangement of storage levels with differing capacities, access speeds, latencies, costs, or persistence.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.