liveBook · Manning

Streaming multiprocessor

Also called SM, SMs

A streaming multiprocessor is a GPU execution unit that schedules and executes groups of threads using its processing and on-chip memory resources.

How 2 Manning books explain it

GPU Programming with Triton

A streaming multiprocessor is NVIDIA's basic GPU computational building block that executes groups of threads and provides computational resources.

How it is used
Uses SMs to connect Triton kernel launches and GPU resource limits to performance.
How deep it goes
Explains block scheduling, register allocation, concurrency limits, and spilling, while deferring detailed memory-hierarchy treatment.
Examples
Calculates H100 register-limited thread counts and asks readers to inspect their own GPU’s compute units and memory properties.
What you can do after
Evaluate how SM scheduling and register use affect kernel concurrency and performance.

Read how GPU Programming with Triton explains streaming multiprocessor →

Grokking GPU Programming

A streaming multiprocessor is a GPU hardware unit that schedules and executes groups of GPU threads using its execution resources.

How it is used
Places CUDA thread execution on GPU hardware by assigning blocks to SMs and running warps.
How deep it goes
Defines SMs within the GPU and identifies warps and CUDA cores, while deferring warp-scheduling details.
Examples
Uses an eight-thread launch to show 24 idle lanes in a 32-thread warp.
What you can do after
Understand how launched blocks are assigned to SMs and how threads are grouped into warps.

Read how Grokking GPU Programming explains streaming multiprocessor →

Also covered in

What to know first

Related concepts

Questions about streaming multiprocessor

What is streaming multiprocessor?

A streaming multiprocessor is a GPU execution unit that schedules and executes groups of threads using its processing and on-chip memory resources.

Which Manning books explain streaming multiprocessor?

GPU Programming with Triton and Grokking GPU Programming.

What should I know before learning streaming multiprocessor?

Manning books that teach streaming multiprocessor usually introduce thread, CUDA and PCIe first.

What is streaming multiprocessor part of?

Streaming multiprocessor is part of GPU. A graphics processing unit (GPU) is a processor designed for highly parallel computation, especially graphics and other data-parallel workloads.

What are the parts of streaming multiprocessor?

Streaming multiprocessor includes gpu core, Tensor Core, warp, warp scheduler and L1 cache.

What is streaming multiprocessor also called?

Streaming multiprocessor is also called SM or SMs.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.