Streaming multiprocessor
A streaming multiprocessor is a GPU execution unit that schedules and executes groups of threads using its processing and on-chip memory resources.
GPU Programming with Triton
A streaming multiprocessor is NVIDIA's basic GPU computational building block that executes groups of threads and provides computational resources.
- How it is used
- Uses SMs to connect Triton kernel launches and GPU resource limits to performance.
- How deep it goes
- Explains block scheduling, register allocation, concurrency limits, and spilling, while deferring detailed memory-hierarchy treatment.
- Examples
- Calculates H100 register-limited thread counts and asks readers to inspect their own GPU’s compute units and memory properties.
- What you can do after
- Evaluate how SM scheduling and register use affect kernel concurrency and performance.
Read how GPU Programming with Triton explains streaming multiprocessor →
Grokking GPU Programming
A streaming multiprocessor is a GPU hardware unit that schedules and executes groups of GPU threads using its execution resources.
- How it is used
- Places CUDA thread execution on GPU hardware by assigning blocks to SMs and running warps.
- How deep it goes
- Defines SMs within the GPU and identifies warps and CUDA cores, while deferring warp-scheduling details.
- Examples
- Uses an eight-thread launch to show 24 idle lanes in a 32-thread warp.
- What you can do after
- Understand how launched blocks are assigned to SMs and how threads are grouped into warps.
Read how Grokking GPU Programming explains streaming multiprocessor →
Also covered in
What to know first
- threadA thread is a distinct sequence of execution with its own control flow and state, managed or scheduled by a processor, runtime, or operating system.
- CUDACUDA is NVIDIA’s parallel computing platform and programming model for performing general-purpose computations on NVIDIA GPUs.
- PCIePCI Express (PCIe) is a high-speed serial interconnect standard for connecting computer components and peripheral devices.
Related concepts
- gpu corehas part · A CUDA core is a relatively simple arithmetic and logic execution unit in an NVIDIA GPU that processes instructions for individual threads.
- GPUpart of · A graphics processing unit (GPU) is a processor designed for highly parallel computation, especially graphics and other data-parallel workloads.
- Tensor Corehas part · A Tensor Core is a specialized NVIDIA GPU execution unit designed to accelerate high-throughput matrix and tensor arithmetic.
- warphas part · A warp is a group of GPU threads scheduled and issued together for execution, typically processing the same instruction on different data.
- warp schedulerhas part · A warp scheduler is a GPU hardware component that selects ready warps and issues their instructions for execution.
- L1 cachehas part · An L1 cache is the smallest, lowest-latency level of a processor’s cache hierarchy, located closest to a processing core.
Questions about streaming multiprocessor
What is streaming multiprocessor?
A streaming multiprocessor is a GPU execution unit that schedules and executes groups of threads using its processing and on-chip memory resources.
Which Manning books explain streaming multiprocessor?
GPU Programming with Triton and Grokking GPU Programming.
What should I know before learning streaming multiprocessor?
Manning books that teach streaming multiprocessor usually introduce thread, CUDA and PCIe first.
What is streaming multiprocessor part of?
Streaming multiprocessor is part of GPU. A graphics processing unit (GPU) is a processor designed for highly parallel computation, especially graphics and other data-parallel workloads.
What are the parts of streaming multiprocessor?
Streaming multiprocessor includes gpu core, Tensor Core, warp, warp scheduler and L1 cache.
What is streaming multiprocessor also called?
Streaming multiprocessor is also called SM or SMs.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

