liveBook · Manning

SIMT

SIMT is a processor execution model in which groups of threads execute a common instruction stream while operating on separate data.

How 3 Manning books explain it

GPU Programming with Triton

The Single Instruction, Multiple Threads (SIMT) execution model runs the same instruction across multiple threads operating on separate data.

How it is used
Motivates Triton's block-level programming model by contrasting it with CUDA's thread-level SIMT model.
How deep it goes
Explains warp instruction issue, divergent branches, and independent thread progress on GPUs since Volta.
Examples
Uses vector addition and conditional ReLU with mixed-sign inputs.
What you can do after
Evaluate how thread grouping and divergent branches affect GPU execution.

Read how GPU Programming with Triton explains SIMT →

Grokking GPU Programming

SIMT is a GPU execution model in which groups of threads execute instructions together while operating on separate data.

How it is used
Explains how CUDA kernel threads are grouped and executed on GPU hardware.
How deep it goes
Traces warp grouping and array execution, then explains divergence and the need for explicit synchronization.
Examples
Uses a marching-band analogy, an array-doubling kernel, and a warp-count exercise.
What you can do after
Diagnose warp divergence and avoid relying on lockstep when threads exchange data.

Read how Grokking GPU Programming explains SIMT →

CUDA for LLMs

SIMT is a processor execution model in which multiple threads execute the same instruction stream while individual threads may branch independently.

How it is used
Identifies data-parallel opportunities by mapping repeated operations on independent values to GPU threads.
How deep it goes
Defines SIMT against SIMD and explains independent branching, stopping short of detailing divergence mechanics.
Examples
Uses element-wise ReLU and cites convolutions, attention, and gradient updates as data-parallel workloads.
What you can do after
Evaluate data-parallel opportunities by spotting repeated operations on independent values and mapping work to GPU threads.

Read how CUDA for LLMs explains SIMT →

What to know first

Related concepts

Questions about SIMT

What is SIMT?

SIMT is a processor execution model in which groups of threads execute a common instruction stream while operating on separate data.

Which Manning books explain SIMT?

GPU Programming with Triton, Grokking GPU Programming and CUDA for LLMs.

What should I know before learning SIMT?

Manning books that teach SIMT usually introduce thread, hardware register and thread block first.

What is the difference between SIMT and SIMD hardware?

SIMT is a processor execution model in which groups of threads execute a common instruction stream while operating on separate data. SIMD hardware applies the same instruction or operation concurrently to multiple data elements.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.