A Tensor Core is a specialized execution unit integrated with an NVIDIA GPU’s streaming multiprocessor (SM), built for matrix multiply-accumulate operations. Unlike scalar CUDA cores, which process scalar values per active thread, a matrix instruction describes many related multiply-accumulates over a supported matrix shape. section 5.7
The matrix multiply-accumulate updates each output position by accumulating products across the shared K dimension. section 5.7
A tiled Triton matrix product uses tl.dot to compute a block of outputs at once, reaching the Tensor Core execution path. This replaces a long stream of scalar multiply, add, and reduction instructions with matrix operations. section 5.7 section 5.0
Counting work in a tile
Multiplying a [64, 32] matrix by a [32, 64] matrix represents 131,072 multiply-accumulates, or 262,144 floating-point operations. section 5.7



