A CUDA core is a general-purpose arithmetic unit in an NVIDIA GPU. Unlike a Tensor Core, it trades specialized matrix-multiplication speed for flexible computation and full FP32 precision. section 5.6.3
Promotion to CUDA Cores addresses precision loss during large low-precision matrix multiplications. Tensor Cores accumulate WGMMA results in bursts, then periodically transfer partial sums to CUDA cores for higher-precision FP32 accumulation. section 5.6.3
Accumulating a large matrix product
For an inner dimension k of 4096 or more, thousands of small products can accumulate numerical error. Periodic promotion limits reliance on the Tensor Core's low-precision accumulator; without sufficient precision, errors can approach 2%. section 5.6.3

