Split-K matrix multiplication divides the contracting dimension among program instances that compute partial results for shared output tiles. Atomic additions combine those partials at shared output addresses. section 4.1.3
For accumulation where only the final sum matters, relaxed atomic ordering preserves atomicity without ordering surrounding memory accesses. Floating-point addition is not associative, so changing the order of partial additions can change the result’s bits. section 4.1.3
tl.atomic_add(pointer, val, mask=None, sem=None, scope=None)
Atomic addition is the operation used to combine partial results at a shared output address. section 4.1.3
