Just-in-time (JIT) compilation translates code into executable form when it is needed during execution, rather than producing a complete executable ahead of time. section 2.2.1
In Triton, @triton.jit marks a kernel for compilation on its first launch. Triton specializes GPU code for the argument types and shapes, then caches the compiled result. The first call includes compilation overhead; later calls use the cached code. section 2.2.1
A live interpreter
Imagine an interpreter translating a speaker’s words as they are delivered, rather than preparing a full translation beforehand. A JIT compiler similarly compiles code paths when they are first executed. section 2.2.1
import torch import triton import triton.language as tl @triton.jit
The @triton.jit decorator marks the following function for Triton compilation. section 2.2.1







