Data parallelism applies the same computation independently across data partitions. Element-wise tensor operations are a clear case: each output depends on one input, so workers need no coordination. section 1.3.2
GPUs suit this work by pursuing throughput: many simple arithmetic units process tasks at once, unlike CPUs, which favor completing individual tasks quickly. In Triton, host code divides work into independent tiles, and the device computes many tiles in parallel. section 1.3.2 section 1.5
Figure 1.5 GPUs dedicate more of their area to compute and less to control and caching.
This figure contrasts GPU and CPU chip-area priorities, illustrating why GPUs favor throughput-oriented work. section 1.3.2











