A throughput-optimized design aims to complete many tasks over a period of time rather than minimize the time for one task. GPUs devote most of their chip area to simple arithmetic units and run many threads simultaneously; an individual GPU thread may be slower than a CPU thread, while aggregate throughput can be much greater. Independent tensor additions, multiplications, and normalizations are examples of work that can benefit from this approach. section 1.3.2
Figure 1.5 GPUs dedicate more of their area to compute and less to control and caching.
Compare how CPU and GPU chip area is allocated to compute, caching, and control. section 1.3.2
