liveBook · Manning

GPU

As explained in Machines that Think

A graphics processing unit (GPU) is a parallel processor designed for graphics workloads and widely used for numerical and machine-learning computation.

A graphics processing unit (GPU) is a parallel processor originally designed to render images. Its ability to perform many operations at once also suits the large-scale numerical workloads used to train and run modern AI models. section 8.1.2

GPUs became standard for AI in part because they combine flexibility with a mature software ecosystem, including NVIDIA’s CUDA platform. That general-purpose flexibility can be less efficient than specialized chips on highly specific workloads. GPU supply is also constrained by a capital-intensive production chain and limited manufacturing capacity. section 8.1.2

Figure 8.1 The large language model ecosystem. Models are built on a layered system that begins with specialized hardware and extends through cloud infrastructure and model providers. Interaction with this system occurs primarily through the two bottom layers, where users either consume models via managed services that abstract the underlying complexity or deploy open-weight models on self-managed infrastructure, taking on greater control and responsibility.

Shows how specialized hardware fits into the broader infrastructure supporting AI models. section 8.1.2

How Machines that Think covers it

How deep it goes
Explains parallel suitability, software support, flexibility tradeoffs, and supply constraints without detailing chip implementation.
Examples
Uses image rendering, AI workloads, NVIDIA’s CUDA platform, and tensor processing units to illustrate GPU roles and tradeoffs.
What you can do after
Understand why GPUs suit AI workloads and how flexibility and supply constraints shape their use.
How it connects
Connects GPUs to parallel computing, CUDA, AI models, and specialized alternatives such as tensor processing units.

Also explained in

Compare how 19 books explain GPU →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machines that Think. The section links point to the parts of the book it draws on.