GPU
A graphics processing unit (GPU) is a processor designed for highly parallel computation, especially graphics and data-parallel workloads.
Web Components in Action
A GPU is a processor specialized for performing highly parallel graphics and numerical computations.
- How it is used
- Motivates GPU-backed rendering for real-time 3D and video effects when CPU or JavaScript processing may be slow.
- How deep it goes
- Explains the CPU-to-GPU shift through shaders and canvas contexts, but leaves GPU internals and extensive 3D math aside.
- Examples
- Uses a radial-fade image shader and a WebGL video component with greyscale, sepia, and edge-detection filters.
- What you can do after
- Apply it via WebGL-backed components or 3D libraries to use GPU rendering without writing every low-level shader.
Fast Python: High performance techniques for large datasets
- How it is used
- Identifies when parallel data-processing workloads can benefit from GPU execution instead of sequential CPU execution.
- How deep it goes
- Explains an illustrative execution-cost comparison and simplified multiprocessor and memory architecture, while deferring tensor cores.
- Examples
- Compares sequential and parallel models for doubling a 100-element NumPy array and diagrams GPU processing units and caches.
- What you can do after
- Apply it via CuPy or cuDF, or redesign parallel array work for GPU execution with Numba.
Read how Fast Python: High performance techniques for large datasets explains GPU →
Deep Learning with R, Third Edition
A GPU is a massively parallel processor designed primarily for graphics computation and also widely used for numerical machine learning workloads.
- How it is used
- Positions GPUs as key deep-learning compute resources and motivates preprocessing fast enough to keep them supplied.
- How deep it goes
- Explains GPU tensor computation, model training, and CPU-side preprocessing constraints.
- Examples
- Shows CPU-side text tokenization and parallel preprocessing, and traces consumer gaming GPUs into deep-learning hardware.
- What you can do after
- Understand why tokenization stays on the CPU and how parallel preprocessing helps prevent GPUs waiting for input.
Starting Data Analytics with Generative AI and Python
A GPU is a massively parallel processor originally designed for graphics that is also used to accelerate general-purpose numerical and machine-learning workloads.
- How it is used
- Accelerates numerical data-processing functions when parallel hardware may improve execution time.
- How deep it goes
- Demonstrates a CuPy implementation and execution-time comparison, without detailing GPU architecture or kernel internals.
- Examples
- Uses optimized and GPU-utilizing bootstrap functions, CuPy installation, and execution-time figures across different DataFrame sizes.
- What you can do after
- Apply it via CuPy to move bootstrap sampling and statistics onto GPU-backed arrays, then compare execution time with an optimized baseline.
Read how Starting Data Analytics with Generative AI and Python explains GPU →
Inside Deep Learning: Math, Algorithms, Models
A graphics processing unit used as a parallel compute device for computation.
- How it is used
- Accelerates tensor operations during neural-network training and other compute-intensive deep-learning workloads.
- How deep it goes
- Explains tensor execution, device transfers, timing tradeoffs, and common errors, while stopping short of GPU hardware internals.
- Examples
- Uses CUDA availability checks, timed matrix multiplication, mixed-device failures, NumPy conversion errors, and recursive object transfer.
- What you can do after
- Operate/configure PyTorch tensors on CUDA, benchmark workload size, avoid device mismatches, and prepare CUDA results for NumPy.
Read how Inside Deep Learning: Math, Algorithms, Models explains GPU →
Graph Neural Networks in Action
A graphics processing unit (GPU) is a massively parallel processor designed to accelerate graphics, numerical, and machine-learning computations.
- How it is used
- Accelerates large-scale GNN training through parallel computation in PyTorch and PyG workflows.
- How deep it goes
- Explains parallelism, memory constraints, multi-GPU distribution, and trade-offs, but does not detail GPU architecture.
- Examples
- Uses NVIDIA Tesla T4, A100, and V100 GPUs available through Colab as training examples.
- What you can do after
- Evaluate GPU suitability, memory needs, cost trade-offs, and multi-GPU scaling for GNN training.
The Complete Obsolete Guide to Generative AI
A massively parallel processor originally designed for graphics workloads and widely used for numerical machine-learning computation.
- How it is used
- Supports training and running LLMs by supplying compute capacity for AI workloads.
- How deep it goes
- Explains GPU acceleration through parallel AI operations and hardware-selection advice without detailing GPU architecture or setup.
- Examples
- Uses consumer computers choosing CPU-only models or rented cloud GPUs as the concrete hardware scenario.
- What you can do after
- Operate/configure it by matching an LLM to CPU-only local hardware or rented cloud GPU capacity.
Read how The Complete Obsolete Guide to Generative AI explains GPU →
Sutskever's List
A graphics processing unit (GPU) is a massively parallel processor designed for graphics and other computations involving many similar operations.
- How it is used
- Scales neural-network training through parallel computation and can accelerate inference with reduced-precision arithmetic.
- How deep it goes
- Explains model and data parallelism, memory limits, and communication trade-offs without detailing GPU hardware internals.
- Examples
- Compares AlexNet’s two-GPU model split with Deep Speech 2’s multi-GPU batch processing and custom all-reduce.
- What you can do after
- Evaluate how memory limits and GPU communication affect the benefits of scaling neural-network training.
Bayesian Optimization in Action
A graphics processing unit is a hardware processor optimized for highly parallel numerical operations such as matrix multiplication.
- How it is used
- Accelerates parallel model training, batch optimization queries, and matrix-heavy Gaussian-process training.
- How deep it goes
- Defines GPU parallel matrix multiplication and demonstrates practical object transfer, without detailing GPU hardware internals.
- Examples
- Uses parallel neural-network training, batch BayesOpt, and CUDA-based Gaussian-process training as practical examples.
- What you can do after
- Apply it via PyTorch and GPyTorch by transferring data, models, and likelihoods to the GPU for training.
Deep Learning with Python, Third Edition
A graphics processing unit used here as accelerated hardware for parallel computation in deep learning workloads.
- How it is used
- Accelerates tensor computations and supports distributed deep-learning training across multiple devices.
- How deep it goes
- Introduces GPU execution and scaling context, but stops short of configuration procedures or hardware internals.
- Examples
- Uses CUDA, consumer GPUs, single-GPU training, and multi-GPU training as concrete reference points.
- What you can do after
- Evaluate/understand how GPUs fit into framework-based model training and scaling decisions.
Read how Deep Learning with Python, Third Edition explains GPU →
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
A GPU is a massively parallel processor designed to execute many computational operations concurrently.
- How it is used
- Speeds gradient-boosted decision-tree training when datasets contain many cases or features.
- How deep it goes
- Explains acceleration, configuration, hardware requirements, and GPU tree growth, but stops short of detailed GPU architecture.
- Examples
- Uses XGBoost device settings, CUDA device ordinals, GPU prediction, and SHAP contribution calculations.
- What you can do after
- Operate/configure GPU-accelerated XGBoost training and prediction while checking supported hardware and CUDA requirements.
Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains GPU →
Hugging Face in Action
A graphics processing unit is a massively parallel processor designed to accelerate computation, including machine learning workloads.
- How it is used
- Accelerates PyTorch training and inference and runs Transformers pipelines on CUDA-compliant NVIDIA GPUs.
- How deep it goes
- Explains CUDA integration, memory movement, device checks, monitoring, and multi-GPU model parallelism without deriving GPU internals.
- Examples
- Demonstrates CUDA availability checks, GPU property inspection, GPUtil monitoring, and sentiment classification on a CUDA pipeline.
- What you can do after
- Operate/configure PyTorch and Transformers workflows to detect GPUs, inspect devices, and place inference on CUDA.
LLMs in Production
A GPU is a processor designed for highly parallel numerical computation, commonly used to accelerate machine-learning workloads.
- How it is used
- Accelerates LLM training and inference when CPU-only execution cannot meet latency demands.
- How deep it goes
- Explains parallel processing and numerical benefits, then covers memory, provisioning, containers, and metrics; stops short of hardware internals.
- Examples
- Uses regional GPU exhaustion, CPU-versus-GPU deployment, and a GPT-3-to-GPT-4 migration with increased timeout errors.
- What you can do after
- Operate/configure GPU-backed LLM systems while anticipating scarcity, workspace failures, container changes, and timeout trade-offs.
Latency
A GPU is a processor designed with many parallel execution resources for graphics and general-purpose data-parallel computation.
- How it is used
- Positions GPUs as hardware for massive parallelism, especially data-parallel workloads applying similar calculations across datasets.
- How deep it goes
- Defines GPU parallel execution and contrasts it with concurrency, but stops short of implementation details or performance measurement.
- Examples
- Uses interleaved single-core threads, multicore execution, and tens of thousands of GPU hardware threads as comparison examples.
- What you can do after
- Evaluate whether a workload fits GPU execution by identifying repeated calculations across independent datasets.
Related concepts
- batch sizeused by · Batch size is the number of items grouped together for processing or computation as a single batch.
- GPU kernelused by · A GPU kernel is an executable program or function that performs computation on a graphics processing unit, commonly using parallel threads.
- threaduses · A thread is an independently schedulable sequence or context of execution within a program or process.
- CPUcontrasts with · A central processing unit (CPU) is a general-purpose processor that executes computer instructions and performs computational operations.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.