CUDA
CUDA is NVIDIA’s parallel computing platform and programming model for performing general-purpose computations on NVIDIA GPUs.
Starting Data Analytics with Generative AI and Python
CUDA is NVIDIA's parallel-computing platform and programming interface for executing general-purpose computations on compatible GPUs.
- How it is used
- Accelerates suitable numerical workloads by directing repeated vector or matrix operations to an NVIDIA GPU.
- How deep it goes
- Demonstrates a CuPy rewrite of bootstrap computation and notes that benefits depend on workload size and GPU hardware.
- Examples
- Uses a CUDA bootstrap confidence-interval function, CuPy installation, and execution-time comparisons against optimized CPU code.
- What you can do after
- Apply CUDA through CuPy to adapt compatible NumPy-style numerical functions for GPU execution and return usable results.
Read how Starting Data Analytics with Generative AI and Python explains CUDA →
Fast Python: High performance techniques for large datasets
- How it is used
- Deploys NVIDIA CUDA APIs to perform GPU-based data processing, including array operations and Mandelbrot generation.
- How deep it goes
- Builds kernels and launch configurations with bounds checks, but defers advanced shared-state algorithms and detailed C instruction.
- Examples
- Demonstrates doubling one- and two-dimensional arrays and generating a Mandelbrot set with CUDA C.
- What you can do after
- Build GPU array kernels with Numba or CUDA C, configure their thread launches, and compare measured execution times.
Read how Fast Python: High performance techniques for large datasets explains CUDA →
Hugging Face in Action
CUDA is NVIDIA's parallel computing platform and programming model for executing general-purpose computations on GPUs.
- How it is used
- Accelerates PyTorch-based training, inference, and tensor computation on NVIDIA GPUs.
- How deep it goes
- Defines CUDA and demonstrates installation, availability checks, device selection, and multi-GPU model parallelism without explaining CUDA internals.
- Examples
- Demonstrates CUDA installation, torch diagnostics, GPUtil inspection, sentiment classification, and pretrained sequence-classification loading.
- What you can do after
- Apply it via PyTorch and Transformers to detect GPUs, select CUDA execution, inspect hardware, and accelerate model workloads.
Inside Deep Learning: Math, Algorithms, Models
NVIDIA's GPU computing software stack used here as the compute interface for running PyTorch operations on a GPU.
- How it is used
- Accelerates PyTorch tensor operations by moving computation from the CPU to an NVIDIA GPU.
- How deep it goes
- Demonstrates device selection, transfers, benchmarking, mismatch diagnosis, and CPU conversion without exposing CUDA kernel internals.
- Examples
- Uses matrix-multiplication timing, cuda:0 versus cpu errors, availability checks, and nested-object transfer helpers.
- What you can do after
- Operate/configure PyTorch GPU execution, diagnose device-placement errors, and return tensors to CPU-based tools.
Read how Inside Deep Learning: Math, Algorithms, Models explains CUDA →
Related concepts
- GPUuses · A graphics processing unit (GPU) is a processor designed for highly parallel computation, especially graphics and data-parallel workloads.
- PyTorchused by · PyTorch is an open-source machine-learning framework for Python that provides tensor computation, automatic differentiation, and tools for building and training neural networks.
- shared memoryconfigures · Shared memory is a memory region or storage area accessible to multiple processes, threads, or other execution components for accessing or exchanging data.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.