liveBook · Manning

Host

A host is a physical or virtual computing system that runs software, provides computing resources, or participates as an addressed endpoint on a network.

How 2 Manning books explain it

GPU Programming with Triton

In GPU computing, the host is the CPU-side execution environment that launches and orchestrates device work.

How it is used
Coordinates GPU work by preparing inputs, choosing computations, and launching kernels on the device.
How deep it goes
Traces launch parameters through grid execution and output completion, including program IDs, offsets, masks, loads, and stores.
Examples
Uses PyTorch matrix multiplication and a Triton vector-addition kernel with a host-side launch wrapper.
What you can do after
Operate a Triton launch by preparing inputs, computing a grid, and invoking a device kernel from host-side code.

Read how GPU Programming with Triton explains host →

CUDA for LLMs

A host is the CPU-based system that controls execution and provides resources to an accelerator in a host-device computing model.

How it is used
Coordinates the application and manages the CPU-side work required to launch GPU computation.
How deep it goes
Traces host allocation, initialization, data transfers, kernel launch, result verification, and cleanup.
Examples
Uses vectorAdd to demonstrate host arrays, transfers, kernel launch, and result checking.
What you can do after
Build a complete CUDA program that prepares data on the host and coordinates device computation.

Read how CUDA for LLMs explains host →

Also covered in

What to know first

Related concepts

Questions about host

What is host?

A host is a physical or virtual computing system that runs software, provides computing resources, or participates as an addressed endpoint on a network.

Which Manning books explain host?

GPU Programming with Triton and CUDA for LLMs.

What should I know before learning host?

Manning books that teach host usually introduce CPU, network interface, CUDA and IP address first.

What is the difference between host and device?

A host is a physical or virtual computing system that runs software, provides computing resources, or participates as an addressed endpoint on a network. A physical or virtual computing component that performs computation or serves as an identifiable endpoint in a computing system.

What is host a kind of?

Host is a kind of physical server. A physical server is a computer implemented in physical hardware that provides computing resources or services to workloads or other systems.

What are the parts of host?

Host includes CPU and RAM.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.