liveBook · Manning

Ray

Ray is an open-source framework for building and scaling distributed applications, including Python and machine-learning workloads.

How 2 Manning books explain it

LLMs in Production

Ray is an open-source framework for executing distributed and parallel Python applications across clusters.

How it is used
Distributes concurrent machine-learning and high-performance workloads across multicore CPUs or cluster nodes.
How deep it goes
Defines tasks, actors, decorators, resources, and clusters, but stops short of detailed cluster operations.
Examples
Compares ten one-second function calls run sequentially with Ray remote calls and collected futures.
What you can do after
Build it from scratch by initializing Ray, adding @ray.remote, collecting results, and shutting the runtime down.

Read how LLMs in Production explains Ray →

Transformers in Action

Ray is an open-source framework for scaling Python and machine-learning applications across distributed computing resources.

How it is used
Scales LLM training, data processing, and hyperparameter searches across distributed computing resources.
How deep it goes
Explains Ray Data, TorchTrainer, Tuner, scheduling, checkpoints, and model publication through executable workflow listings.
Examples
Uses SuperGLUE CommitmentBank classification, Ray-native dataset conversion, TorchTrainer scaling, ASHA search, checkpoint loading, and Hub publication.
What you can do after
Build it from scratch by converting datasets, distributing training, tuning configurations, selecting checkpoints, and loading trained models.

Read how Transformers in Action explains Ray →

Also covered in

What to know first

Related concepts

Questions about Ray

What is Ray?

Ray is an open-source framework for building and scaling distributed applications, including Python and machine-learning workloads.

Which Manning books explain Ray?

LLMs in Production and Transformers in Action.

What should I know before learning Ray?

Manning books that teach Ray usually introduce parallelism and language model first.

What is the difference between Ray and pandas?

Ray is an open-source framework for building and scaling distributed applications, including Python and machine-learning workloads. pandas is an open-source Python library providing labeled data structures and tools for manipulating and analyzing tabular and other structured data.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.