Ray
Ray is an open-source framework for building and scaling distributed applications, including Python and machine-learning workloads.
LLMs in Production
Ray is an open-source framework for executing distributed and parallel Python applications across clusters.
- How it is used
- Distributes concurrent machine-learning and high-performance workloads across multicore CPUs or cluster nodes.
- How deep it goes
- Defines tasks, actors, decorators, resources, and clusters, but stops short of detailed cluster operations.
- Examples
- Compares ten one-second function calls run sequentially with Ray remote calls and collected futures.
- What you can do after
- Build it from scratch by initializing Ray, adding @ray.remote, collecting results, and shutting the runtime down.
Transformers in Action
Ray is an open-source framework for scaling Python and machine-learning applications across distributed computing resources.
- How it is used
- Scales LLM training, data processing, and hyperparameter searches across distributed computing resources.
- How deep it goes
- Explains Ray Data, TorchTrainer, Tuner, scheduling, checkpoints, and model publication through executable workflow listings.
- Examples
- Uses SuperGLUE CommitmentBank classification, Ray-native dataset conversion, TorchTrainer scaling, ASHA search, checkpoint loading, and Hub publication.
- What you can do after
- Build it from scratch by converting datasets, distributing training, tuning configurations, selecting checkpoints, and loading trained models.
Also covered in
- Software Engineering for Data ScientistsIn early access (MEAP)
What to know first
- parallelismParallelism is the execution of multiple independent tasks or computational operations at the same time rather than sequentially.
- language modelA language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
Related concepts
- distributed systemuses · A distributed system is a computing system whose components run across multiple networked processes or machines and coordinate through communication.
- Modinused by · Modin is a Python library that accelerates pandas-compatible data processing through parallel or distributed execution.
- pandasalternative to · pandas is an open-source Python library providing labeled data structures and tools for manipulating and analyzing tabular and other structured data.
- Ray Tuneused by · Ray Tune is a Ray library for distributed hyperparameter tuning and experiment management.
- TorchTrainerused by · TorchTrainer is a Ray training interface for distributing and managing PyTorch training workloads across workers and computational resources.
- distributed traininguses · Distributed training is the coordinated execution of machine-learning model training across multiple computing devices, processes, or machines.
Questions about Ray
What is Ray?
Ray is an open-source framework for building and scaling distributed applications, including Python and machine-learning workloads.
Which Manning books explain Ray?
LLMs in Production and Transformers in Action.
What should I know before learning Ray?
Manning books that teach Ray usually introduce parallelism and language model first.
What is the difference between Ray and pandas?
Ray is an open-source framework for building and scaling distributed applications, including Python and machine-learning workloads. pandas is an open-source Python library providing labeled data structures and tools for manipulating and analyzing tabular and other structured data.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

