concept AWS in category dask

This is an excerpt from Manning's book Data Science with Python and Dask.
I hope you now have an appreciation for how easy it is to use Dask-ML once you’ve put in the hard work to prepare the data! In the next chapter, we’ll finish our journey by exploring how to use Dask in cluster mode and how to deploy Dask on the cloud using AWS.
That said, it’s still worth seeing firsthand how to set up, maintain, and monitor a Dask cluster. In this chapter, we’ll walk through how to set up a cluster using Amazon AWS that you can use as a private sandbox. AWS was chosen for this exercise because it is a very popular cloud computing platform with a supportive community, lots of learning resources, and a generous account tier that allows you to experiment with AWS free of charge. Dask is just as suited to run on other cloud computing platforms such as Microsoft Azure or Google Cloud Platform, and, of course, can also be run on private server farms. While this exercise will also provide some good hands-on experience with elements of AWS and Docker, the focus will primarily be on Dask. We’ll cover only the essentials of AWS and Docker that you need to know to get the cluster up and running. We’ll also look at a few general troubleshooting steps you can take if you run into issues with AWS and Docker. However, they are both vast subjects in their own right, and it wouldn’t be useful to cover them in depth here.