7 Scaling and Performance Optimization
This chapter covers
- Optimizing data analysis code
- Scaling code across multiple CPUs and GPUs
- Code conversion between programming languages
- Cloud-based deployment
- Using the Dask framework for all of the above
Working with data analytics in today's data-driven world, it’s more likely than not that the insights required by your business will be gained from vast amounts of data. As data volumes continue to grow and analytical complexity increases, as algorithms and data processing pipelines reach the point where the sheer volume of data or the complexity of operations limits their ability to deliver timely and accurate results, you’ll encounter the need for code performance optimization. It may likely become essential for ensuring your analytics remain effective and efficient, even when the underlying data and computational demands grow.