concept library in category pyspark

This is an excerpt from Manning's book Data Analysis with Python and PySpark.
Python is a dynamic, general purpose language, available on many platforms and for a variety of tasks. Its versatility and expressiveness makes it an especially good fit for PySpark. The language is one of the most popular for a variety of domains, and currently is a major force in data analysis and science. The syntax is easy to learn and read, and the amount of library available means that you’ll often find one (or more!) who’s just the right fit for your problem.
For the examples in the chapter, we will need three previously unused libraries: pandas, scikit-learn, and PyArrow. If you have installed Anaconda (see appendix B), you can use
condato install the libraries; otherwise, you can usepip[7].