Chapter 6. Deploying your simple app
This chapter covers
- Deploying a Spark application.
- Defining the roles of the critical components in a Spark cluster environment.
- Running an application on a cluster.
- Calculating an approximation of (Pi) using Spark.
- Analyzing the execution logs.
In the previous chapters, you discovered what Apache Spark is, how to build simple applications, and, hopefully, understood key concepts like the dataframe or laziness.
Chapter 5 and 6 are linked: you have built an application in chapter 5 and you will deploy it in this chapter. Reading chapter 5 before this one is not required, but highly recommended.
In this chapter, you will leave code production aside to discover how to interact with Spark as you move towards deployment and production. You could ask: why are we talking deployment so early in the book? Deployment is at the end, no?
A bit over twenty years ago, when I was building applications using Visual Basic 3 (VB3), towards the end of the project, I would run the Visual Basic Setup wizard that would help you build your 3.5” floppy disks. In those days, my bible would be the 25 chapter-Microsoft Visual Basic 3.0 Programmer's Guide and deployment would be covered in chapter 25.