10 Path to production

 

This chapter covers

  • Preliminary work and tasks before productionizing deep learning models
  • Productionizing deep learning models with a deep learning system
  • Model deployment strategies for experimentation in production

For the concluding chapter of the book, we think it makes sense to return to a high-level view and connect all the dots from previous chapters. We have now discussed in detail each service in a deep learning system. In this chapter, we will talk about how the services work together to support the deep learning product development cycle we introduced in chapter 1. That cycle, if you remember, brings the efforts of research and data science all the way through productionization to the end products that customers use.

As a reminder, figure 10.1, borrowed from chapter 1, shows the product development cycle. Our focus in this chapter will be on three phases that occur toward the end of the process: deep learning research, prototyping, and productionization. This focus means we’ll ignore the cycles of experimentation, testing, training, and exploration and look at how to take a final product from the research phase to the end product, making it ready to be released to the public.

Figure 10.1 This deep learning development cycle is a typical scenario for bringing deep learning from research to the finished product. Boxes (3), (4), and (5) are the focus of this chapter.

10.1 Preparing for productionization

10.1.1 Research

10.1.2 Prototyping

10.1.3 Key takeaways

10.2 Model productionization

10.2.1 Code componentization

10.2.2 Code packaging

10.2.3 Code registration

10.2.4 Training workflow setup

10.2.5 Model inferences

10.2.6 Product integration

10.3 Model deployment strategies

10.3.1 Canary deployment