3 Deep Learning System Design
This chapter covers
- The high level architecture of a deep learning system
- Key service components of a deep learning system
- Shipping the system and models to production
- Open source deep learning systems
When asked to design a system, even when given a clear set of goals, it could seem like a daunting, open-ended task. In this chapter, we will walk you through a thought process on how to get started with designing a deep learning system.
The first step to a design is finding requirements and constraints from its users. We will cover this in Section 3.1, where we will provide some concrete examples based on our experience. We will also provide a sample architecture, or reference architecture, that can be used as a starting point for your own design.
In Section 3.2, we will explore roles of key service components of the high level architecture from Section 3.1. This will help you understand what each of them do and how they connect with one another to form a deep learning system that users will find helpful to their daily job function. Each component described in this section will be covered in greater details in their respective chapters that follow.