How deeply does Machine Learning System Design cover AWS Application Load Balancer?

Connects load balancing to stateless workers, guaranteed capacity, scaling, and spot replacement, but defers hardware sizing to experiments.

AWS Application Load Balancer

As explained in Machine Learning System Design

AWS Application Load Balancer is a managed service that distributes application traffic across multiple targets using application-level routing.

AWS Application Load Balancer distributes real-time inference requests across a pool of EC2 servers when high load and low latency make serverless scaling difficult. section 15.5.2

High-load inference serving

PhotoStock places stateless inference workers behind the load balancer, keeps a reasonable number of workers available, and enables additional scaling. Spot instances can reduce cost because terminated workers are replaceable. section 15.5.2

How Machine Learning System Design covers it

liveBook manning.com

Read Machine Learning System Design on liveBook Get the book at manning.com

Also explained in

liveBook manning.com

Amazon Web Services in Action, Third Edition: An in-depth guide to AWSAn application load balancer is an AWS load-balancing service that routes HTTP and HTTPS traffic based on application-level request attributes.

Compare how 2 books explain AWS Application Load Balancer →

Related concepts

load balancingkind of · Load balancing is the distribution of requests or computational work across multiple resources to manage demand, reduce workload imbalance, and improve utilization or availability.
performanceproduces · Performance is the measurable effectiveness or operational behavior of a system under specified conditions, assessed through relevant qualities such as task results, speed, responsiveness, throughput, or resource use.
monitoringproduces · Monitoring is the ongoing observation and measurement of a system’s behavior, state, or operational signals to assess its condition and detect changes or problems.
ECSuses · Amazon ECS is a managed AWS service for deploying, running, scaling, and orchestrating containerized applications.
AWS Lambdauses · AWS Lambda is Amazon Web Services’ managed serverless computing service for running code in response to events or requests without managing servers.
IP addressuses · An IP address is a numerical address used by the Internet Protocol to identify a network interface and support packet delivery across networks.

This explainer was generated by Manning's knowledge graph from the text of Machine Learning System Design. The section links point to the parts of the book it draws on.