AWS Application Load Balancer
AWS Application Load Balancer is a managed load-balancing service that routes HTTP and HTTPS application traffic across targets using application-level request attributes.
Amazon Web Services in Action, Third Edition: An in-depth guide to AWS
An application load balancer is an AWS load-balancing service that routes HTTP and HTTPS traffic based on application-level request attributes.
- How it is used
- Distributes HTTP and HTTPS requests across application backends while separating users from individual server addresses.
- How deep it goes
- Works through load balancer, listener, target group, health checks, and CloudFormation configuration; does not detail ALB internals.
- Examples
- Shows load-balanced WordPress servers, CloudFormation resources for an Auto Scaling group, and an ECS/Fargate note-taking application.
- What you can do after
- Build it from scratch with CloudFormation by configuring an ALB, HTTP listener, health-checked target group, and Auto Scaling group.
Machine Learning System Design
AWS Application Load Balancer is a managed service that distributes application traffic across multiple targets using application-level routing.
- How it is used
- Deploys real-time inference behind EC2 servers when high load and low latency make serverless scaling difficult.
- How deep it goes
- Connects load balancing to stateless workers, guaranteed capacity, scaling, and spot replacement, but defers hardware sizing to experiments.
- Examples
- Uses EC2 inference servers behind an AWS Application Load Balancer for PhotoStock’s high-load, low-latency queries.
- What you can do after
- Operate/configure real-time inference with EC2 workers behind an AWS Application Load Balancer while planning capacity and replacement.
Read how Machine Learning System Design explains AWS Application Load Balancer →
Related concepts
- load balancingkind of · Load balancing is the distribution of requests or computational work across multiple resources to manage demand, reduce workload imbalance, and improve utilization or availability.
- performanceproduces · Performance is the measurable effectiveness or operational behavior of a system under specified conditions, assessed through relevant qualities such as task results, speed, responsiveness, throughput, or resource use.
- monitoringproduces · Monitoring is the ongoing observation and measurement of a system’s behavior, state, or operational signals to assess its condition and detect changes or problems.
- ECSuses · Amazon ECS is a managed AWS service for deploying, running, scaling, and orchestrating containerized applications.
- AWS Lambdauses · AWS Lambda is Amazon Web Services’ managed serverless computing service for running code in response to events or requests without managing servers.
- IP addressuses · An IP address is a numerical address used by the Internet Protocol to identify a network interface and support packet delivery across networks.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

