Queue depth
Queue depth is the number of items waiting for processing or service in a queue at a given time.
Amazon Web Services in Action, Third Edition: An in-depth guide to AWS
Queue length is the number of messages waiting in a message queue at a given time.
- How it is used
- Uses waiting-message volume to scale asynchronous EC2 workers through CloudWatch alarms and Auto Scaling policies.
- How deep it goes
- Defines queue depth and demonstrates threshold alarms and step scaling, but does not develop a general metric model.
- Examples
- Demonstrates URL screenshot workers, a five-message threshold, CloudFormation alarms, and one-instance step scaling.
- What you can do after
- Operate/configure queue-based scaling by defining a CloudWatch alarm and step-scaling policy for an Auto Scaling group.
Build High Value Software Systems
The number of work items waiting in a queue for downstream processing.
- How it is used
- Uses queue depth to surface operational waiting, spot bottlenecks, and assess delays across feature stages.
- How deep it goes
- Defines queue depth as a bottleneck symptom and a stage-level measure in a practical feature-tracing exercise.
- Examples
- Shows five weekly pull requests accumulating when review capacity falls short and traces queue depth across a shipped feature.
- What you can do after
- Diagnose a likely constraint and evaluate an intervention by comparing queue depth, lead time, and activity ratio.
Read how Build High Value Software Systems explains queue depth →
Also covered in
- Latency
- Quantization and Fast InferenceIn early access (MEAP)
What to know first
- queueA queue is an ordered collection that holds items for retrieval or processing, commonly in first-in, first-out order.
- throughputThroughput is the rate at which a system processes or completes work, data, or requests over a specified period.
Related concepts
- wastemeasures · Waste is activity or resource consumption that does not contribute useful value to an intended product, process, customer, or organizational outcome.
- auto-scaling groupconfigures · An auto-scaling group is a managed collection of compute instances whose capacity is automatically adjusted according to configured policies, conditions, or workload demand.
- work queue patternmeasures · The work queue pattern stores pending units of work for workers or processors to retrieve and process, often asynchronously.
- concurrencyconfigures · Concurrency is the structuring or execution of multiple computational activities so their progress overlaps in time, whether or not they run simultaneously.
Questions about queue depth
What is queue depth?
Queue depth is the number of items waiting for processing or service in a queue at a given time.
Which Manning books explain queue depth?
Amazon Web Services in Action, Third Edition: An in-depth guide to AWS and Build High Value Software Systems.
What should I know before learning queue depth?
Manning books that teach queue depth usually introduce queue and throughput first.
What is queue depth also called?
Queue depth is also called queue length.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

