liveBook · Manning

Service time

As explained in Latency

Service time is the time required to process a request.

Service time is the time required to process a request. In this terminology, it is request-processing latency: the work performed by the system itself, distinct from network and queuing delays. section 1.1

Terminology varies: some definitions make response time the sum of service time and wait time, while this model treats response time as total request latency. Separating the components can be difficult when request processing includes queues. section 1.1

An end-to-end web request

A server’s service time excludes delays while it waits for external services or while the response travels to the client. The client may add further latency by rendering the page, executing JavaScript, or issuing additional HTTP requests. section 1.1

How Latency covers it

How deep it goes
Defines service, wait, and response time and notes decomposition difficulties caused by queuing.
Examples
Uses external-service calls, browser rendering, HTTP requests, and Linux packet processing to situate latency across system layers.
What you can do after
Evaluate request latency by distinguishing processing work from network and queuing delays.
How it connects
Connects service time to latency, response time, wait time, queuing latency, network latency, and end-to-end latency.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Latency. The section links point to the parts of the book it draws on.