A latency budget sets the maximum acceptable elapsed time for an operation. On edge devices, set it alongside a power budget: inference costs energy, and sustained workloads can hit a thermal knee that pushes latency above early measurements. section 11.0
Sustained edge testing
MacBook Air M3, iPhone 16, and Pixel 10 Pro serve as reference devices. Latency measured in the first 30 seconds may not reflect performance after five minutes of sustained work. section 11.0
