Grouping inference requests by task lets one active adapter process a batch before switching. This avoids per-request adapter changes that can negate performance benefits. section 7.3.6
Figure 7.7 Adapter routing pattern for multiple specializations over a single base model. A task router classifies incoming requests and buffers them into separate queues. A switch selects which adapter is active: the model processes one full batch, swaps the adapter, and processes the next. The base model stays in memory throughout — only the lightweight adapter changes between batches. The dashed outline indicates the inactive adapter waiting for its turn.
A task router queues requests by type; the model processes each queue as a batch with its corresponding adapter, then switches. section 7.3.6






















