liveBook · Manning

Independent deployment

As explained in Designing AI Systems

An independently deployable service is a service that can be released, scaled, and versioned without coordinating deployment with other services.

Independent deployment makes each workflow its own service, allowing teams to release, scale, and version it without coordinating with other workflows. The one-workflow-to-one-service boundary prevents shared deployment lifecycles and resource contention while preserving clear operational ownership. section 2.2.3 section 2.6

The boundary produces several operational effects:

  • Release changes without coordinating with unrelated teams or workflows. section 2.2.3
  • Scale each workflow according to its own traffic and metrics. section 2.2.3
  • Run multiple versions simultaneously and shift traffic gradually. section 2.2.3
  • Attribute observability data and costs to specific workflows without allocation logic for grouped services. section 2.2.3
  • Accept the trade-off of managing more services as the platform grows. section 2.6

Patient assistant deployment

When Sarah defines a patient intake assistant with the @workflow decorator, it becomes a separate service with its own deployment lifecycle. She can update it without coordinating with another healthcare workflow, scale it on its own traffic, and run versions 1.0 and 2.0 concurrently. section 2.2.3

How Designing AI Systems covers it

How deep it goes
Defines the boundary and its operational consequences, but stops short of implementation code or detailed deployment procedures.
Examples
Uses Sarah’s patient intake assistant, the @workflow decorator, separate deployments, and simultaneous versions 1.0 and 2.0.
What you can do after
Operate workflow services independently and reason about their release, scaling, versioning, observability, and cost boundaries.
How it connects
Connects workflow services with independent scaling, versioning, observability, cost tracking, container isolation, and service discovery.

Also explained in

Compare how 2 books explain independent deployment →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Designing AI Systems. The section links point to the parts of the book it draws on.