liveBook · Manning

Goal

As explained in Machine Learning System Design

A desired outcome that a system or design is intended to achieve.

A goal states the desired outcome a system or design must achieve. It gives a design document a starting point, reduces uncertainty, and establishes boundaries for technical decisions. section 4.2 section 12.1

Use goals to keep an ML project aligned with the outcome that matters:

  • Define the intended outcome before implementing the system or running an experiment. section 12.1
  • Translate the goal into success criteria, metrics, and loss functions that support the project rather than merely optimize convenient proxies. section 4.2 section 5.3.3
  • Pair the goal with antigoals: explicit exclusions that remove low-value requirements and expose tradeoffs. section 4.2
  • Judge changes through offline evaluation first, then test real-world effects and business metrics online. section 12.0 section 12.1

A boutique recommendation system

Suppose a boutique store sells fewer than 1,000 goods and receives low traffic. Its goal may require useful recommendations, but not support for millions of items. Treating extreme scalability as an antigoal keeps attention on outcomes that affect the store rather than on unnecessary capacity. section 4.2

Figure 4.1 A shop with <1,000 goods for sale and low traffic should not aim for scalability when building a recommendation system, as almost any tech solution can handle its load these days.
figure

Use the figure to compare a system’s actual workload with tempting but irrelevant scalability targets. section 4.2

How Machine Learning System Design covers it

How deep it goes
Connects goals to boundaries, antigoals, metrics, losses, offline evaluation, online testing, and business reporting.
Examples
Uses a boutique recommendation engine, reporting-ready internal reports, offline evaluation, and A/B testing to clarify goal-setting tradeoffs.
What it assumes
Assumes enough problem understanding to describe the desired outcome, while using goal-setting to reduce inconsistent understanding among stakeholders.
What you can do after
Evaluate whether system changes improve the intended outcome by linking design choices, metrics, experiments, and business results.
How it connects
Ties goals to design documents, success criteria, antigoals, metrics, loss functions, offline testing, online testing, and business metrics.

Also explained in

Compare how 11 books explain goal →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machine Learning System Design. The section links point to the parts of the book it draws on.