liveBook · Manning

Proxy metric

As explained in Vibe Engineering

A proxy metric is an observable measure that indirectly indicates a value or outcome that cannot be measured directly.

A proxy metric is an observable measure that correlates with value without proving that an intervention caused the outcome. For AI-assisted coding, it replaces unreliable developer self-reports with evidence such as elapsed delivery time, merged work, or review rework. section 9.4.2

Useful engineering proxies include:

  • Cycle time: elapsed time from starting a task to merging its pull request; it captures implementation acceleration but also includes design and review. section 9.4.2
  • Pull-request throughput: merged pull requests per developer per sprint; interpret increases alongside pull-request size because smaller changes can inflate the count. section 9.4.2
  • First-attempt success rate: the percentage of AI-generated code accepted without modification; it indicates quality and retry cost. section 9.4.2

A metric can improve while value remains unclear

After adopting AI tools, Marcus’s team reduced medium-complexity cycle time by 25–35% and increased pull requests from 6.2 to 8.1 per developer per sprint. Because pull-request size also decreased, more merges did not necessarily mean more features. section 9.4.2

How Vibe Engineering covers it

How deep it goes
Defines correlation without causation and compares three operational metrics, while warning against single-metric interpretation.
Examples
Uses cycle-time reduction, pull-request growth, shrinking pull-request size, and first-attempt review success.
What you can do after
Evaluate AI coding impact through observable metrics while checking confounders and avoiding causal overclaims.
How it connects
Connects AI-assisted coding with cycle time, pull-request throughput, code review, and causation.

Also explained in

Compare how 8 books explain proxy metric →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Vibe Engineering. The section links point to the parts of the book it draws on.