liveBook · Manning

Build-versus-buy decision

As explained in LLMs in Production

A decision framework for choosing between developing a capability internally and acquiring it from an external provider.

You need an LLM capability in production. Buying access to an external model can get you moving quickly, but deploying a capability you control may better fit the work you need it to do. The decision is not simply which model is best: it is which approach fits the project now and its likely production requirements. section 1.2 section 1.2.2

Weigh the trade-offs rather than treating either route as the default:

  • Buy when time to market, ease of use, and a relatively low initial cost matter most. External offerings can help a team test an idea without first taking on the harder work of building. section 1.2 section 1.2.2
  • Build when privacy, control, flexibility, cost over time, or regulatory requirements make ownership important. Building is the more difficult path, so those benefits need to justify the effort. section 1.2.2
  • Treat sensitive third-party data processing as a trust decision, not an automatic prohibition. It calls for high levels of trust and contracts. section 1.2.2

Buy first, then reassess

A team might use a GPT-4 or Databricks subscription to prototype quickly, raise funding, or gain stakeholder buy-in. Before production, it can reconsider whether a third-party solution meets its privacy, control, and flexibility needs. Buying and building can be choices for different phases of the same project. section 1.2.2

How LLMs in Production covers it

How deep it goes
Compares practical trade-offs and proposes a phase-dependent approach, but does not specify a decision procedure in the supplied prose.
Examples
Uses GPT-4 or Databricks subscriptions for quick prototypes aimed at funding or stakeholder buy-in.
What you can do after
Evaluate/understand when to buy, build, or use each approach at a different project phase.
How it connects
Connects LLM deployment with prototyping, time to market, privacy, security, and regulation.

Also explained in

Compare how 3 books explain build-versus-buy decision →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of LLMs in Production. The section links point to the parts of the book it draws on.