How deeply does Introduction to Generative AI, Second Edition cover compute?

Links compute to infrastructure and operating costs, but does not explain how processing capacity works technically.

Compute

As explained in Introduction to Generative AI, Second Edition

Compute is the computational processing capacity required to train, run, or adapt machine-learning models.

Compute capacity is part of the infrastructure behind AI systems. Building and running them can involve substantial ongoing compute and energy costs, tying access to investment in chips, data centers, and other infrastructure. section 11.5

Costs and revenue

Leading AI providers, including OpenAI, face inference and infrastructure costs that far exceed subscription revenue, relying on funding and strategic partnerships to offset expenses. section 11.5

How Introduction to Generative AI, Second Edition covers it

Cover of Introduction to Generative AI, Second Edition

liveBook manning.com

Read Introduction to Generative AI, Second Edition on liveBook Get the book at manning.com

Related concepts

Moore's lawmeasured by · Moore’s law is the empirical observation that the number of transistors on an integrated circuit historically tended to double approximately every two years.
parametercontrasts with · A model parameter is a numerical value, such as a weight or bias, that is learned or set to determine how a model computes outputs.
neural networkused by · A neural network is a computational model of interconnected, parameterized units that learns transformations from inputs to outputs.
schedulerused by · A scheduler is a system component that selects, orders, dispatches, or assigns execution resources to tasks according to timing, dependency, placement, or other scheduling criteria.
databasecontrasts with · A database is an organized collection of persistent data managed by software for storage, retrieval, querying, and modification.
training datasetcontrasts with · A collection of examples or observations supplied to a learning procedure to fit or adapt a model or learn its patterns or parameters.

This explainer was generated by Manning's knowledge graph from the text of Introduction to Generative AI, Second Edition. The section links point to the parts of the book it draws on.