liveBook · Manning

BLOOM

As explained in Introduction to Generative AI, Second Edition

BLOOM is a multilingual autoregressive language model trained to support many natural and programming languages.

BLOOM is a multilingual language model designed to support many natural and programming languages. Its broad language coverage illustrates both the promise and difficulty of building AI systems for users worldwide: supporting a language does not guarantee equal quality, cultural nuance, or reliable understanding. section 3.3

BLOOM’s capabilities are shaped by its training data. The ROOTS corpus, a 1.6-terabyte multilingual text collection, was used to train the model and received a dedicated search tool to support transparency. Yet multilingual datasets remain uneven: Common Crawl draws more than 90% of its language content from ten languages, with English nearly half. Models can therefore perform unevenly across languages, especially where scripts, grammar, or cultural context differ sharply from dominant training data. section 3.2 section 3.3

BLOOM’s significance is best understood through the distinction between coverage and meaningful access:

  • A language may appear frequently in a dataset without having much human-authored, culturally rich material; automated content can inflate quantitative representation. section 3.3
  • Underrepresented languages may receive weaker results because their grammatical structures, writing systems, or cultural references are less visible in training data. section 3.3
  • Dataset cards, corpus search tools, and demographic metadata help researchers inspect intended uses, limitations, and possible bias, although complete disclosure remains uncommon. section 3.2

How Introduction to Generative AI, Second Edition covers it

How deep it goes
Defines BLOOM’s multilingual role and data-related limitations but stops short of architecture, training procedure, or implementation details.
Examples
Uses the ROOTS corpus, dataset cards, and automated Cebuano Wikipedia content to illustrate provenance, transparency, and representation limits.
What you can do after
Evaluate BLOOM by separating nominal language coverage from training-data quality, cultural depth, transparency, and language-specific performance.
How it connects
Connects multilingual language models with training data, linguistic diversity, dataset documentation, and bias.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Introduction to Generative AI, Second Edition. The section links point to the parts of the book it draws on.