liveBook · Manning

Linguistic imbalance

As explained in Introduction to Generative AI, Second Edition

Linguistic imbalance is the unequal representation and computational support of different languages in data and AI systems.

Linguistic imbalance is the unequal representation and computational support of languages in training data and artificial intelligence systems. Large language models reflect these disparities because their abilities depend heavily on the languages present in their training data. section 3.3

English and a small group of high-resource languages dominate online data, while thousands of languages remain underrepresented or absent. Differences in grammar, morphology, and cultural nuance make simple word counts an incomplete measure of language support. section 3.3

When article counts mislead

Wikipedia illustrates the problem: articles about countries in Africa and Asia may favor English or colonial languages over local knowledge. Cebuano appears to have millions of articles, yet up to 99% may have been generated by an automated bot, limiting human-authored nuance and cultural context. section 3.3

How Introduction to Generative AI, Second Edition covers it

How deep it goes
Explains dataset causes and qualitative limitations through Wikipedia examples, but stops short of technical measurement or remediation methods.
Examples
Uses English web dominance, Wikipedia language coverage, and automated Cebuano articles to distinguish quantity from qualitative depth.
What you can do after
Evaluate language representation claims by comparing dataset quantity with human-authored depth and cultural coverage.
How it connects
Connects training data with large language models, Wikipedia, Common Crawl, local knowledge, and cultural context.

This explainer was generated by Manning's knowledge graph from the text of Introduction to Generative AI, Second Edition. The section links point to the parts of the book it draws on.