liveBook · Manning

Common sense

As explained in Natural Language Processing in Action, Second Edition

Commonsense knowledge is general background knowledge about everyday entities, events, relationships, and expectations.

Common sense is the background knowledge people use to interpret everyday language: times of day, ordinary expectations, relationships, and unstated intentions. A phrase such as “good morning” depends on knowing that morning precedes afternoon and functions as a greeting rather than a factual report about morning. section 1.2.3

For language systems, commonsense knowledge helps to:

  • Compress meaning: short utterances can communicate more when the listener supplies shared background knowledge. section 1.2.3
  • Interpret relationships and expectations that are absent from a sentence’s literal wording. section 11.8
  • Support chatbots that otherwise miss ordinary meanings, such as the significance of “which way is up.” section 11.8

Machines struggle because much commonsense knowledge is acquired informally before language, is rarely documented in a dedicated corpus, and may include instinctive expectations. Practical systems therefore use ontologies, knowledge bases, and knowledge graphs to represent and query relationships such as kind-of, is-used-for, has-a, and has-profession. section 1.2.3 section 11.8

From phrase to knowledge graph

Understanding a statement about a person may require facts about military ranks, titles, occupations, and how people relate to them. A knowledge graph can store these entities and normalized relationships so an information-extraction system can connect alternate names and related facts. section 11.8

Figure 11.4 Stanislav’s knowledge graph
figure

Inspect a concrete knowledge graph showing how entities and relationships can organize background knowledge. section 11.8

How Natural Language Processing in Action, Second Edition covers it

How deep it goes
Defines the challenge and outlines ontologies and knowledge graphs, but stops short of implementation details.
Examples
Uses “good morning,” “which way is up,” everyday expectations, and relationship-rich knowledge graphs as examples.
What it assumes
Assumes familiarity with language interpretation but explains from intuition why machines lack humans’ accumulated everyday knowledge.
What you can do after
Evaluate how missing background knowledge can cause language systems to misinterpret ordinary statements.
How it connects
Connects commonsense knowledge to natural language processing, theory of mind, ontologies, knowledge bases, knowledge graphs, and information extraction.

Also explained in

Compare how 4 books explain common sense →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Natural Language Processing in Action, Second Edition. The section links point to the parts of the book it draws on.