liveBook · Manning

Relevance

As explained in Starting Data Analytics with Generative AI and Python

Relevance is the data-quality property of being pertinent to the specific business question or problem being addressed.

Relevance is the data-quality property of being pertinent to the specific business question or problem being addressed. It keeps analysis focused on the slice of reality that matters instead of sending you after the wrong rabbit. section 2.2 section 5.2.1

Before analyzing text data, check whether it belongs to the question you are asking:

  • Confirm that reviews concern your product rather than a competitor’s product. section 5.2.1
  • Check whether the data covers the period being analyzed rather than an outdated period. section 5.2.1 section 2.2
  • Establish whether comments are tied to orders or are general impressions from a review site. section 5.2.1
  • Inspect duplicates before analysis, because copied comments can give one opinion disproportionate weight. section 5.2.1

A misleading review dataset

A collection labeled as product reviews may contain competitor reviews, stale comments, or one complaint copied repeatedly. Treating it as relevant can distort the analysis before any text-cleaning or modeling begins. section 5.2.1

How Starting Data Analytics with Generative AI and Python covers it

How deep it goes
Defines relevance and supplies inspection questions, but stops short of prescribing a formal relevance score or algorithm.
Examples
Uses competitor reviews, outdated reviews, order-linked comments, general impressions, and duplicated complaints as checks.
What it assumes
Assumes a defined business question and teaches from zero why data must describe the analyzed slice of reality.
What you can do after
Evaluate whether text data belongs to the business question before analyzing it.
How it connects
Connects relevance with data quality, timeliness, uniqueness, accuracy, completeness, consistency, integrity, and data cleaning.

Also explained in

Compare how 11 books explain relevance →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Starting Data Analytics with Generative AI and Python. The section links point to the parts of the book it draws on.