liveBook · Manning

Text processing

As explained in Graph Algorithms for Data Science

Text processing is the computational manipulation of textual data through operations such as tokenization, replacement, and filtering.

Text processing turns raw text into structured data through small operations such as cleaning, splitting, filtering, normalizing, and storing extracted terms. section 7.1

A practical hashtag-extraction workflow:

  • Exclude retweets so repeated hashtags do not skew the analysis. section 7.1

Hashtag extraction

For a tweet containing “#AI #Python,” cleaning and splitting produce tokens, filtering retains both hashtags, and normalization prepares them for graph storage.

How Graph Algorithms for Data Science covers it

How deep it goes
Demonstrates executable Cypher steps for cleaning, tokenizing, filtering, normalizing, and storing hashtags, without deeper NLP methods.
Examples
Uses tweets, hashtags, extracted-hashtag tables, Cypher listings, and UNWIND output rows as concrete artifacts.
What it assumes
Assumes tweet data and basic Cypher familiarity while teaching replace, split, filtering, list comprehension, and UNWIND operations.
What you can do after
Apply it via Cypher to extract normalized hashtags and create Tag nodes linked to their source tweets.
How it connects
Connects tokenization with natural language processing, hashtag extraction with co-occurrence networks, and list processing with graph storage.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Graph Algorithms for Data Science. The section links point to the parts of the book it draws on.