liveBook · Manning

FastText

FastText is a word-representation model that learns word vectors using character n-grams and composes representations from subword information.

How 2 Manning books explain it

Natural Language Processing in Action, Second Edition

fastText is a word-representation model that learns from character n-grams and composes representations for words from their subwords.

How it is used
Supports word-representation and NLU pipelines when rare, misspelled, or unseen words matter.
How deep it goes
Explains subword composition and OOV behavior, but stops short of detailing the complete training objective or implementation.
Examples
Uses “whisper” n-grams, “Superwoman” composition, pretrained multilingual models, and Python vector inspection.
What you can do after
Apply it via pretrained vectors or domain text to represent rare and unseen words more flexibly than whole-word embeddings.

Read how Natural Language Processing in Action, Second Edition explains FastText →

Transfer Learning for Natural Language Processing

A word-representation method that applies Skip-Gram to character n-grams to represent words, including unseen words.

How it is used
Represents pretrained words and supplies vectors for IMDB review inputs, including out-of-vocabulary forms.
How deep it goes
Extends Skip-Gram to character n-grams and aggregates their vectors for unseen words, without detailing training implementation.
Examples
Uses pretrained Wiki vectors and IMDB movie reviews as concrete artifacts.
What you can do after
Apply pretrained FastText vectors to produce averaged review-level representations, omitting tokens whose lookup fails.

Read how Transfer Learning for Natural Language Processing explains FastText →

What to know first

Related concepts

Questions about FastText

What is FastText?

FastText is a word-representation model that learns word vectors using character n-grams and composes representations from subword information.

Which Manning books explain FastText?

Natural Language Processing in Action, Second Edition and Transfer Learning for Natural Language Processing.

What should I know before learning FastText?

Manning books that teach FastText usually introduce Word2Vec first.

What is FastText a kind of?

FastText is a kind of vectorization. Vectorization is the transformation of data or computations into vector form so they can be processed collectively by vector-oriented operations.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.