liveBook · Manning

Sequence generation

Sequence generation is the process of producing an ordered sequence of elements, such as tokens or characters, often conditioned on an input or context.

How 2 Manning books explain it

Deep Learning with R, Third Edition

Sequence generation is the production of ordered data elements by a computational model.

How it is used
Frames ordered-data production across music, handwriting, and language-modeling applications.
How deep it goes
Traces major historical milestones but stops short of implementation details, algorithms, and mathematical derivations.
Examples
Uses music generation, handwriting from pen-position time series, and next-token text generation as concrete examples.
What you can do after
Evaluate sequence-generation applications and recognize next-token prediction as a language-modeling strategy.

Read how Deep Learning with R, Third Edition explains sequence generation →

Deep Learning with Python, Third Edition

The task of producing an ordered sequence of tokens, characters, or other elements from a model rather than a single label.

How it is used
Frames model-driven production of ordered data, especially text, music, and handwriting.
How deep it goes
Defines next-token prediction and surveys milestones, but stops short of implementation details or decoding procedures.
Examples
Uses music, handwriting trajectories, Shakespeare text generation, and GPT language pretraining as examples.
What you can do after
Evaluate how sequence-generation ideas extend from next-token prediction to generated music, handwriting, and text.

Read how Deep Learning with Python, Third Edition explains sequence generation →

Also covered in

What to know first

Related concepts

Questions about sequence generation

What is sequence generation?

Sequence generation is the process of producing an ordered sequence of elements, such as tokens or characters, often conditioned on an input or context.

Which Manning books explain sequence generation?

Deep Learning with R, Third Edition and Deep Learning with Python, Third Edition.

What should I know before learning sequence generation?

Manning books that teach sequence generation usually introduce ChatGPT, generative recurrent network, GPT model and music generation first.

What kinds of sequence generation are there?

Kinds of sequence generation include sequence prediction.

What is sequence generation a kind of?

Sequence generation is a kind of generation. Generation is the production of an output by a computational model from supplied input or context, often using patterns learned from data.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.