liveBook · Manning

BART

BART is a denoising sequence-to-sequence Transformer model with a bidirectional encoder and an autoregressive decoder, pretrained to reconstruct corrupted text.

How 3 Manning books explain it

Build a Text-to-Image Generator (from Scratch)

BART is a denoising sequence-to-sequence transformer model whose encoder is bidirectional and whose decoder is autoregressive.

How it is used
Maps text prompts to image-token sequences within a transformer-based text-to-image generation pipeline.
How deep it goes
Explains encoder-decoder roles, token flow, training alignment, and autoregressive prediction, stopping short of internal layer implementation.
Examples
Uses paired image-caption data, discrete image tokens, and the prompt “panda with a top hat reading a book.”
What you can do after
Build it from scratch as a text-to-image pipeline that encodes prompts, predicts image tokens, and reconstructs images.

Read how Build a Text-to-Image Generator (from Scratch) explains BART →

Retrieval Augmented Generation, The Foundational Ideas

BART is a denoising sequence-to-sequence Transformer model trained to reconstruct text from corrupted inputs.

How it is used
Generates fluent answers from retrieved passages within a modular retrieval-augmented generation pipeline.
How deep it goes
Explains encoder-decoder roles, denoising pretraining, and retrieved-input concatenation, but stops short of training or decoding internals.
Examples
Uses retrieved passages concatenated with questions and open-domain answers requiring synthesis across documents.
What you can do after
Evaluate/understand when an encoder-decoder generator can synthesize retrieved evidence instead of extracting verbatim spans.

Read how Retrieval Augmented Generation, The Foundational Ideas explains BART →

Causal AI

BART is a denoising sequence-to-sequence transformer language model developed for generating text from input text.

How it is used
Uses BART to represent conditional causal Markov kernels over generated text.
How deep it goes
Explains sequence mapping, fine-tuning, tokenization, training, generation, and log probabilities, but does not derive Transformer internals.
Examples
Uses King, Prince, and Kingdom action vignettes as paired inputs, targets, and generated story components.
What you can do after
Builds and fine-tunes BART sequence-to-sequence models with Hugging Face Transformers for conditional text generation.

Read how Causal AI explains BART →

Also covered in

What to know first

Related concepts

Questions about BART

What is BART?

BART is a denoising sequence-to-sequence Transformer model with a bidirectional encoder and an autoregressive decoder, pretrained to reconstruct corrupted text.

Which Manning books explain BART?

Build a Text-to-Image Generator (from Scratch), Retrieval Augmented Generation, The Foundational Ideas and Causal AI.

What should I know before learning BART?

Manning books that teach BART usually introduce encoder-decoder architecture and transformer architecture first.

What is the difference between BART and T5?

BART is a denoising sequence-to-sequence Transformer model with a bidirectional encoder and an autoregressive decoder, pretrained to reconstruct corrupted text. T5 is a family of encoder-decoder Transformer models that frames natural-language tasks as transformations from input text to output text.

What kinds of BART are there?

Kinds of BART include mBART.

What is BART a kind of?

BART is a kind of encoder-decoder architecture. An encoder-decoder architecture is a neural model design in which an encoder transforms input into a representation and a decoder uses that representation to produce output, often mapping one sequence to another.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.