A sequence is an ordered array whose elements carry information through their positions; moving an element can change the whole. section 2.2.7
Language models can process tokens in sequence, using an internal state as new inputs arrive. Recurrent neural networks accept variable-length inputs, but longer sequences can cause gradients to vanish or explode, making training difficult. section 2.2.7
Sentiment across sentence lengths
“I loved the movie last night” and a much longer sentence expressing similar sentiment may receive different positive ratings in an RNN: the shorter sentence can rate higher because of how sequence processing affects the result. section 2.2.7
