Clipping truncates sequences at a chosen maximum length. In CNN-based text processing, it keeps inputs fixed-size so encoding vectors remain comparable, while padding fills shorter sequences. section 7.4.1
Clipping supports a stable text-processing pipeline by:
- Removing words or characters beyond the model’s maximum sequence length. section 7.4.1
- Keeping meaningful patterns usable wherever they occur within the permitted input range. section 7.4.1
Listing 7.18 A multipurpose padding function
def pad(sequence, pad_value, seq_len):
padded = list(sequence)[:seq_len]
padded = padded + [pad_value] * (seq_len - len(padded))
return padded
The padding helper demonstrates clipping through list(sequence)[:seq_len], then extends shorter sequences with a pad value. section 7.4.1
