A Transformer encoder layer enriches each zone’s representation by letting it attend to every other zone, then processes each zone independently with a feedforward network. section 9.6
Each sub-layer preserves and stabilizes the representation:
- Add the sub-layer output to its input through a residual connection, then apply layer normalization. section 9.6
- Stack layers to build deeper relationships: one layer can capture direct neighbors, while a second can capture indirect links such as zone 1 influencing zone 3 through zone 2. section 9.6
Figure 9.8 Transformer architecture.
Use the architecture figure to follow the encoder layer’s structure. section 9.6



