A convolutional layer applies learned spatial filters to image-like tensors, detecting local patterns and producing feature maps. Unlike pooling, it learns pattern detectors rather than selecting values from fixed windows. section 6.2.3
A convolutional layer typically contributes to a visual model in this sequence:
- Apply filters across the input to detect patterns such as edges, textures, and shapes. section 6.2.3 section 6.5
- Represent the detected patterns as feature maps, preserving spatial organization. section 6.2.3
- Combine convolutional layers with pooling layers in contracting paths to reduce spatial dimensions and encode increasingly abstract features. section 6.2.3 section 6.5
- Use the resulting representations in architectures such as U-Net or convert image patches into token vectors for a vision transformer. section 6.2 section 3.3
Patch projection in a vision transformer
For a 3 × 32 × 32 image divided into an 8 × 8 grid, a convolutional layer converts each 3 × 4 × 4 patch into a 48-value vector, producing 64 tokens. section 3.3













