liveBook · Manning

Position-wise feedforward network

As explained in Applied Reinforcement Learning

A feedforward neural subnetwork applied independently to each position or entity representation.

A position-wise feedforward network processes each zone’s enriched representation independently. In a Transformer encoder layer, it follows multi-head self-attention; both sub-layers use residual connections and layer normalization. section 9.6

How Applied Reinforcement Learning covers it

How deep it goes
Defines its position-wise role but does not detail the network’s internal computation.
Examples
Uses cooling-floor zones as entities whose representations are processed independently.
What you can do after
Understand how the encoder processes each zone’s representation after adding relational context.
How it connects
Connects with multi-head self-attention, residual connections, and layer normalization within the encoder layer.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Applied Reinforcement Learning. The section links point to the parts of the book it draws on.