liveBook · Manning

Feedforward network

As explained in Timeless Algorithms, The Foundational Ideas

A neural network component that applies learned transformations independently at each sequence position.

A feed-forward network is one component of a transformer, alongside attention heads and stacked layers. In a pronoun-resolution example, attention is worked through while feed-forward computation is left unspecified. section 12.2.1

How Timeless Algorithms, The Foundational Ideas covers it

How deep it goes
Names feed-forward networks as transformer components but stops before specifying their computation or behavior.
How it connects
Connects feed-forward networks to transformers, attention heads, and stacked layers.

Also explained in

Compare how 20 books explain feedforward network →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Timeless Algorithms, The Foundational Ideas. The section links point to the parts of the book it draws on.