liveBook · Manning

Fully connected neural network

As explained in Machines that Think

A dense network is a neural network whose units are broadly connected between adjacent layers without specialized exploitation of spatial or sequential structure.

A fully connected, or dense, network connects every neuron in one layer to every neuron in the next. This gives it flexibility: in principle, it can approximate almost any function. But dense layers have no built-in assumptions about how inputs are structured, so patterns must be learned from data rather than supported by the architecture. section 3.4.1

That flexibility can be inefficient. Flattening an image obscures spatial proximity; representing a sentence as inputs loses ordering, and a time series loses temporal rhythm. Dense networks can learn such patterns, but may require many parameters and examples and still handle them less naturally than specialized architectures. Convolutional networks encode local spatial structure, while recurrent networks carry information through sequences. section 3.4.1 section 3.4.7

How Machines that Think covers it

How deep it goes
Defines layer-to-layer connectivity and explains structural limitations, but does not detail implementation or training mechanics.
Examples
Uses flattened images, unordered sentence inputs, and time series without temporal rhythm to illustrate lost structure.
What you can do after
Evaluate whether dense networks suit data whose spatial, sequential, or temporal patterns require architectural support.
How it connects
Connects dense networks to convolutional and recurrent networks as alternatives that encode spatial and sequential structure.

Also explained in

Compare how 3 books explain fully connected neural network →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machines that Think. The section links point to the parts of the book it draws on.