2 Neural network architectures

The vast majority of DL models are based on one or a combination of three types of layers: fully connected, convolutional, and recurrent. The success of a DL model depends in great part on choosing the right architecture for the problem at hand.

If you want to analyze data that has no structure, like tabular data in Excel sheets, then you should consider fully connected networks. If the data has a special local structure like images, then convolutional neural networks (NNs) are your friends. Finally, if the data is sequential like text, then the easiest option is to use 1D convolutional networks. This chapter gives you an overview of the different architectures used in DL and provides hints as to when to use which architectural type.

2.1 Fully connected neural networks (fcNNs)

2.1.1 The biology that inspired the design of artificial NNs

2.1.2 Getting started with implementing an NN

2.1.3 Using a fully connected NN (fcNN) to classify images

2.2 Convolutional NNs for image-like data

2.2.1 Main ideas in a CNN architecture

2.2.2 A minimal CNN for edge lovers

2.2.3 Biological inspiration for a CNN architecture

2.2.4 Building and understanding a CNN

2.3 One-dimensional CNNs for ordered data

2.3.1 Format of time-ordered data

2.3.2 What’s special about ordered data?

2.3.3 Architectures for time-ordered data

Summary