liveBook · Manning

Depthwise separable convolution

A depthwise separable convolution combines per-channel spatial filtering with a pointwise convolution that mixes channels.

How 2 Manning books explain it

Deep Learning with R, Third Edition

A depthwise separable convolution factorizes convolution into independent spatial convolutions over input channels followed by a pointwise convolution that mixes channels.

How it is used
Uses separable convolution as an efficient Conv2D alternative for image models.
How deep it goes
Explains the two stages and their assumptions, and points to an Xception paper for further theoretical grounding.
Examples
Builds a mini Xception-like dogs-versus-cats classifier and compares its parameter count and test accuracy with an earlier model.
What you can do after
Apply it via R/Keras layer_separable_conv_2d in a repeated convolutional block.

Read how Deep Learning with R, Third Edition explains depthwise separable convolution →

Deep Learning with Python, Third Edition

A convolution variant that applies per-channel spatial convolution followed by pointwise channel mixing to reduce parameters and computation.

How it is used
Replaces regular convolution in ConvNets to reduce model size and computation while preserving useful representational power.
How deep it goes
Explains the depthwise-then-pointwise operation, its independence prior, efficiency benefits, and Keras application, without deriving its mathematics.
Examples
Uses Keras SeparableConv2D blocks in a mini Xception-like dogs-versus-cats classifier and compares its parameters and test accuracy.
What you can do after
Apply it via Keras SeparableConv2D when constructing smaller, more parameter-efficient ConvNet blocks.

Read how Deep Learning with Python, Third Edition explains depthwise separable convolution →

What to know first

Related concepts

Questions about depthwise separable convolution

What is depthwise separable convolution?

A depthwise separable convolution combines per-channel spatial filtering with a pointwise convolution that mixes channels.

Which Manning books explain depthwise separable convolution?

Deep Learning with R, Third Edition and Deep Learning with Python, Third Edition.

What should I know before learning depthwise separable convolution?

Manning books that teach depthwise separable convolution usually introduce channel dimension, accuracy, convolutional layer and convolutional neural network first.

What is the difference between depthwise separable convolution and convolutional layer?

A depthwise separable convolution combines per-channel spatial filtering with a pointwise convolution that mixes channels. A convolutional layer is a neural-network layer that applies shared learned filters to local regions of structured input to produce feature representations.

What is depthwise separable convolution part of?

Depthwise separable convolution is part of Xception. Xception is a convolutional neural-network architecture based primarily on depthwise separable convolutions.

What are the parts of depthwise separable convolution?

Depthwise separable convolution includes pointwise convolution.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.