liveBook · Manning

Tensor operation

A tensor operation is a mathematical or computational transformation applied to one or more tensors, producing tensor or scalar values.

How 3 Manning books explain it

Deep Learning with R, Third Edition

A tensor operation is a mathematical or computational transformation that takes one or more tensors as input and produces tensor values.

How it is used
Uses tensor operations as the building blocks of neural network layers and transformations.
How deep it goes
Explains operation sequences and geometric interpretations, then connects tensor functions to gradients and backpropagation without formal mathematical notation.
Examples
Illustrates a dense layer with matrix multiplication, bias, and ReLU, plus vector translation and matrix-based rotation and scaling.
What you can do after
Apply tensor operations via PyTorch to construct a dense-layer function and compute gradients.

Read how Deep Learning with R, Third Edition explains tensor operation →

Deep Learning with Python, Third Edition

An elementary array/tensor computation such as matrix multiplication, rectified linear activation, or normalization used as a building block in neural networks.

How it is used
Builds neural-network layers from numerical transformations applied to tensors.
How deep it goes
Explains dense-layer composition and practical TensorFlow operations, then connects differentiability to gradients without deriving their mathematics.
Examples
Demonstrates a dense function using matmul, bias addition, and ReLU, plus TensorFlow square, square-root, and concatenation calls.
What you can do after
Build it from scratch as a dense computation and retrieve gradients for differentiable tensor expressions with GradientTape.

Read how Deep Learning with Python, Third Edition explains tensor operation →

Deep Learning with PyTorch, Second Edition

An operation provided by PyTorch that acts on tensor data, either as a torch-module function or as a tensor method.

How it is used
Organizes PyTorch tensor manipulation for preparing data and working with tensors in deep-learning workflows.
How deep it goes
Defines operation families and demonstrates transpose and in-place behavior, but defers exhaustive API coverage to the documentation.
Examples
Demonstrates transpose through module and method calls, zeroing a tensor in place, and indexing and mutating a Python list.
What you can do after
Apply it via PyTorch by selecting tensor APIs, choosing functional or method syntax, and recognizing operations that mutate inputs.

Read how Deep Learning with PyTorch, Second Edition explains tensor operation →

What to know first

Related concepts

Questions about tensor operation

What is tensor operation?

A tensor operation is a mathematical or computational transformation applied to one or more tensors, producing tensor or scalar values.

Which Manning books explain tensor operation?

Deep Learning with R, Third Edition, Deep Learning with Python, Third Edition and Deep Learning with PyTorch, Second Edition.

What should I know before learning tensor operation?

Manning books that teach tensor operation usually introduce array, atomic type, language model and objective function first.

What kinds of tensor operation are there?

Kinds of tensor operation include ReLU and tensor product.

What is tensor operation a kind of?

Tensor operation is a kind of geometric transformation. A geometric transformation is a mapping or operation that changes or expresses the position, orientation, scale, shape, or coordinate representation of geometric objects.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.