liveBook · Manning

Video

As explained in Deep Learning with R, Third Edition

Video data represents videos as ordered sequences of image frames.

Video data represents each video as an ordered sequence of image frames. A dataset of videos is stored as a rank-5 tensor with shape (samples, frames, height, width, channels). section 2.2.8

Read the dimensions as follows:

  • samples identifies the videos in the dataset. section 2.2.8
  • frames preserves the sequence of images making up each video. section 2.2.8
  • height and width describe each frame’s two-dimensional pixel grid. section 2.2.8
  • channels store the values associated with each pixel. section 2.2.8

Representing a video dataset

A batch of videos can be organized as (samples, frames, height, width, channels): the first video is a sequence of frames, and each frame is an image represented by a height-by-width grid of channel values. section 2.2.8

How Deep Learning with R, Third Edition covers it

How deep it goes
Defines the rank-5 shape and names its axes without discussing video models or processing operations.
Examples
Uses the symbolic shape (samples, frames, height, width, channels) to show how a batch of videos is organized.
What you can do after
Evaluate video datasets as rank-5 tensors by identifying samples, frames, spatial dimensions, and channels.
How it connects
Connects video data to image data, sequence data, and tensors through nested frame and pixel representations.

Also explained in

Compare how 5 books explain video →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Deep Learning with R, Third Edition. The section links point to the parts of the book it draws on.