liveBook · Manning

Pose

As explained in Graph Neural Networks in Action

The spatial configuration or arrangement of the body parts of an entity.

A pose is the spatial arrangement of an entity’s body parts. Modeling how that arrangement changes over time supports trajectory prediction and applications such as medical consultation, remote home security, filmmaking, and robotic planning. section 6.1

For human-pose prediction, treat the observed pose sequence as sensor-like input and learn relations among its components. The model then predicts future trajectories rather than only classifying a single configuration. section 6.1

An NRI-based pose-prediction workflow proceeds as follows:

  • Encode input data into edge probabilities representing whether components are connected. section 6.4.3
  • Decode future trajectories conditionally on those inferred relations, using a GRU. section 6.4.3
  • Optimize reconstruction loss together with KL divergence, repeating training until convergence. section 6.4.3
  • Evaluate predictions across multiple future horizons with mean squared error, recognizing that accuracy generally declines farther into the future. section 6.4.3

Long-horizon pose prediction

A trained NRI model predicts the next timestep with an MSE of 0.00008 and achieves 94% accuracy forty timesteps into the future, outperforming the reported LSTM and GAT results. section 6.4.3

Figure 6.14 Pipeline for the NRI model
figure

Use the NRI pipeline diagram to follow encoding, relational decoding, trajectory prediction, and pose-loss computation as one process. section 6.4.3

How Graph Neural Networks in Action covers it

How deep it goes
Builds pose prediction through encoder-decoder training, GRU rollout, reconstruction loss, KL divergence, and multi-horizon evaluation.
Examples
Uses human-pose sequences, reconstructed poses, future-horizon predictions, and an NRI pipeline as concrete artifacts.
What you can do after
Apply it via an NRI model to predict future pose trajectories and measure error across prediction horizons.
How it connects
Connects human pose with dynamic graphs, spatiotemporal GNNs, recurrent neural networks, graph attention networks, and neural relational inference.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Graph Neural Networks in Action. The section links point to the parts of the book it draws on.