liveBook · Manning

Rotation matrix

As explained in Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI

A rotation matrix is a square orthogonal matrix that preserves vector lengths and angles under transformation.

A rotation matrix is a square matrix that rotates input-feature vectors while preserving their lengths and the angles between them. Because the transformation is perfectly reversible, rotated data remains equivalent to the original data. section 5.2.3

In machine learning, random rotations can:

  • Transform dataset features before model training. section 5.2.3
  • Increase ensemble diversity and improve robustness. section 5.2.3
  • Expose differences between model families: deep architectures can learn the applied rotation, while gradient-boosted decision trees depend on feature-aligned splitting rules. section 5.2.3

Rotating tabular features

Apply a random rotation matrix to tabular input features before training. The transformation preserves geometric relationships, but may obscure predictor–target relationships for tree-based algorithms. Deep architectures are less affected because they can learn rotated signals. section 5.2.3

How Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI covers it

How deep it goes
Defines preservation and reversibility, then explains model consequences without deriving matrix construction.
Examples
Uses rotated tabular features to compare deep architectures with gradient-boosted decision trees.
What you can do after
Evaluate model behavior by applying reversible rotations and interpreting their effects on tree-based and deep models.
How it connects
Connects random rotations with deep learning, gradient-boosted decision trees, principal component analysis, and singular value decomposition.

Also explained in

Compare how 2 books explain rotation matrix →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI. The section links point to the parts of the book it draws on.