liveBook · Manning

Inductive inference

As explained in Graph Neural Networks in Action

Inductive learning learns a generalizable function or representation from observed data for application to unseen data.

Inductive inference is useful when a graph may gain nodes or when a learned model must work on another graph. Instead of learning an embedding tied to each training node, a graph neural network (GNN) learns a function that maps node features to embeddings. It can apply that function to unseen nodes, including nodes in a new graph, without retraining—provided their feature spaces are similar. section 2.2.2 section 2.1.4

The practical distinction is what carries over after training:

  • A GNN uses node features and graph structure to produce embeddings. Message passing is its graph-learning mechanism. section 2.4 section 2.2.2
  • Node2Vec (N2V) learns embeddings for a fixed graph through random walks. It does not easily handle unseen nodes or a new graph without being reapplied, although inductive extensions exist. section 2.2 section 2.5

Choose the approach for the data and task, not by assuming one always wins. Inductive GNN embeddings suit changing graphs and tasks where node features matter. Structure-only, random-walk methods can perform better when labels are scarce or noisy; embeddings from either approach can also serve as features in a conventional classifier. section 2.2 section 2.5

How Graph Neural Networks in Action covers it

How deep it goes
Explains the learned feature-to-embedding mapping and contrasts it with fixed-graph embeddings, but does not give an inductive implementation.
Examples
Uses unseen nodes, new graphs, and evolving networks to contrast GNN embeddings with Node2Vec embeddings.
What you can do after
Evaluate/understand when to choose GNN embeddings over Node2Vec for changing graphs and feature-rich tasks.
How it connects
Connects graph neural networks, message passing, node features, graph embeddings, and transductive Node2Vec.

Also explained in

Compare how 3 books explain inductive inference →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Graph Neural Networks in Action. The section links point to the parts of the book it draws on.