liveBook · Manning

Hyperbolic space

As explained in Knowledge Graphs and LLMs in Action

Hyperbolic space is a negatively curved geometric space whose available volume grows exponentially with distance from a center.

Hyperbolic space is a negatively curved embedding space whose available volume grows exponentially with distance from a center, unlike Euclidean space, where growth is polynomial. section 11.1.1

Coordinates still represent vectors, but distances expand as points approach the boundary, so hyperbolic similarities require specialized distance formulas. section 11.1.1

Hyperbolic embeddings are especially useful when graph structure is hierarchical:

  • Corporate organizations, biological taxonomies, and internet network topologies can map more faithfully than in Euclidean space. section 11.1.1
  • The expanding geometry accommodates branching structures whose available relationships increase rapidly across levels. section 11.1.1

Choosing an embedding geometry

Use Euclidean embeddings when relationships are relatively uniform; consider hyperbolic embeddings when a graph contains strong hierarchy and branching. section 11.1.1

Figure 11.1 The node embedding problem. The goal of the task is to learn an encoding function, encode(x), that maps nodes to a multidimensional embedding space. These embeddings are optimized so that distances in the embedding space reflect relevant aspects of the original graph, such as the relative positions of the nodes.
figure

Relate the geometry to node embedding: an encoding function maps graph nodes into a space where distances preserve relevant graph structure. section 11.1.1

How Knowledge Graphs and LLMs in Action covers it

How deep it goes
Defines exponential growth and boundary-sensitive distances, but stops short of deriving specialized distance formulas.
Examples
Uses corporate organizations, biological taxonomies, internet topologies, branching trees, and node embedding.
What you can do after
Evaluate whether hyperbolic geometry better preserves a graph’s hierarchical structure than Euclidean geometry.
How it connects
Connects hyperbolic space to Euclidean space, graph embeddings, and hierarchical graph structures.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Knowledge Graphs and LLMs in Action. The section links point to the parts of the book it draws on.