liveBook · Manning

Nonmetric multidimensional scaling

As explained in Data Without Labels

Nonmetric multidimensional scaling is a dimensionality-reduction method that represents ranked dissimilarities in a lower-dimensional space while preserving their order.

Nonmetric multidimensional scaling reduces multidimensional data to fewer dimensions while preserving the ranked order of pairwise dissimilarities. It suits cases where distances come from subjective assessments or experiments and absolute values are not reliable. section 6.2.2 section 6.2

A practical interpretation follows this sequence:

  • Calculate the pairwise distances or dissimilarities between observations. section 6.2.2
  • Replace questionable absolute distances with their relative ranks. section 6.2.2
  • Search for a lower-dimensional representation by optimizing a loss or cost function. section 6.2.2
  • Inspect stress as a goodness-of-fit measure: 0.050 is described as good, 0.025 as excellent, and 0.000 as perfect. section 6.2.2

Ranking distances among four points

For points A, B, C, and D, the distances A–D, A–B, A–C, B–D, B–C, and C–D receive ranks 2, 3, 4, 5, 6, and 1 respectively. Nonmetric MDS uses this ordering instead of treating 95, 100, 105, 150, 205, and 55 as directly comparable magnitudes. section 6.2.2

Table 6.1 The respective distance between four points and the ranks of the distances
Pair of points
Distance
Ranks of the respective distances
A and B
100
3
A and C
105
4
A and D
95
2
B and C
205
6
B and D
150
5
C and D
55
1

Use the distance-and-rank table to inspect how nonmetric MDS converts pairwise measurements into an ordering. section 6.2.2

How Data Without Labels covers it

How deep it goes
Defines ranked-distance handling and optimization, then interprets stress and dimensionality selection without detailing implementation code.
Examples
Uses four labeled points, a distance-ranking table, stress thresholds, and a scree plot for choosing dimensions.
What it assumes
Assumes familiarity with pairwise distance and multidimensional data while explaining rank-based dissimilarities from the ground up.
What you can do after
Evaluate lower-dimensional representations using ranked distances, stress values, and an elbow in a scree plot.
How it connects
Connects ranked dissimilarities to multidimensional scaling, classical MDS, metric MDS, Euclidean distance, cost functions, and gradient descent.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Data Without Labels. The section links point to the parts of the book it draws on.