liveBook · Manning

Average silhouette

As explained in Statistics Slam Dunk

The silhouette method evaluates candidate clusterings by comparing each observation's cohesion within its cluster with its separation from other clusters, often using the average silhouette value to select a cluster count.

Average silhouette evaluates candidate cluster counts by comparing each observation’s cohesion within its cluster with its separation from the nearest alternative cluster. Each silhouette coefficient ranges from −1 to +1: positive values indicate better-separated assignments, while low values suggest that K may be too low or too high. section 11.5.2

Unlike the elbow method, which depends on identifying a bend in a scree plot, the silhouette method provides a more precise choice of K. Plot the candidate cluster counts against their silhouette coefficients and select the count with the strongest result. section 11.5.2 section 20.1

Choosing clusters for NBA teams

For standardized team payroll and regular-season wins from 2000–2017, factoextra’s fviz_nbclust() compares cluster counts using the silhouette method. The silhouette result returned two clusters, while the within-cluster sum of squares method returned six; the analysis ultimately used four clusters as a compromise. section 11.5.2 section 20.1

options(scipen = 000)
p3 <- fviz_nbclust(final_kmeans, kmeans, method = "wss") 
p4 <- fviz_nbclust(final_kmeans, kmeans, method = "silhouette")

Use the R listing to generate the within-cluster sum of squares and silhouette diagnostics with fviz_nbclust(). section 11.5.2

How Statistics Slam Dunk covers it

How deep it goes
Defines coefficient calculation and interpretation, demonstrates plotting, and stops short of deriving the method beyond its dissimilarity formula.
Examples
Uses NBA payrolls and regular-season wins, fviz_nbclust() plots, and competing results of two, four, and six clusters.
What it assumes
Assumes K-means clustering, continuous variables, and candidate K values; reinforces standardization and cluster-count comparison.
What you can do after
Apply it via factoextra’s fviz_nbclust() to visualize silhouette scores and choose a candidate cluster count.
How it connects
Connects K-means clustering, cluster count selection, within-cluster sum of squares, standardization, and factoextra visualization.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Statistics Slam Dunk. The section links point to the parts of the book it draws on.