liveBook · Manning

Explained variance

As explained in Build AI Drug Discovery Pipelines

Explained variance is the proportion of variability in data accounted for by a representation or statistical model.

Explained variance measures how much of a dataset’s variability is retained by a representation or statistical model. In PCA, it ranks principal components by the variance they explain, helping choose a reduced dimensionality without discarding too much information. section 6.2.3

Use explained variance to select the number of principal components:

  • Retain components until they explain a chosen percentage of total variance, such as 95% or 99%. section 6.2.3
  • Compare this choice with the eigenvalue criterion or the elbow in a scree plot; the elbow is more subjective. section 6.2.3

Reducing binding-constant data

For lnKD measurements in a small-molecule RNA-binding study, selecting components that preserve 99% explained variance reduced the dataset to 32 dimensions. PC1 explained 28.77% and PC2 explained 21.70%, together retaining 50.47% of the variance. section 6.2.3

Figure 6.9 PCA defines a new coordinate system based on principal components, where the important dimensions are self-evident, and we can reduce the data dimensionality to k by retaining the first k PCs as ranked by the amount of variance they explain.

See how PCA creates a coordinate system whose dimensions are ranked by explained variance, making dimensionality reduction possible. section 6.2.3

How Build AI Drug Discovery Pipelines covers it

How deep it goes
Explains component-selection criteria and interprets retained variance, but stops short of deriving PCA mathematically.
Examples
Demonstrates 99% PVE reducing lnKD data to 32 dimensions and reports PC1 and PC2 variance contributions.
What you can do after
Evaluate PCA compression choices using retained-variance thresholds and scree-plot or eigenvalue comparisons.
How it connects
Connects explained variance with PCA, principal components, dimensionality reduction, scree plots, and eigenvalue criteria.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Build AI Drug Discovery Pipelines. The section links point to the parts of the book it draws on.