liveBook · Manning

Matthews correlation coefficient

As explained in Build AI Drug Discovery Pipelines

The Matthews correlation coefficient is a binary-classification metric computed from all four entries of the confusion matrix and ranging from -1 to +1.

The Matthews correlation coefficient (MCC) evaluates binary classifiers using all four confusion-matrix entries: true positives, true negatives, false positives, and false negatives. It is especially useful when class frequencies are uneven. section 3.4.4

Interpret MCC through its range and compare it against relevant baselines:

  • +1 indicates perfect classification, 0 represents random classification, and −1 indicates complete disagreement between predictions and actual classes. section 3.4.4
  • Compute MCC on a held-out test set and compare it with baseline or published models rather than treating the score in isolation. section 3.4.4

hERG blocker prediction

A model evaluated on the hERG blockers test set achieved an MCC of 0.452, compared with 0.576 for a published model using more complex feature generation and modeling. section 3.4.4

How Build AI Drug Discovery Pipelines covers it

How deep it goes
Defines the confusion-matrix formula and score range, then demonstrates test-set comparison without detailing statistical testing.
Examples
Uses hERG blocker prediction, a test-set MCC of 0.452, and a published comparison score of 0.576.
What it assumes
Assumes binary classification and confusion-matrix terminology, including true and false positive and negative counts.
What you can do after
Evaluate binary classifiers on imbalanced test sets and compare their performance with baselines or published methods.
How it connects
Connects binary classification with confusion matrices, class imbalance, model baselines, and held-out test sets.

Also explained in

Compare how 2 books explain matthews correlation coefficient →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Build AI Drug Discovery Pipelines. The section links point to the parts of the book it draws on.