liveBook · Manning

Classification report

As explained in Data-Driven Cybersecurity

A classification report is a summary of evaluation metrics for the predicted classes of a classification model.

A classification report summarizes how well a classification model predicts each class. It combines precision, recall, F1-score, and accuracy so performance can be judged beyond a single headline number. section 12.4.1 section 12.5.1

Read each measure as a different operational question:

  • Precision asks how many articles or alerts labeled as a class were correct. section 12.4.1
  • Recall asks how many actual high-risk articles or threats the model identified. section 12.4.1 section 12.5.1
  • F1-score balances precision and recall, which is particularly useful when classes are imbalanced. section 12.4.1
  • Accuracy reports the percentage of all predictions that were correct, but it can conceal weak performance for an important class. section 12.4.1 section 12.5.1

Interpreting a cybersecurity report

A threat classifier can show 63% accuracy while achieving zero recall for threats. That result may look acceptable overall but means the model missed every threat in the reported test output. Compare class-level metrics and inspect the confusion matrix before trusting the model for alerting or response decisions. section 12.5.1

How Data-Driven Cybersecurity covers it

How deep it goes
Explains four metrics and pairs them with confusion matrices, but does not derive formulas or optimize decision thresholds.
Examples
Uses high- and low-risk cybersecurity articles and synthetic network traffic, with tabular reports and confusion-matrix visualizations.
What it assumes
Assumes familiarity with classification outputs but defines each evaluation metric through cybersecurity examples.
What you can do after
Evaluate model behavior by comparing class metrics and locating false positives or missed threats in a confusion matrix.
How it connects
Connects precision, recall, F1-score, accuracy, confusion matrices, logistic regression, TF-IDF, and neural networks.

Also explained in

Compare how 2 books explain classification report →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Data-Driven Cybersecurity. The section links point to the parts of the book it draws on.