liveBook · Manning

Monitoring

As explained in Starting Data Analytics with Generative AI and Python

Monitoring is the ongoing collection and analysis of system measurements to track behavior and detect changes or problems.

Monitoring collects and analyzes measurements over time to understand system behavior, compare results with requirements, and detect changes or problems. Good monitoring starts by defining what “good” means for the situation: latency may matter most for patient monitoring, while concurrent linked processes may matter most in a chemical plant. section 7.1

Use monitoring as a practical feedback loop:

  • Define relevant targets and requirements before judging performance. section 7.1
  • Collect measurements such as execution time, memory allocation, response speed, accuracy, and relevance. section 7.1 section 8.2.2
  • Compare the current system with earlier versions or expected behavior after changes. section 7.1
  • Review results regularly, investigate misleading or incorrect outputs, and intervene before small issues become larger failures. section 8.2.2
  • Record use cases, data sources, preprocessing, reviews, and performance findings so monitoring supports accountability rather than box-ticking. section 8.2.2

From infrastructure change to useful signals

After a cloud migration makes processing dramatically slower, profiling can reveal which functions or algorithms consume the most time or memory. Stress testing then examines behavior near or beyond expected loads. For an AI model, monitoring also checks whether responses remain accurate and relevant, not merely fast. section 7.1 section 8.2.2

How Starting Data Analytics with Generative AI and Python covers it

How deep it goes
Explains requirements, metrics, profiling, stress testing, comparison, and review, but does not specify implementation tools or detailed procedures.
Examples
Uses cloud migration, observatory, hospital, chemical-plant, and AI-employee analogies to show why monitoring priorities differ.
What it assumes
Assumes defined system requirements and teaches how to select measurements and review results against those requirements.
What you can do after
Diagnose performance bottlenecks, compare system changes, and identify misleading, biased, or incorrect AI outputs for correction.
How it connects
Connects performance measurement with profiling, stress testing, transparency, accountability, auditing, error detection, and bias identification.

Also explained in

Compare how 40 books explain monitoring →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Starting Data Analytics with Generative AI and Python. The section links point to the parts of the book it draws on.