liveBook · Manning

Machine learning system

As explained in Machine Learning Platform Engineering

A software system that incorporates machine learning models and the data, computation, and operational components required to deliver their outputs.

A machine learning system combines models with data, computation, pipelines, and operational services to deliver reliable outputs in production. It spans the ML life cycle from problem formulation and experimentation through deployment, monitoring, and maintenance. section 1.0 section 1.4

Production ML systems must coordinate:

  • Reproducible data preparation, training, validation, and pipeline execution. section 8.0
  • Inference patterns such as batch prediction and real-time serving. section 10.1
  • Scalability, resource management, hardware requirements, and model versioning. section 10.1
  • Performance monitoring, drift detection, retraining, explainability, security, and privacy. section 10.1

Two production paths

An image-based ID card detection system exercises object-detection training, validation, tracking, and pipeline integration. A movie recommendation system applies the same production patterns to tabular data and recommendation workflows. section 1.4 section 8.0

Figure 1.3 MLOps is a mix of different skill sets.
A diagram of software engineering

AI-generated content may be incorrect.

Use the skill-set map to relate software engineering, data science, and MLOps capabilities within an ML system. section 1.2

Figure 8.1 The mental map where we’re now focusing on the fourth and fifth step/component of our pipeline—model training (4) and evaluation (5)
A screenshot of a computer

AI-generated content may be incorrect.

Use the pipeline map to locate model training and evaluation among the components of a production ML workflow. section 8.0

How Machine Learning Platform Engineering covers it

How deep it goes
Connects platforms, pipelines, training, validation, serving, and monitoring while deferring implementation details to specialized workflows.
Examples
Uses an ID card detection system, YOLO object detection, and a movie recommendation system to illustrate varied production workflows.
What it assumes
Learn Kubernetes basics and MLOps tooling incrementally rather than assuming broad expertise across software engineering and data science.
What you can do after
Build it from scratch by assembling an ML platform, reproducible pipelines, validated models, serving infrastructure, and monitoring.
How it connects
Links MLOps, ML platforms, data preparation, model training, validation, model serving, monitoring, and continuous learning.

Also explained in

Compare how 4 books explain machine learning system →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machine Learning Platform Engineering. The section links point to the parts of the book it draws on.