liveBook · Manning

Tracking server

As explained in Machine Learning Platform Engineering

A tracking server is a service that centrally records and provides access to machine learning experiment parameters, metrics, data references, and artifacts.

A tracking server gives ML experiments a shared record. Instead of relying on periodically committed parameter files and instructions for reproducing a notebook, teams can collect hyperparameters, data references, metrics, and artifacts under named experiments. Runs provide individual records that can be compared or revisited later. section 4.1 section 4.1.2

A local MLflow workflow has three parts:

  • Start the server outside the notebook with `mlflow ui`; the local UI listens on port 5000. section 4.1.2
  • Set the tracking URI and experiment name once in the notebook, then use `mlflow.start_run()` around work you want to record. section 4.1.2
  • Log outputs to the run. For example, `mlflow.log_artifacts("categorical_variable_plots")` attaches saved exploratory plots; the run page then exposes artifacts alongside parameters and metrics. section 4.1.2
mlflow.set_tracking_uri("http://localhost:5000")
mlflow.set_experiment("income-classifier")

Use this notebook configuration to point MLflow at the local server and group subsequent runs under the `income-classifier` experiment. section 4.1.2

In training code, the same tracking approach can record input hyperparameters, train/test losses, model summaries, model signatures, and models. A run ID can also identify a model to load for validation or a warm restart. Artifact routing needs a deliberate choice: proxied access lets training code communicate only with the server, but large uploads can bottleneck there; direct storage access can perform better when training nodes have the necessary credentials. section 9.3.4

How Machine Learning Platform Engineering covers it

How deep it goes
Shows local setup, run logging, model reuse, and artifact-routing trade-offs without detailing server implementation.
Examples
Uses income-classifier plot runs and training code that logs losses, model summaries, signatures, and models.
What it assumes
Assumes familiarity with ML experiments and notebook workflows while showing the local MLflow setup from installation onward.
What you can do after
Operate/configure it with MLflow to inspect runs and choose between proxied uploads and direct artifact-storage access.
How it connects
Links experiment tracking to Jupyter Notebook, model validation, artifact storage, and model registry workflows.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machine Learning Platform Engineering. The section links point to the parts of the book it draws on.