liveBook · Manning

MLflow

As explained in Generative AI in Action

MLflow is an open-source platform for managing machine-learning experimentation, reproducibility, model packaging, deployment, and lifecycle operations.

MLflow is an open-source platform for managing machine-learning experimentation, reproducibility, packaging, deployment, and lifecycle operations. In LLM applications, it supports observability by centralizing tracking, model management, and deployment across providers and cloud platforms. section 11.4.7

Its production-oriented capabilities include:

  • Packaging code, registering models, and deploying models through an MLflow server. section 11.4.7
  • Supporting debugging and operational analysis alongside logs, KPIs, and request tracing. section 11.4.7

Track an LLM experiment

Configure an MLflow tracking URI, create a GenAI experiment, call a chat-completion API, and record latency, prompt tokens, conversation tokens, and completion tokens for each response.

How Generative AI in Action covers it

How deep it goes
Explains core components and demonstrates tracking configuration and metrics logging, without detailing deployment internals.
Examples
Uses Docker Compose, an MLflow dashboard, and an OpenAI chat-completion example that records prompts, responses, latency, and token counts.
What it assumes
Assumes familiarity with Python and chat-completion APIs, while requiring MLflow and Prometheus to be installed and running.
What you can do after
Operate and configure MLflow tracking for LLM requests, experiments, artifacts, and operational metrics.
How it connects
Connects experiment tracking, model registry, model deployment, logging, tracing, Prometheus, and LLM observability.

Also explained in

Compare how 3 books explain MLflow →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Generative AI in Action. The section links point to the parts of the book it draws on.