Kubeflow
Kubeflow is an open-source platform for developing, deploying, and managing machine-learning workflows on Kubernetes.
Machine Learning Platform Engineering
Kubeflow Pipelines is a Kubeflow component and software development kit for defining, executing, and orchestrating machine-learning pipelines.
- How it is used
- Uses Kubeflow as a Kubernetes ML platform and Kubeflow Pipelines to automate reusable ML workflows.
- How deep it goes
- Builds components, connects their artifacts and dependencies, compiles pipeline YAML, and runs workflows; also addresses notebook configuration and drift gating.
- Examples
- Uses a batch income-classifier pipeline and an object-detection data-preparation pipeline with dataset downloading and splitting.
- What you can do after
- Build it from scratch as a Kubeflow pipeline of reusable components, then compile, run, inspect, and extend it.
Read how Machine Learning Platform Engineering explains Kubeflow →
Distributed Machine Learning Patterns
An open-source platform for deploying and orchestrating portable, scalable machine learning workflows on Kubernetes.
- How it is used
- Submits and manages distributed machine-learning training jobs on Kubernetes as part of an automated workflow.
- How deep it goes
- Defines core terminology and provides hands-on job submission, while deferring complete implementation details to an end-to-end project.
- Examples
- Uses MNIST and Fashion-MNIST examples, Kubernetes clusters, TensorFlow training logic, and Argo Workflows pipelines.
- What you can do after
- Operate distributed TensorFlow training jobs on Kubernetes and connect them to machine-learning workflows.
Read how Distributed Machine Learning Patterns explains Kubeflow →
Also covered in
What to know first
- language modelA language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- recommender systemA recommender system is a computational system that predicts, selects, or ranks items, content, or actions for users based on available information.
- YAMLYAML is a human-readable data serialization standard for representing structured data, commonly using indentation to express mappings and sequences.
Related concepts
- ML Metadatauses · An open-source library for recording, storing, and querying metadata about machine learning workflows and their artifacts.
- Kubeflow training operatorhas part · The Kubeflow Training Operator is a Kubernetes operator that manages distributed and nondistributed machine learning training jobs through custom resources.
- Kubernetesuses · Kubernetes is an open-source platform for orchestrating containerized workloads and automating their deployment, scaling, and management.
- automationuses · Automation is the execution of tasks or processes by machines or software with reduced direct human intervention.
- directed acyclic graphuses · A directed acyclic graph is a graph whose edges have directions and contain no directed cycles.
- distributed traininguses · Distributed training is the coordinated execution of machine-learning model training across multiple computing devices, processes, or machines.
Questions about Kubeflow
What is Kubeflow?
Kubeflow is an open-source platform for developing, deploying, and managing machine-learning workflows on Kubernetes.
Which Manning books explain Kubeflow?
Machine Learning Platform Engineering and Distributed Machine Learning Patterns.
What should I know before learning Kubeflow?
Manning books that teach Kubeflow usually introduce language model, recommender system and YAML first.
What are the parts of Kubeflow?
Kubeflow includes Kubeflow training operator.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

