liveBook · Manning

Directed acyclic graph

As explained in Machine Learning System Design

A directed acyclic graph is a directed graph whose edges have no cycle, so its nodes can be arranged in an evaluation order.

A directed acyclic graph (DAG) models an ordered pipeline: each step receives input, performs an action, and passes its output to a later step without forming a cycle. section 10.1.1

In machine learning, a training pipeline is a higher-level DAG that turns a full dataset and optional metadata into a trained model. An inference pipeline is a lower-level DAG that turns raw data into predictions. section 10.1.1

A machine-learning pipeline

A typical image-classification DAG can connect image reading, normalization, resizing, and model execution. A training DAG commonly connects data fetching, preprocessing, and model training. section 10.1.1

Figure 10.1 A DAG scheme representing a training pipeline
figure

Use the DAG figure to visualize how training steps connect from data inputs to a trained model. section 10.1.1

How Machine Learning System Design covers it

How deep it goes
Defines DAGs through pipeline inputs, actions, and outputs, then distinguishes training from inference without detailing graph algorithms.
Examples
Uses image reading, normalization, resizing, model execution, data fetching, preprocessing, and model training as pipeline steps.
What it assumes
Assumes ordered steps with inputs and outputs, then clarifies how those steps form machine-learning pipeline abstractions.
What you can do after
Evaluate machine-learning workflows by distinguishing higher-level training DAGs from lower-level inference DAGs.
How it connects
Connects DAGs with machine-learning pipelines, preprocessing, feature engineering, model training, and predictions.

Also explained in

Compare how 15 books explain directed acyclic graph →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machine Learning System Design. The section links point to the parts of the book it draws on.