liveBook · Manning

ONNX Runtime

As explained in Fight Fraud with Machine Learning

ONNX Runtime is an open-source cross-platform inference engine for executing and optimizing machine-learning models represented in the Open Neural Network Exchange format.

ONNX Runtime is an inference optimization framework for deep-learning models represented in ONNX, helping improve execution performance on available hardware. section 4.2.2

ONNX provides an intermediate model format for moving trained models between frameworks such as PyTorch, TensorFlow, and MXNet. ONNX Runtime then supports optimized inference without requiring the model to remain tied to its original training framework. section 4.2.2

Cross-framework deployment

A model trained with PyTorch can be converted to ONNX, transferred through the ONNX representation, and used for inference with another framework or an optimized runtime. OpenVINO provides a comparable inference-optimization path. section 4.2.2

Figure 4.11 ONNX as an intermediate representation to convert trained deep learning models from one framework (left) to another (right).

Diagram the role of ONNX as an intermediate representation between deep-learning frameworks. section 4.2.2

How Fight Fraud with Machine Learning covers it

How deep it goes
Defines its optimization role and cross-framework context but stops short of implementation commands or runtime configuration.
Examples
Uses a PyTorch-to-ONNX conversion pipeline and compares ONNX Runtime with OpenVINO.
What it assumes
Assumes familiarity with trained deep-learning models and frameworks while introducing ONNX-based interoperability.
What you can do after
Apply it via ONNX Runtime to optimize inference for converted deep-learning models.
How it connects
Connects ONNX with PyTorch, TensorFlow, MXNet, and OpenVINO.

Also explained in

Compare how 5 books explain ONNX Runtime →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Fight Fraud with Machine Learning. The section links point to the parts of the book it draws on.