ONNX Runtime

Cross-platform inference and training accelerator

Language: C++/PythonCategory: AI/MLFirst released: 2018Created by: MicrosoftLicense: MIT

ONNX Runtime is a cross-platform, high-performance scoring engine for Open Neural Network Exchange (ONNX) models. It enables efficient inference and training across cloud, edge, and on-device environments with hardware-specific optimizations. ONNX Runtime supports models from PyTorch, TensorFlow, scikit-learn, and other frameworks, allowing developers to train anywhere and deploy everywhere with consistent performance and minimal latency.

Links

Key Features

Cross-Platform InferenceHardware AccelerationONNX Model SupportQuantizationTraining SupportExecution Providers