Overview of Intel® Distribution of OpenVINO™ Toolkit

AI inference applies capabilities learned after training a neural network to yield results. The Intel® Distribution of OpenVINO™ toolkit enables you to optimize, tune, and run comprehensive AI inference using the included model optimizer and runtime and development tools.

Quick Links

Installation and Setup

Get Started

Documentation

Performance Benchmarks

System Requirements

Discover the Capabilities

High Performance, Deep Learning

Convert and optimize models to achieve high performance for deep-learning inference applications.

Streamlined Development

Facilitate a smoother development process using the included inference tools for low-precision optimization and media processing, computer vision libraries, and preoptimized kernels.

Write Once, Deploy Anywhere

Deploy your same application across combinations of host processors, accelerators, and environments, including CPUs, GPUs, VPUs, FPGAs, on-premise and on-device, and in the browser or in the cloud.

How It Works

1. BUILD

Use the Open Model Zoo to find open-source, pretrained, and preoptimized models ready for inference, or use your own deep-learning model.

Open Model Zoo

2. OPTIMIZE

Run the trained model through the Model Optimizer to convert the model to an Intermediate Representation (IR), which is represented in a pair of files (.xml and .bin). These files describe the network topology and contain the weights and biases binary data of the model.

Model Optimizer Developer Guide

3. DEPLOY

Use the Inference Engine to run inference and output results on multiple processors, accelerators, and environments with a write once, deploy anywhere efficiency.

Inference Engine Developer Guide

What You Can Do

See how developers use the Intel Distribution of OpenVINO toolkit on multiple Intel® architectures to enable new and enhanced use cases across industries, including manufacturing, health and life sciences, retail, security, and more.

At the Edge

Advantech Addresses Retail Dilemmas with Intel® Vision Products

On a Laptop

Enhance AI Performance with Adobe Sensei* On-Device SDK

In the Cloud

NimbleBox’s Intel Optimizations Speed Up In-Cloud Inferencing Performance

2021.3

What's New in the 2021.3 Release

  • Introduces Conditional Compilation, which enables a significant reduction to the binary footprint of the runtime components for particular models (available only as open source).
  • Introduces support for the 3rd generation Intel® Xeon® Scalable platform (code-named Ice Lake), which delivers advanced performance, security, efficiency, and built-in AI acceleration to handle unique workloads and more powerful AI​
  • Adds new pretrained models and support for public models to streamline development.
    • Public models include aclnet-int8 (sound_classification), deblurgan-v2 (image_processing), fastseg-small and fastseg-large (semantic segmentation) and more.​
  • Developer tools are now available as Python wheel packages using pip install openvino-dev for Windows, macOS, and Linux for more efficient package installation, upgrade, and management.

Release Notes

Choose & Download

System Requirements

2020.3.2 LTS

What's New in the 2020.3.2 LTS Release

Long-Term Support (LTS) is a new annual release type that provides longer-term maintenance and support with a focus on stability and compatibility. This release type allows you to deploy applications powered by the Intel Distribution of OpenVINO toolkit with more confidence. To get the latest features and leading performance, standard releases will continue to be made available three to four times a year.

  • Provides bug fixes for the previous 2020.3.1 LTS release. Read more about the support details.
  • Includes security and functionality bug fixes, and minor capability changes.
  • Includes bug fixes for the Inference Engine MYRIAD, HDDL and FPGA plugins, and the Deep Learning Workbench.

Note Intel Distribution of OpenVINO toolkit 2020.3.X LTS releases will continue to support Intel® Vision Accelerator Design with an Intel® Arria® 10 FPGA and the Intel® Programmable Acceleration Card with Intel® Arria® 10 GX FPGA.

Release Notes

Choose & Download

LTS Documentation

Community and Support

Explore different ways to get involved and stay up-to-date with the latest announcements.

Get Help

Ask on the Community Forum

Contact Intel Support

File an Issue on GitHub*

Get Answers on StackOverflow*

 

Stay Informed

Read the Documentation

Read the Knowledge Base

Learning

Training and Certifications

Downloadable Resources

Webinars

Ready to Get Started?

Choose & Download

Awarded by the Embedded Vision Alliance*

Powered by oneAPI

The productive, smart path to freedom for accelerated computing from the economic and technical burdens of proprietary alternatives.

Give Feedback

Product and Performance Information

1

Performance varies by use, configuration and other factors. Learn more at www.Intel.com/PerformanceIndex.