What is Intel® Deep Learning Boost (Intel® DL Boost)?
The second generation of Intel® Xeon® Scalable processors introduced a collection of features for deep learning, packaged together as Intel® Deep Learning Boost. These features include Vector Neural Network Instructions (VNNI), which increases throughput for inference applications with support for INT8 convolutions by combining multiple machine instructions from previous generations into one machine instruction.
Frameworks and Tools
These frameworks and tools include support for Intel DL Boost on second generation Intel® Xeon® Scalable processors.
Find out what you need to know before investing in quantization.
Get an explanation of the model quantization steps using the Intel® Distribution of OpenVINO™ toolkit.