Case Study: Tencent Optimizes an Illegal Image Filtering System

Submitted: June 27, 2016 Last updated: June 27, 2016
  • File:
    tencent-case-study.pdf
  • Size:
    1.04 MB
Download

Detailed Description

Tencent, China's largest and most used Internet service portal, was able to double the speed of its illegal image filter system using the SIMD instruction set and Intel® Integrated Performance Primitives (Intel® IPP).

For a large Internet service provider like Tencent, being able to detect illegal images is key. Every year, the volume of newly generated images reach about 100 petabytes―even after image compression. Some users may try to upload illegal images (e.g., porn). They certainly don’t tell the system that the image is illegal, so the system runs a check on each image to try to block them. This is a huge computing workload, with billions of images uploaded each day.

Intel helped Tencent optimize the top three hotspot functions of its illegal image filter system. By manually implementing the fingerprint generation with SIMD instructions, and replacing the filter2D function with a call into the Intel IPP library, Tencent was able to speed up both hotspots by more than 10x. As a result, the entire illegal image filter system has more than doubled its speed. This will help Tencent double the capability of its systems. The latency reduction also improves the user experience for customers sharing and sending images.

1

Product and Performance Information

1

Intel's compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reserverd for Intel microprocessors. Please refer to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice.

Notice revision #20110804