Archived - Tips and Tricks for Intel® RealSense™ Background Segmentation

Published: 05/15/2015, Last Updated: 05/15/2015

The Intel® RealSense™ SDK has been discontinued. No ongoing support or updates will be available.

The 5.0 release of the Intel® RealSense™ SDK includes improved hair and finger and hand segmentation. I also has lessened the module's power consumption and  provided more usage cues, including user is too close, too far, or had an entry event. It also adds optional callback support.

However, there are still some "known issues" and tips for getting better results:

  • Don't turn on any other module while using 3D Background Segmentation.
  • Long dark hair segments better with a plain background of a different color.  
  • Black objects segment better when placing the camera's "eye level" at the user’s head.
  • Avoid glossy or IR absorbing materials (glasses, watches, headphones, hats/scarves) as they degrade mask quality.
  • Don't touch the background. Similarly don't have hand against face or head (or another object). Separate the targets, so they're distinct. (This can also happen at "very close" to touching.)
  • Keep user in FOV. If user touches target objects and then leaves FOV, it's best to break continuity by covering the camera or moving the objects. Also try to center the user (especially away from right edge). May also need to change resolution..
  • Focus on one person at a time. Mask quality degrades when multiple people are in range.
  • Targets should be thicker than 2mm. Thin objects (1-2 mm) are not segmented correctly


Product and Performance Information


Intel's compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reserved for Intel microprocessors. Please refer to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice.

Notice revision #20110804