The Intel® RealSense™ SDK has been discontinued. No ongoing support or updates will be available.
The Intel® RealSense™ SDK Gold R2 (v4.0) release is now available! This brief overview walks you through product improvements from Gold R1 (v3.1) and some of the new natural interaction modalities that can be used to create compelling applications using the Intel RealSense SDK.
Two major changes in the Gold R2 release demand attention.
First, the SDK now comes with improved and additional capabilities for the front facing Intel® Realsense™ camera (F200). Details on these capabilities are listed in subsequent sections. Additionally, this version of the SDK also includes APIs for the rear facing camera (R200). Developers can read the API documentation to understand the capabilities specific to each model of the camera. Most of the capabilities listed in the article focusses on F200 camera. Features specific to R200 are explicitly called out.
DCM packaging has changed. Essentially, the camera driver is called the Depth Camera Manager. In R1, the DCM was a part of the SDK install package. From the R2 SDK forward, the DCM will only be available as a separate download. Note: Uninstalling Gold R1 SDK will also uninstall the DCM, requiring that you separately install DCM 1.2 after the R2 SDK installation. End users with an integrated camera OEM device will notice that the DCM is already installed on the system. In case you need to update the DCM, please use the DCM install link below for updates.
DCM version required for F200: 220.127.116.1122
DCM version required for R200: 18.104.22.168980
The long awaited 3D scanning feature is available for preview with the Gold R2 SDK. The module generates 3D mesh data from the camera images. With this feature, you can now perform static object capture, optional object on planar surface detection/trimming and optional hole filling and solidification. The module works in targeting and scanning modes and allows for standard OBJ, PLY and STL output formats.
In addition to identifying up to 4 faces, you can now track subtle changes in face skin color over time and estimate the person’s pulse rate. These functions are included as a part of the face detection modality. For more information, refer to the PulseConfiguration interface, QueryPulse and PulseData functions.
For improved performance, where joint level data is not essential, blob tracking is a good alternative. It allows tracking anything in front of the camera, supports up to 4 blobs, without hand classification and supports different access orders. Note, however, that this feature is in preview mode.
The Gold R2 SDK comes with some utilities that help improve the robustness and performance of your application.
The APIs required to program for the R200 camera is introduced for the first time in the Gold R2 SDK. Some of the key features are highlighted in the table below. Please note that the feature maturity varies between available capabilities. Developers are instructed to read the SDK documentation for a detailed list of APIs supporting each of the below modalities.
|Gold||Speech Recognition and Synthesis|
|Alpha||SDK essential interfaces and color/depth/IR data streaming.
The hand tracking module has been enhanced for performance in Gold R2 together with the inclusion of several new capabilities.
The Unity web player works through a web server and allows for the use of any C# function except those marked not supported (For example, File I/O).
The Intel RealSense SDK architecture allows for all of the SDK capabilities to be uniformly accessible from Java/Processing as with any other C++ or C# interfaces. However, Java/Processing support in the Intel RealSense SDK R2 release is still in preview and capabilities are currently limited. Please watch future releases for enhanced support.
The touchless controller, which provides the ability to control Windows UI functions with hand gestures now provides more gestures, improved recognition and performance, and methods to control point and scroll sensitivity. Additional capabilities include mapping user behavior to UI events, scrolling, zooming, navigating to the start menu, backing up and edge scrolling. For more information, refer to the PXC[M]TouchlessController function.
Some of the utilities that were available in Gold R1 are now deprecated in R2. These include:
To ensure that applications run on end-user systems without any problems, package the application with the runtime specific to the SDK version used for development.
Intel® RealSense™ Gold R2 SDK provides significant feature and performance improvements compared to Gold R1 SDK. Developers are encouraged to move to the Gold R2 SDK to take advantage of the improved and new capabilities to develop robust natural interactive applications.
Intel's compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reserved for Intel microprocessors. Please refer to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice.
Notice revision #20110804