The application uses the depth maps from the Creative camera together with a customized color printout placed in front of the camera to determine touch locations relative to the printout. Users can interact with the current version of the application by printing out colorful keyboards such as an emoticon set, drum and piano set, and a regular but small keyboard. The idea is to enable a novel user interface that uses the nearby worksurface (table) and also the volume in front of the camera as the interaction space.
Tools and Technology
- DepthSense 325 v1
- Paint - in order to create the keyboards images
- Matlab - to develop and check the accuracy of our algorithms
- Visual Studio.