A More Flexible Approach to Utilizing Depth Cameras for Hand & Touch Interaction

Many researchers have utilized depth cameras for tracking user\u27s hands to implement various interaction methods, such as touch-sensitive displays and gestural input. With the recent introduction of Microsoft\u27s low-cost Kinect sensor, there is increased interest in this strategy. However, a review of the existing literature on these systems suggests that the majority suffer from similar limitations due to the image processing methods used to extract, segment, and relate the user\u27s body to the environment/display. This paper presents a simple, efficient method for extracting interactions from depth images that is more flexible in terms of sensor placement, display orientation, and dependency on surface reflectivity