Real-Time Gesture Based Human Computer Interaction for Office Applications

Abstract—The project proposes a method to control the movement of a mouse pointer using simple hand gestures and a webcam is proposed. A real-time tracking algorithm is implemented based on adaptive skin detection and motion analysis. Using the history of motion, the trajectory of the movement of the hand is drawn and then used to identify a gesture. A region of interest algorithm is proposed, in order to scale the motion when the user is located far away from the point of capture. The motion of the mouse pointer is scaled accordingly. Demonstrations using our prototype clearly illustrate the benefits of our system. We first created an Image Database consisting of four different hand gesture images. Before populating the database for an images of various gesture categories in Hand Gesture Recognition system, each image was first processed i.e., the images were converted to 8-bit grayscale images and filtering was performed to minimize any noise present in the images. The method mentioned above were applied on the input test images captured form the sensor device of the system to find the suitable match form the data base. The methods used were successful to retrieve the correct matches. The results based on speed and accuracy was analyzed