A Study of Gesture-driven Interaction for Efficient Product Validation in Virtual Environment

?????? ?????????, ??????, ?????? ?????? ?????????????????? ??????????????? ???????????? ??????, ????????? ?????? ??????????????? ???????????? ?????? ???????????? ???????????? ?????? ???????????? ???????????? ????????? ????????? ?????? ??????. ????????? ?????? ?????????????????? ?????? ????????? ??????????????? ?????? HCI(Human-Computer Interaction) ???????????? ???????????? ??????. ??? ??? ???????????? ???????????? ??????????????? ???????????? ??? ??????(Hand Tracking)????????? ????????? ??????????????? ???????????? ?????? ????????? ?????????, ?????? ????????? ?????? ?????? ????????? ????????? ????????? ???????????? ????????? ??????????????? ????????? ?????? ???????????? ????????? ???????????? ????????????. ??? ??????????????? ???????????? ?????? ?????? ?????? ?????? ??? ??????????????? ?????? ?????? ????????? ??? ?????????, ???????????? ??? ????????? ?????? ??? ?????? ????????? ????????? ???????????? ????????? ????????????. ?????? ?????? ????????? ??????????????? ????????? ??? ?????? 3D CAD ????????? ???????????? ?????? ????????????, ????????? ????????? ?????? ?????? ????????? ???????????? ????????? ????????????. ??? ???????????? ????????? ???????????? ????????? ????????? ?????? ??????????????? ??????, ?????? ?????? ?????? ??????, ?????? ????????? ?????? ?????? ?????? ????????????. ????????? ?????? ????????? ????????? ????????? ?????? ???????????? ???????????? ?????? ???????????? ?????? ??????????????? ???????????? ??????. ??? ????????? ?????? ??????????????? Microsoft KINECT ??? ???????????????, HMM(Hidden Markov Model)??? ???????????? ???????????? ?????? ???????????? ???????????????.As the information technology is getting developed in the areas of vehicle, shipbuilding and construction industries, the usage of virtual reality solutions for efficient verifications of their products is getting broaden. Hence, the human-computer interaction(HCI) technologies, which are important for virtual interaction, have been raised in same order. Hand tracking is a main technique of the HCI, and enables intuitive interaction between the user and the system by tracking user's hands in real time. This tracking technique is mainly used to visualize the user's motion achieved from tracking devices such as data gloves, and used to deliver the user's intent to the system. However, the hand tracking technique has been barely used for the design verification so far. The aim of this paper is to propose a new approach of interaction method to verify design in virtual reality environment efficiently. We accomplished this by using the hands gesture tracking and recognition technologies. For this purpose, we first classified functions required for the vurtual design verification. Secondly, we defined gestures to map the pre-classified functions. Finally, we implemented a gesture-driven interaction system for product validation in virtual environment. Microsoft KINECT was used as an input device of hands for hand tracking, and we improved the recognition rate by applying HMM (Hidden Markov Model)