Investigating a gesture based interaction model, controlling a truck with the help of gestures.

This paper examines if a gesture based interaction model to control a heavy vehicle is a suitable mean of control. It looks at what the interaction model needs to make it reliable, trusted and usable. The methods that was used during this thesis included a literature review, prototype development and testing. To test this a prototype was developed in Unity. To handle the gesture recognition, it was paired with a Kinect 2.0, and the gesture learning was done with Visual Gesture Builder. With this we created two sets of gestures that were tested against each other. We found that a the gesture based interaction model was found intuitive, natural and seems to allow the operators to efficiently execute their tasks. However, there are two key aspects that needs to be taken in to consideration. Firstly the gesture recognition has to be at a really high standardas in having high recognition and well thought out gestures, both out of safety reason, but also to not cause frustration with the users. Secondly, the gestures themselves need to be designed in a way that will not cause fatigue, with poorly designed gestures the users would not be able to use this interaction model for a longer period of time