Flow of action in mixed interaction modalities

The increasing complexity of immersive virtual environments (VEs) is leading to multivariate interaction. In order to access and display the functionality of the application, developers start mixing interaction modalities by integrating two and three-dimensional input and output devices. Hence, the input structure of an application gets composite, and is difficult to organize. In order to optimize the input structure, and there from forthcoming output structure, this paper focuses at the flow of action within VEs using mixed interaction modalities. We describe the basic concepts behind flow of action in VEs. Successively, we present how these concepts have affected interaction in our software environment AVANGO, by describing aspects of a collaborative virtual engineering application. Overall, we focus on three main areas. The areas, mapping of interaction on devices, allocation of interface elements, and continuous feedback, address major problems of flow of action in VEs