J.-B.d.l.: Toucheo: multitouch and stereo combined in a seamless workspace

We propose a new system that efficiently combines direct multitouch interaction with co-located 3D stereoscopic vi-sualization. In our approach, users benefit from well-known 2D metaphors and widgets displayed on a monoscopic touch-screen, while visualizing occlusion-free 3D objects floating above the surface at an optically correct distance. Techni-cally, a horizontal semi-transparent mirror is used to reflect 3D images produced by a stereoscopic screen, while the user’s hand as well as a multitouch screen located below this mir-ror remain visible. By registering the 3D virtual space and the physical space, we produce a rich and unified workspace where users benefit simultaneously from the advantages of both direct and indirect interaction, and from 2D and 3D vi-sualizations. A pilot usability study shows that this combina-tion of technology provides a good user experience. ACM Classification: H5.1 [Information interfaces and pre-sentation]: Multimedia Information Systems.- Artificial, augmented, and virtual realities. H5.2 [Information inter-faces and presentation]: User Interfaces.- Input devices and strategies