BUILD-IT: an intuitive design tool based on direct object manipulation

Natural interaction, in the context of this paper, means human action in a world of tangible objects and live subjects. We introduce the concept of action regulation and relate it to observable human behaviour. A tool bringing together motor and cognitive action is a promising way to assure complete task regulation. Aiming for such tools, we propose a set of guidelines for the next generation of user interfaces, the Natural User Interface (NUI). We present a NUI instantiation called BUILD-IT, featuring video-mediated interaction in a task specific context. This multi-brick interaction tool renders virtual objects tangible and allows multiple user simultaneous interaction in one common space. A few user experiences are briefly describe