Experience Programming: an exploration of hybrid tangible-virtual block based programming interaction

In less than a century, programming languages have assumed many forms in adapting to system’s needs and capacities, of which our cognitive systems are a part. One variation, tailored specifically for the cognitive processes in children’s education of computational concepts, and nowadays successful among novice adult learners too, is that of visual block based programming. From the pool of available block based programming environments, Scratch is the most popular for users, and therefore becomes a good topic for researchers interested in contemporary educational discussions, including that of coding as a curricular activity in schools. Although inspired by the educational philosophy of using abstract physical blocks in foundational learning, the mainly visual interface of Scratch is made for keyboard and mouse mediated interaction with the digital content on-screen, producing audio-visual feedback. This research is a case study of Scratch, where the shortcomings found in interactions with its environment motivate the investigation of a potential hybrid technology – tangible and visual – for enhanced learning of foundational concepts in block based programming. The investigation is characterized by progressive cycles of conceptual design, supported by prototyping and testing. The results from its design process present the benefits and challenges of this hybrid concept to inform and inspire the development of new technologies for learning, as well as it should inspire designers of Tangible User Interfaces (TUIs) for learning and the educational community of computing to challenge the current ways of learning. The work here presented is concerned with acknowledging and building onto strengths of existing technologies, rather than substituting them with disruptive ideas