Haptic Learning: The Effects of Multimedia Learning on Haptic Robotic Operation

abstract: This is a report on an experiment that examines if the principles of multimedia learning outlined in Richard E. Mayer’s journal article, “Using multimedia for e-learning”, located in the Journal of Computer Assisted Learning would apply to haptic feedback used for haptic robotic operation. This was tested by developing and using a haptic robotic manipulator known as the Haptic Testbed (HTB). The HTB is a manipulator designed to emulate human hand movement for haptic testing purposes and features an index finger and thumb for the right hand. Control is conducted through a Leap Motion Controller, a visual sensor that uses infrared lights and cameras to gather various data about hands it can see. The goal of the experiment was to have test subjects complete a task where they shifted objects along a circuit of positions where they were measured on time to complete the circuit as well as accuracy in reaching the individual points. Analysis of subject responses to surveys as well as performance during the experiment showed haptic feedback during training improving initial performance of individuals as well as lowering mental effort and mental demand during said training. The findings of this experiment showed support for the hypothesis that Mayer’s principles do apply to haptic feedback in training for haptic robotic manipulation. One of the implications of this experiment would be the possibility for haptics and tactile senses to be an applicable sense for Mayer’s principles of multimedia learning as most of the current work in the field is mostly focused on visual or auditory senses. If the results of the experiment were replicated in a future experiment it would provide support to the hypothesis that the principles of multimedia learning can be utilized to improve the training of haptic robotic operation