Using the method of Loci in virtual reality to reduce robotic operations training time of astronauts

The European Astronaut Centre (EAC), in Germany, trains and supports astronauts for space missions on board the International Space Station (ISS). As part of their preparations, future ISS crew members must train to operate the Mobile Servicing System (MSS) safely. The MSS is the collection of robotic systems that includes the Space Station Remote Manipulator System (SSRMS–also known as Canadarm2), a 17m-long robotic arm that can be piloted from inside ISS. Astronauts may need to complete various operations with the SSRMS, such as capturing free-flying visiting vehicles, or moving other astronauts between worksites during Extravehicular Activities (EVAs, also known as spacewalks). However, operating SSRMS requires precise technique, since there are only limited means for the operator to monitor the arm’s surroundings, and mistakes can cause crew injuries or severe hardware damage. Moreover, predicting the arm’s motion can be challenging, since the arm maneuvers via seven revolving joints, while the operator commands using only two hand controllers. Instructors prepare astronauts to execute complex tasks through lengthy training with replicas of the arm commanding interface and an interactive 3D simulation of its movements. With that training system, achieving the first level of proficiency takes between 20 and 30 hours of training. The same system is also used to train some ground personnel, so they may support the crew in orbit. Unfortunately, such volumes of students elevate the required teaching time to levels that challenge the instructor’s team capacity. To lower the training time, the eXtended Reality Laboratory of EAC and the National Aeronautics and Space Administration CX-2 Robotics operation team launched a Joint Investigation into Virtual reality for Education (JIVE). JIVE changes the training paradigm, from being purely simulation-based to presenting knowledge in a purposely-built museum exhibition in Virtual Reality (VR). The virtual training rooms foster the method of loci, a famous memory enhancement technique leveraging spatial memory. The rooms are deliberately very different from each other, including claustrophobic rooms, bright areas, or open spaces, to create a strong anchor for teaching content. In addition, the inherent stereoscopy of VR allows for more efficient presentation of spatially demanding knowledge, such as 3D coordinate frames or clearance monitoring. This paper presents the innovative pedagogy of JIVE enabled by VR and its use for ISS training