Analysis of masking effects during typical helicopter missions in a VR-based cockpit and their compensation by 3D audio technologies

When flying a helicopter in DVE, HWD can contribute to maintaining situational awareness. 3D audio can also help to improve orientation. The VC represents a new approach to the representation of the helicopter and the cockpit. Here, the helicopter and flight instruments are displayed in an exocentric view in an immersive HWD. This paper combines the use of the VC and 3D audio to investigate how 3D audio can compensate for the disadvantages of an exocentric view. The focus is on the masking effects resulting from the exocentric view. The extent of these effects, the influencing parameters and the compensation are investigated. For this purpose, a study with three participants was conducted. They had to fly different scenarios in a virtual city developed with Unity. The study showed that the participants reacted faster to dynamic objects with the support of the 3D audio warning system. Furthermore, the participants maintained greater distance to obstacles and collisions could be avoided. 3D audio proved to be very helpful during landings and was also able to compensate for the helicopter masking effects in the exocentric view. Since the obstacle localization still proved to be difficult in certain situations, further research is needed in the future. In addition to that, the study must be continued with more participants, as this was not possible due to the Corona pandemic