Evaluating the User Experience of Microsoft HoloLens and Mobile Device Using an Augmented Reality Application

Context: In recent years, everyone is completely relying on using computers and smartphones in our daily activities. Augmented Reality will superimpose virtual and computer-generated information on top of the real world. Volvo Construction Equipment (VCE) team is planning to use Augmented Reality applications on a real construction site to track the details of the vehicles without going to the laboratory. An Augmented reality application is developed for Microsoft HoloLensand Mobile device and the user experience is evaluated. This research has been conducted at PDRL-BTH, in collaboration with VCE. Objectives: In this research, the key attributes are collected, which should be displayed in both the devices and compare the user experience using the user satisfaction score. Furthermore, this research involves exploring and evaluating the difference in the user experience between both the devices. Methods: In this study first an interview is carried out with the design engineers of the VCE team. Some open-ended questions were asked to the VCE team. The information required from the VCE team is collected and documented and further an experiment on the user experience has been conducted to calculate the User Satisfaction Score between the Microsoft HoloLens and Mobile device. After the experiment, the significant difference has been measured using statistical techniques among the two devices. To measure the size of the difference Cohen’s D effect size is used. Results: The significant difference between the User Satisfaction Score of the two devices has been done using T-test. The results state that the significant value is less than 0.05 and hence the null hypothesis is rejected. The measurable difference states that Microsoft HoloLens has a better user interface than the Mobile device with respect to the user satisfaction Score. Conclusions: After obtaining the results and analyzing the data, we conclude that there is a significant difference in the user experience of Microsoft HoloLens when compared to Mobile device. We also conclude that Microsoft HoloLens has better user experience when compared to the Mobile device