Validation of a behavioral marker system for rating cadet’s non-technical skills

Simulator-based training assumes a very important role in the maritime domain, particularly in the education of Officers Of the Watch (OOW). In the Portuguese Navy, most of the cadet’s skills as future OOW rely on the success of this training. Beyond theory and technical training, the development of non-technical skills is a key factor for obtaining officers capable of identifying and solving problems. To optimize the training and development of non-technical skills, using the Portuguese Naval Academy Simulator, a previously designed Behavioral Marker System model was further assessed. The revised model, which comprises new parameters such as the effectiveness of the task, was validated through a set of simulated sessions, where 11 instructors and 48 students participated. After each session, data was collected with questionnaires and focus group discussion, focusing on the quality and usability of the model and on the design of the scenario. The results show that the revised model, positively addresses the limitations found on the previous version, and it has received encouraging feedback from both instructors and cadets. This new model is now under implementation in all the Naval Academy course programs, and future research aims to digitalize the behavior markers