Using situation awareness and workload to predict performance in submarine track management: a multilevel approach

OBJECTIVE: Examine the extent to which subjective workload and situation awareness (SA) can predict variance in performance at the between- and within-person levels of analysis in a simulated submarine track management task. BACKGROUND: SA and workload are crucial constructs in human factors that are conceptualized as states that change within individuals over time. Thus, a change in an individual's subjective workload or SA over the course of performing a task should be predictive of their subsequent performance (within-person effects). However, there is little empirical evidence for this. METHOD: Participants monitored displays to track the behaviors of contacts in relationship to their own ship (Ownship) and landmarks. The Situational Awareness Global Assessment Technique measured SA, and the Air Traffic Workload Input Technique measured subjective workload. RESULTS: When a participant's subjective workload rating increased, their subsequent performance decreased, but there was no evidence for within-person effects of SA on performance. We replicated prior between-person level effects of SA; participants with higher SA performed better than those with lower SA. CONCLUSION: Change in an individual's subjective workload rating (but not SA) was predictive of their subsequent performance. Because an increase in SA should increase the extent to which operators hold the knowledge required to perform subsequent tasks, further research is required to examine SA effects on performance at the within-person level. APPLICATION: Adapting automation is more likely to produce optimal outcomes if based on measurement of operator states that predict future task performance, such as workload