Comparing Post-Run and Retrospective Minute-by-Minute Workload Scores

Abstract

When we ask participants to evaluate their workload in a real or contrived scenario it isunknown how they quantify their response. This uncertainty compounds when the scenariois long and has several subtasks. Thus, it is difficult to determine what the workload scoresindicate. The questions arise: Are participants reporting a peak level of workload? Somesort of aggregate? In this paper, we aim to correlate NASA Task-Load Index (TLX) scoresobtained during a contrived scenario in a flight simulator with minute-by-minute measuresof workload. We describe the strength and direction of correlations between the twoworkload ratings and determine if there is a consistent categorical score (e.g., maximumminute-by-minute workload) that represents the post-run TLX. The goal of this work is toprovide guidance to those that prefer to run longer human-in-the-loop simulations so thereis confidence in the data and understanding of the TLX scores