Pip and Pop: When auditory alarms facilitate visual change detection in dynamic settings

Dynamic and complex command and control situations often require the timely recognition of changes in the environment in order to detect potentially malicious actions. Change detection can be challenging within a continually evolving scene, and particularly under multitasking conditions whereby attention is necessarily divided between several subtasks. On-screen tools can assist with detection (e.g., providing a visual record of changes, ensuring that none are overlooked), however, in a high workload environment, this may result in information overload to the detriment of the primary task. One alternative is to exploit the auditory modality as a means to support visual change detection. In the current study, we use a naval air-warfare simulation, and introduce an auditory alarm to coincide with critical visual changes (in aircraft speed/direction) on the radar. We found that participants detected a greater percentage of visual changes and were significantly quicker to detect these changes when they were accompanied by an auditory alarm than when they were not. Furthermore, participants reported that mental demand was lower in the auditory alarm condition, and this was reflected in reduced classification omissions on the primary task. Results are discussed in relation to Wickens’ multiple resource theory of attention and indicate the potential for using the auditory modality to facilitate visual change detection

The Benefits and the Costs of Using Auditory Warning Messages in Dynamic Decision Making Settings

The failure to notice critical changes in both visual and auditory scenes may have important consequences for performance in complex dynamic environments, especially those related to security such as aviation, surveillance during major events, and command and control of emergency response. Previous work has shown that a significant number of situation changes remain undetected by operators in such environments. In the current study, we examined the impact of using auditory warning messages to support the detection of critical situation changes and to a broader extent the decision making required by the environment. Twenty-two participants performed a radar operator task involving multiple subtasks while detecting critical task-related events that were cued by a specific type of audio message. Results showed that about 22% of the critical changes remained undetected by participants, a percentage similar to that found in previous work using visual cues to support change detection. However, we found that audio messages tended to bias threat evaluation towards perceiving objects as more threatening than they were in reality. Such findings revealed both benefits and costs associated with using audio messages to support change detection in complex dynamic environments