2 research outputs found
Measuring situation awareness in complex systems: Comparison of measures study
Situation Awareness (SA) is a distinct critical commodity for teams working in complex industrial systems and its measurement is a key provision in system, procedural and training design efforts. This article describes a study that was undertaken in order to compare three different SA measures (a freeze probe recall approach, a post trial subjective rating approach and a critical incident interview technique) when used to assess participant SA during a military planning task. The results indicate that only the freeze probe recall method produced a statistically significant correlation with performance on the planning task and also that there was no significant correlation between the three methods, which suggests that they were effectively measuring different things during the trials. In conclusion, the findings, whilst raising doubts over the validity of post trial subjective rating and interview-based approaches, offer validation evidence for the use of freeze probe recall approaches to measure SA. The findings are subsequently discussed with regard to their implications for the future measurement of SA in complex collaborative systems
Recommended from our members
Distributed situation awareness: Advances in theory, measurement and application to team work
This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.Situation Awareness (SA) is critical commodity for teams working in complex sociotechnical systems and is thus a fundamental consideration in collaborative system design and evaluation. Despite this, SA remains predominantly an individual construct, with the majority of models and measures focused on SA from an individual perspective. In comparison, team SA has received much less attention and this thesis argues that further work is required in the area both in relation to the development of theoretical perspectives and of valid measures, and to the development of guidelines for system, training and procedure design. This thesis advances team SA theory and measurement by further investigating a recently proposed model of SA in complex collaborative environments, the Distributed Situation Awareness (DSA) approach, and by testing a new methodology for representing and analysing DSA during real world collaborative activities. A review of SA theory and SA measurement approaches is presented. Following this, the DSA theory and propositional network assessment methodology are outlined and a series of case studies on DSA during real world collaborative activities in the military and civil domains are presented. The findings are subsequently used to explore the concept of DSA and the sub-concepts of compatible and transactive SA. In conclusion, a model of DSA in complex collaborative systems is presented, and a series of system design guidelines for supporting DSA are outlined