24,207 research outputs found
Measuring situation awareness in complex systems: Comparison of measures study
Situation Awareness (SA) is a distinct critical commodity for teams working in complex industrial systems and its measurement is a key provision in system, procedural and training design efforts. This article describes a study that was undertaken in order to compare three different SA measures (a freeze probe recall approach, a post trial subjective rating approach and a critical incident interview technique) when used to assess participant SA during a military planning task. The results indicate that only the freeze probe recall method produced a statistically significant correlation with performance on the planning task and also that there was no significant correlation between the three methods, which suggests that they were effectively measuring different things during the trials. In conclusion, the findings, whilst raising doubts over the validity of post trial subjective rating and interview-based approaches, offer validation evidence for the use of freeze probe recall approaches to measure SA. The findings are subsequently discussed with regard to their implications for the future measurement of SA in complex collaborative systems
Hazard alerting and situational awareness in advanced air transport cockpits
Advances in avionics and display technology have significantly changed the cockpit environment in current 'glass cockpit' aircraft. Recent developments in display technology, on-board processing, data storage, and datalinked communications are likely to further alter the environment in second and third generation 'glass cockpit' aircraft. The interaction of advanced cockpit technology with human cognitive performance has been a major area of activity within the MIT Aeronautical Systems Laboratory. This paper presents an overview of the MIT Advanced Cockpit Simulation Facility. Several recent research projects are briefly reviewed and the most important results are summarized
Situation awareness measurement: A review of applicability for C4i environments
The construct of situation awareness (SA) has become a core theme within the human factors (HF) research community. Consequently, there have been numerous attempts to develop reliable and valid measures of SA but there is a lack of techniques developed specifically for the assessment of SA in command, control, communication, computers and intelligence (C4i) environments. During the design, development and evaluation of novel systems, technology and procedures, valid and reliable situation awareness measurement techniques are required for the assessment of individual and team SA, in order to determine the improvements (or in some cases decrements) resulting from proposed design and technological interventions. The paper presents a review of existing situation awareness measurement techniques for their suitability for use in the assessment of SA in C4i environments. Seventeen SA measures were evaluated against a set of HF methods criteria. It was concluded that current SA measurement techniques are inadequate by themselves for use in the assessment of SA in C4i environments, and a multiple-measure approach utilising different approaches is recommended
Search Theory and U-Boats in the Bay of Biscay
Threats to our nation\u27s resources and forces are becoming increasingly lethal and mobile. Therefore, our ability to locate and interdict these threats is more important than ever. Search theory is one tool that is vital to countering the increasing threat. This research presents a multi-agent simulation, built around the Allied search for U-boats in the Bay of Biscay during World War II, which extends several classic search theory algorithms. Comparison of techniques is based on the effectiveness of finding high- valued, mobile assets. A JAVA-based multi-agent simulation model is designed, built and tested, and used to demonstrate the existence of differing emergent behaviors between search patterns currently used by the United States military
Modeling Network Centric Warfare (NCW) With the System Effectiveness Analysis Simulation (SEAS)
Significant technological advances over the past few decades have fueled the continual and rapid development of an information-based world. Network Centric Warfare (NCW) has become the buzzword of the young millennium within the Department of Defense (DoD) and is quickly becoming a popularly shared vision and rallying cry for force transformation among United States military leaders. An essential element in fully implementing this network-centric way of thinking is to develop useful measures to help gauge the effectiveness and efficiency of both our military networks and our strategic NCW doctrine. The goal of this research is first to provide a comprehensive summary of the key literary works that have forged a foundational basis for defining NCW. Second, this work will utilize a System Effectiveness Analysis Simulation (SEAS) combat model, which represents a Kosovo-like engagement (provided by the Space and Missile Center), to serve as a tool in exploring the use of NCW metrics in military worth analysis. Third and last, this effort selects measures for the physical, information, and cognitive domains of NCW and analyzes the outputs from the Kosovo scenario that are pertinent to each domain in order to assess the usefulness of each metric. In the final analysis, the average target detection distance outputs and average communication channel message loading metrics chosen for the physical and information domains yielded mixed results and levels of utility, while the highly aggregated metric of target kills served as a useful, and yet rough, final metric for the cognitive domain
Automatic Target Recognition Classification System Evaluation Methodology
This dissertation research makes contributions towards the evaluation of developing Automatic Target Recognition (ATR) technologies through the application of decision analysis (DA) techniques. ATR technology development decisions should rely not only on the measures of performance (MOPs) associated with a given ATR classification system (CS), but also on the expected measures of effectiveness (MOEs). The purpose of this research is to improve the decision-makers in the ATR Technology development. A decision analysis framework that allows decision-makers in the ATR community to synthesize the performance measures, costs, and characteristics of each ATR system with the preferences and values of both the evaluators and the warfighters is developed. The inclusion of the warfighter\u27s perspective is important in that it has been proven that basing ATR CS comparisons solely upon performance characteristics does not ensure superior operational effectiveness. The methodology also captures the relationship between MOPs and MOEs via a combat model. An example scenario demonstrates how ATR CSs may be compared. Sensitivity analysis is performed to demonstrate the robustness of the MOP to value score and MOP to MOE translations. A multinomial section procedure is introduced to account for the random nature of the MOP estimates
Co-Evolutionary Learning for Cognitive Computer Generated Entities
In this paper, an approach is advocated to use a hybrid approach towards learning behaviour for computer generated entities (CGEs) in a serious gaming setting. Hereby, an agent equipped with cognitive model is used but this agent is enhanced with Machine Learning (ML) capabilities. This facilitates the agent to exhibit human like behaviour but avoid an expert having to define all parameters explicitly. More in particular, the ML approach utilizes co-evolution as a learning paradigm. An evaluation in the domain of one-versus-one air combat shows promising results
Traffic Alert and Collision Avoidance System (TCAS): Cockpit Display of Traffic Information (CDTI) investigation. Phase 1: Feasibility study
The possibility of the Threat Alert and Collision Avoidance System (TCAS) traffic sensor and display being used for meaningful Cockpit Display of Traffic Information (CDTI) applications has resulted in the Federal Aviation Administration initiating a project to establish the technical and operational requirements to realize this potential. Phase 1 of the project is presented here. Phase 1 was organized to define specific CDTI applications for the terminal area, to determine what has already been learned about CDTI technology relevant to these applications, and to define the engineering required to supply the remaining TCAS-CDTI technology for capacity benefit realization. The CDTI applications examined have been limited to those appropriate to the final approach and departure phases of flight
- …