Characterization of Information Automation on the Flight Deck

This paper summarizes the results of analyses to identify characteristics of flight deck information automation systems which can lead to potential human factors issues. Information automation systems are responsible for the collection, processing, analysis, and presentation of information to the flightcrew. Information automation systems can pose human factors issues and challenges particular to this type of automation. This paper presents a formal definition of information automation and identifies characteristics and associated human factors issues in the domain of aircraft flight deck systems. A method was developed to identify a set of consistent and independent characteristics of information automation. Characteristics, a set of properties or attributes which describe its operation or behavior, can be used to identify and assess potential human factors issues. This effort lays the groundwork for providing data to support the development of recommendations specific to different characteristics of information automation

Flight Deck Information Automation: A Human-in-the-Loop In-Trail Procedure Simulation Study

Information automation systems are generally intended to support pilot tasks and improve flightcrew awareness and decision making, but not to directly control the aircraft or its systems. As a result these systems do not include cases where automation decisions and actions directly affect the aircraft performance, flight path or systems. Next Generation Air Transportation System (NextGen) operational concepts and technologies will dramatically affect both the types and amount of information available on flight decks. Much of that information will be produced by flight deck information automation systems that collect, process, and present that information to the flightcrew. It is therefore important to understand the human factors characteristics of information automation systems and identify human factors issues specifically related to information automation. This paper presents an investigation of two information automation characteristics (functional complexity and automation visibility) using prototype oceanic In-Trail Procedures (ITP) display systems. The outcome will be used to develop and iterate recommendations for design and evaluation of information automation systems that will mitigate the identified human factors issues

Autonomous, Context-Sensitive, Task Management Systems and Decision Support Tools I: Human-Autonomy Teaming Fundamentals and State of the Art

Recent advances in artificial intelligence, machine learning, data mining and extraction, and especially in sensor technology have resulted in the availability of a vast amount of digital data and information and the development of advanced automated reasoners. This creates the opportunity for the development of a robust dynamic task manager and decision support tool that is context sensitive and integrates information from a wide array of on-board and off aircraft sourcesa tool that monitors systems and the overall flight situation, anticipates information needs, prioritizes tasks appropriately, keeps pilots well informed, and is nimble and able to adapt to changing circumstances. This is the first of two companion reports exploring issues associated with autonomous, context-sensitive, task management and decision support tools. In the first report, we explore fundamental issues associated with the development of an integrated, dynamic, flight information and automation management system. We discuss human factors issues pertaining to information automation and review the current state of the art of pilot information management and decision support tools. We also explore how effective human-human team behavior and expectations could be extended to teams involving humans and automation or autonomous systems

Evaluation of Technology Concepts for Energy, Automation, and System State Awareness in Commercial Airline Flight Decks

A pilot-in-the-loop flight simulation study was conducted at NASA Langley Research Center to evaluate flight deck systems that (1) provide guidance for recovery from low energy states and stalls, (2) present the current state and expected future state of automated systems, and/or (3) show the state of flight-critical data systems in use by automated systems and primary flight instruments. The study was conducted using 13 commercial airline crews from multiple airlines, paired by airline to minimize procedural effects. Scenarios spanned a range of complex conditions and several emulated causal and contributing factors found in recent accidents involving loss of state awareness by pilots (e.g., energy state, automation state, and/or system state). Three new technology concepts were evaluated while used in concert with current state-of-the-art flight deck systems and indicators. The technologies include a stall recovery guidance algorithm and display concept, an enhanced airspeed control indicator that shows when automation is no longer actively controlling airspeed, and enhanced synoptic pages designed to work with simplified interactive electronic checklists. An additional synoptic was developed to provide the flight crew with information about the effects of loss of flight critical data. Data was collected via questionnaires administered at the completion of flight scenarios, audio/video recordings, flight data, head and eye tracking data, pilot control inputs, and researcher observations. This paper presents findings derived from the questionnaire responses and subjective data measures including workload, situation awareness, usability, and acceptability as well as analyses of two low-energy flight events that resulted in near-stall conditions

Improving situation awareness of a single human operator interacting with multiple unmanned vehicles: first results

In the context of the supervision of one or several unmanned vehicles by a human operator, the design of an adapted user interface is a major challenge. Therefore, in the context of an existing experimental set up composed of a ground station and heterogeneous unmanned ground and air vehicles we aim at redesigning the human-robot interactions to improve the operator's situation awareness. We base our new design on a classical user centered approach

High-speed civil transport flight- and propulsion-control technological issues

Technology advances required in the flight and propulsion control system disciplines to develop a high speed civil transport (HSCT) are identified. The mission and requirements of the transport and major flight and propulsion control technology issues are discussed. Each issue is ranked and, for each issue, a plan for technology readiness is given. Certain features are unique and dominate control system design. These features include the high temperature environment, large flexible aircraft, control-configured empennage, minimizing control margins, and high availability and excellent maintainability. The failure to resolve most high-priority issues can prevent the transport from achieving its goals. The flow-time for hardware may require stimulus, since market forces may be insufficient to ensure timely production. Flight and propulsion control technology will contribute to takeoff gross weight reduction. Similar technology advances are necessary also to ensure flight safety for the transport. The certification basis of the HSCT must be negotiated between airplane manufacturers and government regulators. Efficient, quality design of the transport will require an integrated set of design tools that support the entire engineering design team

Eye Tracking Metrics for Workload Estimation in Flight Deck Operation

Flight decks of the future are being enhanced through improved avionics that adapt to both aircraft and operator state. Eye tracking allows for non-invasive analysis of pilot eye movements, from which a set of metrics can be derived to effectively and reliably characterize workload. This research identifies eye tracking metrics that correlate to aircraft automation conditions, and identifies the correlation of pilot workload to the same automation conditions. Saccade length was used as an indirect index of pilot workload: Pilots in the fully automated condition were observed to have on average, larger saccadic movements in contrast to the guidance and manual flight conditions. The data set itself also provides a general model of human eye movement behavior and so ostensibly visual attention distribution in the cockpit for approach to land tasks with various levels of automation, by means of the same metrics used for workload algorithm development

Towards a characterization of information automation systems on the flight deck

This thesis summarizes research to investigate the characteristics that define information automation systems used on aircraft flight decks and the significant impacts that these characteristics have on pilot performance. Major accomplishments of the work include the development of a set of characteristics that describe information automation systems on the flight deck and an experiment designed to study a subset of these characteristics. Information automation systems on the flight deck are responsible for the collection, processing, analysis, and presentation of data to the flightcrew. These systems pose human factors issues and challenges that must be considered by designers of these systems. Based on a previously developed formal definition of information automation for aircraft flight deck systems, an analysis process was developed and conducted to reach a refined set of information automation characteristics. In this work, characteristics are defined as a set of properties or attributes that describe an information automation system\u27s operation or behavior, which can be used to identify and assess potential human factors issues. Hypotheses were formed for a subset of the characteristics: Automation Visibility, Information Quality, and Display Complexity. An experimental investigation was developed to measure performance impacts related to these characteristics, which showed mixed results of expected and surprising findings, with many interactions. A set of recommendations were then developed based on the experimental observations. Ensuring that the right information is presented to pilots at the right time and in the appropriate manner is the job of flight deck system designers. This work provides a foundation for developing recommendations and guidelines specific to information automation on the flight deck with the goal of improving the design and evaluation of information automation systems before they are implemented

A voyage to Mars: A challenge to collaboration between man and machines

A speech addressing the design of man machine systems for exploration of space beyond Earth orbit from the human factors perspective is presented. Concerns relative to the design of automated and intelligent systems for the NASA Space Exploration Initiative (SEI) missions are largely based on experiences with integrating humans and comparable systems in aviation. The history, present status, and future prospect, of human factors in machine design are discussed in relation to a manned voyage to Mars. Three different cases for design philosophy are presented. The use of simulation is discussed. Recommendations for required research are given

Understanding Crew Decision-Making in the Presence of Complexity: A Flight Simulation Experiment

Crew decision making and response have long been leading causal and contributing factors associated with aircraft accidents. Further, it is anticipated that future aircraft and operational environments will increase exposure to risks related to these factors if proactive steps are not taken to account for ever-increasing complexity. A flight simulation study was designed to collect data to help in understanding how complexity can, or may, be manifest. More specifically, an experimental apparatus was constructed that allowed for manipulation of information complexity and uncertainty, while also manipulating operational complexity and uncertainty. Through these manipulations, and the aid of experienced airline pilots, several issues have been discovered, related most prominently to the influence of information content, quality, and management. Flight crews were immersed in an environment that included new operational complexities suggested for the future air transportation system as well as new technological complexities (e.g. electronic flight bags, expanded data link services, synthetic and enhanced vision systems, and interval management automation). In addition, a set of off-nominal situations were emulated. These included, for example, adverse weather conditions, traffic deviations, equipment failures, poor data quality, communication errors, and unexpected clearances, or changes to flight plans. Each situation was based on one or more reference events from past accidents or incidents, or on a similar case that had been used in previous developmental tests or studies. Over the course of the study, 10 twopilot airline crews participated, completing over 230 flights. Each flight consisted of an approach beginning at 10,000 ft. Based on the recorded data and pilot and research observations, preliminary results are presented regarding decision-making issues in the presence of the operational and technological complexities encountered during the flights