Evaluation of Technology Concepts for Traffic Data Management and Relevant Audio for Datalink in Commercial Airline Flight Decks

Datalink is currently operational for departure clearances and in oceanic environments and is currently being tested in high altitude domestic enroute airspace. Interaction with even simple datalink clearances may create more workload for flight crews than the voice system they replace if not carefully designed. Datalink may also introduce additional complexity for flight crews with hundreds of uplink messages now defined for use. Finally, flight crews may lose airspace awareness and operationally relevant information that they normally pickup from Air Traffic Control (ATC) voice communications with other aircraft (i.e., party-line transmissions). Once again, automation may be poised to increase workload on the flight deck for incremental benefit. Datalink implementation to support future air traffic management concepts needs to be carefully considered, understanding human communication norms and especially, the change from voice- to text-based communications modality and its effect on pilot workload and situation awareness. Increasingly autonomous systems, where autonomy is designed to support human-autonomy teaming, may be suited to solve these issues. NASA is conducting research and development of increasingly autonomous systems, utilizing machine-learning algorithms seamlessly integrated with humans whereby task performance of the combined system is significantly greater than the individual components. Increasingly autonomous systems offer the potential for significantly improved levels of performance and safety that are superior to either human or automation alone. Two increasingly autonomous systems concepts - a traffic data manager and a conversational co-pilot - were developed to intelligently address the datalink issues in a complex, future state environment with significant levels of traffic. The system was tested for suitability of datalink usage for terminal airspace. The traffic data manager allowed for automated declutter of the Automatic Dependent Surveillance-Broadcast (ADS-B) display. The system determined relevant traffic for display based on machine learning algorithms trained by experienced human pilot behaviors. The conversational co-pilot provided relevant audio air traffic control messages based on context and proximity to ownship. Both systems made use of the connected aircraft concepts to provide intelligent context to determine relevancy above and beyond proximity to ownship. A human-in-the-loop test was conducted in NASA Langley Research Centers Integration Flight Deck B-737-800 simulator to evaluate the traffic data manager and the conversational co-pilot. Twelve airline crews flew various normal and non-normal procedures and their actions and performance were recorded in response to the procedural events. This paper details the flight crew performance and evaluation during the events

Increasing Pilots Understanding of Future Automation State an Evaluation of an Automation State and Trajectory Prediction System

A pilot in the loop flight simulation study was conducted at NASA Langley Research Center to evaluate a trajectory prediction system. The trajectory prediction system computes a five-minute prediction of the lateral and vertical path of the aircraft given the current and intent state of the automation. The prediction is shown as a graphical representation so the pilots can form an accurate mental model of the future state. Otherwise, many automation changes and triggers are hidden from the flight crew or need to be consolidated to understand if a change will occur and the exact timing of the change. Varying dynamic conditions like deceleration can obscure the future trajectory and the ability to meet constraints, especially in the vertical dimension. Current flight deck indications of flight path assume constant conditions and do not adequately support the flight crew to make correct judgments regarding constraints. The study was conducted using ten commercial airline crews from multiple airlines, paired by airline to minimize procedural effects. Scenarios spanned a range of conditions that provided evaluation in a realistic environment with complex traffic and weather conditions. In particular, scenarios probed automation state and loss of state awareness. The technology was evaluated and contrasted with current state-of-the-art flight deck capabilities modeled from the Boeing 787. Objective and subjective data were collected from aircraft parameters, questionnaires, audio/video recordings, head/eye tracking data, and observations. This paper details findings about the trajectory prediction system including recommendations about further study

Evaluation of Technology Concepts for Energy, Automation, and System State Awareness in Commercial Airline Flight Decks

A pilot-in-the-loop flight simulation study was conducted at NASA Langley Research Center to evaluate flight deck systems that (1) provide guidance for recovery from low energy states and stalls, (2) present the current state and expected future state of automated systems, and/or (3) show the state of flight-critical data systems in use by automated systems and primary flight instruments. The study was conducted using 13 commercial airline crews from multiple airlines, paired by airline to minimize procedural effects. Scenarios spanned a range of complex conditions and several emulated causal and contributing factors found in recent accidents involving loss of state awareness by pilots (e.g., energy state, automation state, and/or system state). Three new technology concepts were evaluated while used in concert with current state-of-the-art flight deck systems and indicators. The technologies include a stall recovery guidance algorithm and display concept, an enhanced airspeed control indicator that shows when automation is no longer actively controlling airspeed, and enhanced synoptic pages designed to work with simplified interactive electronic checklists. An additional synoptic was developed to provide the flight crew with information about the effects of loss of flight critical data. Data was collected via questionnaires administered at the completion of flight scenarios, audio/video recordings, flight data, head and eye tracking data, pilot control inputs, and researcher observations. This paper presents findings derived from the questionnaire responses and subjective data measures including workload, situation awareness, usability, and acceptability as well as analyses of two low-energy flight events that resulted in near-stall conditions

Regarding Pilot Usage of Display Technologies for Improving Awareness of Aircraft System States

ed systems and the procedures for ng in complexity. This interacting trend places a larger burden on pilots to manage increasing amounts of information and to understand system interactions. The result is an increase in the likelihood of loss of airplane state awareness (ASA). One way to gain more insight into this issue is through experimentation using objective measures of visual behavior. This study summarizes an analysis of oculometer data obtained during a high-fidelity flight simulation study that included a variety of complex pilot-system interactions that occur in current flight decks, as well as several planned for the next generation air transportation system. The study was comprised of various scenarios designed to induce low and high energy aircraft states coupled with other emulated causal factors in recent accidents. Three different display technologies were evaluated in this recent pilot-in-the-loop study conducted at NASA Langley Research Center. These technologies include a stall recovery guidance algorithm and display concept, an enhanced airspeed control indication of when the automation is no longer actively controlling airspeed, and enhanced synoptic diagrams with corresponding simplified electronic interactive checklists. Multiple data analyses were performed to understand how the 26 participating airline pilots were observing ASA-related information provided during different stag specific events within these stages

Information Management to Mitigate Loss of Control Airline Accidents

Loss of control inflight continues to be the leading contributor to airline accidents worldwide and unreliable airspeed has been a contributing factor in many of these accidents. Airlines and the FAA developed training programs for pilot recognition of these airspeed events and many checklists have been designed to help pilots troubleshoot. In addition, new aircraft designs incorporate features to detect and respond in such situations. NASA has been using unreliable airspeed events while conducting research recommended by the Commercial Aviation Safety Team. Even after significant industry focus on unreliable airspeed, research and other evidence shows that highly skilled and trained pilots can still be confused by the condition and there is a lack of understanding of what the associated checklist(s) attempts to uncover. Common mode failures of analog sensors designed for measuring airspeed continue to confound both humans and automation when determining which indicators are correct. This paper describes failures that have occurred in the past and where/how pilots may still struggle in determining reliable airspeed when confronted with conflicting information. Two latest generation aircraft architectures will be discussed and contrasted. This information will be used to describe why more sensors used in classic control theory will not solve the problem. Technology concepts are suggested for utilizing existing synoptic pages and a new synoptic page called System Interactive Synoptic (SIS). SIS details the flow of flight critical data through the avionics system and how it is used by the automation. This new synoptic page as well as existing synoptics can be designed to be used in concert with a simplified electronic checklist (sECL) to significantly reduce the time to configure the flight deck avionics in the event of a system or sensor failure

Analysis domain model for shared virtual environments

The field of shared virtual environments, which also encompasses online games and social 3D environments, has a system landscape consisting of multiple solutions that share great functional overlap. However, there is little system interoperability between the different solutions. A shared virtual environment has an associated problem domain that is highly complex raising difficult challenges to the development process, starting with the architectural design of the underlying system. This paper has two main contributions. The first contribution is a broad domain analysis of shared virtual environments, which enables developers to have a better understanding of the whole rather than the part(s). The second contribution is a reference domain model for discussing and describing solutions - the Analysis Domain Model

Improving situation awareness of a single human operator interacting with multiple unmanned vehicles: first results

In the context of the supervision of one or several unmanned vehicles by a human operator, the design of an adapted user interface is a major challenge. Therefore, in the context of an existing experimental set up composed of a ground station and heterogeneous unmanned ground and air vehicles we aim at redesigning the human-robot interactions to improve the operator's situation awareness. We base our new design on a classical user centered approach