Augmented Reality Tower Technology Assessment

Augmented Reality technology may help improve Air Traffic Control Tower efficiency and safety during low-visibility conditions. This paper presents the assessments of five off-duty controllers who shadow-controlled' with an augmented reality prototype in their own facility. Initial studies indicated unanimous agreement that this technology is potentially beneficial, though the prototype used in the study was not adequate for operational use. Some controllers agreed that augmented reality technology improved situational awareness, had potential to benefit clearance, control, and coordination tasks and duties and could be very useful for acquiring aircraft and weather information, particularly aircraft location, heading, and identification. The strongest objections to the prototype used in this study were directed at aircraft registration errors, unacceptable optical transparency, insufficient display performance in sunlight, inadequate representation of the static environment and insufficient symbology

Static and Motion-Based Visual Features Used by Airport Tower Controllers: Some Implications for the Design of Remote or Virtual Towers

Visual motion and other visual cues are used by tower controllers to provide important support for their control tasks at and near airports. These cues are particularly important for anticipated separation. Some of them, which we call visual features, have been identified from structured interviews and discussions with 24 active air traffic controllers or supervisors. The visual information that these features provide has been analyzed with respect to possible ways it could be presented at a remote tower that does not allow a direct view of the airport. Two types of remote towers are possible. One could be based on a plan-view, map-like computer-generated display of the airport and its immediate surroundings. An alternative would present a composite perspective view of the airport and its surroundings, possibly provided by an array of radially mounted cameras positioned at the airport in lieu of a tower. An initial more detailed analyses of one of the specific landing cues identified by the controllers, landing deceleration, is provided as a basis for evaluating how controllers might detect and use it. Understanding other such cues will help identify the information that may be degraded or lost in a remote or virtual tower not located at the airport. Some initial suggestions how some of the lost visual information may be presented in displays are mentioned. Many of the cues considered involve visual motion, though some important static cues are also discussed

Augmented reality technology selection based on integrated QFD-AHP model

In the last decade, Augmented Reality has become increasingly popular. As improved performances are gathered in terms of mature hardware and software tools, we are observing the stemming of a huge number of applications of this technology both in the entertainment and in the industrial domains. On the one hand, such applications are usually claimed to bring benefits in terms of productivity or enhancement of the human\u2019s capability to perform tasks. On the other hand, researchers and developers seem not to adequately consider the different meanings that AR assumes when implemented through visualization devices that can differ significantly in nature and in their capability to provide a mixed real-virtual scenario. In this paper, we describe a user-centred method based on an integrated QFD-AHP approach to select the best visualization display technology with regard to a specific application context. The aim is to establish a repeatable and documented process for the identification of the technology that best suits and mitigates the acceptability risks of the transition from a legacy working environment to an AR based operational environment. The method has been developed in the framework of the RETINA (Resilient Synthetic Vision for Advanced Control Tower Air Navigation Service Provision) project involving the end users, in this case, air traffic controllers. Nevertheless, it can be generalised and applied to other contexts of use. Furthermore, in order to be resilient to the fast, technological development in AR, it can be used to update the results as improvements arise in the performance level of the display devices in a specific technology

Development and validation of the Multiple Remote Tower (MRT) for remote air traffic control

The symbol in air traffic control (ATC), essentially unchanged since the beginning of commercial air traffic early last century, is the characteristic control tower with its large, tilted windows, situated at an exposed location, and rising high above the airport. “Remote Tower” is changing the provision of Air Traffic Services (ATS) in a way that it is more service tailored, dynamically located and available when and where needed, enabled by digital solutions replacing the physical presence of controllers and control towers at aerodromes with a remotely provided Air Traffic Service for Multiple Aerodromes. The paper examines this phenomenon that will mark an epochal change, analysing the experiments and validations carried out in the last years

How much is too much on monitoring tasks? Visual scan patterns of single air traffic controller performing multiple remote tower operations

The innovative concept of multiple remote tower operation (MRTO) is where a single air traffic controller (ATCO) provides air traffic services to two or more different airports from a geographically separated virtual Tower. Effective visual scanning by the air traffic controller is the main safety concern for human-computer interaction, as the aim of MRTO is a single controller performing air traffic management tasks originally carried out by up to four ATCOs, comprehensively supported by innovative technology. Thirty-two scenarios were recorded and analyzed using an eye tracking device to investigate the above safety concern and the effectiveness of multiple remote tower operations. The results demonstrated that ATCOs' visual scan patterns showed significant task related variation while performing different tasks and interacting with various interfaces on the controller's working position (CWP). ATCOs were supported by new display systems equipped with pan tilt zoom (PTZ) cameras allowing enhanced visual checking of airport surfaces and aircraft positions. Therefore, one ATCO could monitor and provide services for two airports simultaneously. The factors influencing visual attention include how the information is presented, the complexity of that information, and the characteristics of the operating environment. ATCO's attention distribution among display systems is the key human-computer interaction issue in single ATCO performing multiple monitoring tasks

3D-in-2D Displays for ATC.

This paper reports on the efforts and accomplishments of the 3D-in-2D Displays for ATC project at the end of Year 1. We describe the invention of 10 novel 3D/2D visualisations that were mostly implemented in the Augmented Reality ARToolkit. These prototype implementations of visualisation and interaction elements can be viewed on the accompanying video. We have identified six candidate design concepts which we will further research and develop. These designs correspond with the early feasibility studies stage of maturity as defined by the NASA Technology Readiness Level framework. We developed the Combination Display Framework from a review of the literature, and used it for analysing display designs in terms of display technique used and how they are combined. The insights we gained from this framework then guided our inventions and the human-centered innovation process we use to iteratively invent. Our designs are based on an understanding of user work practices. We also developed a simple ATC simulator that we used for rapid experimentation and evaluation of design ideas. We expect that if this project continues, the effort in Year 2 and 3 will be focus on maturing the concepts and employment in a operational laboratory settings

Acceptability of Flight Deck-Based Interval Management Crew Procedures

The Interval Management for Near-term Operations Validation of Acceptability (IM-NOVA) experiment was conducted at the National Aeronautics and Space Administration (NASA) Langley Research Center (LaRC) in support of the NASA Next Generation Air Transportation System (NextGen) Airspace Systems Program's Air Traffic Management Technology Demonstration - 1 (ATD-1). ATD-1 is intended to showcase an integrated set of technologies that provide an efficient arrival solution for managing aircraft using NextGen surveillance, navigation, procedures, and automation for both airborne and ground-based systems. The goal of the IM-NOVA experiment was to assess if procedures outlined by the ATD-1 Concept of Operations, when used with a minimum set of Flight deck-based Interval Management (FIM) equipment and a prototype crew interface, were acceptable to and feasible for use by flight crews in a voice communications environment. To investigate an integrated arrival solution using ground-based air traffic control tools and aircraft automatic dependent surveillance broadcast (ADS-B) tools, the LaRC FIM system and the Traffic Management Advisor with Terminal Metering and Controller Managed Spacing tools developed at the NASA Ames Research Center (ARC) were integrated in LaRC's Air Traffic Operations Laboratory. Data were collected from 10 crews of current, qualified 757/767 pilots asked to fly a high-fidelity, fixed based simulator during scenarios conducted within an airspace environment modeled on the Dallas-Fort Worth (DFW) Terminal Radar Approach Control area. The aircraft simulator was equipped with the Airborne Spacing for Terminal Area Routes algorithm and a FIM crew interface consisting of electronic flight bags and ADS-B guidance displays. Researchers used "pseudo-pilot" stations to control 24 simulated aircraft that provided multiple air traffic flows into DFW, and recently retired DFW air traffic controllers served as confederate Center, Feeder, Final, and Tower controllers. Pilot participant feedback indicated that the procedures used by flight crews to receive and execute interval management (IM) clearances in a voice communications environment were logical, easy to follow, did not contain any missing or extraneous steps, and required the use of an acceptable level of workload. The majority of the pilot participants found the IM concept, in addition to the proposed FIM crew procedures, to be acceptable and indicated that the ATD-1 procedures can be successfully executed in a near-term NextGen environment

Multiple remote tower for Single European Sky: The evolution from initial operational concept to regulatory approved implementation

The European Union project of Single European Sky initiated a reorganization of European airspace and proposed additional measures for air traffic management to achieve the key objectives of improving efficiency and capacity while at the same time enhancing safety. The concept of multiple remote tower operation is that air traffic controllers (ATCOs) can control several airfields from a distant virtual control centre. The control of multiple airfields can be centralised to a virtual centre permitting the more efficient use of ATCO resources. This research was sponsored by the Single European Sky ATM Research Program and the ATM Operations Division of the Irish Aviation Authority. A safety case was developed for migration of multiple remote tower services to live operations. This research conducted 50 large scale demonstration trials of remote tower operations from single tower operations to multiple tower operations for safety assessment by air navigation safety regulators in 2016. A dedicated team of air traffic controllers and technology experts successfully completed the safety assessment of multiple remote tower operations in real time. The implementation of this innovative technology requires a careful balance between cost-efficiency and the safety of the air traffic control in terms of capacity and human performance. The live trial exercises demonstrated that the air traffic services provided by the remote tower for a single airport and two medium airports by a single ATCO with ‘in sequence’ and ‘simultaneous’ aircraft operation was at least as safe as provided by the local towers at Cork and Shannon aerodromes. No safety occurrence was reported nor did any operational safety issue arise during the conduct of the fifty live trial exercises