A Program in Air Transportation Technology (Joint University Program)

The Joint University Program on Air Transportation Technology was conducted at Princeton University from 1971 to 1995. Our vision was to further understanding of the design and operation of transport aircraft, of the effects of atmospheric environment on aircraft flight, and of the development and utilization of the National Airspace System. As an adjunct, the program emphasized the independent research of both graduate and undergraduate students. Recent principal goals were to develop and verify new methods for design and analysis of intelligent flight control systems, aircraft guidance logic for recovery from wake vortex encounter, and robust flight control systems. Our research scope subsumed problems associated with multidisciplinary aircraft design synthesis and analysis based on flight physics, providing a theoretical basis for developing innovative control concepts that enhance aircraft performance and safety. Our research focus was of direct interest not only to NASA but to manufacturers of aircraft and their associated systems. Our approach, metrics, and future directions described in the remainder of the report

Learning-based perception and control with adaptive stress testing for safe autonomous air mobility

The use of electrical vertical takeoff and landing (eVTOL) aircraft to provide efficient, high-speed, on-demand air transportation within a metropolitan area is a topic of increasing interest, which is expected to bring fundamental changes to the city infrastructures and daily commutes. NASA, Uber, and Airbus have been exploring this exciting concept of Urban Air Mobility (UAM), which has the potential to provide meaningful door-to-door trip time savings compared with automobiles. However, successfully bringing such vehicles and airspace operations to fruition will require introducing orders-of-magnitude more aircraft to a given airspace volume, and the ability to manage many of these eVTOL aircraft safely in a congested urban area presents a challenge unprecedented in air traffic management. Although there are existing solutions for communication technology, onboard computing capability, and sensor technology, the computation guidance algorithm to enable safe, efficient, and scalable flight operations for dense self-organizing air traffic still remains an open question. In order to enable safe and efficient autonomous on-demand free flight operations in this UAM concept, a suite of tools in learning-based perception and control systems with stress testing for safe autonomous air mobility is proposed in this dissertation. First, a key component for the safe autonomous operation of unmanned aircraft is an effective onboard perception system, which will support sense-and-avoid functions. For example, in a package delivery mission, or an emergency landing event, pedestrian detection could help unmanned aircraft with safe landing zone identification. In this dissertation, we developed a deep-learning-based onboard computer vision algorithm on unmanned aircraft for pedestrian detection and tracking. In contrast with existing research with ground-level pedestrian detection, the developed algorithm achieves highly accurate multiple pedestrian detection from a bird-eye view, when both the pedestrians and the aircraft platform are moving. Second, for the aircraft guidance, a message-based decentralized computational guidance algorithm with separation assurance capability for single aircraft case and multiple cooperative aircraft case is designed and analyzed in this dissertation. The algorithm proposed in this work is to formulate this problem as a Markov Decision Process (MDP) and solve it using an online algorithm Monte Carlo Tree Search (MCTS). For the multiple cooperative aircraft case, a novel coordination strategy is introduced by using the logit level-$k$ model in behavioral game theory. To achieve higher scalability, we introduce the airspace sector concept into the UAM environment by dividing the airspace into sectors, so that each aircraft only needs to coordinate with aircraft in the same sector. At each decision step, all of the aircraft will run the proposed computational guidance algorithm onboard, which can guide all the aircraft to their respective destinations while avoiding potential conflicts among them. In addition, to make the proposed algorithm more practical, we also consider the communication constraints and communication loss among the aircraft by modifying our computational guidance algorithms given certain communication constraints (time, bandwidth, and communication loss) and designing air-to-air and air-to-ground communication frameworks to facilitate the computational guidance algorithm. To demonstrate the performance of the proposed computational guidance algorithm, a free-flight airspace simulator that incorporates environment uncertainty is built in an OpenAI Gym environment. Numerical experiment results over several case studies including the roundabout test problem show that the proposed computational guidance algorithm has promising performance even with the high-density air traffic case. Third, to ensure the developed autonomous systems meet the high safety standards of aviation, we propose a novel, simulation driven approach for validation that can automatically discover the failure modes of a decision-making system, and optimize the parameters that configure the system to improve its safety performance. Using simulation, we demonstrate that the proposed validation algorithm is able to discover failure modes in the system that would be challenging for humans to find and fix, and we show how the algorithm can learn from these failure modes to improve the performance of the decision-making system under test

Towards Flight Trials for an Autonomous UAV Emergency Landing using Machine Vision

This paper presents the evolution and status of a number of research programs focussed on developing an automated fixed wing UAV landing system. Results obtained in each of the three main areas of research as vision-based site identification, path and trajectory planning and multi-criteria decision making are presented. The results obtained provide a baseline for further refinements and constitute the starting point for the implementation of a prototype system ready for flight testing

Airborne collision scenario flight tests: impact of angle measurement errors on reactive vision-based avoidance control

The future emergence of many types of airborne vehicles and unpiloted aircraft in the national airspace means collision avoidance is of primary concern in an uncooperative airspace environment. The ability to replicate a pilot’s see and avoid capability using cameras coupled with vision based avoidance control is an important part of an overall collision avoidance strategy. But unfortunately without range collision avoidance has no direct way to guarantee a level of safety. Collision scenario flight tests with two aircraft and a monocular camera threat detection and tracking system were used to study the accuracy of image-derived angle measurements. The effect of image-derived angle errors on reactive vision-based avoidance performance was then studied by simulation. The results show that whilst large angle measurement errors can significantly affect minimum ranging characteristics across a variety of initial conditions and closing speeds, the minimum range is always bounded and a collision never occurs

Crew procedures and workload of retrofit concepts for microwave landing system

Crew procedures and workload for Microwave Landing Systems (MLS) that could be retrofitted into existing transport aircraft were evaluated. Two MLS receiver concepts were developed. One is capable of capturing a runway centerline and the other is capable of capturing a segmented approach path. Crew procedures were identified and crew task analyses were performed using each concept. Crew workload comparisons were made between the MLS concepts and an ILS baseline using a task-timeline workload model. Workload indexes were obtained for each scenario. The results showed that workload was comparable to the ILS baseline for the MLS centerline capture concept, but significantly higher for the segmented path capture concept

High speed research system study. Advanced flight deck configuration effects

In mid-1991 NASA contracted with industry to study the high-speed civil transport (HSCT) flight deck challenges and assess the benefits, prior to initiating their High Speed Research Program (HSRP) Phase 2 efforts, then scheduled for FY-93. The results of this nine-month effort are presented, and a number of the most significant findings for the specified advanced concepts are highlighted: (1) a no nose-droop configuration; (2) a far forward cockpit location; and (3) advanced crew monitoring and control of complex systems. The results indicate that the no nose-droop configuration is critically dependent upon the design and development of a safe, reliable, and certifiable Synthetic Vision System (SVS). The droop-nose configuration would cause significant weight, performance, and cost penalties. The far forward cockpit location, with the conventional side-by-side seating provides little economic advantage; however, a configuration with a tandem seating arrangement provides a substantial increase in either additional payload (i.e., passengers) or potential downsizing of the vehicle with resulting increases in performance efficiencies and associated reductions in emissions. Without a droop nose, forward external visibility is negated and takeoff/landing guidance and control must rely on the use of the SVS. The technologies enabling such capabilities, which de facto provides for Category 3 all-weather operations on every flight independent of weather, represent a dramatic benefits multiplier in a 2005 global ATM network: both in terms of enhanced economic viability and environmental acceptability

EVS: Head-up or Head Down? Evaluation of Crew Procedure and Human Factors for Enhanced Vision Systems

Feasibility of an EVS head-down procedure is examined that may provide the same operational benefits under low visibility as the FAA rule on Enhanced Flight Visibility that requires the use of a head-up display (HUD). The main element of the described EVS head-down procedure is the crew procedure within cockpit for flying the approach. The task sharing between Pilot-Flying and Pilot-Not-Flying is arranged such that multiple head-up/head-down transitions can be avoided. The pilot-flying is using the head-down display for acquisition of the necessary visual cues in the EVS image. The pilot-not-flying is monitoring the instruments and looking for the outside visual cues

Tree Memory Networks for Modelling Long-term Temporal Dependencies

In the domain of sequence modelling, Recurrent Neural Networks (RNN) have been capable of achieving impressive results in a variety of application areas including visual question answering, part-of-speech tagging and machine translation. However this success in modelling short term dependencies has not successfully transitioned to application areas such as trajectory prediction, which require capturing both short term and long term relationships. In this paper, we propose a Tree Memory Network (TMN) for modelling long term and short term relationships in sequence-to-sequence mapping problems. The proposed network architecture is composed of an input module, controller and a memory module. In contrast to related literature, which models the memory as a sequence of historical states, we model the memory as a recursive tree structure. This structure more effectively captures temporal dependencies across both short term and long term sequences using its hierarchical structure. We demonstrate the effectiveness and flexibility of the proposed TMN in two practical problems, aircraft trajectory modelling and pedestrian trajectory modelling in a surveillance setting, and in both cases we outperform the current state-of-the-art. Furthermore, we perform an in depth analysis on the evolution of the memory module content over time and provide visual evidence on how the proposed TMN is able to map both long term and short term relationships efficiently via a hierarchical structure