Adaptive Critic Based Neurocontroller for Autolanding of Aircraft with Varying Glideslopes

In this paper, adaptive critic based neural networks have been used to design a controller for a benchmark problem in aircraft autolanding. The adaptive critic control methodology comprises successive adaptations of two neural networks, namely `action\u27 and `critic\u27 networks until closed loop optimal control is achieved. The autolanding problem deals with longitudinal dynamics of an aircraft which is to be landed in a specified touchdown region in the presence of wind disturbances and gusts using elevator deflection as the control for glideslope and flare modes. The performance of the neurocontroller is compared to that of a conventional PID controller. Neurocontroller\u27s capabilities are further explored by making it more generic and versatile in the sense that the glideslope angle can be changed at will during the landing process. Flight paths (trajectories) obtained for a wide range of glideslope angles in presence of wind gusts are compared with the optimal flight paths which are obtained by solving the linear quadratic regulator formulation using conventional optimal control theor

Adaptive output feedback control based on neural networks: application to flexible aircraft control

One of the major challenges in aeronautical flexible structures control is the uncertain for the non stationary feature of the systems. Transport aircrafts are of unceasingly growing size but are made from increasingly light materials so that their motion dynamics present some flexible low frequency modes coupled to rigid modes. For reasons that range from fuel transfer to random flying conditions, the parameters of these planes may be subject to significative variations during a flight. A single control law that would be robust to so large levels of uncertainties is likely to be limited in performance. For that reason, we follow in this work an adaptive control approach. Given an existing closed-loop system where a basic controller controls the rigid body modes, the problem of interest consists in designing an adaptive controller that could deal with the flexible modes of the system in such a way that the performance of the first controller is not deteriorated even in the presence of parameter variations. To this purpose, we follow a similar strategy as in Hovakimyan (2002) where a reference model adaptive control method has been proposed. The basic model of the rigid modes is regarded as a reference model and a neural network based learning algorithm is used to compensate online for the effects of unmodelled dynamics and parameter variations. We then successfully apply this control policy to the control of an Airbus aircraft. This is a very high dimensional dynamical model (about 200 states) whose direct control is obviously hard. However, by applying the aforementioned adaptive control technique to it, some promising simulation results can be achieved

Investigation of Air Transportation Technology at Princeton University, 1989-1990

The Air Transportation Technology Program at Princeton University proceeded along six avenues during the past year: microburst hazards to aircraft; machine-intelligent, fault tolerant flight control; computer aided heuristics for piloted flight; stochastic robustness for flight control systems; neural networks for flight control; and computer aided control system design. These topics are briefly discussed, and an annotated bibliography of publications that appeared between January 1989 and June 1990 is given

System Identification for Nonlinear Control Using Neural Networks

An approach to incorporating artificial neural networks in nonlinear, adaptive control systems is described. The controller contains three principal elements: a nonlinear inverse dynamic control law whose coefficients depend on a comprehensive model of the plant, a neural network that models system dynamics, and a state estimator whose outputs drive the control law and train the neural network. Attention is focused on the system identification task, which combines an extended Kalman filter with generalized spline function approximation. Continual learning is possible during normal operation, without taking the system off line for specialized training. Nonlinear inverse dynamic control requires smooth derivatives as well as function estimates, imposing stringent goals on the approximating technique

Reinforcement Learning for UAV Attitude Control

Autopilot systems are typically composed of an "inner loop" providing stability and control, while an "outer loop" is responsible for mission-level objectives, e.g. way-point navigation. Autopilot systems for UAVs are predominately implemented using Proportional, Integral Derivative (PID) control systems, which have demonstrated exceptional performance in stable environments. However more sophisticated control is required to operate in unpredictable, and harsh environments. Intelligent flight control systems is an active area of research addressing limitations of PID control most recently through the use of reinforcement learning (RL) which has had success in other applications such as robotics. However previous work has focused primarily on using RL at the mission-level controller. In this work, we investigate the performance and accuracy of the inner control loop providing attitude control when using intelligent flight control systems trained with the state-of-the-art RL algorithms, Deep Deterministic Gradient Policy (DDGP), Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO). To investigate these unknowns we first developed an open-source high-fidelity simulation environment to train a flight controller attitude control of a quadrotor through RL. We then use our environment to compare their performance to that of a PID controller to identify if using RL is appropriate in high-precision, time-critical flight control.Comment: 13 pages, 9 figure

Adaptive output feedback control of aircraft flexible modes

The application of adaptive output feedback augmentative control to the flexible aircraft problem is presented. Experimental validation of control scheme was carried out using a three disk torsional pendulum. In the reference model adaptive control scheme, the rigid aircraft reference model and neural network adaptation is used to control structural flexible modes and compensate for the effects unmodeled dynamics and parametric variations of a classical high order large passenger aircraft. The attenuation of specific low and high frequency flexible mode depending on linear controller design specifications and adaptation parameters were observed. The effectiveness of the approach was seen in flexibility control of the high dimensional, nonminimum phase, nonlinear aircraft model with parametric uncertainties of wind and unmodeled dynamics of actuators and sensors