Design, Implementation and Testing of Advanced Control Laws for Fixed-wing UAVs

The present PhD thesis addresses the problem of the control of small fixed-wing Unmanned Aerial Vehicles (UAVs). In the scientific community much research is dedicated to the study of suitable control laws for this category of aircraft. This interest is motivated by the several applications that these platforms can perform and by their peculiarities as dynamical systems. In fact, small UAVs are characterized by highly nonlinear behavior, strong coupling between longitudinal and latero-directional planes, and high sensitivity to external disturbances and to parametric uncertainties. Furthermore, the challenge is increased by the limited space and weight available for the onboard electronics. The aim of this PhD thesis is to provide a valid confrontation among three different control techniques and to introduce an innovative autopilot configuration suitable for the unmanned aircraft field. Three advanced controllers for fixed-wing unmanned aircraft vehicles are designed and implemented: PID with H1 robust approach, L1 adaptive controller and nonlinear backstepping controller. All of them are analyzed from the theoretical point of view and validated through numerical simulations with a mathematical UAV model. One is implemented on a microcontroller board, validated through hardware simulations and tested in flight. The PID with H1 robust approach is used for the definition of the gains of a commercial autopilot. The proposed technique combines traditional PID control with an H1 loop shaping method to assess the robustness characteristics achievable with simple PID gains. It is demonstrated that this hybrid approach provides a promising solution to the problem of tuning commercial autopilots for UAVs. Nevertheless, it is clear that a tradeoff between robustness and performance is necessary when dealing with this standard control technique. The robustness problem is effectively solved by the adoption of an L1 adaptive controller for complete aircraft control. In particular, the L1 logic here adopted is based on piecewise constant adaptive laws with an adaptation rate compatible with the sampling rate of an autopilot board CPU. The control scheme includes an L1 adaptive controller for the inner loop, while PID gains take care of the outer loop. The global controller is tuned on a linear decoupled aircraft model. It is demonstrated that the achieved configuration guarantees satisfying performance also when applied to a complete nonlinear model affected by uncertainties and parametric perturbations. The third controller implemented is based on an existing nonlinear backstepping technique. A scheme for longitudinal and latero-directional control based on the combination of PID for the outer loop and backstepping for the inner loop is proposed. Satisfying results are achieved also when the nonlinear aircraft model is perturbed by parametric uncertainties. A confrontation among the three controllers shows that L1 and backstepping are comparable in terms of nominal and robust performance, with an advantage for L1, while the PID is always inferior. The backstepping controller is chosen for being implemented and tested on a real fixed-wing RC aircraft. Hardware-in-the-loop simulations validate its real-time control capability on the complete nonlinear model of the aircraft adopted for the tests, inclusive of sensors noise. An innovative microcontroller technology is employed as core of the autopilot system, it interfaces with sensors and servos in order to handle input/output operations and it performs the control law computation. Preliminary ground tests validate the suitability of the autopilot configuration. A limited number of flight tests is performed. Promising results are obtained for the control of longitudinal states, while latero-directional control still needs major improvements

An Algorithm for Autonomous Aerial Navigation using MATLAB® Mapping Tool Box

In the present era of aviation technology, autonomous navigation and control have emerged as a prime area of active research. Owing to the tremendous developments in the field, autonomous controls have led today’s engineers to claim that future of aerospace vehicle is unmanned. Development of guidance and navigation algorithms for an unmanned aerial vehicle (UAV) is an extremely challenging task, which requires efforts to meet strict, and at times, conflicting goals of guidance and control. In this paper, aircraft altitude and heading controllers and an efficient algorithm for self-governing navigation using MATLAB® mapping toolbox is presented which also enables loitering of a fixed wing UAV over a specified area. For this purpose, a nonlinear mathematical model of a UAV is used. The nonlinear model is linearized around a stable trim point and decoupled for controller design. The linear controllers are tested on the nonlinear aircraft model and navigation algorithm is subsequently developed for for autonomous flight of the UAV. The results are presented for trajectory controllers and waypoint based navigation. Our investigation reveals that MATLAB® mapping toolbox can be exploited to successfully deliver an efficient algorithm for autonomous aerial navigation for a UAV

Aerial Object Following Using Visual Fuzzy Servoing

This article presents a visual servoing system to follow a 3D moving object by a Micro Unmanned Aerial Vehicle (MUAV). The presented control strategy is based only on the visual information given by an adaptive tracking method based on the colour information. A visual fuzzy system has been developed for servoing the camera situated on a rotary wing MAUV, that also considers its own dynamics. This system is focused on continuously following of an aerial moving target object, maintaining it with a fixed safe distance and centred on the image plane. The algorithm is validated on real flights on outdoors scenarios, showing the robustness of the proposed systems against winds perturbations, illumination and weather changes among others. The obtained results indicate that the proposed algorithms is suitable for complex controls task, such object following and pursuit, flying in formation, as well as their use for indoor navigatio

Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs Using Proximal Policy Optimization

Contemporary autopilot systems for unmanned aerial vehicles (UAVs) are far more limited in their flight envelope as compared to experienced human pilots, thereby restricting the conditions UAVs can operate in and the types of missions they can accomplish autonomously. This paper proposes a deep reinforcement learning (DRL) controller to handle the nonlinear attitude control problem, enabling extended flight envelopes for fixed-wing UAVs. A proof-of-concept controller using the proximal policy optimization (PPO) algorithm is developed, and is shown to be capable of stabilizing a fixed-wing UAV from a large set of initial conditions to reference roll, pitch and airspeed values. The training process is outlined and key factors for its progression rate are considered, with the most important factor found to be limiting the number of variables in the observation vector, and including values for several previous time steps for these variables. The trained reinforcement learning (RL) controller is compared to a proportional-integral-derivative (PID) controller, and is found to converge in more cases than the PID controller, with comparable performance. Furthermore, the RL controller is shown to generalize well to unseen disturbances in the form of wind and turbulence, even in severe disturbance conditions.Comment: 11 pages, 3 figures, 2019 International Conference on Unmanned Aircraft Systems (ICUAS

Intelligent adaptive control for nonlinear applications

The thesis deals with the design and implementation of an Adaptive Flight Control technique for Unmanned Aerial Vehicles (UAVs). The application of UAVs has been increasing exponentially in the last decade both in Military and Civilian fronts. These UAVs fly at very low speeds and Reynolds numbers, have nonlinear coupling, and tend to exhibit time varying characteristics. In addition, due to the variety of missions, they fly in uncertain environments exposing themselves to unpredictable external disturbances. The successful completion of the UAV missions is largely dependent on the accuracy of the control provided by the flight controllers. Thus there is a necessity for accurate and robust flight controllers. These controllers should be able to adapt to the changes in the dynamics due to internal and external changes. From the available literature, it is known that, one of the better suited adaptive controllers is the model based controller. The design and implementation of model based adaptive controller is discussed in the thesis. A critical issue in the design and application of model based control is the online identification of the UAV dynamics from the available sensors using the onboard processing capability. For this, proper instrumentation in terms of sensors and avionics for two platforms developed at UNSW@ADFA is discussed. Using the flight data from the remotely flown platforms, state space identification and fuzzy identification are developed to mimic the UAV dynamics. Real time validations using Hardware in Loop (HIL) simulations show that both the methods are feasible for control. A finer comparison showed that the accuracy of identification using fuzzy systems is better than the state space technique. The flight tests with real time online identification confirmed the feasibility of fuzzy identification for intelligent control. Hence two adaptive controllers based on the fuzzy identification are developed. The first adaptive controller is a hybrid indirect adaptive controller that utilises the model sensitivity in addition to output error for adaptation. The feedback of the model sensitivity function to adapt the parameters of the controller is shown to have beneficial effects, both in terms of convergence and accuracy. HIL simulations applied to the control of roll stabilised pitch autopilot for a typical UAV demonstrate the improvements compared to the direct adaptive controller. Next a novel fuzzy model based inversion controller is presented. The analytical approximate inversion proposed in this thesis does not increase the computational effort. The comparisons of this controller with other controller for a benchmark problem are presented using numerical simulations. The results bring out the superiority of this technique over other techniques. The extension of the analytical inversion based controller for multiple input multiple output problem is presented for the design of roll stabilised pitch autopilot for a UAV. The results of the HIL simulations are discussed for a typical UAV. Finally, flight test results for angle of attack control of one of the UAV platforms at UNSW@ADFA are presented. The flight test results show that the adaptive controller is capable of controlling the UAV suitably in a real environment, demonstrating its robustness characteristics

Fault Tolerance Analysis of L1 Adaptive Control System for Unmanned Aerial Vehicles

Trajectory tracking is a critical element for the better functionality of autonomous vehicles. The main objective of this research study was to implement and analyze L1 adaptive control laws for autonomous flight under normal and upset flight conditions. The West Virginia University (WVU) Unmanned Aerial Vehicle flight simulation environment was used for this purpose. A comparison study between the L1 adaptive controller and a baseline conventional controller, which relies on position, proportional, and integral compensation, has been performed for a reduced size jet aircraft, the WVU YF-22. Special attention was given to the performance of the proposed control laws in the presence of abnormal conditions. The abnormal conditions considered are locked actuators (stabilator, aileron, and rudder) and excessive turbulence. Several levels of abnormal condition severity have been considered. The performance of the control laws was assessed over different-shape commanded trajectories. A set of comprehensive evaluation metrics was defined and used to analyze the performance of autonomous flight control laws in terms of control activity and trajectory tracking errors. The developed L1 adaptive control laws are supported by theoretical stability guarantees. The simulation results show that L1 adaptive output feedback controller achieves better trajectory tracking with lower level of control actuation as compared to the baseline linear controller under nominal and abnormal conditions

Development of Robust Control Laws for Disturbance Rejection in Rotorcraft UAVs

Inherent stability inside the flight envelope must be guaranteed in order to safely introduce private and commercial UAV systems into the national airspace. The rejection of unknown external wind disturbances offers a challenging task due to the limited available information about the unpredictable and turbulent characteristics of the wind. This thesis focuses on the design, development and implementation of robust control algorithms for disturbance rejection in rotorcraft UAVs. The main focus is the rejection of external disturbances caused by wind influences. Four control algorithms are developed in an effort to mitigate wind effects: baseline nonlinear dynamic inversion (NLDI), a wind rejection extension for the NLDI, NLDI with adaptive artificial neural networks (ANN) augmentation, and NLDI with L1 adaptive control augmentation. A simulation environment is applied to evaluate the performance of these control algorithms under external wind conditions using a Monte Carlo analysis. Outdoor flight test results are presented for the implementation of the baseline NLDI, NLDI augmented with adaptive ANN and NLDI augmented with L1 adaptive control algorithms in a DJI F330 Flamewheel quadrotor UAV system. A set of metrics is applied to compare and evaluate the overall performance of the developed control algorithms under external wind disturbances. The obtained results show that the extended NLDI exhibits undesired characteristics while the augmentation of the baseline NLDI control law with adaptive ANN and L1 output-feedback adaptive control improve the robustness of the translational and rotational dynamics of a rotorcraft UAV in the presence of wind disturbances

Evolution of Neural Networks for Helicopter Control: Why Modularity Matters

The problem of the automatic development of controllers for vehicles for which the exact characteristics are not known is considered in the context of miniature helicopter flocking. A methodology is proposed in which neural network based controllers are evolved in a simulation using a dynamic model qualitatively similar to the physical helicopter. Several network architectures and evolutionary sequences are investigated, and two approaches are found that can evolve very competitive controllers. The division of the neural network into modules and of the task into incremental steps seems to be a precondition for success, and we analyse why this might be so

Using learning from demonstration to enable automated flight control comparable with experienced human pilots

Modern autopilots fall under the domain of Control Theory which utilizes Proportional Integral Derivative (PID) controllers that can provide relatively simple autonomous control of an aircraft such as maintaining a certain trajectory. However, PID controllers cannot cope with uncertainties due to their non-adaptive nature. In addition, modern autopilots of airliners contributed to several air catastrophes due to their robustness issues. Therefore, the aviation industry is seeking solutions that would enhance safety. A potential solution to achieve this is to develop intelligent autopilots that can learn how to pilot aircraft in a manner comparable with experienced human pilots. This work proposes the Intelligent Autopilot System (IAS) which provides a comprehensive level of autonomy and intelligent control to the aviation industry. The IAS learns piloting skills by observing experienced teachers while they provide demonstrations in simulation. A robust Learning from Demonstration approach is proposed which uses human pilots to demonstrate the task to be learned in a flight simulator while training datasets are captured. The datasets are then used by Artificial Neural Networks (ANNs) to generate control models automatically. The control models imitate the skills of the experienced pilots when performing the different piloting tasks while handling flight uncertainties such as severe weather conditions and emergency situations. Experiments show that the IAS performs learned skills and tasks with high accuracy even after being presented with limited examples which are suitable for the proposed approach that relies on many single-hidden-layer ANNs instead of one or few large deep ANNs which produce a black-box that cannot be explained to the aviation regulators. The results demonstrate that the IAS is capable of imitating low-level sub-cognitive skills such as rapid and continuous stabilization attempts in stormy weather conditions, and high-level strategic skills such as the sequence of sub-tasks necessary to takeoff, land, and handle emergencies