Optimal control of a helicopter unmanned aerial vehicle (UAV)

This thesis addresses optimal control of a helicopter unmanned aerial vehicle (UAV). Helicopter UAVs may be widely used for both military and civilian operations. Because these helicopters are underactuated nonlinear mechanical systems, high-performance controller design for them presents a challenge. This thesis presents an optimal controller design via both state and output feedback for trajectory tracking of a helicopter UAV using a neural network (NN). The state and output-feedback control system utilizes the backstepping methodology, employing kinematic and dynamic controllers while the output feedback approach uses an observer in addition to these controllers. The online approximator-based dynamic controller learns the Hamilton-Jacobi-Bellman (HJB) equation in continuous time and calculates the corresponding optimal control input to minimize the HJB equation forward-in-time. Optimal tracking is accomplished with a single NN utilized for cost function approximation. The overall closed-loop system stability is demonstrated using Lyapunov analysis. Simulation results are provided to demonstrate the effectiveness of the proposed control design for trajectory tracking. A description of the hardware for confirming the theoretical approach, and a discussion of material pertaining to the algorithms used and methods employed specific to the hardware implementation is also included. Additional attention is devoted to challenges in implementation as well as to opportunities for further research in this field. This thesis is presented in the form of two papers --Abstract, page iv

Formation control of mobile robots and unmanned aerial vehicles

In this dissertation, the nonlinear control of nonholonomic mobile robot formations and unmanned aerial vehicle (UAV) formations is undertaken and presented in six papers. In the first paper, an asymptotically stable combined kinematic/torque control law is developed for leader-follower based formation control of mobile robots using backstepping. A neural network (NN) is introduced along with robust integral of the sign of the error (RISE) feedback to approximate the dynamics of the follower as well as its leader using online weight tuning. Subsequently, in the second paper, a novel NN observer is designed to estimate the linear and angular velocities of both the follower and its leader robot and a NN output feedback control law is developed. On the other hand, in the third paper, a NN-based output feedback control law is presented for the control of an underactuated quad rotor UAV, and a NN virtual control input scheme is proposed which allows all six degrees of freedom to be controlled using only four control inputs. The results of this paper are extended to include the control of quadrotor UAV formations, and a novel three-dimensional leader-follower framework is proposed in the fourth paper. Next, in the fifth paper, the discrete-time nonlinear optimal control is undertaken using two online approximators (OLA\u27s) to solve the infinite horizon Hamilton-Jacobi-Bellman (HJB) equation forward-in-time to achieve nearly optimal regulation and tracking control. In contrast, paper six utilizes a single OLA to solve the infinite horizon HJB and Hamilton-Jacobi-Isaacs (HJI) equations forward-intime for the near optimal regulation and tracking control of continuous affine nonlinear systems. The effectiveness of the optimal tracking controllers proposed in the fifth and sixth papers are then demonstrated using nonholonomic mobile robot formation control --Abstract, page iv

A review of safe online learning for nonlinear control systems

Learning for autonomous dynamic control systems that can adapt to unforeseen environmental changes are of great interest but the realisation of a practical and safe online learning algorithm is incredibly challenging. This paper highlights some of the main approaches for safe online learning of stabilisable nonlinear control systems with a focus on safety certification for stability. We categorise a non-exhaustive list of salient techniques, with a focus on traditional control theory as opposed to reinforcement learning and approximate dynamic programming. This paper also aims to provide a simplified overview of techniques as an introduction to the field. It is the first paper to our knowledge that compares key attributes and advantages of each technique in one paper

Development of Robust Control Strategies for Autonomous Underwater Vehicles

The resources of the energy and chemical balance in the ocean sustain mankind in many ways. Therefore, ocean exploration is an essential task that is accomplished by deploying Underwater Vehicles. An Underwater Vehicle with autonomy feature for its navigation and control is called Autonomous Underwater Vehicle (AUV). Among the task handled by an AUV, accurately positioning itself at a desired position with respect to the reference objects is called set-point control. Similarly, tracking of the reference trajectory is also another important task. Battery recharging of AUV, positioning with respect to underwater structure, cable, seabed, tracking of reference trajectory with desired accuracy and speed to avoid collision with the guiding vehicle in the last phase of docking are some significant applications where an AUV needs to perform the above tasks. Parametric uncertainties in AUV dynamics and actuator torque limitation necessitate to design robust control algorithms to achieve motion control objectives in the face of uncertainties. Sliding Mode Controller (SMC), H / μ synthesis, model based PID group controllers are some of the robust controllers which have been applied to AUV. But SMC suffers from less efficient tuning of its switching gains due to model parameters and noisy estimated acceleration states appearing in its control law. In addition, demand of high control effort due to high frequency chattering is another drawback of SMC. Furthermore, real-time implementation of H / μ synthesis controller based on its stability study is restricted due to use of linearly approximated dynamic model of an AUV, which hinders achieving robustness. Moreover, model based PID group controllers suffer from implementation complexities and exhibit poor transient and steady-state performances under parametric uncertainties. On the other hand model free Linear PID (LPID) has inherent problem of narrow convergence region, i.e.it can not ensure convergence of large initial error to zero. Additionally, it suffers from integrator-wind-up and subsequent saturation of actuator during the occurrence of large initial error. But LPID controller has inherent capability to cope up with the uncertainties. In view of addressing the above said problem, this work proposes wind-up free Nonlinear PID with Bounded Integral (BI) and Bounded Derivative (BD) for set-point control and combination of continuous SMC with Nonlinear PID with BI and BD namely SM-N-PID with BI and BD for trajectory tracking. Nonlinear functions are used for all P,I and D controllers (for both of set-point and tracking control) in addition to use of nonlinear tan hyperbolic function in SMC(for tracking only) such that torque demand from the controller can be kept within a limit. A direct Lyapunov analysis is pursued to prove stable motion of AUV. The efficacies of the proposed controllers are compared with other two controllers namely PD and N-PID without BI and BD for set-point control and PD plus Feedforward Compensation (FC) and SM-NPID without BI and BD for tracking control. Multiple AUVs cooperatively performing a mission offers several advantages over a single AUV in a non-cooperative manner; such as reliability and increased work efficiency, etc. Bandwidth limitation in acoustic medium possess challenges in designing cooperative motion control algorithm for multiple AUVs owing to the necessity of communication of sensors and actuator signals among AUVs. In literature, undirected graph based approach is used for control design under communication constraints and thus it is not suitable for large number of AUVs participating in a cooperative motion plan. Formation control is a popular cooperative motion control paradigm. This thesis models the formation as a minimally persistent directed graph and proposes control schemes for maintaining the distance constraints during the course of motion of entire formation. For formation control each AUV uses Sliding Mode Nonlinear PID controller with Bounded Integrator and Bounded Derivative. Direct Lyapunov stability analysis in the framework of input-to-state stability ensures the stable motion of formation while maintaining the desired distance constraints among the AUVs

Nonlinear Controller Design for UAVs with Time-Varying Aerodynamic Uncertainties

Unmanned Aerial Vehicles (UAVs) are here and they are here to stay. Unmanned Aviation has expanded significantly in recent years and research and development in the field of navigation and control have advanced beyond expectations. UAVs are currently being used for defense programs around the world but the range of applications is expected to grow in the near future, with civilian applications such as environmental and aerial monitoring, aerial surveillance and homeland security being some representative examples. Conventional and commercially available small-scale UAVs have limited utilization and applicability to executing specific short-duration missions because of limitations in size, payload, power supply and endurance. This fact has already marked the dawn of a new era of more powerful and versatile UAVs (e.g. morphing aircraft), able to perform a variety of missions. This dissertation presents a novel, comprehensive, step-by-step, nonlinear controller design framework for new generation, non-conventional UAVs with time-varying aerodynamic characteristics during flight. Controller design for such UAVs is a challenging task mainly due to uncertain aerodynamic parameters in the UAV mathematical model. This challenge is tackled by using and implementing μ-analysis and additive uncertainty weighting functions. The technique described herein can be generalized and applied to the class of non-conventional UAVs, seeking to address uncertainty challenges regarding the aircraft\u27s aerodynamic coefficients

Robust Control Methods for Nonlinear Systems with Uncertain Dynamics and Unknown Control Direction

Robust nonlinear control design strategies using sliding mode control (SMC) and integral SMC (ISMC) are developed, which are capable of achieving reliable and accurate tracking control for systems containing dynamic uncertainty, unmodeled disturbances, and actuator anomalies that result in an unknown and time-varying control direction. In order to ease readability of this dissertation, detailed explanations of the relevant mathematical tools is provided, including stability denitions, Lyapunov-based stability analysis methods, SMC and ISMC fundamentals, and other basic nonlinear control tools. The contributions of the dissertation are three novel control algorithms for three different classes of nonlinear systems: single-input multipleoutput (SIMO) systems, systems with model uncertainty and bounded disturbances, and systems with unknown control direction. Control design for SIMO systems is challenging due to the fact that such systems have fewer actuators than degrees of freedom to control (i.e., they are underactuated systems). While traditional nonlinear control methods can be utilized to design controllers for certain classes of cascaded underactuated systems, more advanced methods are required to develop controllers for parallel systems, which are not in a cascade structure. A novel control technique is proposed in this dissertation, which is shown to achieve asymptotic tracking for dual parallel systems, where a single scalar control input directly affects two subsystems. The result is achieved through an innovative sequential control design algorithm, whereby one of the subsystems is indirectly stabilized via the desired state trajectory that is commanded to the other subsystem. The SIMO system under consideration does not contain uncertainty or disturbances. In dealing with systems containing uncertainty in the dynamic model, a particularly challenging situation occurs when uncertainty exists in the input-multiplicative gain matrix. Moreover, special consideration is required in control design for systems that also include unknown bounded disturbances. To cope with these challenges, a robust continuous controller is developed using an ISMC technique, which achieves asymptotic trajectory tracking for systems with unknown bounded disturbances, while simultaneously compensating for parametric uncertainty in the input gain matrix. The ISMC design is rigorously proven to achieve asymptotic trajectory tracking for a quadrotor system and a synthetic jet actuator (SJA)-based aircraft system. In the ISMC designs, it is assumed that the signs in the uncertain input-multiplicative gain matrix (i.e., the actuator control directions) are known. A much more challenging scenario is encountered in designing controllers for classes of systems, where the uncertainty in the input gain matrix is extreme enough to result in an a priori-unknown control direction. Such a scenario can result when dealing with highly inaccurate dynamic models, unmodeled parameter variations, actuator anomalies, unknown external or internal disturbances, and/or other adversarial operating conditions. To address this challenge, a SMCbased self-recongurable control algorithm is presented, which automatically adjusts for unknown control direction via periodic switching between sliding manifolds that ultimately forces the state to a converging manifold. Rigorous mathematical analyses are presented to prove the theoretical results, and simulation results are provided to demonstrate the effectiveness of the three proposed control algorithms

Cooperative Control and Fault Recovery for Network of Heterogeneous Autonomous Underwater Vehicles

The purpose of this thesis is to develop cooperative recovery control schemes for a team of heterogeneous autonomous underwater vehicles (AUV). The objective is to have the network of autonomous underwater vehicles follow a desired trajectory while agents maintain a desired formation. It is assumed that the model parameters associated with each vehicle is different although the order of the vehicles are the same. Three cooperative control schemes based on dynamic surface control (DSC) technique are developed. First, a DSC-based centralized scheme is presented in which there is a central controller that has access to information of all agents at the same time and designs the optimal solution for this cooperative problem. This scheme is used as a benchmark to evaluate the performance of other schemes developed in this thesis. Second, a DSC-based decentralized scheme is presented in which each agent designs its controller based on only its information and the information of its desired trajectory. In this scheme, there is no information exchange among the agents in the team. This scheme is also developed for the purpose of comparative studies. Third, two different semi-decentralized or distributed schemes for the network of heterogeneous autonomous underwater vehicles are proposed. These schemes are a synthesis of a consensus-based algorithm and the dynamic surface control technique with the difference that in one of them the desired trajectories of agents are used in the consensus algorithm while in the other the actual states of the agents are used. In the former scheme, the agents communicate their desired relative distances with the agents within their set of nearest neighbors and each agent determines its own control trajectory. In this semi-decentralized scheme, the velocity measurements of the virtual leader and all the followers are not required to reach the consensus formation. However, in the latter, agents communicate their relative distances and velocities with the agents within their set of nearest neighbors. In both semi-decentralized schemes only a subset of agents has access to information of a virtual leader. The comparative studies between these two semi-decentralized schemes are provided which show the superiority of the former semi-decentralized scheme over latter. Furthermore, to evaluate the efficiency of the proposed DSC-based semi-decentralized scheme with consensus algorithm using desired trajectories, a comparative study is performed between this scheme and three cooperative schemes of model-dependent coordinated tracking algorithm, namely the centralized, decentralized, and semi-decentralized schemes. Given that the dynamics of autonomous underwater vehicles are inevitably subjected to system faults, and in particular the actuator faults, to improve the performance of the network of agents, active fault-tolerant control strategies corresponding to the three developed schemes are also designed to recover the team from the loss-of-effectiveness in the actuators and to ensure that the closed-loop signals remain bounded and the team of heterogeneous autonomous underwater vehicles satisfy the overall design specifications and requirements. The results of this research can potentially be used in various marine applications such as underwater oil and gas pipeline inspection and repairing, monitoring oil and gas pipelines, detecting and preventing any oil and gas leakages. However, the applications of the proposed cooperative control and its fault-tolerant scheme are not limited to underwater formation path-tracking and can be applied to any other multi-vehicle systems that are characterized by Euler–Lagrange equations