Issues on Stability of ADP Feedback Controllers for Dynamical Systems

This paper traces the development of neural-network (NN)-based feedback controllers that are derived from the principle of adaptive/approximate dynamic programming (ADP) and discusses their closed-loop stability. Different versions of NN structures in the literature, which embed mathematical mappings related to solutions of the ADP-formulated problems called “adaptive critics” or “action-critic” networks, are discussed. Distinction between the two classes of ADP applications is pointed out. Furthermore, papers in “model-free” development and model-based neurocontrollers are reviewed in terms of their contributions to stability issues. Recent literature suggests that work in ADP-based feedback controllers with assured stability is growing in diverse forms

Robust Control Methods for Nonlinear Systems with Uncertain Dynamics and Unknown Control Direction

Robust nonlinear control design strategies using sliding mode control (SMC) and integral SMC (ISMC) are developed, which are capable of achieving reliable and accurate tracking control for systems containing dynamic uncertainty, unmodeled disturbances, and actuator anomalies that result in an unknown and time-varying control direction. In order to ease readability of this dissertation, detailed explanations of the relevant mathematical tools is provided, including stability denitions, Lyapunov-based stability analysis methods, SMC and ISMC fundamentals, and other basic nonlinear control tools. The contributions of the dissertation are three novel control algorithms for three different classes of nonlinear systems: single-input multipleoutput (SIMO) systems, systems with model uncertainty and bounded disturbances, and systems with unknown control direction. Control design for SIMO systems is challenging due to the fact that such systems have fewer actuators than degrees of freedom to control (i.e., they are underactuated systems). While traditional nonlinear control methods can be utilized to design controllers for certain classes of cascaded underactuated systems, more advanced methods are required to develop controllers for parallel systems, which are not in a cascade structure. A novel control technique is proposed in this dissertation, which is shown to achieve asymptotic tracking for dual parallel systems, where a single scalar control input directly affects two subsystems. The result is achieved through an innovative sequential control design algorithm, whereby one of the subsystems is indirectly stabilized via the desired state trajectory that is commanded to the other subsystem. The SIMO system under consideration does not contain uncertainty or disturbances. In dealing with systems containing uncertainty in the dynamic model, a particularly challenging situation occurs when uncertainty exists in the input-multiplicative gain matrix. Moreover, special consideration is required in control design for systems that also include unknown bounded disturbances. To cope with these challenges, a robust continuous controller is developed using an ISMC technique, which achieves asymptotic trajectory tracking for systems with unknown bounded disturbances, while simultaneously compensating for parametric uncertainty in the input gain matrix. The ISMC design is rigorously proven to achieve asymptotic trajectory tracking for a quadrotor system and a synthetic jet actuator (SJA)-based aircraft system. In the ISMC designs, it is assumed that the signs in the uncertain input-multiplicative gain matrix (i.e., the actuator control directions) are known. A much more challenging scenario is encountered in designing controllers for classes of systems, where the uncertainty in the input gain matrix is extreme enough to result in an a priori-unknown control direction. Such a scenario can result when dealing with highly inaccurate dynamic models, unmodeled parameter variations, actuator anomalies, unknown external or internal disturbances, and/or other adversarial operating conditions. To address this challenge, a SMCbased self-recongurable control algorithm is presented, which automatically adjusts for unknown control direction via periodic switching between sliding manifolds that ultimately forces the state to a converging manifold. Rigorous mathematical analyses are presented to prove the theoretical results, and simulation results are provided to demonstrate the effectiveness of the three proposed control algorithms

Adaptive neural control of nonlinear systems with hysteresis

Ph.DDOCTOR OF PHILOSOPH

Total Energy Shaping with Neural Interconnection and Damping Assignment - Passivity Based Control

In this work we exploit the universal approximation property of Neural Networks (NNs) to design interconnection and damping assignment (IDA) passivity-based control (PBC) schemes for fully-actuated mechanical systems in the port-Hamiltonian (pH) framework. To that end, we transform the IDA-PBC method into a supervised learning problem that solves the partial differential matching equations, and fulfills equilibrium assignment and Lyapunov stability conditions. A main consequence of this, is that the output of the learning algorithm has a clear control-theoretic interpretation in terms of passivity and Lyapunov stability. The proposed control design methodology is validated for mechanical systems of one and two degrees-of-freedom via numerical simulations.Comment: Accepted in 4th Annual Learning for Dynamics and Control (L4DC) Conferenc

Formation control of mobile robots and unmanned aerial vehicles

In this dissertation, the nonlinear control of nonholonomic mobile robot formations and unmanned aerial vehicle (UAV) formations is undertaken and presented in six papers. In the first paper, an asymptotically stable combined kinematic/torque control law is developed for leader-follower based formation control of mobile robots using backstepping. A neural network (NN) is introduced along with robust integral of the sign of the error (RISE) feedback to approximate the dynamics of the follower as well as its leader using online weight tuning. Subsequently, in the second paper, a novel NN observer is designed to estimate the linear and angular velocities of both the follower and its leader robot and a NN output feedback control law is developed. On the other hand, in the third paper, a NN-based output feedback control law is presented for the control of an underactuated quad rotor UAV, and a NN virtual control input scheme is proposed which allows all six degrees of freedom to be controlled using only four control inputs. The results of this paper are extended to include the control of quadrotor UAV formations, and a novel three-dimensional leader-follower framework is proposed in the fourth paper. Next, in the fifth paper, the discrete-time nonlinear optimal control is undertaken using two online approximators (OLA\u27s) to solve the infinite horizon Hamilton-Jacobi-Bellman (HJB) equation forward-in-time to achieve nearly optimal regulation and tracking control. In contrast, paper six utilizes a single OLA to solve the infinite horizon HJB and Hamilton-Jacobi-Isaacs (HJI) equations forward-intime for the near optimal regulation and tracking control of continuous affine nonlinear systems. The effectiveness of the optimal tracking controllers proposed in the fifth and sixth papers are then demonstrated using nonholonomic mobile robot formation control --Abstract, page iv

Adaptive Robust Control of Biomass Fuel Co-Combustion Process

The share of biomass in energy production is constantly growing. This is caused by environmental and industry standards and EU guidelines. Biomass is used in the process of co-firing in large power plants and industrial installations. In the existing power stations, biomass is milled and burned simultaneously with coal. However, low-emission combustion techniques, including biomass co-combustion, have some negative side effects that can be split into two categories. The direct effects influence the process control stability, whereas the indirect ones on combustion installations via increased corrosion or boiler slagging. The effects can be minimised using additional information about the process. The proper combustion diagnosis as well as an appropriate, robust control system ought to be applied. The chapter is devoted to the analysis of modern, robust control techniques for complex power engineering applications

Design and Implementation of an Artificial Neural Network Controller for Quadrotor Flight in Confined Environment

Quadrotors offer practical solutions for many applications, such as emergency rescue, surveillance, military operations, videography and many more. For this reason, they have recently attracted the attention of research and industry. Even though they have been intensively studied, quadrotors still suffer from some challenges that limit their use, such as trajectory measurement, attitude estimation, obstacle avoidance, safety precautions, and land cybersecurity. One major problem is flying in a confined environment, such as closed buildings and tunnels, where the aerodynamics around the quadrotor are affected by close proximity objects, which result in tracking performance deterioration, and sometimes instability. To address this problem, researchers followed three different approaches; the Modeling approach, which focuses on the development of a precise dynamical model that accounts for the different aerodynamic effects, the Sensor Integration approach, which focuses on the addition of multiple sensors to the quadrotor and applying algorithms to stabilize the quadrotor based on their measurements, and the Controller Design approach, which focuses on the development of an adaptive and robust controller. In this research, a learning controller is proposed as a solution for the issue of quadrotor trajectory control in confined environments. This controller utilizes Artificial Neural Networks to adjust for the unknown aerodynamics on-line. A systematic approach for controller design is developed, so that, the approach could be followed for the development of controllers for other nonlinear systems of similar form. One goal for this research is to develop a global controller that could be applied to any quadrotor with minimal adjustment. A novel Artificial Neural Network structure is presented that increases learning efficiency and speed. In addition, a new learning algorithm is developed for the Artificial Neural Network, when utilized with the developed controller. Simulation results for the designed controller when applied to the Qball-X4 quadrotor are presented that show the effectiveness of the proposed Artificial Neural Network structure and the developed learning algorithm in the presence of variety of different unknown aerodynamics. These results are confirmed with real time experimentation, as the developed controller was successfully applied to Quanser’s Qball-X4 quadrotor for the flight control in confined environment. The practical challenges associated with the application of such a controller for quadrotor flight in confined environment are analyzed and adequately resolved to achieve an acceptable tracking performance