Event-sampled direct adaptive neural network control of uncertain strict-feedback system with application to quadrotor unmanned aerial vehicle

Neural networks (NNs) are utilized in the backstepping approach to design a control input by approximating unknown dynamics of the strict-feedback nonlinear system with event-sampled inputs. The system state vector is assumed to be unknown and an observer is used to estimate the state vector. By using the estimated state vector and backstepping design approach, an event-sampled controller is introduced. As part of the controller design, first, input-to-state-like stability (ISS) for a continuously sampled controller that has been injected with bounded measurement errors is demonstrated and, subsequently, an event-execution control law is derived such that the measurement errors are guaranteed to remain bounded. Lyapunov theory is used to demonstrate that the tracking errors, the observer estimation errors, and the NN weight estimation errors for each NN are locally uniformly ultimately bounded (UUB) in the presence bounded disturbances, NN reconstruction errors, as well as errors introduced by event-sampling. Simulation results are provided to illustrate the effectiveness of the proposed controllers. Subsequently, the output-feedback neural network (NN) controller that was presented above is considered for an underactuated quadrotor UAV application. The flexibility for the control of a quadrotor UAV is extended by incorporating notions of event-sampling and by designing an appropriate event-execution law. First, the continuously sampled controller is considered in the presence of bounded measurement errors and it is shown that the system generates a local ISS-like Lyapunov function. Next, by designing an appropriate event-execution law, the measurement errors that result from event-sampling are shown to be bounded for all time. Finally, the effectiveness of the proposed event-sampled controller is demonstrated with simulation results --Abstract, page iv

Lyapunov based optimal control of a class of nonlinear systems

Optimal control of nonlinear systems is in fact difficult since it requires the solution to the Hamilton-Jacobi-Bellman (HJB) equation which has no closed-form solution. In contrast to offline and/or online iterative schemes for optimal control, this dissertation in the form of five papers focuses on the design of iteration free, online optimal adaptive controllers for nonlinear discrete and continuous-time systems whose dynamics are completely or partially unknown even when the states not measurable. Thus, in Paper I, motivated by homogeneous charge compression ignition (HCCI) engine dynamics, a neural network-based infinite horizon robust optimal controller is introduced for uncertain nonaffine nonlinear discrete-time systems. First, the nonaffine system is transformed into an affine-like representation while the resulting higher order terms are mitigated by using a robust term. The optimal adaptive controller for the affinelike system solves HJB equation and identifies the system dynamics provided a target set point is given. Since it is difficult to define the set point a priori in Paper II, an extremum seeking control loop is designed while maximizing an uncertain output function. On the other hand, Paper III focuses on the infinite horizon online optimal tracking control of known nonlinear continuous-time systems in strict feedback form by using state and output feedback by relaxing the initial admissible controller requirement. Paper IV applies the optimal controller from Paper III to an underactuated helicopter attitude and position tracking problem. In Paper V, the optimal control of nonlinear continuous-time systems in strict feedback form from Paper III is revisited by using state and output feedback when the internal dynamics are unknown. Closed-loop stability is demonstrated for all the controller designs developed in this dissertation by using Lyapunov analysis --Abstract, page iv

Linear matrix inequality-based nonlinear adaptive robust control with application to unmanned aircraft systems

Unmanned aircraft systems (UASs) are gaining popularity in civil and commercial applications as their lightweight on-board computers become more powerful and affordable, their power storage devices improve, and the Federal Aviation Administration addresses the legal and safety concerns of integrating UASs in the national airspace. Consequently, many researchers are pursuing novel methods to control UASs in order to improve their capabilities, dependability, and safety assurance. The nonlinear control approach is a common choice as it offers several benefits for these highly nonlinear aerospace systems (e.g., the quadrotor). First, the controller design is physically intuitive and is derived from well known dynamic equations. Second, the final control law is valid in a larger region of operation, including far from the equilibrium states. And third, the procedure is largely methodical, requiring less expertise with gain tuning, which can be arduous for a novice engineer. ^ Considering these facts, this thesis proposes a nonlinear controller design method that combines the advantages of adaptive robust control (ARC) with the powerful design tools of linear matrix inequalities (LMI). The ARC-LMI controller is designed with a discontinuous projection-based adaptation law, and guarantees a prescribed transient and steady state tracking performance for uncertain systems in the presence of matched disturbances. The norm of the tracking error is bounded by a known function that depends on the controller design parameters in a known form. Furthermore, the LMI-based part of the controller ensures the stability of the system while overcoming polytopic uncertainties, and minimizes the control effort. This can reduce the number of parameters that require adaptation, and helps to avoid control input saturation. ^ These desirable characteristics make the ARC-LMI control algorithm well suited for the quadrotor UAS, which may have unknown parameters and may encounter external disturbances such as wind gusts and turbulence. This thesis develops the ARC-LMI attitude and position controllers for an X-configuration quadrotor helicopter. The inner-loop of the autopilot controls the attitude and altitude of the quadrotor, and the outer-loop controls its position in the earth-fixed coordinate frame. Furthermore, by intelligently generating a smooth trajectory from the given reference coordinates (waypoints), the transient performance is improved. The simulation results indicate that the ARC-LMI controller design is useful for a variety of quadrotor applications, including precise trajectory tracking, autonomous waypoint navigation in the presence of disturbances, and package delivery without loss of performanc

Decentralized adaptive neural network control of interconnected nonlinear dynamical systems with application to power system

Traditional nonlinear techniques cannot be directly applicable to control large scale interconnected nonlinear dynamic systems due their sheer size and unavailability of system dynamics. Therefore, in this dissertation, the decentralized adaptive neural network (NN) control of a class of nonlinear interconnected dynamic systems is introduced and its application to power systems is presented in the form of six papers. In the first paper, a new nonlinear dynamical representation in the form of a large scale interconnected system for a power network free of algebraic equations with multiple UPFCs as nonlinear controllers is presented. Then, oscillation damping for UPFCs using adaptive NN control is discussed by assuming that the system dynamics are known. Subsequently, the dynamic surface control (DSC) framework is proposed in continuous-time not only to overcome the need for the subsystem dynamics and interconnection terms, but also to relax the explosion of complexity problem normally observed in traditional backstepping. The application of DSC-based decentralized control of power system with excitation control is shown in the third paper. On the other hand, a novel adaptive NN-based decentralized controller for a class of interconnected discrete-time systems with unknown subsystem and interconnection dynamics is introduced since discrete-time is preferred for implementation. The application of the decentralized controller is shown on a power network. Next, a near optimal decentralized discrete-time controller is introduced in the fifth paper for such systems in affine form whereas the sixth paper proposes a method for obtaining the L2-gain near optimal control while keeping a tradeoff between accuracy and computational complexity. Lyapunov theory is employed to assess the stability of the controllers --Abstract, page iv

On adaptive control and particle filtering in the automatic administration of medicinal drugs

Automatic feedback methodologies for the administration of medicinal drugs offer undisputed potential benefits in terms of cost reduction and improved clinical outcomes. However, despite several decades of research, the ultimate safety of many--it would be fair to say most--closed-loop drug delivery approaches remains under question and manual methods based on clinicians' expertise are still dominant in clinical practice. Key challenges to the design of control systems for these applications include uncertainty in pharmacological models, as well as intra- and interpatient variability in the response to drug administration. Pharmacological systems may feature nonlinearities, time delays, time-varying parameters and non-Gaussian stochastic processes. This dissertation investigates a novel multi-controller adaptive control strategy capable of delivering safe control for closed-loop drug delivery applications without impairing clinicians' ability to make an expert assessment of a clinical situation. Our new feedback control approach, which we have named Robust Adaptive Control with Particle Filtering (RAC-PF), estimates a patient's individual response characteristic in real-time through particle filtering and uses the Bayesian inference result to select the most suitable controller for closed-loop operation from a bank of candidate controllers designed using the robust methodology of mu-synthesis. The work is presented as four distinct pieces of research. We first apply the existing approach of Robust Multiple-Model Adaptive Control (RMMAC), which features robust controllers and Kalman filter estimators, to the case-study of administration of the vasodepressor drug sodium nitroprusside and examine benefits and drawbacks. We then consider particle filtering as an alternative to Kalman filter-based methods for the real-time estimation of pharmacological dose-response, and apply this to the nonlinear pharmacokinetic-pharmacodynamic model of the anaesthetic drug propofol. We ultimately combine particle filters and robust controllers to create RAC-PF, and test our novel approach first in a proof-of-concept design and finally in the case of sodium nitroprusside. The results presented in the dissertation are based on computational studies, including extensive Monte-Carlo simulation campaigns. Our findings of improved parameter estimates from noisy observations support the use of particle filtering as a viable tool for real-time Bayesian inference in pharmacological system identification. The potential of the RAC-PF approach as an extension of RMMAC for closed-loop control of a broader class of systems is also clearly highlighted, with the proposed new approach delivering safe control of acute hypertension through sodium nitroprusside infusion when applied to a very general population response model. All approaches presented are generalisable and may be readily adapted to other drug delivery instances

Brachiating power line inspection robot: controller design and implementation

The prevalence of electrical transmission networks has led to an increase in productivity and prosperity. In 2014, estimates showed that the global electric power transmission network consisted of 5.5 million circuit kilometres (Ckm) of high-voltage transmission lines with a combined capacity of 17 million mega-volt ampere. The vastness of the global transmission grid presents a significant problem for infrastructure maintenance. The high maintenance costs, coupled with challenging terrain, provide an opportunity for autonomous inspection robots. The Brachiating Power Line Inspection Robot (BPLIR) with wheels [73] is a transmission line inspection robot. The BPLIR is the focus of this research and this dissertation tackles the problem of state estimation, adaptive trajectory generation and robust control for the BPLIR. A kinematics-based Kalman Filter state estimator was designed and implemented to determine the full system state. Instrumentation used for measurement consisted of 2 Inertial Measurement Units (IMUs). The advantages of utilising IMUs is that they are less susceptible to drift, have no moving parts and are not prone to misalignment errors. The use of IMU's in the design meant that absolute angles (link angles measured with respect to earth) could be estimated, enabling the BPLIR to navigate inclined slopes. Quantitative Feedback Control theory was employed to address the issue of parameter uncertainty during operation. The operating environment of the BPLIR requires it to be robust to environmental factors such as wind disturbance and uncertainty in joint friction over time. The resulting robust control system was able to compensate for uncertain system parameters and reject disturbances in simulation. An online trajectory generator (OTG), inspired by Raibert-style reverse-time symmetry[10], fed into the control system to drive the end effector to the power line by employing brachiation. The OTG produced two trajectories; one of which was reverse time symmetrical and; another which minimised the perpendicular distance between the end gripper and the power line. Linear interpolation between the two trajectories ensured a smooth bump-less trajectory for the BPLIR to follow

Adaptive Control of Systems with Quantization and Time Delays

This thesis addresses problems relating to tracking control of nonlinear systems in the presence of quantization and time delays. Motivated by the importance in areas such as networked control systems (NCSs) and digital systems, where the use of a communication network in NCS introduces several constraints to the control system, such as the occurrence of quantization and time delays. Quantization and time delays are of both practical and theoretical importance, and the study of systems where these issues arises is thus of great importance. If the system also has parameters that vary or are uncertain, this will make the control problem more complicated. Adaptive control is one tool to handle such system uncertainty. In this thesis, adaptive backstepping control schemes are proposed to handle uncertainties in the system, and to reduce the effects of quantization. Different control problems are considered where quantization is introduced in the control loop, either at the input, the state or both the input and the state. The quantization introduces difficulties in the controller design and stability analysis due to the limited information and nonlinear characteristics, such as discontinuous phenomena. In the thesis, it is analytically shown how the choice of quantization level affects the tracking performance, and how the stability of the closed-loop system equilibrium can be achieved by choosing proper design parameters. In addition, a predictor feedback control scheme is proposed to compensate for a time delay in the system, where the inputs are quantized at the same time. Experiments on a 2-degrees of freedom (DOF) helicopter system demonstrate the different developed control schemes.publishedVersio