Lyapunov based optimal control of a class of nonlinear systems

Optimal control of nonlinear systems is in fact difficult since it requires the solution to the Hamilton-Jacobi-Bellman (HJB) equation which has no closed-form solution. In contrast to offline and/or online iterative schemes for optimal control, this dissertation in the form of five papers focuses on the design of iteration free, online optimal adaptive controllers for nonlinear discrete and continuous-time systems whose dynamics are completely or partially unknown even when the states not measurable. Thus, in Paper I, motivated by homogeneous charge compression ignition (HCCI) engine dynamics, a neural network-based infinite horizon robust optimal controller is introduced for uncertain nonaffine nonlinear discrete-time systems. First, the nonaffine system is transformed into an affine-like representation while the resulting higher order terms are mitigated by using a robust term. The optimal adaptive controller for the affinelike system solves HJB equation and identifies the system dynamics provided a target set point is given. Since it is difficult to define the set point a priori in Paper II, an extremum seeking control loop is designed while maximizing an uncertain output function. On the other hand, Paper III focuses on the infinite horizon online optimal tracking control of known nonlinear continuous-time systems in strict feedback form by using state and output feedback by relaxing the initial admissible controller requirement. Paper IV applies the optimal controller from Paper III to an underactuated helicopter attitude and position tracking problem. In Paper V, the optimal control of nonlinear continuous-time systems in strict feedback form from Paper III is revisited by using state and output feedback when the internal dynamics are unknown. Closed-loop stability is demonstrated for all the controller designs developed in this dissertation by using Lyapunov analysis --Abstract, page iv

Stochastically Resilient Observer Design for a Class of Continuous-Time Nonlinear Systems

This work addresses the design of stochastically resilient or non-fragile continuous-time Luenberger observers for systems with incrementally conic nonlinearities. Such designs maintain the convergence and/or performance when the observer gain is erroneously implemented due possibly to computational errors i.e. round off errors in computing the observer gain or changes in the observer parameters during operation. The error in the observer gain is modeled as a random process and a common linear matrix inequality formulation is presented to address the stochastically resilient observer design problem for a variety of performance criteria. Numerical examples are given to illustrate the theoretical results

Robust Multi-Criteria Optimal Fuzzy Control of Continuous-Time Nonlinear Systems

This paper presents a novel fuzzy control design of continuous-time nonlinear systems with multiple performance criteria. The purpose behind this work is to improve the traditional fuzzy controller performance to satisfy several performance criteria simultaneously to secure quadratic optimality with inherent stability property together with dissipativity type of disturbance reduction. The Takagi– Sugeno fuzzy model is used in our control system design. By solving the linear matrix inequality at each time step, the control solution can be found to satisfy the mixed performance criteria. The effectiveness of the proposed technique is demonstrated by simulation of the control of the inverted pendulum system

Robust and Resilient State-dependent Control of Continuous-time Nonlinear Systems with General Performance Criteria

A novel state-dependent control approach for continuous-time nonlinear systems with general performance criteria is presented in this paper. This controller is optimally robust for model uncertainties and resilient against control feedback gain perturbations in achieving general performance criteria to secure quadratic optimality with inherent asymptotic stability property together with quadratic dissipative type of disturbance reduction. For the system model, unstructured uncertainty description is assumed, which incorporates commonly used types of uncertainties, such as norm-bounded and positive real uncertainties as special cases. By solving a state-dependent linear matrix inequality at each time, sufficient condition for the control solution can be found which satisfies the general performance criteria. The results of this paper unify existing results on nonlinear quadratic regulator, H∞ and positive real control. The efficacy of the proposed technique is demonstrated by numerical simulations of the nonlinear control of the inverted pendulum on a cart system

3 sampled-data control of nonlinear systems

This chapter provides some of the main ideas resulting from recent developments in sampled-data control of nonlinear systems. We have tried to bring the basic parts of the new developments within the comfortable grasp of graduate students. Instead of presenting the more general results that are available in the literature, we opted to present their less general versions that are easier to understand and whose proofs are easier to follow. We note that some of the proofs we present have not appeared in the literature in this simplified form. Hence, we believe that this chapter will serve as an important reference for students and researchers that are willing to learn about this area of research