Lyapunov based optimal control of a class of nonlinear systems

Optimal control of nonlinear systems is in fact difficult since it requires the solution to the Hamilton-Jacobi-Bellman (HJB) equation which has no closed-form solution. In contrast to offline and/or online iterative schemes for optimal control, this dissertation in the form of five papers focuses on the design of iteration free, online optimal adaptive controllers for nonlinear discrete and continuous-time systems whose dynamics are completely or partially unknown even when the states not measurable. Thus, in Paper I, motivated by homogeneous charge compression ignition (HCCI) engine dynamics, a neural network-based infinite horizon robust optimal controller is introduced for uncertain nonaffine nonlinear discrete-time systems. First, the nonaffine system is transformed into an affine-like representation while the resulting higher order terms are mitigated by using a robust term. The optimal adaptive controller for the affinelike system solves HJB equation and identifies the system dynamics provided a target set point is given. Since it is difficult to define the set point a priori in Paper II, an extremum seeking control loop is designed while maximizing an uncertain output function. On the other hand, Paper III focuses on the infinite horizon online optimal tracking control of known nonlinear continuous-time systems in strict feedback form by using state and output feedback by relaxing the initial admissible controller requirement. Paper IV applies the optimal controller from Paper III to an underactuated helicopter attitude and position tracking problem. In Paper V, the optimal control of nonlinear continuous-time systems in strict feedback form from Paper III is revisited by using state and output feedback when the internal dynamics are unknown. Closed-loop stability is demonstrated for all the controller designs developed in this dissertation by using Lyapunov analysis --Abstract, page iv

Robust Multi-Criteria Optimal Fuzzy Control of Continuous-Time Nonlinear Systems

This paper presents a novel fuzzy control design of continuous-time nonlinear systems with multiple performance criteria. The purpose behind this work is to improve the traditional fuzzy controller performance to satisfy several performance criteria simultaneously to secure quadratic optimality with inherent stability property together with dissipativity type of disturbance reduction. The Takagi– Sugeno fuzzy model is used in our control system design. By solving the linear matrix inequality at each time step, the control solution can be found to satisfy the mixed performance criteria. The effectiveness of the proposed technique is demonstrated by simulation of the control of the inverted pendulum system

Time-Varying Input and State Delay Compensation for Uncertain Nonlinear Systems

A robust controller is developed for uncertain, second-order nonlinear systems subject to simultaneous unknown, time-varying state delays and known, time-varying input delays in addition to additive, sufficiently smooth disturbances. An integral term composed of previous control values facilitates a delay-free open-loop error system and the development of the feedback control structure. A stability analysis based on Lyapunov-Krasovskii (LK) functionals guarantees uniformly ultimately bounded tracking under the assumption that the delays are bounded and slowly varying

3 sampled-data control of nonlinear systems

This chapter provides some of the main ideas resulting from recent developments in sampled-data control of nonlinear systems. We have tried to bring the basic parts of the new developments within the comfortable grasp of graduate students. Instead of presenting the more general results that are available in the literature, we opted to present their less general versions that are easier to understand and whose proofs are easier to follow. We note that some of the proofs we present have not appeared in the literature in this simplified form. Hence, we believe that this chapter will serve as an important reference for students and researchers that are willing to learn about this area of research

Resilient Observer Design for Discrete-Time Nonlinear Systems with General Criteria

A class of discrete-time nonlinear system and measurement equations having incrementally conic nonlinearities and finite energy disturbances is considered. A linear matrix inequality based resilient observer design approach is presented to guarantee the satisfaction of a variety of performance criteria ranging from simple estimation error boundedness to dissipativity in the presence of bounded perturbations on the gain. Some simulation examples are included to illustrate the proposed design methodology