137 research outputs found

    Control of Nonaffine Nonlinear Discrete Time Systems using Reinforcement-learning-Based Linearly Parameterized Neural Networks

    Get PDF
    A nonaffine discrete-time system represented by the nonlinear autoregressive moving average with eXogenous input (NARMAX) representation with unknown nonlinear system dynamics is considered. An equivalent affinelike representation in terms of the tracking error dynamics is first obtained from the original nonaffine nonlinear discrete-time system so that reinforcement-learning-based near-optimal neural network (NN) controller can be developed. The control scheme consists of two linearly parameterized NNs. One NN is designated as the critic NN, which approximates a predefined long-term cost function, and an action NN is employed to derive a near-optimal control signal for the system to track a desired trajectory while minimizing the cost function simultaneously. The NN weights are tuned online. by using the standard Lyapunov approach, the stability of the closed-loop system is shown. The net result is a supervised actor-critic NN controller scheme which can be applied to a general nonaffine nonlinear discrete-time system without needing the affinelike representation. Simulation results demonstrate satisfactory performance of the controlle

    Adaptive Control of Unknown Pure Feedback Systems with Pure State Constraints

    Full text link
    This paper deals with the tracking control problem for a class of unknown pure feedback system with pure state constraints on the state variables and unknown time-varying bounded disturbances. An adaptive controller is presented for such systems for the very first time. The controller is designed using the backstepping method. While designing it, Barrier Lyapunov Functions is used so that the state variables do not contravene its constraints. In order to cope with the unknown dynamics of the system, an online approximator is designed using a neural network with a novel adaptive law for its weight update. In the stability analysis of the system, the time derivative of Lyapunov function involves known virtual control coefficient with unknown direction and to deal with such problem Nussbaum gain is used to design the control law. Furthermore, to make the controller robust and computationally inexpensive, a novel disturbance observer is designed to estimate the disturbance along with neural network approximation error and the time derivative of virtual control input. The effectiveness of the proposed approach is demonstrated through a simulation study on the third-order nonlinear system

    Neural network control of nonstrict feedback and nonaffine nonlinear discrete-time systems with application to engine control

    Get PDF
    In this dissertation, neural networks (NN) approximate unknown nonlinear functions in the system equations, unknown control inputs, and cost functions for two different classes of nonlinear discrete-time systems. Employing NN in closed-loop feedback systems requires that weight update algorithms be stable...Controllers are developed and applied to a nonlinear, discrete-time system of equations for a spark ignition engine model to reduce the cyclic dispersion of heat release --Abstract, page iv

    Adaptive control and neural network control of nonlinear discrete-time systems

    Get PDF
    Ph.DDOCTOR OF PHILOSOPH
    corecore