Adaptive Predictive Control Using Neural Network for a Class of Pure-feedback Systems in Discrete-time

10.1109/TNN.2008.2000446IEEE Transactions on Neural Networks1991599-1614ITNN

Output feedback NN control for two classes of discrete-time systems with unknown control directions in a unified approach

10.1109/TNN.2008.2003290IEEE Transactions on Neural Networks19111873-1886ITNN

Control of Nonaffine Nonlinear Discrete Time Systems using Reinforcement-learning-Based Linearly Parameterized Neural Networks

A nonaffine discrete-time system represented by the nonlinear autoregressive moving average with eXogenous input (NARMAX) representation with unknown nonlinear system dynamics is considered. An equivalent affinelike representation in terms of the tracking error dynamics is first obtained from the original nonaffine nonlinear discrete-time system so that reinforcement-learning-based near-optimal neural network (NN) controller can be developed. The control scheme consists of two linearly parameterized NNs. One NN is designated as the critic NN, which approximates a predefined long-term cost function, and an action NN is employed to derive a near-optimal control signal for the system to track a desired trajectory while minimizing the cost function simultaneously. The NN weights are tuned online. by using the standard Lyapunov approach, the stability of the closed-loop system is shown. The net result is a supervised actor-critic NN controller scheme which can be applied to a general nonaffine nonlinear discrete-time system without needing the affinelike representation. Simulation results demonstrate satisfactory performance of the controlle

Online Reinforcement Learning Control of Unknown Nonaffine Nonlinear Discrete Time Systems

In this paper, a novel neural network (NN) based online reinforcement learning controller is designed for nonaffine nonlinear discrete-time systems with bounded disturbances. The nonaffine systems are represented by nonlinear auto regressive moving average with exogenous input (NARMAX) model with unknown nonlinear functions. An equivalent affine-like representation for the tracking error dynamics is developed first from the original nonaffine system. Subsequently, a reinforcement learning-based neural network (NN) controller is proposed for the affine-like nonlinear error dynamic system. The control scheme consists of two NNs. One NN is designated as the critic, which approximates a predefined long-term cost function, whereas an action NN is employed to derive a control signal for the system to track a desired trajectory while minimizing the cost function simultaneously. Offline NN training is not required and online NN weight tuning rules are derived. By using the standard Lyapunov approach, the uniformly ultimate boundedness (UUB) of the tracking error and weight estimates is demonstrated

Adaptive neural control of MIMO nonlinear systems with a block-triangular pure-feedback control structure

This paper presents adaptive neural tracking control for a class of uncertain multi-input-multi-output (MIMO) nonlinear systems in block-triangular form. All subsystems within these MIMO nonlinear systems are of completely nonaffine purefeedback form and allowed to have different orders. To deal with the nonaffine appearance of the control variables, the mean value theorem (MVT) is employed to transform the systems into a block-triangular strict-feedback form with control coefficients being couplings among various inputs and outputs. A systematic procedure is proposed for the design of a new singularityfree adaptive neural tracking control strategy. Such a design procedure can remove the couplings among subsystems and hence avoids the possible circular control construction problem. As a consequence, all the signals in the closed-loop system are guaranteed to be semiglobally uniformly ultimately bounded (SGUUB). Moreover, the outputs of the systems are ensured to converge to a small neighborhood of the desired trajectories. Simulation studies verify the theoretical findings revealed in this work

A brief review of neural networks based learning and control and their applications for robots

As an imitation of the biological nervous systems, neural networks (NN), which are characterized with powerful learning ability, have been employed in a wide range of applications, such as control of complex nonlinear systems, optimization, system identification and patterns recognition etc. This article aims to bring a brief review of the state-of-art NN for the complex nonlinear systems. Recent progresses of NNs in both theoretical developments and practical applications are investigated and surveyed. Specifically, NN based robot learning and control applications were further reviewed, including NN based robot manipulator control, NN based human robot interaction and NN based behavior recognition and generation

On-line modeling and control via T-S fuzzy models for nonaffine nonlinear systems using a second type adaptive fuzzy approach

[[abstract]]This paper proposes a novel method for on-line modeling and robust adaptive control via Takagi-Sugeno (T-S) fuzzy models for nonaffine nonlinear systems, with external disturbances. The T-S fuzzy model is established to approximate the nonaffine nonlinear dynamic system in a linearized way. The so-called second type adaptive law is adopted, where not only the consequent part (the weighting factors) of fuzzy implications but also the antecedent part (the membership functions) of fuzzy implications are adjusted. Fuzzy B-spline membership functions (BMFs) are used for on-line tuning. Furthermore, the effect of all the unmodeled dynamics, BMF modeling errors and external disturbances on the tracking error is attenuated by a fuzzy error compensator which is also constructed from the T-S fuzzy model. In this paper, we can prove that the closed-loop system which is controlled by the proposed controller is stable and the tracking error will converge to zero. Three examples are simulated in order to confirm the effectiveness and applicability of the proposed methods in this paper.[[notice]]補正完

Data-Driven Robust Control of Unknown MIMO Nonlinear System Subject to Input Saturations and Disturbances

This paper presented a new data-driven robust control scheme for unknown nonlinear systems in the presence of input saturation and external disturbances. According to the input and output data of the nonlinear system, a recurrent neural network (RNN) data-driven model is established to reconstruct the dynamics of the nonlinear system. An adaptive output-feedback controller is developed to approximate the unknown disturbances and a novel input saturation compensation method is used to attenuate the effect of the input saturation. Under the proposed adaptive control scheme, the uniformly ultimately bounded convergence of all the signals of the closed-loop nonlinear system is guaranteed via Lyapunov analysis. The simulation results are given to show the effectiveness of the proposed data-driven robust controller

Neural network control of nonstrict feedback and nonaffine nonlinear discrete-time systems with application to engine control

In this dissertation, neural networks (NN) approximate unknown nonlinear functions in the system equations, unknown control inputs, and cost functions for two different classes of nonlinear discrete-time systems. Employing NN in closed-loop feedback systems requires that weight update algorithms be stable...Controllers are developed and applied to a nonlinear, discrete-time system of equations for a spark ignition engine model to reduce the cyclic dispersion of heat release --Abstract, page iv