Control of Complex Dynamic Systems by Neural Networks

This paper considers the use of neural networks (NN's) in controlling a nonlinear, stochastic system with unknown process equations. The NN is used to model the resulting unknown control law. The approach here is based on using the output error of the system to train the NN controller without the need to construct a separate model (NN or other type) for the unknown process dynamics. To implement such a direct adaptive control approach, it is required that connection weights in the NN be estimated while the system is being controlled. As a result of the feedback of the unknown process dynamics, however, it is not possible to determine the gradient of the loss function for use in standard (back-propagation-type) weight estimation algorithms. Therefore, this paper considers the use of a new stochastic approximation algorithm for this weight estimation, which is based on a 'simultaneous perturbation' gradient approximation that only requires the system output error. It is shown that this algorithm can greatly enhance the efficiency over more standard stochastic approximation algorithms based on finite-difference gradient approximations

Adaptive Output Feedback Apparatuses And Methods Capable Of Controlling A Non-minimum Phase System

The invention comprises apparatuses and methods for providing the capability to stabilize and control a non-minimum phase, nonlinear plant with unmodeled dynamics and/or parametric uncertainty through the use of adaptive output feedback. A disclosed apparatus can comprise a reference model unit for generating a reference model output signal ym. The apparatus can comprise a combining unit that combines and differences a plant output signal y of a non-minimum phase plant for which not all of the states can be sensed, and a plant output signal y, to generate an output error signal ỹ. The apparatus can further comprise an adaptive control unit for generating an adaptive control signal uad used to control the plant.Georgia Tech Research Corporatio

Output Reachable Set Estimation and Verification for Multi-Layer Neural Networks

In this paper, the output reachable estimation and safety verification problems for multi-layer perceptron neural networks are addressed. First, a conception called maximum sensitivity in introduced and, for a class of multi-layer perceptrons whose activation functions are monotonic functions, the maximum sensitivity can be computed via solving convex optimization problems. Then, using a simulation-based method, the output reachable set estimation problem for neural networks is formulated into a chain of optimization problems. Finally, an automated safety verification is developed based on the output reachable set estimation result. An application to the safety verification for a robotic arm model with two joints is presented to show the effectiveness of proposed approaches.Comment: 8 pages, 9 figures, to appear in TNNL

Adaptive output feedback control based on neural networks: application to flexible aircraft control

One of the major challenges in aeronautical flexible structures control is the uncertain for the non stationary feature of the systems. Transport aircrafts are of unceasingly growing size but are made from increasingly light materials so that their motion dynamics present some flexible low frequency modes coupled to rigid modes. For reasons that range from fuel transfer to random flying conditions, the parameters of these planes may be subject to significative variations during a flight. A single control law that would be robust to so large levels of uncertainties is likely to be limited in performance. For that reason, we follow in this work an adaptive control approach. Given an existing closed-loop system where a basic controller controls the rigid body modes, the problem of interest consists in designing an adaptive controller that could deal with the flexible modes of the system in such a way that the performance of the first controller is not deteriorated even in the presence of parameter variations. To this purpose, we follow a similar strategy as in Hovakimyan (2002) where a reference model adaptive control method has been proposed. The basic model of the rigid modes is regarded as a reference model and a neural network based learning algorithm is used to compensate online for the effects of unmodelled dynamics and parameter variations. We then successfully apply this control policy to the control of an Airbus aircraft. This is a very high dimensional dynamical model (about 200 states) whose direct control is obviously hard. However, by applying the aforementioned adaptive control technique to it, some promising simulation results can be achieved

Neural Modeling and Control of Diesel Engine with Pollution Constraints

The paper describes a neural approach for modelling and control of a turbocharged Diesel engine. A neural model, whose structure is mainly based on some physical equations describing the engine behaviour, is built for the rotation speed and the exhaust gas opacity. The model is composed of three interconnected neural submodels, each of them constituting a nonlinear multi-input single-output error model. The structural identification and the parameter estimation from data gathered on a real engine are described. The neural direct model is then used to determine a neural controller of the engine, in a specialized training scheme minimising a multivariable criterion. Simulations show the effect of the pollution constraint weighting on a trajectory tracking of the engine speed. Neural networks, which are flexible and parsimonious nonlinear black-box models, with universal approximation capabilities, can accurately describe or control complex nonlinear systems, with little a priori theoretical knowledge. The presented work extends optimal neuro-control to the multivariable case and shows the flexibility of neural optimisers. Considering the preliminary results, it appears that neural networks can be used as embedded models for engine control, to satisfy the more and more restricting pollutant emission legislation. Particularly, they are able to model nonlinear dynamics and outperform during transients the control schemes based on static mappings.Comment: 15 page