A brief review of neural networks based learning and control and their applications for robots

As an imitation of the biological nervous systems, neural networks (NN), which are characterized with powerful learning ability, have been employed in a wide range of applications, such as control of complex nonlinear systems, optimization, system identification and patterns recognition etc. This article aims to bring a brief review of the state-of-art NN for the complex nonlinear systems. Recent progresses of NNs in both theoretical developments and practical applications are investigated and surveyed. Specifically, NN based robot learning and control applications were further reviewed, including NN based robot manipulator control, NN based human robot interaction and NN based behavior recognition and generation

Simultaneous identification, tracking control and disturbance rejection of uncertain nonlinear dynamics systems: A unified neural approach

Previous works of traditional zeroing neural networks (or termed Zhang neural networks, ZNN) show great success for solving specific time-variant problems of known systems in an ideal environment. However, it is still a challenging issue for the ZNN to effectively solve time-variant problems for uncertain systems without the prior knowledge. Simultaneously, the involvement of external disturbances in the neural network model makes it even hard for time-variant problem solving due to the intensively computational burden and low accuracy. In this paper, a unified neural approach of simultaneous identification, tracking control and disturbance rejection in the framework of the ZNN is proposed to address the time-variant tracking control of uncertain nonlinear dynamics systems (UNDS). The neural network model derived by the proposed approach captures hidden relations between inputs and outputs of the UNDS. The proposed model shows outstanding tracking performance even under the influences of uncertainties and disturbances. Then, the continuous-time model is discretized via Euler forward formula (EFF). The corresponding discrete algorithm and block diagram are also presented for the convenience of implementation. Theoretical analyses on the convergence property and discretization accuracy are presented to verify the performance of the neural network model. Finally, numerical studies, robot applications, performance comparisons and tests demonstrate the effectiveness and advantages of the proposed neural network model for the time-variant tracking control of UNDS

Adaptive control and neural network control of nonlinear discrete-time systems

Ph.DDOCTOR OF PHILOSOPH

Control of chaos in nonlinear circuits and systems

Nonlinear circuits and systems, such as electronic circuits (Chapter 5), power converters (Chapter 6), human brains (Chapter 7), phase lock loops (Chapter 8), sigma delta modulators (Chapter 9), etc, are found almost everywhere. Understanding nonlinear behaviours as well as control of these circuits and systems are important for real practical engineering applications. Control theories for linear circuits and systems are well developed and almost complete. However, different nonlinear circuits and systems could exhibit very different behaviours. Hence, it is difficult to unify a general control theory for general nonlinear circuits and systems. Up to now, control theories for nonlinear circuits and systems are still very limited. The objective of this book is to review the state of the art chaos control methods for some common nonlinear circuits and systems, such as those listed in the above, and stimulate further research and development in chaos control for nonlinear circuits and systems. This book consists of three parts. The first part of the book consists of reviews on general chaos control methods. In particular, a time-delayed approach written by H. Huang and G. Feng is reviewed in Chapter 1. A master slave synchronization problem for chaotic Lur’e systems is considered. A delay independent and delay dependent synchronization criteria are derived based on the H performance. The design of the time delayed feedback controller can be accomplished by means of the feasibility of linear matrix inequalities. In Chapter 2, a fuzzy model based approach written by H.K. Lam and F.H.F. Leung is reviewed. The synchronization of chaotic systems subject to parameter uncertainties is considered. A chaotic system is first represented by the fuzzy model. A switching controller is then employed to synchronize the systems. The stability conditions in terms of linear matrix inequalities are derived based on the Lyapunov stability theory. The tracking performance and parameter design of the controller are formulated as a generalized eigenvalue minimization problem which is solved numerically via some convex programming techniques. In Chapter 3, a sliding mode control approach written by Y. Feng and X. Yu is reviewed. Three kinds of sliding mode control methods, traditional sliding mode control, terminal sliding mode control and non-singular terminal sliding mode control, are employed for the control of a chaotic system to realize two different control objectives, namely to force the system states to converge to zero or to track desired trajectories. Observer based chaos synchronizations for chaotic systems with single nonlinearity and multi-nonlinearities are also presented. In Chapter 4, an optimal control approach written by C.Z. Wu, C.M. Liu, K.L. Teo and Q.X. Shao is reviewed. Systems with nonparametric regression with jump points are considered. The rough locations of all the possible jump points are identified using existing kernel methods. A smooth spline function is used to approximate each segment of the regression function. A time scaling transformation is derived so as to map the undecided jump points to fixed points. The approximation problem is formulated as an optimization problem and solved via existing optimization tools. The second part of the book consists of reviews on general chaos controls for continuous-time systems. In particular, chaos controls for Chua’s circuits written by L.A.B. Tôrres, L.A. Aguirre, R.M. Palhares and E.M.A.M. Mendes are discussed in Chapter 5. An inductorless Chua’s circuit realization is presented, as well as some practical issues, such as data analysis, mathematical modelling and dynamical characterization, are discussed. The tradeoff among the control objective, the control energy and the model complexity is derived. In Chapter 6, chaos controls for pulse width modulation current mode single phase H-bridge inverters written by B. Robert, M. Feki and H.H.C. Iu are discussed. A time delayed feedback controller is used in conjunction with the proportional controller in its simple form as well as in its extended form to stabilize the desired periodic orbit for larger values of the proportional controller gain. This method is very robust and easy to implement. In Chapter 7, chaos controls for epileptiform bursting in the brain written by M.W. Slutzky, P. Cvitanovic and D.J. Mogul are discussed. Chaos analysis and chaos control algorithms for manipulating the seizure like behaviour in a brain slice model are discussed. The techniques provide a nonlinear control pathway for terminating or potentially preventing epileptic seizures in the whole brain. The third part of the book consists of reviews on general chaos controls for discrete-time systems. In particular, chaos controls for phase lock loops written by A.M. Harb and B.A. Harb are discussed in Chapter 8. A nonlinear controller based on the theory of backstepping is designed so that the phase lock loops will not be out of lock. Also, the phase lock loops will not exhibit Hopf bifurcation and chaotic behaviours. In Chapter 9, chaos controls for sigma delta modulators written by B.W.K. Ling, C.Y.F. Ho and J.D. Reiss are discussed. A fuzzy impulsive control approach is employed for the control of the sigma delta modulators. The local stability criterion and the condition for the occurrence of limit cycle behaviours are derived. Based on the derived conditions, a fuzzy impulsive control law is formulated so that the occurrence of the limit cycle behaviours, the effect of the audio clicks and the distance between the state vectors and an invariant set are minimized supposing that the invariant set is nonempty. The state vectors can be bounded within any arbitrary nonempty region no matter what the input step size, the initial condition and the filter parameters are. The editors are much indebted to the editor of the World Scientific Series on Nonlinear Science, Prof. Leon Chua, and to Senior Editor Miss Lakshmi Narayan for their help and congenial processing of the edition

Identification and Control of Nonlinear Singularly Perturbed Systems Using Multi-time-scale Neural Networks

Many industrial systems are nonlinear with "slow" and "fast" dynamics because of the presence of some ``parasitic" parameters such as small time constants, resistances, inductances, capacitances, masses and moments of inertia. These systems are usually labeled as "singularly perturbed" or ``multi-time-scale" systems. Singular perturbation theory has been proved to be a useful tool to control and analyze singularly perturbed systems if the full knowledge of the system model parameters is available. However, the accurate and faithful mathematical models of those systems are usually difficult to obtain due to the uncertainties and nonlinearities. To obtain the accurate system models, in this research, a new identification scheme for the discrete time nonlinear singularly perturbed systems using multi-time-scale neural network and optimal bounded ellipsoid method is proposed firstly. Compared with other gradient descent based identification schemes, the new identification method proposed in this research can achieve faster convergence and higher accuracy due to the adaptively adjusted learning gain. Later, the optimal bounded ellipsoid based identification method for discrete time systems is extended to the identification of continuous singularly perturbed systems. Subsequently, by adding two additional terms in the weight's updating laws, a modified identification scheme is proposed to guarantee the effectiveness of the identification algorithm during the whole identification process. Lastly, through introducing some filtered variables, a robust neural network training algorithm is proposed for the system identification problem subjected to measurement noises. Based on the identification results, the singular perturbation theory is introduced to decompose a high order multi-time-scale system into two low order subsystems -- the reduced slow subsystem and the reduced fast subsystem. Then, two controllers are designed for the two subsystems separately. By using the singular perturbation theory, an adaptive controller for a regulation problem is designed in this research firstly. Because the system order is reduced, the adaptive controller proposed in this research has a simpler structure and requires much less computational resources, compared with other conventional controllers. Afterward, an indirect adaptive controller is proposed for solving the trajectory tracking problem. The stability of both identification and control schemes are analyzed through the Lyapunov approach, and the effectiveness of the identification and control algorithms are demonstrated using simulations and experiments

Nanopositionnement 3D à base de mesure à courant tunnel et piezo-actionnement

The objective of this thesis was to elaborate high performance control strategies and their real-time validation on a tunneling current-based 3D nanopositioning system developed in GIPSA-lab. The thesis lies in the domain of micro-/nano mechatronic systems (MEMS) focused on applications of fast and precise positioning and scanning tunneling microscopy (STM). More precisely, the aim is to position the metallic tunneling tip (like in STM) over the metallic surface using piezoelectric actuators in X, Y and Z directions and actuated micro-cantilever (like in Atomic Force Microscope AFM), electrostatically driven in Z direction, with high precision, over possibly high bandwidth. However, the presence of different adverse effects appearing at such small scale (e.g. measurement noise, nonlinearities of different nature, cross-couplings, vibrations) strongly affect the overall performance of the 3D system. Therefore a high performance control is needed. To that end, a novel 3D model of the system has been developed and appropriate control methods for such a system have been elaborated. First the focus is on horizontal X and Y directions. The nonlinear hysteresis and creep effects exhibited by piezoelectric actuators have been compensated and a comparison between different compensation methods is provided. Modern SISO and MIMO robust control methods are next used to reduce high frequency effects of piezo vibration and cross-couplings between X and Y axes. Next, the horizontal motion is combined with the vertical one (Z axis) with tunneling current and micro-cantilever control. Illustrative experimental results for 3D nanopositioning of tunneling tip, as well as simulation results for surface topography reconstruction and multi-mode cantilever positioning, are finally given.L'objectif de la thèse est l'élaboration de lois de commande de haute performance et leur validation en temps réel sur une plateforme expérimentale 3D de nano-positionnement à base de courant à effet tunnel, développée au laboratoire GIPSA-lab. Elle s'inscrit donc dans le cadre des systèmes micro-/nano-mécatronique (MEMS), et de la commande. Plus précisément, le principal enjeu considéré est de positionner la pointe métallique à effet tunnel (comme en microscopie à effet tunnel STM) contre la surface métallique en utilisant des actionneurs piézoélectriques en X, Y et Z et un micro-levier (comme en microscopie à force atomique AFM) actionné électrostatiquement en Z avec une grande précision et une bande passante élevée. Cependant, la présence de différents effets indésirables apparaissant à cette petite échelle (comme le bruit de mesure, des non-linéarités de natures différentes, les couplages, les vibrations) affectent fortement la performance globale du système 3D. En conséquence, une commande de haute performance est nécessaire. Pour cela, un nouveau modèle 3D du système a été développé et des méthodes de contrôle appropriées pour un tel système ont été élaborées. Tout d'abord l'accent est mis sur de positionnement selon les axes X et Y. Les effets d'hystérésis et de fluage non linéaires présents dans les actionneurs piézoélectriques ont été compensés et une comparaison entre les différentes méthodes de compensation est effectuée. Des techniques modernes de commande robuste SISO et MIMO sont ensuite utilisées pour réduire les effets des vibrations piézoélectriques et des couplages entre les axes X et Y. Le mouvement horizontal est alors combiné avec le mouvement vertical (Axe Z) et une commande du courant tunnel et du micro-levier. Des résultats expérimentaux illustrent le nano positionnement 3D de la pointe, et des résultats de simulation pour la reconstruction de la topographie de la surface ainsi que le positionnement du micro-levier à base d'un modèle multi-modes

Contraction Theory for Robust Learning-Based Control: Toward Aerospace and Robotic Autonomy

Machine learning and AI have been used for achieving autonomy in various aerospace and robotic systems. In next-generation research tasks, which could involve highly nonlinear, complicated, and large-scale decision-making problems in safety-critical situations, however, the existing performance guarantees of black-box AI approaches may not be sufficiently powerful. This thesis gives a mathematical overview of contraction theory, with some practical examples drawn from joint projects with NASA JPL, for enjoying formal guarantees of nonlinear control theory even with the use of machine learning-based and data-driven methods. This is not to argue that these methods are always better than conventional approaches, but to provide formal tools to investigate their performance for further discussion, so we can design and operate truly autonomous aerospace and robotic systems safely, robustly, adaptively, and intelligently in real-time. Contraction theory is an analytical tool to study differential dynamics of a non-autonomous (i.e., time-varying) nonlinear system under a contraction metric defined with a uniformly positive definite matrix, the existence of which results in a necessary and sufficient characterization of incremental exponential stability of multiple solution trajectories with respect to each other. Its nonlinear stability analysis boils down to finding a suitable contraction metric that satisfies a stability condition expressed as a linear matrix inequality, resulting in many parallels drawn between linear systems theory and contraction theory for nonlinear systems. This yields much-needed safety and stability guarantees for neural network-based control and estimation schemes, without resorting to a more involved method of using uniform asymptotic stability for input-to-state stability. Such distinctive features permit the systematic construction of a contraction metric via convex optimization, thereby obtaining an explicit exponential bound on the distance between a time-varying target trajectory and solution trajectories perturbed externally due to disturbances and learning errors. The first two parts of this thesis are about a theoretical overview of contraction theory and its advantages, with an emphasis on deriving formal robustness and stability guarantees for deep learning-based 1) feedback control, 2) state estimation, 3) motion planning, 4) multi-agent collision avoidance and robust tracking augmentation, 5) adaptive control, 6) neural net-based system identification and control, for nonlinear systems perturbed externally by deterministic and stochastic disturbances. In particular, we provide a detailed review of techniques for finding contraction metrics and associated control and estimation laws using deep neural networks. In the third part of the thesis, we present several numerical simulations and empirical validation of our proposed approaches to assess the impact of our findings on realizing aerospace and robotic autonomy. We mainly focus on the two joint projects with NASA JPL: 1) Science-Infused Spacecraft Autonomy for Interstellar Object Exploration and 2) Constellation Autonomous Space Technology Demonstration of Orbital Reconfiguration (CASTOR), where we also perform hardware demonstrations of our methods using our thruster-based spacecraft simulators (M-STAR) and in high-conflict, distributed, intelligent UAV swarm reconfiguration with up to 20 UAVs (crazyflies).</p