A brief review of neural networks based learning and control and their applications for robots

As an imitation of the biological nervous systems, neural networks (NN), which are characterized with powerful learning ability, have been employed in a wide range of applications, such as control of complex nonlinear systems, optimization, system identification and patterns recognition etc. This article aims to bring a brief review of the state-of-art NN for the complex nonlinear systems. Recent progresses of NNs in both theoretical developments and practical applications are investigated and surveyed. Specifically, NN based robot learning and control applications were further reviewed, including NN based robot manipulator control, NN based human robot interaction and NN based behavior recognition and generation

Time-and event-driven communication process for networked control systems: A survey

Copyright © 2014 Lei Zou et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.In recent years, theoretical and practical research topics on networked control systems (NCSs) have gained an increasing interest from many researchers in a variety of disciplines owing to the extensive applications of NCSs in practice. In particular, an urgent need has arisen to understand the effects of communication processes on system performances. Sampling and protocol are two fundamental aspects of a communication process which have attracted a great deal of research attention. Most research focus has been on the analysis and control of dynamical behaviors under certain sampling procedures and communication protocols. In this paper, we aim to survey some recent advances on the analysis and synthesis issues of NCSs with different sampling procedures (time-and event-driven sampling) and protocols (static and dynamic protocols). First, these sampling procedures and protocols are introduced in detail according to their engineering backgrounds as well as dynamic natures. Then, the developments of the stabilization, control, and filtering problems are systematically reviewed and discussed in great detail. Finally, we conclude the paper by outlining future research challenges for analysis and synthesis problems of NCSs with different communication processes.This work was supported in part by the National Natural Science Foundation of China under Grants 61329301, 61374127, and 61374010, the Royal Society of the UK, and the Alexander von Humboldt Foundation of Germany

Online fault detection and isolation of nonlinear systems

This paper describes an online fault detection scheme for a class of nonlinear dynamic systems with modelling uncertainty and inaccessible states. Only the inputs and outputs of the system can be measured. The faults are assumed to be functions of the state, instead of the output and the input of the system. A nonlinear online approximator using dynamic recurrent neural network is utilised to monitor the faults in the system. The construction and the learning algorithm of the online approximator are presented. The stability, robustness and sensitivity of the fault detection scheme under certain assumptions are analysed. An example demonstrates the efficiency of the proposed fault detection scheme.published_or_final_versio

Adaptive Critic Based Neuro-Observer

A new Neural Network (NN) based observer design method for nonlinear systems represented by nonlinear dynamics and linear/nonlinear measurement is proposed in this paper. In this new approach, as the first step, the observer design problem is changed into a controller design problem by establishing the error dynamics, and then the Adaptive Critic (AC) based approach is applied on this error dynamics to design a \u27controller\u27, such that the errors are driven to zero. The resulting observer has inherent robustness from the AC based design approach. Some simulations are presented to illustrate the effectiveness of this approach

Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes

I argue that data becomes temporarily interesting by itself to some self-improving, but computationally limited, subjective observer once he learns to predict or compress the data in a better way, thus making it subjectively simpler and more beautiful. Curiosity is the desire to create or discover more non-random, non-arbitrary, regular data that is novel and surprising not in the traditional sense of Boltzmann and Shannon but in the sense that it allows for compression progress because its regularity was not yet known. This drive maximizes interestingness, the first derivative of subjective beauty or compressibility, that is, the steepness of the learning curve. It motivates exploring infants, pure mathematicians, composers, artists, dancers, comedians, yourself, and (since 1990) artificial systems.Comment: 35 pages, 3 figures, based on KES 2008 keynote and ALT 2007 / DS 2007 joint invited lectur

Terminal sliding mode control strategy design for second-order nonlinear system

This study mainly focuses on the terminal sliding mode control (TSMC) strategy design, including an adaptive terminal sliding mode control (ATSMC) and an exact-estimator-based terminal sliding mode control (ETSMC) for second-order nonlinear dynamical systems. In the ATSMC system, an adaptive bound estimation for the lump uncertainty is proposed to ensure the system stability. On the other hand, an exact estimator is designed for exact estimating system uncertainties to solve the trouble of chattering phenomena caused by a sign function in ATSMC law in despite of the utilization of a fixed value or an adaptive tuning algorithm for the lumped uncertainty bound. The effectiveness of the proposed control schemes can be verified in numerical simulations.<br /

Adaptive self-recurrent wavelet neural network and sliding mode controller/observer for a slider crank mechanism

In this paper, a novel control strategy based on an adaptive Self-Recurrent Wavelet Neural Network (SRWNN) and a sliding mode controller/observer for a slider crank mechanism is proposed. The aim is to reduce the tracking error of the linear displacement of this mechanism while following a specified trajectory. The controller design consists of two parts. The first one is a sliding mode control strategy and the second part is an SRWNN controller. This controller is trained offline first, and then the SRWNN weights are updated online by the adaptive control law. Apart from the hybrid control strategy proposed in this paper, a velocity observer is implemented to replace the use of velocity sensors. The outcomes obtained in the numerical experiment section prove that the smallest tracking error is obtained for the linear and angular displacements in comparison with other strategies found in literature due to the uncertainty and disturbance rejection properties of the sliding mode and the self-recurrent wavelet neural network controllers.Peer ReviewedPostprint (author's final draft

An Output-Recurrent-Neural-Network-Based Iterative Learning Control for Unknown Nonlinear Dynamic Plants

We present a design method for iterative learning control system by using an output recurrent neural network (ORNN). Two ORNNs are employed to design the learning control structure. The first ORNN, which is called the output recurrent neural controller (ORNC), is used as an iterative learning controller to achieve the learning control objective. To guarantee the convergence of learning error, some information of plant sensitivity is required to design a suitable adaptive law for the ORNC. Hence, a second ORNN, which is called the output recurrent neural identifier (ORNI), is used as an identifier to provide the required information. All the weights of ORNC and ORNI will be tuned during the control iteration and identification process, respectively, in order to achieve a desired learning performance. The adaptive laws for the weights of ORNC and ORNI and the analysis of learning performances are determined via a Lyapunov like analysis. It is shown that the identification error will asymptotically converge to zero and repetitive output tracking error will asymptotically converge to zero except the initial resetting error