A brief review of neural networks based learning and control and their applications for robots

As an imitation of the biological nervous systems, neural networks (NN), which are characterized with powerful learning ability, have been employed in a wide range of applications, such as control of complex nonlinear systems, optimization, system identification and patterns recognition etc. This article aims to bring a brief review of the state-of-art NN for the complex nonlinear systems. Recent progresses of NNs in both theoretical developments and practical applications are investigated and surveyed. Specifically, NN based robot learning and control applications were further reviewed, including NN based robot manipulator control, NN based human robot interaction and NN based behavior recognition and generation

A Novel Self-organizing Fuzzy Cerebellar Model Articulation Controller Based Overlapping Gaussian Membership Function for Controlling Robotic System

This paper introduces an effective intelligent controller for robotic systems with uncertainties. The proposed method is a novel self-organizing fuzzy cerebellar model articulation controller (NSOFC) which is a combination of a cerebellar model articulation controller (CMAC) and sliding mode control (SMC). We also present a new Gaussian membership function (GMF) that is designed by the combination of the prior and current GMF for each layer of CMAC. In addition, the relevant data of the prior GMF is used to check tracking errors more accurately. The inputs of the proposed controller can be mixed simultaneously between the prior and current states according to the corresponding errors. Moreover, the controller uses a self-organizing approach which can increase or decrease the number of layers, therefore the structures of NSOFC can be adjusted automatically. The proposed method consists of a NSOFC controller and a compensation controller. The NSOFC controller is used to estimate the ideal controller, and the compensation controller is used to eliminate the approximated error. The online parameters tuning law of NSOFC is designed based on Lyapunov’s theory to ensure stability of the system. Finally, the experimental results of a 2 DOF robot arm are used to demonstrate the efficiency of the proposed controller

Design of cross-coupled CMAC for contour-following – a reinforcement-based ILC approach

One of the most popular applications of a bi-axial motion stage is precision motion control. The reduction of tracking error and contour error is one of the most coveted goals in precision motion control systems. The accuracy of a motion control system is often affected by external disturbances. In addition, system non-linearity such as friction also represents a major hurdle to motion precision. In order to deal with the aforementioned problem, this paper proposes a fuzzy logic-based Reinforcement Iterative Learning Control (RILC) and a Cross-Coupled Cerebellar Model Articulation Controller (CCCMAC). In particular, the proposed fuzzy logicbased RILC and a LuGre friction model-based compensation approach are exploited to improve motion accuracy. The fuzzy logic-based RILC aims at reducing tracking error and compensating for external disturbance, while the LuGre friction model is responsible for friction compensation. In addition, the CCCMAC consisting of a cerebellar model articulation controller and a cross-coupled controller aims at reducing contour error and dealing with the problem of dynamics mismatch between different axes. Performance comparisons between the proposed fuzzy logic-based Reinforcement Iterative Learning Cross-Coupled Cerebellar Model Articulation Controller (RIL–CCCMAC) and several existing control schemes are conducted on a bi-axial motion stage. Experimental results verify the effectiveness of the proposed RIL–CCCMAC

An Application of Modified T2FHC Algorithm in Two-Link Robot Controller

Parallel robotic systems have shown their advantages over the traditional serial robots such as high payload capacity, high speed, and high precision. Their applications are widespread from transportation to manufacturing fields. Therefore, most of the recent studies in parallel robots focus on finding the best method to improve the system accuracy. Enhancing this metric, however, is still the biggest challenge in controlling a parallel robot owing to the complex mathematical model of the system. In this paper, we present a novel solution to this problem with a Type 2 Fuzzy Coherent Controller Network (T2FHC), which is composed of a Type 2 Cerebellar Model Coupling Controller (CMAC) with its fast convergence ability and a Brain Emotional Learning Controller (BELC) using the Lyaponov-based weight updating rule. In addition, the T2FHC is combined with a surface generator to increase the system flexibility. To evaluate its applicability in real life, the proposed controller was tested on a Quanser 2-DOF robot system in three case studies: no load, 180 g load and 360 g load, respectively. The results showed that the proposed structure achieved superior performance compared to those of available algorithms such as CMAC and Novel Self-Organizing Fuzzy CMAC (NSOF CMAC). The Root Mean Square Error (RMSE) index of the system that was 2.20E-06 for angle A and 2.26E-06 for angle B and the tracking error that was -6.42E-04 for angle A and 2.27E-04 for angle B demonstrate the good stability and high accuracy of the proposed T2FHC. With this outstanding achievement, the proposed method is promising to be applied to many applications using nonlinear systems

A recurrent emotional CMAC neural network controller for vision-based mobile robots

Vision-based mobile robots often suffer from the difficulties of high nonlinear dynamics and precise positioning requirements, which leads to the development demand of more powerful nonlinear approximation in controlling and monitoring of mobile robots. This paper proposes a recurrent emotional cerebellar model articulation controller (RECMAC) neural network in meeting such demand. In particular, the proposed network integrates a recurrent loop and an emotional learning mechanism into a cerebellar model articulation controller (CMAC), which is implemented as the main component of the controller module of a vision-based mobile robot. Briefly, the controller module consists of a sliding surface, the RECMAC, and a compensator controller. The incorporation of the recurrent structure in a slide model neural network controller ensures the retaining of the previous states of the robot to improve its dynamic mapping ability. The convergence of the proposed system is guaranteed by applying the Lyapunov stability analysis theory. The proposed system was validated and evaluated by both simulation and a practical moving-target tracking task. The experimentation demonstrated that the proposed system outperforms other popular neural network-based control systems, and thus it is superior in approximating highly nonlinear dynamics in controlling vision-based mobile robots

Model-based reinforcement learning: A survey

Reinforcement learning is an important branch of machine learning and artificial intelligence. Compared with traditional reinforcement learning, model-based reinforcement learning obtains the action of the next state by the model that has been learned, and then optimizes the policy, which greatly improves data efficiency. Based on the present status of research on model-based reinforcement learning at home and abroad, this paper comprehensively reviews the key techniques of model-based reinforcement learning, summarizes the characteristics, advantages and defects of each technology, and analyzes the application of model-based reinforcement learning in games, robotics and brain science