A recurrent emotional CMAC neural network controller for vision-based mobile robots

Vision-based mobile robots often suffer from the difficulties of high nonlinear dynamics and precise positioning requirements, which leads to the development demand of more powerful nonlinear approximation in controlling and monitoring of mobile robots. This paper proposes a recurrent emotional cerebellar model articulation controller (RECMAC) neural network in meeting such demand. In particular, the proposed network integrates a recurrent loop and an emotional learning mechanism into a cerebellar model articulation controller (CMAC), which is implemented as the main component of the controller module of a vision-based mobile robot. Briefly, the controller module consists of a sliding surface, the RECMAC, and a compensator controller. The incorporation of the recurrent structure in a slide model neural network controller ensures the retaining of the previous states of the robot to improve its dynamic mapping ability. The convergence of the proposed system is guaranteed by applying the Lyapunov stability analysis theory. The proposed system was validated and evaluated by both simulation and a practical moving-target tracking task. The experimentation demonstrated that the proposed system outperforms other popular neural network-based control systems, and thus it is superior in approximating highly nonlinear dynamics in controlling vision-based mobile robots

A brief review of neural networks based learning and control and their applications for robots

As an imitation of the biological nervous systems, neural networks (NN), which are characterized with powerful learning ability, have been employed in a wide range of applications, such as control of complex nonlinear systems, optimization, system identification and patterns recognition etc. This article aims to bring a brief review of the state-of-art NN for the complex nonlinear systems. Recent progresses of NNs in both theoretical developments and practical applications are investigated and surveyed. Specifically, NN based robot learning and control applications were further reviewed, including NN based robot manipulator control, NN based human robot interaction and NN based behavior recognition and generation

A CMAC-Based Systematic Design Approach of an Adaptive Embedded Control Force Loading System

In this chapter, an adaptive embedded control system is developed to measure yield strength of the material plate with an applied load. A systematic approach is proposed to handle special requirements of embedded control systems which are different from computer-based control systems as there are much less computational power and hardware resources available. Efficient control algorithm has to be designed to remove CPU burden so that the microcontroller has enough power available. A three-step approach is proposed to address the embedded control issue: Firstly, the mathematical description of the whole system is studied using both theoretical and experimental methods. A mathematical model is derived from the physical models of each component used, and an experiment is retrieved by employing Levy’s method and least square estimation to identify specific parameters of the system model. Secondly, an adaptive feedforward plus feedback controller is designed and simulated as a preparation for the embedded system implementation. The Cerebellar Model Articulation Controller (CMAC) is chosen as the feedforward part, and a PD controller is used as the feedback part to train the CMAC. Finally, the proposed algorithm is applied to the embedded system, and experiments are conducted to verify both the identified model and designed controller

Review of air fuel ratio prediction and control methods

Air pollution is one of main challenging issues nowadays that researchers have been trying to address.The emissions of vehicle engine exhausts are responsible for 50 percent of air pollution. Different types of emissions emit from vehicles including carbon monoxide, hydrocarbons, NOX, and so on. There is a tendency to develop strategies of engine control which work in a fast way. Accomplishing this task will result in a decrease in emissions which coupled with the fuel composition can bring about the best performance of the vehicle engine.Controlling the Air-Fuel Ratio (AFR) is necessary, because the AFR has an enormous impact on the effectiveness of the fuel and reduction of emissions.This paper is aimed at reviewing the recent studies on the prediction and control of the AFR, as a bulk of research works with different approaches, was conducted in this area.These approaches include both classical and modern methods, namely Artificial Neural Networks (ANN), Fuzzy Logic, and Neuro-Fuzzy Systems are described in this paper.The strength and the weakness of individual approaches will be discussed at length

Type-2 Fuzzy Hybrid Controller Network for Robotic Systems

Dynamic control, including robotic control, faces both the theoretical challenge of obtaining accurate system models and the practical difficulty of defining uncertain system bounds. To facilitate such challenges, this paper proposes a control system consisting of a novel type of fuzzy neural network and a robust compensator controller. The new fuzzy neural network is implemented by integrating a number of key components embedded in a Type-2 fuzzy cerebellar model articulation controller (CMAC) and a brain emotional learning controller (BELC) network, thereby mimicking an ideal sliding mode controller. The system inputs are fed into the neural network through a Type-2 fuzzy inference system (T2FIS), with the results subsequently piped into sensory and emotional channels which jointly produce the final outputs of the network. That is, the proposed network estimates the nonlinear equations representing the ideal sliding mode controllers using a powerful compensator controller with the support of T2FIS and BELC, guaranteeing robust tracking of the dynamics of the controlled systems. The adaptive dynamic tuning laws of the network are developed by exploiting the popular brain emotional learning rule and the Lyapunov function. The proposed system was applied to a robot manipulator and a mobile robot, demonstrating its efficacy and potential; and a comparative study with alternatives indicates a significant improvement by the proposed system in performing the intelligent dynamic control

Self-organizing Brain Emotional Learning Controller Network for Intelligent Control System of Mobile Robots

The trajectory tracking ability of mobile robots suffers from uncertain disturbances. This paper proposes an adaptive control system consisting of a new type of self-organizing neural network controller for mobile robot control. The newly designed neural network contains the key mechanisms of a typical brain emotional learning controller network and a self-organizing radial basis function network. In this system, the input values are delivered to a sensory channel and an emotional channel; and the two channels interact with each other to generate the final outputs of the proposed network. The proposed network possesses the ability of online generation and elimination of fuzzy rules to achieve an optimal neural structure. The parameters of the proposed network are on-line tunable by the brain emotional learning rules and gradient descent method; in addition, the stability analysis theory is used to guarantee the convergence of the proposed controller. In the experimentation, a simulated mobile robot was applied to verify the feasibility and effectiveness of the proposed control system. The comparative study using the cutting-edge neural network-based control systems confirms the proposed network is capable of producing better control performances with high computational efficiency

A Neural Network Approach to Dependent *Reliability Estimation.

This research presents the creation of a new model for automating the generation of component and system reliability estimates from simulated field data for tightly coupled systems. The model utilizes the CMAC neural network architecture, which resembles the human cerebellum and is capable of approximating nonlinear functions. An analysis and testing of the network as a tool for reliability prediction of dependent components within an assembly has been performed. In order to evaluate the performance of the model, the network has been tested on simulated data and provided over 90% performance accuracy in learning non-linear functions that represent the dependency between components. This serves as a valuable tool for maintenance personnel faced with important and costly decisions regarding equipment maintenance policies

Model-based reinforcement learning: A survey

Reinforcement learning is an important branch of machine learning and artificial intelligence. Compared with traditional reinforcement learning, model-based reinforcement learning obtains the action of the next state by the model that has been learned, and then optimizes the policy, which greatly improves data efficiency. Based on the present status of research on model-based reinforcement learning at home and abroad, this paper comprehensively reviews the key techniques of model-based reinforcement learning, summarizes the characteristics, advantages and defects of each technology, and analyzes the application of model-based reinforcement learning in games, robotics and brain science