Use of human gestures for controlling a mobile robot via adaptive CMAC network and fuzzy logic controller

Mobile robots with manipulators have been more and more commonly applied in extreme and hostile environments to assist or even replace human operators for complex tasks. In addition to autonomous abilities, mobile robots need to facilitate the human–robot interaction control mode that enables human users to easily control or collaborate with robots. This paper proposes a system which uses human gestures to control an autonomous mobile robot integrating a manipulator and a video surveillance platform. A human user can control the mobile robot just as one drives an actual vehicle in the vehicle’s driving cab. The proposed system obtains human’s skeleton joints information using a motion sensing input device, which is then recognized and interpreted into a set of control commands. This is implemented, based on the availability of training data set and requirement of in-time performance, by an adaptive cerebellar model articulation controller neural network, a finite state machine, a fuzzy controller and purposely designed gesture recognition and control command generation systems. These algorithms work together implement the steering and velocity control of the mobile robot in real-time. The experimental results demonstrate that the proposed approach is able to conveniently control a mobile robot using virtual driving method, with smooth manoeuvring trajectories in various speeds

A recurrent emotional CMAC neural network controller for vision-based mobile robots

Vision-based mobile robots often suffer from the difficulties of high nonlinear dynamics and precise positioning requirements, which leads to the development demand of more powerful nonlinear approximation in controlling and monitoring of mobile robots. This paper proposes a recurrent emotional cerebellar model articulation controller (RECMAC) neural network in meeting such demand. In particular, the proposed network integrates a recurrent loop and an emotional learning mechanism into a cerebellar model articulation controller (CMAC), which is implemented as the main component of the controller module of a vision-based mobile robot. Briefly, the controller module consists of a sliding surface, the RECMAC, and a compensator controller. The incorporation of the recurrent structure in a slide model neural network controller ensures the retaining of the previous states of the robot to improve its dynamic mapping ability. The convergence of the proposed system is guaranteed by applying the Lyapunov stability analysis theory. The proposed system was validated and evaluated by both simulation and a practical moving-target tracking task. The experimentation demonstrated that the proposed system outperforms other popular neural network-based control systems, and thus it is superior in approximating highly nonlinear dynamics in controlling vision-based mobile robots

Self-organizing Brain Emotional Learning Controller Network for Intelligent Control System of Mobile Robots

The trajectory tracking ability of mobile robots suffers from uncertain disturbances. This paper proposes an adaptive control system consisting of a new type of self-organizing neural network controller for mobile robot control. The newly designed neural network contains the key mechanisms of a typical brain emotional learning controller network and a self-organizing radial basis function network. In this system, the input values are delivered to a sensory channel and an emotional channel; and the two channels interact with each other to generate the final outputs of the proposed network. The proposed network possesses the ability of online generation and elimination of fuzzy rules to achieve an optimal neural structure. The parameters of the proposed network are on-line tunable by the brain emotional learning rules and gradient descent method; in addition, the stability analysis theory is used to guarantee the convergence of the proposed controller. In the experimentation, a simulated mobile robot was applied to verify the feasibility and effectiveness of the proposed control system. The comparative study using the cutting-edge neural network-based control systems confirms the proposed network is capable of producing better control performances with high computational efficiency

An Improved Fuzzy Brain Emotional Learning Model Network Controller for Humanoid Robots

The brain emotional learning (BEL) system was inspired by the biological amygdala-orbitofrontal model to mimic the high speed of the emotional learning mechanism in the mammalian brain, which has been successfully applied in many real-world applications. Despite of its success, such system often suffers from slow convergence for online humanoid robotic control. This paper presents an improved fuzzy BEL model (iFBEL) neural network by integrating a fuzzy neural network (FNN) to a conventional BEL, in an effort to better support humanoid robots. In particular, the system inputs are passed into a sensory and emotional channels that jointly produce the final outputs of the network. The non-linear approximation ability of the iFBEL is achieved by taking the BEL network as the emotional channel. The proposed iFBEL works with a robust controller in generating the hand and gait motion of a humanoid robot. The updating rules of the iFBEL-based controller are composed of two parts, including a sensory channel followed by the updating rules of the conventional BEL model, and the updating rules of the FNN and the robust controller which are derived from the "Lyapunov" function. The experiments on a three-joint robot manipulator and a six-joint biped robot demonstrated the superiority of the proposed system in reference to a conventional proportional-integral-derivative controller and a fuzzy cerebellar model articulation controller, based on the more accurate and faster control performance of the proposed iFBEL

A Robust Adaptive Control using Fuzzy Neural Network for Robot Manipulators with Dead-Zone

In this paper, a robust-adaptive-fuzzy-neural-network controller (RAFNNs) bases on dead zone compensator for industrial robot manipulators (RM) is proposed to dead the unknown model and external disturbance. Here, the unknown dynamics of the robot system is deal by using fuzzy neural network to approximate the unknown dynamics. The online training laws and estimation of the dead-zone are determined by Lyapunov stability theory and the approximation theory. In this proposal, the robust sliding-mode-control (SMC) is constructed to optimize parameter vectors, solve the approximation error and higher order terms. Therefore, the stability, robustness, and desired tracking performance of RAFNNs for RM are guaranteed. The simulations and experiments performed on three-link RM are provided in comparison with neural-network (NNs) and proportional-integral-derivative (PID) to demonstrate the robustness and effectiveness of the RAFNNs

Error minimising gradients for improving cerebellar model articulation controller performance

In motion control applications where the desired trajectory velocity exceeds an actuator’s maximum velocity limitations, large position errors will occur between the desired and actual trajectory responses. In these situations standard control approaches cannot predict the output saturation of the actuator and thus the associated error summation cannot be minimised.An adaptive feedforward control solution such as the Cerebellar Model Articulation Controller (CMAC) is able to provide an inherent level of prediction for these situations, moving the system output in the direction of the excessive desired velocity before actuator saturation occurs. However the pre-empting level of a CMAC is not adaptive, and thus the optimal point in time to start moving the system output in the direction of the excessive desired velocity remains unsolved. While the CMAC can adaptively minimise an actuator’s position error, the minimisation of the summation of error over time created by the divergence of the desired and actual trajectory responses requires an additional adaptive level of control.This thesis presents an improved method of training CMACs to minimise the summation of error over time created when the desired trajectory velocity exceeds the actuator’s maximum velocity limitations. This improved method called the Error Minimising Gradient Controller (EMGC) is able to adaptively modify a CMAC’s training signal so that the CMAC will start to move the output of the system in the direction of the excessive desired velocity with an optimised pre-empting level.The EMGC was originally created to minimise the loss of linguistic information conveyed through an actuated series of concatenated hand sign gestures reproducing deafblind sign language. The EMGC concept however is able to be implemented on any system where the error summation associated with excessive desired velocities needs to be minimised, with the EMGC producing an improved output approximation over using a CMAC alone.In this thesis, the EMGC was tested and benchmarked against a feedforward / feedback combined controller using a CMAC and PID controller. The EMGC was tested on an air-muscle actuator for a variety of situations comprising of a position discontinuity in a continuous desired trajectory. Tested situations included various discontinuity magnitudes together with varying approach and departure gradient profiles.Testing demonstrated that the addition of an EMGC can reduce a situation’s error summation magnitude if the base CMAC controller has not already provided a prior enough pre-empting output in the direction of the situation. The addition of an EMGC to a CMAC produces an improved approximation of reproduced motion trajectories, not only minimising position error for a single sampling instance, but also over time for periodic signals

Humanoid Robots

For many years, the human being has been trying, in all ways, to recreate the complex mechanisms that form the human body. Such task is extremely complicated and the results are not totally satisfactory. However, with increasing technological advances based on theoretical and experimental researches, man gets, in a way, to copy or to imitate some systems of the human body. These researches not only intended to create humanoid robots, great part of them constituting autonomous systems, but also, in some way, to offer a higher knowledge of the systems that form the human body, objectifying possible applications in the technology of rehabilitation of human beings, gathering in a whole studies related not only to Robotics, but also to Biomechanics, Biomimmetics, Cybernetics, among other areas. This book presents a series of researches inspired by this ideal, carried through by various researchers worldwide, looking for to analyze and to discuss diverse subjects related to humanoid robots. The presented contributions explore aspects about robotic hands, learning, language, vision and locomotion

Prediction and optimization of a desulphurization system using CMAC neural network and genetic algorithm

In this paper, taking desulphurizing ratio and economic cost as two objectives, a ten-input two-output prediction model was structured and validated for desulphurization system. Cerebellar model articulation controller (CMAC) neural network and genetic algorithm (GA) were used for model building and optimization of cost respectively. In the model building process, the grey relation entropy analysis and uniform design method were used to screen the input variables and study the model parameters separately. Traditional regression analysis and proposed location number analysis method were adopted to analyze output errors of experiment group and predict the results of test group. Results show that regression analyses keep high fit degree with experiment group results while the fitting accuracies for test group are quite different. As for location number analysis, a power function between output errors and location numbers was fitted well with the data of experiment group and test group for SO2. Prediction model was initialized by location number analysis method. Model was validated and cost optimization case was performed with GA subsequently. The result shows that the optimal cost obtained from GA could be reduced by more than 30% compared with original optimal operating parameters under same constraints

Fuzzy transfer learning in human activity recognition.

Assisted living environments are incorporated with different technological solutions to improve the quality of life and well-being. In recent years, there has been a growing interest in the research community on how to develop evolving solutions to aid assisted living. Different techniques have been studied to address the need for technological systems which are intelligent enough to evolve their knowledge to solve tasks which have not been previously encountered. One such approach is Transfer Learning (TL), for example, between humans and robots. Humans excel at dealing with everyday activities, learning and adapting to different activities. This comprises different complex techniques which enable the lifelong learning process from observation of our environment. To obtain similar learning in assistive agents, TL is needed. The aim of the research reported in this thesis is to address the challenge associated with learning and reuse of knowledge by assistive agents in an Ambient Assisted Living (AAL) environment. In this thesis, a novel approach to transfer learning of human activities through the combination of three methods; TL, Fuzzy Systems (FS) and Human Activity Recognition (HAR) is presented. Through the incorporation of FS into the proposed approach, uncertainty that is evident in the dynamic nature of human activities are embedded into the learning model. This research is focused on applications in assistive robotics. This is with a purpose of enabling assistive robots in AAL environments to acquire knowledge of such activities as are performed by humans. To achieve this, an extensive investigation into existing learning methods applied in human activities is conducted. The investigation encompasses current state-of-the-art of TL approaches employed in skill transfer across different but contextually related activities. To address the research questions identified in the thesis, the contributions of the methodology employed are in three main categories; 1) Firstly, a novel framework for human activity learning from information observed. Experiments are conducted on selected human activities to acquire enough information for building the framework. From the acquired information, relevant features extracted are used in a learning model to recognise different activities. 2) Secondly, the sequence of occurrence(s) of tasks in an activity needs to be considered in the learning process. Therefore, in this research, a novel technique for adaptive learning of activity sequences from acquired information is developed. 3) Finally, from the sequence obtained, a novel technique for transfer of human activity across heterogeneous feature space existing between a human and an assistive robot is developed. These categories form the basis of the TL framework modelled in this research. The framework proposed is applied to TL of human activity from data generated experimentally and benchmark datasets of various classes of human activities. The results presented in this thesis show that exploring the process of human activity learning is an important aspect in the TL framework. The features extracted sufficiently distinguish relevant patterns for each activity. Also, the results demonstrate the ability of the methodology to learn and predict human actions with a high degree of certainty. This encourages the use of TL in assisted living environments and other applications. This and many more applications of TL in technology would be a potential driver of the next revolution in artificial intelligence