Type-2 Fuzzy Hybrid Controller Network for Robotic Systems

Dynamic control, including robotic control, faces both the theoretical challenge of obtaining accurate system models and the practical difficulty of defining uncertain system bounds. To facilitate such challenges, this paper proposes a control system consisting of a novel type of fuzzy neural network and a robust compensator controller. The new fuzzy neural network is implemented by integrating a number of key components embedded in a Type-2 fuzzy cerebellar model articulation controller (CMAC) and a brain emotional learning controller (BELC) network, thereby mimicking an ideal sliding mode controller. The system inputs are fed into the neural network through a Type-2 fuzzy inference system (T2FIS), with the results subsequently piped into sensory and emotional channels which jointly produce the final outputs of the network. That is, the proposed network estimates the nonlinear equations representing the ideal sliding mode controllers using a powerful compensator controller with the support of T2FIS and BELC, guaranteeing robust tracking of the dynamics of the controlled systems. The adaptive dynamic tuning laws of the network are developed by exploiting the popular brain emotional learning rule and the Lyapunov function. The proposed system was applied to a robot manipulator and a mobile robot, demonstrating its efficacy and potential; and a comparative study with alternatives indicates a significant improvement by the proposed system in performing the intelligent dynamic control

An Application of Modified T2FHC Algorithm in Two-Link Robot Controller

Parallel robotic systems have shown their advantages over the traditional serial robots such as high payload capacity, high speed, and high precision. Their applications are widespread from transportation to manufacturing fields. Therefore, most of the recent studies in parallel robots focus on finding the best method to improve the system accuracy. Enhancing this metric, however, is still the biggest challenge in controlling a parallel robot owing to the complex mathematical model of the system. In this paper, we present a novel solution to this problem with a Type 2 Fuzzy Coherent Controller Network (T2FHC), which is composed of a Type 2 Cerebellar Model Coupling Controller (CMAC) with its fast convergence ability and a Brain Emotional Learning Controller (BELC) using the Lyaponov-based weight updating rule. In addition, the T2FHC is combined with a surface generator to increase the system flexibility. To evaluate its applicability in real life, the proposed controller was tested on a Quanser 2-DOF robot system in three case studies: no load, 180 g load and 360 g load, respectively. The results showed that the proposed structure achieved superior performance compared to those of available algorithms such as CMAC and Novel Self-Organizing Fuzzy CMAC (NSOF CMAC). The Root Mean Square Error (RMSE) index of the system that was 2.20E-06 for angle A and 2.26E-06 for angle B and the tracking error that was -6.42E-04 for angle A and 2.27E-04 for angle B demonstrate the good stability and high accuracy of the proposed T2FHC. With this outstanding achievement, the proposed method is promising to be applied to many applications using nonlinear systems

Advances in Reinforcement Learning

Reinforcement Learning (RL) is a very dynamic area in terms of theory and application. This book brings together many different aspects of the current research on several fields associated to RL which has been growing rapidly, producing a wide variety of learning algorithms for different applications. Based on 24 Chapters, it covers a very broad variety of topics in RL and their application in autonomous systems. A set of chapters in this book provide a general overview of RL while other chapters focus mostly on the applications of RL paradigms: Game Theory, Multi-Agent Theory, Robotic, Networking Technologies, Vehicular Navigation, Medicine and Industrial Logistic

Development of Self-Learning Type-2 Fuzzy Systems for System Identification and Control of Autonomous Systems

Modelling and control of dynamic systems are faced by multiple technical challenges, mainly due to the nature of uncertain complex, nonlinear, and time-varying systems. Traditional modelling techniques require a complete understanding of system dynamics and obtaining comprehensive mathematical models is not always achievable due to limited knowledge of the systems as well as the presence of multiple uncertainties in the environment. As universal approximators, fuzzy logic systems (FLSs), neural networks (NNs) and neuro-fuzzy systems have proved to be successful computational tools for representing the behaviour of complex dynamical systems. Moreover, FLSs, NNs and learning-based techniques have been gaining popularity for controlling complex, ill-defined, nonlinear, and time-varying systems in the face of uncertainties. However, fuzzy rules derived by experts can be too ad-hoc, and the performance is less than optimum. In other words, generating fuzzy rules and membership functions in fuzzy systems is a potential challenge especially for systems with many variables. Moreover, under the umbrella of FLSs, although type-1 fuzzy logic control systems (T1-FLCs) have been applied to control various complex nonlinear systems, they have limited capability to handle uncertainties. Aiming to accommodate uncertainties, type-2 fuzzy logic control systems (T2-FLCs) were established. This thesis aims to address the shortcomings of existing fuzzy techniques by utilisation of type-2 FLCs with novel adaptive capabilities. The first contribution of this thesis is a novel online system identification technique by means of a recursive interval type-2 Takagi-Sugeno fuzzy C-means clustering technique (IT2-TS-FC) to accommodate the footprint-of-uncertainties (FoUs). This development is meant to specifically address the shortcomings of type-1 fuzzy systems in capturing the footprint-of-uncertainties such as mechanical wear, rotor damage, battery drain and sensor and actuator faults. Unlike previous type-2 TS fuzzy models, the proposed method constructs two fuzzifiers (upper and lower) and two regression coefficients in the consequent part to handle uncertainties. The weighted least square method is employed to compute the regression coefficients. The proposed method is validated using two benchmarks, namely, real flight test data of a quadcopter drone and Mackey-Glass time series data. The algorithm has the capability to model uncertainties (e.g., noisy dataset). The second contribution of this thesis is the development of a novel self-adaptive interval type-2 fuzzy controller named the SAF2C for controlling multi-input multi-output (MIMO) nonlinear systems. The adaptation law is derived using sliding mode control (SMC) theory to reduce the computation time so that the learning process can be expedited by 80% compared to separate single-input single-output (SISO) controllers. The system employs the `Enhanced Iterative Algorithm with Stop Condition' (EIASC) type-reduction method, which is more computationally efficient than the `Karnik-Mendel' type-reduction algorithm. The stability of the SAF2C is proven using the Lyapunov technique. To ensure the applicability of the proposed control scheme, SAF2C is implemented to control several dynamical systems, including a simulated MIMO hexacopter unmanned aerial vehicle (UAV) in the face of external disturbance and parameter variations. The ability of SAF2C to filter the measurement noise is demonstrated, where significant improvement is obtained using the proposed controller in the face of measurement noise. Also, the proposed closed-loop control system is applied to control other benchmark dynamic systems (e.g., a simulated autonomous underwater vehicle and inverted pendulum on a cart system) demonstrating high accuracy and robustness to variations in system parameters and external disturbance. Another contribution of this thesis is a novel stand-alone enhanced self-adaptive interval type-2 fuzzy controller named the ESAF2C algorithm, whose type-2 fuzzy parameters are tuned online using the SMC theory. This way, we expect to design a computationally efficient adaptive Type-2 fuzzy system, suitable for real-time applications by introducing the EIASC type-reducer. The proposed technique is applied on a quadcopter UAV (QUAV), where extensive simulations and real-time flight tests for a hovering QUAV under wind disturbances are also conducted to validate the efficacy of the ESAF2C. Specifically, the control performance is investigated in the face of external wind gust disturbances, generated using an industrial fan. Stability analysis of the ESAF2C control system is investigated using the Lyapunov theory. Yet another contribution of this thesis is the development of a type-2 evolving fuzzy control system (T2-EFCS) to facilitate self-learning (either from scratch or from a certain predefined rule). T2-EFCS has two phases, namely, the structure learning and the parameters learning. The structure of T2-EFCS does not require previous information about the fuzzy structure, and it can start the construction of its rules from scratch with only one rule. The rules are then added and pruned in an online fashion to achieve the desired set-point. The proposed technique is applied to control an unmanned ground vehicle (UGV) in the presence of multiple external disturbances demonstrating the robustness of the proposed control systems. The proposed approach turns out to be computationally efficient as the system employs fewer fuzzy parameters while maintaining superior control performance

Design and analysis of Intelligent Navigational controller for Mobile Robot

Since last several years requirement graph for autonomous mobile robots according to its virtual application has always been an upward one. Smother and faster mobile robots navigation with multiple function are the necessity of the day. This research is based on navigation system as well as kinematics model analysis for autonomous mobile robot in known environments. To execute and attain introductory robotic behaviour inside environments(e.g. obstacle avoidance, wall or edge following and target seeking) robot uses method of perception, sensor integration and fusion. With the help of these sensors robot creates its collision free path and analyse an environmental map time to time. Mobile robot navigation in an unfamiliar environment can be successfully studied here using online sensor fusion and integration. Various AI algorithm are used to describe overall procedure of mobilerobot navigation and its path planning problem. To design suitable controller that create collision free path are achieved by the combined study of kinematics analysis of motion as well as an artificial intelligent technique. In fuzzy logic approach, a set of linguistic fuzzy rules are generated for navigation of mobile robot. An expert controller has been developed for the navigation in various condition of environment using these fuzzy rules. Further, type-2 fuzzy is employed to simplify and clarify the developed control algorithm more accurately due to fuzzy logic limitations. In addition, recurrent neural network (RNN) methodology has been analysed for robot navigation. Which helps the model at the time of learning stage. The robustness of controller has been checked on Webots simulation platform. Simulation results and performance of the controller using Webots platform show that, the mobile robot is capable for avoiding obstacles and reaching the termination point in efficient manner

Multiobjective Trajectory Optimization and Adaptive Backstepping Control for Rubber Unstacking Robot Based on RFWNN Method

Multiobjective trajectory optimization and adaptive backstepping control method based on recursive fuzzy wavelet neural network (RFWNN) are proposed to solve the problem of dynamic modeling uncertainties and strong external disturbance of the rubber unstacking robot during recycling process. First, according to the rubber viscoelastic properties, the Hunt-Crossley nonlinear model is used to construct the robot dynamics model. Then, combined with the dynamic model and the recycling process characteristics, the multiobjective trajectory optimization of the rubber unstacking robot is carried out for the operational efficiency, the running trajectory smoothness, and the energy consumption. Based on the trajectory optimization results, the adaptive backstepping control method based on RFWNN is adopted. The RFWNN method is applied in the main controller to cope with time-varying uncertainties of the robot dynamic system. Simultaneously, an adaptive robust control law is developed to eliminate inevitable approximation errors and unknown disturbances and relax the requirement for prior knowledge of the controlled system. Finally, the validity of the proposed control strategy is verified by experiment

Adaptive dynamic programming with eligibility traces and complexity reduction of high-dimensional systems

This dissertation investigates the application of a variety of computational intelligence techniques, particularly clustering and adaptive dynamic programming (ADP) designs especially heuristic dynamic programming (HDP) and dual heuristic programming (DHP). Moreover, a one-step temporal-difference (TD(0)) and n-step TD (TD(λ)) with their gradients are utilized as learning algorithms to train and online-adapt the families of ADP. The dissertation is organized into seven papers. The first paper demonstrates the robustness of model order reduction (MOR) for simulating complex dynamical systems. Agglomerative hierarchical clustering based on performance evaluation is introduced for MOR. This method computes the reduced order denominator of the transfer function by clustering system poles in a hierarchical dendrogram. Several numerical examples of reducing techniques are taken from the literature to compare with our work. In the second paper, a HDP is combined with the Dyna algorithm for path planning. The third paper uses DHP with an eligibility trace parameter (λ) to track a reference trajectory under uncertainties for a nonholonomic mobile robot by using a first-order Sugeno fuzzy neural network structure for the critic and actor networks. In the fourth and fifth papers, a stability analysis for a model-free action-dependent HDP(λ) is demonstrated with batch- and online-implementation learning, respectively. The sixth work combines two different gradient prediction levels of critic networks. In this work, we provide a convergence proofs. The seventh paper develops a two-hybrid recurrent fuzzy neural network structures for both critic and actor networks. They use a novel n-step gradient temporal-difference (gradient of TD(λ)) of an advanced ADP algorithm called value-gradient learning (VGL(λ)), and convergence proofs are given. Furthermore, the seventh paper is the first to combine the single network adaptive critic with VGL(λ). --Abstract, page iv

Systematic Design of Type-2 Fuzzy Logic Systems for Modeling and Control with Applications to Modular and Reconfigurable Robots

Fuzzy logic systems (FLSs) are well known in the literature for their ability to model linguistics and system uncertainties. Due to this ability, FLSs have been successfully used in modeling and control applications such as medicine, finance, communications, and operations research. Moreover, the ability of higher order fuzzy systems to handle system uncertainty has become an interesting topic of research in the field. In particular, type-2 FLSs (T2 FLSs), systems consisting of fuzzy sets with fuzzy grades of membership, a feature that type-1 (T1) does not offer, are most well-known for this capability. The structure of T2 FLSs allows for the incorporation of uncertainty in the input membership grades, a common situation in reasoning with physical systems. General T2 FLSs have a complex structure, thus making them difficult to adopt on a large scale. As a result, interval T2 FLSs (IT2 FLSs), a special class of T2 FLSs, have recently shown great potential in various applications with input-output (I/O) system uncertainties. Due to the sophisticated mathematical structure of IT2 FLSs, little to no systematic analysis has been reported in the literature to use such systems in control design. Moreover, to date, designers have distanced themselves from adopting such systems on a wide scale because of their design complexity. Furthermore, the very few existing control methods utilizing IT2 fuzzy logic control systems (IT2 FLCSs) do not guarantee the stability of their system. Therefore, this thesis presents a systematic method for designing stable IT2 Takagi-Sugeno-Kang (IT2 TSK) fuzzy systems when antecedents are T2 fuzzy sets and consequents are crisp numbers (A2-C0). Five new inference mechanisms are proposed that have closed-form I/O mappings, making them more feasible for FLCS stability analysis. The thesis focuses on control applications for when (a) both plant and controller use A2-C0 TSK models, and (b) the plant uses T1 Takagi-Sugeno (T1 TS) and the controller uses IT2 TS models. In both cases, sufficient stability conditions for the stability of the closed-loop system are derived. Furthermore, novel linear matrix inequality-based algorithms are developed for satisfying the stability conditions. Numerical analyses are included to validate the effectiveness of the new inference methods. Case studies reveal that a well-tuned IT2 TS FLCS using the proposed inference engine can potentially outperform its T1 TSK counterpart, a result of IT2 having greater structural flexibility than T1. Moreover, due to the simple nature of the proposed inference engine, it is easy to implement in real-time control systems. In addition, a novel design methodology is proposed for IT2 TSK FLC for modular and reconfigurable robot (MRR) manipulators with uncertain dynamic parameters. A mathematical framework for the design of IT2 TSK FLCs is developed for tracking purposes that can be effectively used in real-time applications. To verify the effectiveness of the proposed controller, experiments are performed on an MRR with two degrees of freedom which exhibits dynamic coupling behavior. Results show that the developed controller can outperform some well-known linear and nonlinear controllers for different configurations. Therefore, the proposed structure can be adopted for the position control of MRRs with unknown dynamic parameters in trajectory-tracking applications. Finally, a rigorous mathematical analysis of the robustness of FLSs (both T1 and IT2) is presented in the thesis and entails a formulation of the robustness of FLSs as a constraint multi-objective optimization problem. Consequently, a procedure is proposed for the design of robust IT2 FLSs. Several examples are presented to demonstrate the effectiveness of the proposed methodologies. It was concluded that both T1 and IT2 FLSs can be designed to achieve robust behavior in various applications. IT2 FLSs, having a more flexible structure than T1 FLSs, exhibited relatively small approximation errors in the several examples investigated. The rigorous methodologies presented in this thesis lay the mathematical foundations for analyzing the stability and facilitating the design of stabilizing IT2 FLCSs. In addition, the proposed control technique for tracking purposes of MRRs will provide control engineers with tools to control dynamic systems with uncertainty and changing parameters. Finally, the systematic approach developed for the analysis and design of robust T1 and IT2 FLSs is of great practical value in various modeling and control applications

Soft Computing Techniques and Their Applications in Intel-ligent Industrial Control Systems: A Survey

Soft computing involves a series of methods that are compatible with imprecise information and complex human cognition. In the face of industrial control problems, soft computing techniques show strong intelligence, robustness and cost-effectiveness. This study dedicates to providing a survey on soft computing techniques and their applications in industrial control systems. The methodologies of soft computing are mainly classified in terms of fuzzy logic, neural computing, and genetic algorithms. The challenges surrounding modern industrial control systems are summarized based on the difficulties in information acquisition, the difficulties in modeling control rules, the difficulties in control system optimization, and the requirements for robustness. Then, this study reviews soft-computing-related achievements that have been developed to tackle these challenges. Afterwards, we present a retrospect of practical industrial control applications in the fields including transportation, intelligent machines, process industry as well as energy engineering. Finally, future research directions are discussed from different perspectives. This study demonstrates that soft computing methods can endow industry control processes with many merits, thus having great application potential. It is hoped that this survey can serve as a reference and provide convenience for scholars and practitioners in the fields of industrial control and computer science