Generating Interpretable Fuzzy Controllers using Particle Swarm Optimization and Genetic Programming

Autonomously training interpretable control strategies, called policies, using pre-existing plant trajectory data is of great interest in industrial applications. Fuzzy controllers have been used in industry for decades as interpretable and efficient system controllers. In this study, we introduce a fuzzy genetic programming (GP) approach called fuzzy GP reinforcement learning (FGPRL) that can select the relevant state features, determine the size of the required fuzzy rule set, and automatically adjust all the controller parameters simultaneously. Each GP individual's fitness is computed using model-based batch reinforcement learning (RL), which first trains a model using available system samples and subsequently performs Monte Carlo rollouts to predict each policy candidate's performance. We compare FGPRL to an extended version of a related method called fuzzy particle swarm reinforcement learning (FPSRL), which uses swarm intelligence to tune the fuzzy policy parameters. Experiments using an industrial benchmark show that FGPRL is able to autonomously learn interpretable fuzzy policies with high control performance.Comment: Accepted at Genetic and Evolutionary Computation Conference 2018 (GECCO '18

Q-LEARNING, POLICY ITERATION AND ACTOR-CRITIC REINFORCEMENT LEARNING COMBINED WITH METAHEURISTIC ALGORITHMS IN SERVO SYSTEM CONTROL

This paper carries out the performance analysis of three control system structures and approaches, which combine Reinforcement Learning (RL) and Metaheuristic Algorithms (MAs) as representative optimization algorithms. In the first approach, the Gravitational Search Algorithm (GSA) is employed to initialize the parameters (weights and biases) of the Neural Networks (NNs) involved in Deep Q-Learning by replacing the traditional way of initializing the NNs based on random generated values. In the second approach, the Grey Wolf Optimizer (GWO) algorithm is employed to train the policy NN in Policy Iteration RL-based control. In the third approach, the GWO algorithm is employed as a critic in an Actor-Critic framework, and used to evaluate the performance of the actor NN. The goal of this paper is to analyze all three RL-based control approaches, aiming to determine which one represents the best fit for solving the proposed control optimization problem. The performance analysis is based on non-parametric statistical tests conducted on the data obtained from real-time experimental results specific to nonlinear servo system position control

Automatic synthesis of fuzzy systems: An evolutionary overview with a genetic programming perspective

Studies in Evolutionary Fuzzy Systems (EFSs) began in the 90s and have experienced a fast development since then, with applications to areas such as pattern recognition, curve‐fitting and regression, forecasting and control. An EFS results from the combination of a Fuzzy Inference System (FIS) with an Evolutionary Algorithm (EA). This relationship can be established for multiple purposes: fine‐tuning of FIS's parameters, selection of fuzzy rules, learning a rule base or membership functions from scratch, and so forth. Each facet of this relationship creates a strand in the literature, as membership function fine‐tuning, fuzzy rule‐based learning, and so forth and the purpose here is to outline some of what has been done in each aspect. Special focus is given to Genetic Programming‐based EFSs by providing a taxonomy of the main architectures available, as well as by pointing out the gaps that still prevail in the literature. The concluding remarks address some further topics of current research and trends, such as interpretability analysis, multiobjective optimization, and synthesis of a FIS through Evolving methods

Particle swarm optimization and spiral dynamic algorithm-based interval type-2 fuzzy logic control of triple-link inverted pendulum system: A comparative assessment

This paper presents investigations into the development of an interval type-2 fuzzy logic control (IT2FLC) mechanism integrated with particle swarm optimization and spiral dynamic algorithm. The particle swarm optimization and spiral dynamic algorithm are used for enhanced performance of the IT2FLC by finding optimised values for input and output controller gains and parameter values of IT2FLC membership function as comparison purpose in order to identify better solution for the system. A new model of triple-link inverted pendulum on two-wheels system, developed within SimWise 4D software environment and integrated with Matlab/Simulink for control purpose. Several tests comprising system stabilization, disturbance rejection and convergence accuracy of the algorithms are carried out to demonstrate the robustness of the control approach. It is shown that the particle swarm optimization-based control mechanism performs better than the spiral dynamic algorithm-based control in terms of system stability, disturbance rejection and reduce noise. Moreover, the particle swarm optimization-based IT2FLC shows better performance in comparison to previous research. It is envisaged that this system and control algorithm can be very useful for the development of a mobile robot with extended functionality

Literature Review of the Recent Trends and Applications in various Fuzzy Rule based systems

Fuzzy rule based systems (FRBSs) is a rule-based system which uses linguistic fuzzy variables as antecedents and consequent to represent human understandable knowledge. They have been applied to various applications and areas throughout the soft computing literature. However, FRBSs suffers from many drawbacks such as uncertainty representation, high number of rules, interpretability loss, high computational time for learning etc. To overcome these issues with FRBSs, there exists many extensions of FRBSs. This paper presents an overview and literature review of recent trends on various types and prominent areas of fuzzy systems (FRBSs) namely genetic fuzzy system (GFS), hierarchical fuzzy system (HFS), neuro fuzzy system (NFS), evolving fuzzy system (eFS), FRBSs for big data, FRBSs for imbalanced data, interpretability in FRBSs and FRBSs which use cluster centroids as fuzzy rules. The review is for years 2010-2021. This paper also highlights important contributions, publication statistics and current trends in the field. The paper also addresses several open research areas which need further attention from the FRBSs research community.Comment: 49 pages, Accepted for publication in ijf

Intelligent Robotics Navigation System: Problems, Methods, and Algorithm

This paper set out to supplement new studies with a brief and comprehensible review of the advanced development in the area of the navigation system, starting from a single robot, multi-robot, and swarm robots from a particular perspective by taking insights from these biological systems. The inspiration is taken from nature by observing the human and the social animal that is believed to be very beneficial for this purpose. The intelligent navigation system is developed based on an individual characteristic or a social animal biological structure. The discussion of this paper will focus on how simple agent’s structure utilizes flexible and potential outcomes in order to navigate in a productive and unorganized surrounding. The combination of the navigation system and biologically inspired approach has attracted considerable attention, which makes it an important research area in the intelligent robotic system. Overall, this paper explores the implementation, which is resulted from the simulation performed by the embodiment of robots operating in real environments

Policy optimization for industrial benchmark using deep reinforcement learning

2020 Summer.Includes bibliographical references.Significant advancements have been made in the field of Reinforcement Learning (RL) in recent decades. Numerous novel RL environments and algorithms are mastering these problems that have been studied, evaluated, and published. The most popular RL benchmark environments produced by OpenAI Gym and DeepMind Labs are modeled after single/multi-player board, video games, or single-purpose robots and the RL algorithms modeling optimal policies for playing those games have even outperformed humans in almost all of them. However, the real-world applications using RL is very limited, as the academic community has limited access to real industrial data and applications. Industrial Benchmark (IB) is a novel RL benchmark motivated by Industrial Control problems with properties such as continuous state and action spaces, high dimensionality, partially observable state space, delayed effects combined with complex heteroscedastic stochastic behavior. We have used Deep Reinforcement Learning (DRL) algorithms like Deep Q-Networks (DQN) and Double-DQN (DDQN) to study and model optimal policies on IB. Our empirical results show various DRL models outperforming previously published models on the same IB

Controller tuning by means of multi-objective optimization algorithms: a global tuning framework

© 2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.A holistic multi-objective optimization design technique for controller tuning is presented. This approach gives control engineers greater flexibility to select a controller that matches their specifications. Furthermore, for a given controller it is simple to analyze the tradeoff achieved between conflicting objectives. By using the multi-objective design technique it is also possible to perform a global comparison between different control strategies in a simple and robust way. This approach thereby enables an analysis to be made of whether a preference for a certain control technique is justified. This proposal is evaluated and validated in a nonlinear multiple-input multiple-output system using two control strategies: a classical proportional- integral-derivative control scheme and a feedback state controller.This work was supported in part by the FPI-2010/19 Grant and the Project PAID-06-11 from the Universitat Politecnica de Valencia and in part by the Projects DPI2008-02133, TIN2011-28082, and ENE2011-25900 from the Spanish Ministry of Science and Innovation.Reynoso Meza, G.; García-Nieto Rodríguez, S.; Sanchís Saez, J.; Blasco, X. (2013). Controller tuning by means of multi-objective optimization algorithms: a global tuning framework. IEEE Transactions on Control Systems Technology. 21(2):445-458. https://doi.org/10.1109/TCST.2012.2185698S44545821

A Big-Bang Big-Crunch Type-2 Fuzzy Logic-based System for Malaria Epidemic Prediction in Ethiopia

ABSTRACT- Malaria is a life-threatening disease caused by Plasmodium parasite infection with huge medical, economic, and social impact. Malaria is one of a serious public health problem in Ethiopia since 1959, even if, its morbidity and mortality have been reduced starting from 2001. Various studies were conducted to predict the Malaria epidemic using mathematical and statistical regression approaches, nevertheless, they had no learning capabilities. In this paper, we presented a type-2 fuzzy logic-based system for Malaria epidemic prediction (MEP) in Ethiopia which has been optimized by the Big-Bang Big-Crunch (BBBC) approach to maximizing the model accuracy and interpretability to predict for the future occurrence of Malaria. We compared the proposed BBBC optimized type-2 fuzzy logic-based system against its counterpart T1FLS, non-optimized T2FLS, ANFIS and ANN. The results show that the optimized proposed T2FLS provides a more interpretable model that predicts the future occurrence of Malaria from one up to three months ahead with optimal accuracy. This helps to answer the question of when and where must make preparation to prevent and control the occurrence of Malaria epidemic since the generated rules from our system were able to explain the situations and intensity of input factors which contributed to the Malaria epidemic and outbreak

Automatic Design of Semantic Similarity Ensembles Using Grammatical Evolution

Semantic similarity measures are widely used in natural language processing to catalyze various computer-related tasks. However, no single semantic similarity measure is the most appropriate for all tasks, and researchers often use ensemble strategies to ensure performance. This research work proposes a method for automatically designing semantic similarity ensembles. In fact, our proposed method uses grammatical evolution, for the first time, to automatically select and aggregate measures from a pool of candidates to create an ensemble that maximizes correlation to human judgment. The method is evaluated on several benchmark datasets and compared to state-of-the-art ensembles, showing that it can significantly improve similarity assessment accuracy and outperform existing methods in some cases. As a result, our research demonstrates the potential of using grammatical evolution to automatically compare text and prove the benefits of using ensembles for semantic similarity tasks. The source code that illustrates our approach can be downloaded from https://github.com/jorge-martinez-gil/sesige.Comment: 29 page