Q-LEARNING, POLICY ITERATION AND ACTOR-CRITIC REINFORCEMENT LEARNING COMBINED WITH METAHEURISTIC ALGORITHMS IN SERVO SYSTEM CONTROL

This paper carries out the performance analysis of three control system structures and approaches, which combine Reinforcement Learning (RL) and Metaheuristic Algorithms (MAs) as representative optimization algorithms. In the first approach, the Gravitational Search Algorithm (GSA) is employed to initialize the parameters (weights and biases) of the Neural Networks (NNs) involved in Deep Q-Learning by replacing the traditional way of initializing the NNs based on random generated values. In the second approach, the Grey Wolf Optimizer (GWO) algorithm is employed to train the policy NN in Policy Iteration RL-based control. In the third approach, the GWO algorithm is employed as a critic in an Actor-Critic framework, and used to evaluate the performance of the actor NN. The goal of this paper is to analyze all three RL-based control approaches, aiming to determine which one represents the best fit for solving the proposed control optimization problem. The performance analysis is based on non-parametric statistical tests conducted on the data obtained from real-time experimental results specific to nonlinear servo system position control

Particle swarm optimization and spiral dynamic algorithm-based interval type-2 fuzzy logic control of triple-link inverted pendulum system: A comparative assessment

This paper presents investigations into the development of an interval type-2 fuzzy logic control (IT2FLC) mechanism integrated with particle swarm optimization and spiral dynamic algorithm. The particle swarm optimization and spiral dynamic algorithm are used for enhanced performance of the IT2FLC by finding optimised values for input and output controller gains and parameter values of IT2FLC membership function as comparison purpose in order to identify better solution for the system. A new model of triple-link inverted pendulum on two-wheels system, developed within SimWise 4D software environment and integrated with Matlab/Simulink for control purpose. Several tests comprising system stabilization, disturbance rejection and convergence accuracy of the algorithms are carried out to demonstrate the robustness of the control approach. It is shown that the particle swarm optimization-based control mechanism performs better than the spiral dynamic algorithm-based control in terms of system stability, disturbance rejection and reduce noise. Moreover, the particle swarm optimization-based IT2FLC shows better performance in comparison to previous research. It is envisaged that this system and control algorithm can be very useful for the development of a mobile robot with extended functionality

Performance Improvement of Low-Cost Iterative Learning-Based Fuzzy Control Systems for Tower Crane Systems

This paper is dedicated to the memory of Prof. Ioan Dzitac, one of the fathers of this journal and its founding Editor-in-Chief till 2021. The paper addresses the performance improvement of three Single Input-Single Output (SISO) fuzzy control systems that control separately the positions of interest of tower crane systems, namely the cart position, the arm angular position and the payload position. Three separate low-cost SISO fuzzy controllers are employed in terms of first order discrete-time intelligent Proportional-Integral (PI) controllers with Takagi-Sugeno-Kang Proportional-Derivative (PD) fuzzy terms. Iterative Learning Control (ILC) system structures with PD learning functions are involved in the current iteration SISO ILC structures. Optimization problems are defined in order to tune the parameters of the learning functions. The objective functions are defined as the sums of squared control errors, and they are solved in the iteration domain using the recent metaheuristic Slime Mould Algorithm (SMA). The experimental results prove the performance improvement of the SISO control systems after ten iterations of SMA

A CENTER MANIFOLD THEORY-BASED APPROACH TO THE STABILITY ANALYSIS OF STATE FEEDBACK TAKAGI-SUGENO-KANG FUZZY CONTROL SYSTEMS

The aim of this paper is to propose a stability analysis approach based on the application of the center manifold theory and applied to state feedback Takagi-Sugeno-Kang fuzzy control systems. The approach is built upon a similar approach developed for Mamdani fuzzy controllers. It starts with a linearized mathematical model of the process that is accepted to belong to the family of single input second-order nonlinear systems which are linear with respect to the control signal. In addition, smooth right-hand terms of the state-space equations that model the processes are assumed. The paper includes the validation of the approach by application to stable state feedback Takagi-Sugeno-Kang fuzzy control system for the position control of an electro-hydraulic servo-system

RESULTS AND CHALLENGES OF ARTIFICIAL NEURAL NETWORKS USED FOR DECISION-MAKING AND CONTROL IN MEDICAL APPLICATIONS

The aim of this paper is to present several approaches by which technology can assist medical decision-making. This is an essential, but also a difficult activity, which implies a large number of medical and technical aspects. But, more important, it involves humans: on the one hand, the patient, who has a medical problem and who requires the best solution; on the other hand, the physician, who should be able to provide, in any circumstances, a decision or a prediction regarding the current and the future medical status of the patient. The technology, in general, and particularly the Artificial Intelligence (AI) tools could help both of them, and it is assisted by appropriate theory regarding modeling tools. One of the most powerful mechanisms that can be used in this field is the Artificial Neural Networks (ANNs). This paper presents some of the results obtained by the Process Control group of the Politehnica University Timisoara, Romania, in the field of ANNs applied to modeling, prediction and decision-making related to medical systems. An Iterative Learning Control-based approach to batch training a feedforward ANN architecture is given. The paper includes authors’ concerns in this domain and emphasizes that these intelligent models, even if they are artificial, are able to make decisions, being useful tools for prevention, early detection and personalized healthcare

Non-dominated sorting Harris’s hawk multi-objective optimizer based on reference point approach

A non-dominated sorting Harris’s hawk multi- objective optimizer (NDSHHMO) algorithm is presented in this paper. The algorithm is able to improve the population diversity, convergence of non-dominated solutions toward the Pareto front, and prevent the population from trapping into local optimal. This was achieved by integrating fast non-dominated sorting with the original Harris’s hawk multi-objective optimizer (HHMO). Non-dominated sorting divides the objective space into levels based on fitness values and then selects non-dominated solutions to produce the next generation of hawks. A set of well-known multi-objective optimization problems has been used to evaluate the performance of the proposed NDSHHMO algorithm. The results of the NDSHHMO algorithm were verified against the results of an HHMO algorithm. Experimental results demonstrate the efficiency of the proposed NDSHHMO algorithm in terms of enhancing the ability of convergence toward the Pareto front and significantly improve the search ability of the HHMO

Speed control of wheeled mobile robot by nature-inspired social spider algorithm-based PID controller

: Mobile robot is an automatic vehicle with wheels that can be moved automatically from one place to another. A motor is built on its wheels for mobility purposes, which is controlled using a controller. DC motor speed is controlled by the proportional integral derivative (PID) controller. Kinematic modeling is used in our work to understand the mechanical behavior of robots for designing the appropriate mobile robots. Right and left wheel velocity and direction are calculated by using the kinematic modeling, and the kinematic modeling is given to the PID controller to gain the output. Motor speed is controlled by the PID low-level controller for the robot mobility; the speed controlling is done using the constant values Kd, Kp, and Ki which depend on the past, future, and present errors. For better control performance, the integral gain, differential gain, and proportional gain are adjusted by the PID controller. Robot speed may vary by changing the direction of the vehicle, so to avoid this the Social Spider Optimization (SSO) algorithm is used in PID controllers. PID controller parameter tuning is hard by using separate algorithms, so the parameters are tuned by the SSO algorithm which is a novel nature-inspired algorithm. The main goal of this paper is to demonstrate the effectiveness of the proposed approach in achieving precise speed control of the robot, particularly in the presence of disturbances and uncertainties

Data-Intensive Computing in Smart Microgrids

Microgrids have recently emerged as the building block of a smart grid, combining distributed renewable energy sources, energy storage devices, and load management in order to improve power system reliability, enhance sustainable development, and reduce carbon emissions. At the same time, rapid advancements in sensor and metering technologies, wireless and network communication, as well as cloud and fog computing are leading to the collection and accumulation of large amounts of data (e.g., device status data, energy generation data, consumption data). The application of big data analysis techniques (e.g., forecasting, classification, clustering) on such data can optimize the power generation and operation in real time by accurately predicting electricity demands, discovering electricity consumption patterns, and developing dynamic pricing mechanisms. An efficient and intelligent analysis of the data will enable smart microgrids to detect and recover from failures quickly, respond to electricity demand swiftly, supply more reliable and economical energy, and enable customers to have more control over their energy use. Overall, data-intensive analytics can provide effective and efficient decision support for all of the producers, operators, customers, and regulators in smart microgrids, in order to achieve holistic smart energy management, including energy generation, transmission, distribution, and demand-side management. This book contains an assortment of relevant novel research contributions that provide real-world applications of data-intensive analytics in smart grids and contribute to the dissemination of new ideas in this area

Advances in Artificial Intelligence: Models, Optimization, and Machine Learning

The present book contains all the articles accepted and published in the Special Issue “Advances in Artificial Intelligence: Models, Optimization, and Machine Learning” of the MDPI Mathematics journal, which covers a wide range of topics connected to the theory and applications of artificial intelligence and its subfields. These topics include, among others, deep learning and classic machine learning algorithms, neural modelling, architectures and learning algorithms, biologically inspired optimization algorithms, algorithms for autonomous driving, probabilistic models and Bayesian reasoning, intelligent agents and multiagent systems. We hope that the scientific results presented in this book will serve as valuable sources of documentation and inspiration for anyone willing to pursue research in artificial intelligence, machine learning and their widespread applications

Selected Papers from the ICEUBI2019 - International Congress on Engineering - Engineering for Evolution

Energies SI Book "Selected Papers from the ICEUBI2019 – International Congress on Engineering – Engineering for Evolution", groups six papers into fundamental engineering areas: Aeronautics and Astronautics, and Electrotechnical and Mechanical Engineering. ICEUBI—International Congress on Engineering is organized every two years by the Engineering Faculty of Beira Interior University, Portugal, promoting engineering in society through contact among researchers and practitioners from different fields of engineering, and thus encouraging the dissemination of engineering research, innovation, and development. All selected papers are interrelated with energy topics (fundamentals, sources, exploration, conversion, and policies), and provide relevant data for academics, research-focused practitioners, and policy makers