Theoretical Interpretations and Applications of Radial Basis Function Networks

Medical applications usually used Radial Basis Function Networks just as Artificial Neural Networks. However, RBFNs are Knowledge-Based Networks that can be interpreted in several way: Artificial Neural Networks, Regularization Networks, Support Vector Machines, Wavelet Networks, Fuzzy Controllers, Kernel Estimators, Instanced-Based Learners. A survey of their interpretations and of their corresponding learning algorithms is provided as well as a brief survey on dynamic learning algorithms. RBFNs' interpretations can suggest applications that are particularly interesting in medical domains

Fuzzy System Identification Based Upon a Novel Approach to Nonlinear Optimization

Fuzzy systems are often used to model the behavior of nonlinear dynamical systems in process control industries because the model is linguistic in nature, uses a natural-language rule set, and because they can be included in control laws that meet the design goals. However, because the rigorous study of fuzzy logic is relatively recent, there is a shortage of well-defined and understood mechanisms for the design of a fuzzy system. One of the greatest challenges in fuzzy modeling is to determine a suitable structure, parameters, and rules that minimize an appropriately chosen error between the fuzzy system, a mathematical model, and the target system. Numerous methods for establishing a suitable fuzzy system have been proposed, however, none are able to demonstrate the existence of a structure, parameters, or rule base that will minimize the error between the fuzzy and the target system. The piecewise linear approximator (PLA) is a mathematical construct that can be used to approximate an input-output data set with a series of connected line segments. The number of segments in the PLA is generally selected by the designer to meet a given error criteria. Increasing the number of segments will generally improve the approximation. If the location of the breakpoints between segments is known, it is a straightforward process to select the PLA parameters to minimize the error. However, if the location of the breakpoints is not known, a mechanism is required to determine their locations. While algorithms exist that will determine the location of the breakpoints, they do not minimize the error between data and the model. This work will develop theory that shows that an optimal solution to this nonlinear optimization problem exists and demonstrates how it can be applied to fuzzy modeling. This work also demonstrates that a fuzzy system restricted to a particular class of input membership functions, output membership functions, conjunction operator, and defuzzification technique is equivalent to a piecewise linear approximator (PLA). Furthermore, this work develops a new nonlinear optimization technique that minimizes the error between a PLA and an arbitrary one-dimensional set of input-output data and solves the optimal breakpoint problem. This nonlinear optimization technique minimizes the approximation error of several classes of nonlinear functions leading up to the generalized PLA. While direct application of this technique is computationally intensive, several paths are available for investigation that may ease this limitation. An algorithm is developed based on this optimization theory that is significantly more computationally tractable. Several potential applications of this work are discussed including the ability to model the nonlinear portions of Hammerstein and Wiener systems

Global Feed-Forward Adaptive Fuzzy Control of Uncertain MIMO Nonlinear Systems

This study proposes a novel adaptive control approach using a feedforward Takagi-Sugeno (TS) fuzzy approximator for a class of highly unknown multi-input multi-output (MIMO) nonlinear plants. First of all, the design concept, namely, feedforward fuzzy approximator (FFA) based control, is introduced to compensate the unknown feedforward terms required during steady state via a forward TS fuzzy system which takes the desired commands as the input variables. Different from the traditional fuzzy approximation approaches, this scheme allows easier implementation and drops the boundedness assumption on fuzzy universal approximation errors. Furthermore, the controller is synthesized to assure either the disturbance attenuation or the attenuation of both disturbances and estimated fuzzy parameter errors or globally asymptotic stable tracking. In addition, all the stability is guaranteed from a feasible gain solution of the derived linear matrix inequality (LMI). Meanwhile, the highly uncertain holonomic constrained systems are taken as applications with either guaranteed robust tracking performances or asymptotic stability in a global sense. It is demonstrated that the proposed adaptive control is easily and straightforwardly extended to the robust TS FFA-based motion/force tracking controller. Finally, two planar robots transporting a common object is taken as an application example to show the expected performance. The comparison between the proposed and traditional adaptive fuzzy control schemes is also performed in numerical simulations. Keywords: Adaptive control; Takagi-Sugeno (TS) fuzzy system; holonomic systems; motion/force control

Value Function Estimation in Optimal Control via Takagi-Sugeno Models and Linear Programming

[ES] La presente Tesis emplea técnicas de programación dinámica y aprendizaje por refuerzo para el control de sistemas no lineales en espacios discretos y continuos. Inicialmente se realiza una revisión de los conceptos básicos de programación dinámica y aprendizaje por refuerzo para sistemas con un número finito de estados. Se analiza la extensión de estas técnicas mediante el uso de funciones de aproximación que permiten ampliar su aplicabilidad a sistemas con un gran número de estados o sistemas continuos. Las contribuciones de la Tesis son: -Se presenta una metodología que combina identificación y ajuste de la función Q, que incluye la identificación de un modelo Takagi-Sugeno, el cálculo de controladores subóptimos a partir de desigualdades matriciales lineales y el consiguiente ajuste basado en datos de la función Q a través de una optimización monotónica. -Se propone una metodología para el aprendizaje de controladores utilizando programación dinámica aproximada a través de programación lineal. La metodología hace que ADP-LP funcione en aplicaciones prácticas de control con estados y acciones continuos. La metodología propuesta estima una cota inferior y superior de la función de valor óptima a través de aproximadores funcionales. Se establecen pautas para los datos y la regularización de regresores con el fin de obtener resultados satisfactorios evitando soluciones no acotadas o mal condicionadas. -Se plantea una metodología bajo el enfoque de programación lineal aplicada a programación dinámica aproximada para obtener una mejor aproximación de la función de valor óptima en una determinada región del espacio de estados. La metodología propone aprender gradualmente una política utilizando datos disponibles sólo en la región de exploración. La exploración incrementa progresivamente la región de aprendizaje hasta obtener una política convergida.[CA] La present Tesi empra tècniques de programació dinàmica i aprenentatge per reforç per al control de sistemes no lineals en espais discrets i continus. Inicialment es realitza una revisió dels conceptes bàsics de programació dinàmica i aprenentatge per reforç per a sistemes amb un nombre finit d'estats. S'analitza l'extensió d'aquestes tècniques mitjançant l'ús de funcions d'aproximació que permeten ampliar la seua aplicabilitat a sistemes amb un gran nombre d'estats o sistemes continus. Les contribucions de la Tesi són: -Es presenta una metodologia que combina identificació i ajust de la funció Q, que inclou la identificació d'un model Takagi-Sugeno, el càlcul de controladors subòptims a partir de desigualtats matricials lineals i el consegüent ajust basat en dades de la funció Q a través d'una optimització monotónica. -Es proposa una metodologia per a l'aprenentatge de controladors utilitzant programació dinàmica aproximada a través de programació lineal. La metodologia fa que ADP-LP funcione en aplicacions pràctiques de control amb estats i accions continus. La metodologia proposada estima una cota inferior i superior de la funció de valor òptima a través de aproximadores funcionals. S'estableixen pautes per a les dades i la regularització de regresores amb la finalitat d'obtenir resultats satisfactoris evitant solucions no fitades o mal condicionades. -Es planteja una metodologia sota l'enfocament de programació lineal aplicada a programació dinàmica aproximada per a obtenir una millor aproximació de la funció de valor òptima en una determinada regió de l'espai d'estats. La metodologia proposa aprendre gradualment una política utilitzant dades disponibles només a la regió d'exploració. L'exploració incrementa progressivament la regió d'aprenentatge fins a obtenir una política convergida.[EN] The present Thesis employs dynamic programming and reinforcement learning techniques in order to obtain optimal policies for controlling nonlinear systems with discrete and continuous states and actions. Initially, a review of the basic concepts of dynamic programming and reinforcement learning is carried out for systems with a finite number of states. After that, the extension of these techniques to systems with a large number of states or continuous state systems is analysed using approximation functions. The contributions of the Thesis are: -A combined identification/Q-function fitting methodology, which involves identification of a Takagi-Sugeno model, computation of (sub)optimal controllers from Linear Matrix Inequalities, and the subsequent data-based fitting of Q-function via monotonic optimisation. -A methodology for learning controllers using approximate dynamic programming via linear programming is presented. The methodology makes that ADP-LP approach can work in practical control applications with continuous state and input spaces. The proposed methodology estimates a lower bound and upper bound of the optimal value function through functional approximators. Guidelines are provided for data and regressor regularisation in order to obtain satisfactory results avoiding unbounded or ill-conditioned solutions. -A methodology of approximate dynamic programming via linear programming in order to obtain a better approximation of the optimal value function in a specific region of state space. The methodology proposes to gradually learn a policy using data available only in the exploration region. The exploration progressively increases the learning region until a converged policy is obtained.This work was supported by the National Department of Higher Education, Science, Technology and Innovation of Ecuador (SENESCYT), and the Spanish ministry of Economy and European Union, grant DPI2016-81002-R (AEI/FEDER,UE). The author also received the grant for a predoctoral stay, Programa de Becas Iberoamérica- Santander Investigación 2018, of the Santander Bank.Díaz Iza, HP. (2020). Value Function Estimation in Optimal Control via Takagi-Sugeno Models and Linear Programming [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/139135TESI

Intelligent sliding mode control in flexible structures

The first objective of this work is to develop an intelligent sliding mode controller for vibration control in flexible structures. The proposed control consists of two processes: system identification and sliding mode control. System identification is performed based on a neural fuzzy (NF) approximator. A novel extended gradient method and a modified least square estimate (LSE) algorithm are proposed for neuro-fuzzy system training. The training is performed in a hybrid approach: the nonlinear parameters in the NF approximator are updated using the extended gradient method while the linear parameters are optimized by the modified LSE. In system control, an enhanced sliding mode (ESM) control system is developed to promote the control effort for active vibration suppression especially in flexible structures. Based on experimental investigation, when the principle of the terminal attractor is used in the classical gradient descent algorithm or sliding mode control systems, it causes implementation problems because the initial condition should be nonzero. The proposed training techniques provide faster convergence while avoiding the associated implementation problems. The stability of the proposed training techniques is demonstrated by the Lyapunov analysis. The effectiveness of the developed techniques is verified experimentally with a flexible structure experimental setup. Test results show that the suggested hybrid training technique can effectively improve the convergence of the NF approximator; the ESM controller can efficiently perform vibration suppression in flexible structures and easy to implement. The commonly used global search method is genetic algorithm (GA). The problems in the classical GA are low convergence speed and lack of fast global search capability for complex search space. The second objective of this work is to develop a more efficient global training approach, called enhanced genetic algorithm (EGA) for system training and optimization applications. Two approaches are proposed: Firstly, a novel group-based branch crossover operator is suggested to thoroughly explore local space and speed up convergence. Secondly, an enhanced MPT (Makinen-Periaux-Toivanen) mutation operator is proposed to promote global search capability for complex search space. The effectiveness of the developed EGA is verified by simulations based on a series of benchmark test problems. Test results show that the branch crossover operator and enhanced MPT mutation operator can effectively improve the convergence speed and global search capability. The EGA technique outperforms other related GA methods with respect to global search efficiency and operation efficiency