GP-SUM. Gaussian Processes Filtering of non-Gaussian Beliefs

This work studies the problem of stochastic dynamic filtering and state propagation with complex beliefs. The main contribution is GP-SUM, a filtering algorithm tailored to dynamic systems and observation models expressed as Gaussian Processes (GP), and to states represented as a weighted sum of Gaussians. The key attribute of GP-SUM is that it does not rely on linearizations of the dynamic or observation models, or on unimodal Gaussian approximations of the belief, hence enables tracking complex state distributions. The algorithm can be seen as a combination of a sampling-based filter with a probabilistic Bayes filter. On the one hand, GP-SUM operates by sampling the state distribution and propagating each sample through the dynamic system and observation models. On the other hand, it achieves effective sampling and accurate probabilistic propagation by relying on the GP form of the system, and the sum-of-Gaussian form of the belief. We show that GP-SUM outperforms several GP-Bayes and Particle Filters on a standard benchmark. We also demonstrate its use in a pushing task, predicting with experimental accuracy the naturally occurring non-Gaussian distributions.Comment: WAFR 2018, 16 pages, 7 figure

Enhancement of the HILOMOT Algorithm with Modified EM and Modified PSO Algorithms for Nonlinear Systems Identification

Developing a mathematical model has become an inevitable need in studies of all disciplines. With advancements in technology, there is an emerging need to develop complex mathematical models. System identification is a popular way of constructing mathematical models of highly complex processes when an analytical model is not feasible. One of the many model architectures of system identification is to utilize a Local Model Network (LMN). Hierarchical Local Model Tree (HILOMOT) is an iterative LMN training algorithm that uses the axis-oblique split method to divide the input space hierarchically. The split positions of the local models directly influence the accuracy of the entire model. However, finding the best split positions of the local models presents a nonlinear optimization problem. This paper presents an optimized HILOMOT algorithm with enhanced Expectation-Maximization (EM) and Particle Swarm Optimization (PSO) algorithms which includes the normalization parameter and utilizes the reduced-parameter vector. Finally, the performance of the improved HILOMOT algorithm is compared with the existing algorithm by modeling the NOx emission model of a gas turbine and multiple nonlinear test functions of different orders and structures.Scopu

Dynamic surrogate modelling for multistep-ahead prediction of multivariate nonlinear chemical processes

This work proposes a methodology for multivariate dynamic modeling and multistep-ahead prediction of nonlinear systems using surrogate models for the application to nonlinear chemical processes. The methodology provides a systematic and robust procedure for the development of data-driven dynamic models capable of predicting the process outputs over long time horizons. It is based on using surrogate models to construct several nonlinear autoregressive exogenous models (NARX) with each one approximating the future behavior of one process output as a function of the current and previous process inputs and outputs. The developed dynamic models are employed in a recursive schema to predict the process future outputs over several time steps (multistep-ahead prediction). The methodology is able to manage two different scenarios: (1) one in which a set of input–output signals collected from the process is only available for training and (2) another in which a mathematical model of the process is available and can be used to generate specific datasets for training. With respect to the latter, the proposed methodology includes a specific procedure for the selection of training data in dynamic modeling based on design of computer experiment (DOCE) techniques. The proposed methodology is applied to case studies from the process industry presented in the literature. The results show very high prediction accuracies over long time horizons. Also, owing to the flexibility, robustness, and computational efficiency of surrogate modeling, the methodology allows dealing with a wide range of situations, which would be difficult to address using first-principles models.Peer ReviewedPostprint (author's final draft

Design and implementation of a soft computing-based controller for a complex mechanical system

Soft-Computing basierende Regler beinhalten Algorithmen, die im Bereich des Maschinellen Lernens einzuordnen sind. Diese Regler sind in der Lage eine geeignete Steuerungsstrategie durch direkte Interaktion mit einer dynamischen Regelstrecke zu entwerfen. Sowohl klassische als auch moderne Reglerentwurfsmethoden hangen von der Genauigkeit des verwendeten dynamischen Systemmodells ab, was insbesondere bei steigender Komplexitat des Systems und auftretenden Modellunsicherheiten nicht mehr uneingeschrankt gewahrleistet werden kann. Die Ziele von Soft- Computing basierenden Reglern sind die Verbesserung der Gute des Regelverhaltens und eine geeignete Anpassung der Regler ohne eine mathematische Modellbildung auf Grundlage von physikalischen Gesetzen. Im Rahmen dieser Arbeit werden funf Algorithmen zur Modellbildung und Regelung dynamischer Systeme untersucht, welche auf dem Mehrschichten-Perzeptron-Netzwerk (Multi-Layer Perceptron network, MLP), auf der Methode der Support Vector Machine (SVM), der Gau-Prozesse, der radialen Basisfunktionen (Radial Basis Functions, RBF) sowie der Fuzzy-Inferenz-Systeme basieren. Im Anschluss an die Darstellung der zugrunde liegenden mathematischen Zusammenhange dieser Methoden sowie deren Hauptanwendungsfelder im Bereich der Modellbildung und Regelung dynamischer Systeme wird eine systematische Evaluierung der funf Methoden diskutiert. Anhand der Verwendung quantitativer Gutekennziern werden diese Methoden fur die Verwendung in der Modellbildung und Regelung dynamischer Systeme vergleichbar gegenubergestellt. Basierend auf den Ergebnissen der Evaluierung wird der SVM-basierte Algorithmus als Kernalgorithmus des Soft-Computing basierenden Reglers verwendet. Der vorgestellte Regler besteht aus zwei Hauptteilen, wobei der erste Teil aus einer Modellfunktion der dynamischen Regelstrecke und einem SVM-basierten Beobachter besteht, und der zweite Teil basierend auf dem Systemmodell eine geeignete Regelstrategie generiert. Die Verikation des SVM-basierten Regleralgorithmus erfolgt anhand eines FEM-Modells eines dynamischen elastischen Balken bzw. einseitig eingespannten elastischen Balkens. Dieses Modell kann z. B. als Ersatzmodell fur das mechanische Verhalten eines exiblen Roboterarms oder einer Flugzeugtrag ache verwendet werden. Der Hauptteil der Modellfunktion besteht aus einem automatischen Systemidentikationsalgorithmus, der auch die Integration eines systematischen Modellbildungsansatzes fur dynamische Systeme ermoglicht.Die Ergebnisse des SVM-basierten Beobachter zeigen ahnliches Verhalten zum Kalman- Bucy Beobachter. Auch die Sensitivitatsanalyse der Parameter zeigt eine bessere Gute der SVM-basierten Beobachter im Vergleich mit den Kalman-Bucy Beobachtern. Im Anschluss wird der SVM-basierte Regler zur Schwingungsregelung des Kragtragers verwendet. Hierbei werden vergleichbare Ergebnisse zum LQR-Regler erzielt. Eine experimentelle Validierung des SVM basierten Reglers erfolgt an Versuchsst anden eines elastischen Biegebalkens sowie eines invertierten Biegebalkens. Die Zustandsbeobachtung fuhrt zu vergleichbaren Ergebnissen verglichen mit einem Kalman-Bucy Beobachter. Auch die Modellbildung des elastischen Balkens fuhrt zu guten Ubereinstimmungen. Die Regelgute des Soft-Computing basierenden Reglers wurde am Versuchsstand des invertierten Biegebalkens experimentell erprobt. Es wird deutlich, dass Ergebnisse im Rahmen der erforderlichen Vorgaben erzielt werden konnen.The focus of this thesis is to obtain a soft computing-based controller for complex mechanical system. soft computing based controllers are based on machine learning algorithm that able to develop suitable control strategies by direct interaction with targeted dynamic systems. Classical and modern control design methods depend on the accuracy of the system dynamic model which cannot be achieved due to the dynamic system complexity and modeling uncertainties. A soft computing-based controller aims to improve the performance of the close loop system and to give the controller adaptation ability as well as to reduce the need for mathematical modeling based on physical laws. In this work ve dierent softcomputing algorithms used in the eld of modeling and controlling dynamic systems are investigated.These algorithms are Multi-Layer Perceptron(MLP) network, Support Vector Machine (SVM),Gaussian process, Radial Basis Function (RBF), and Fuzzy Inference System (FIS). The basic mathematical description of each algorithm is given. Additionally, the most recent applications in modeling and controlling of dynamic system are summarized. A systematic evaluation of the ve algorithms is proposed. The goal of the evaluation is to provide quantitative measure of the performance of soft computing algorithms when used in modeling and controlling a dynamic system. Based on the evaluation, the SVM algorithm is selected as the core learning algorithm for the soft computing based controller. The controller has two main units. The rst unit has two functions of modeling dynamic system and obtaining a SVM-based observer. The second unit is in charge of generating suitable control strategy based on the dynamic model obtained. The verication of the controller using SVM algorithm is done using an elastic cantilever beam modeled using Finite Element Method (FEM). An elastic cantilever beam can be considered as a representation of exible single-link manipulator or aircraft wing. In the core of the modeling unit, an automatic system identication algorithm which allows a systematic modeling approach of dynamic systems is implemented. The results show that the system dynamic model using SVM algorithm is accurate with respect to the FEM model. As for the SVM-based observer the results show that it has good estimation in comparison with to dierent Kalman-Bucy observers. The sensitivity to parameters variations analysis shows that the SVM-based observer has better performance than Kalman-Bucy observer. The SVM based controller is used to control the vibration of the cantilever beam; the results show that the model reference controller using SVM has a similar performance to LQR controller. The validation of the controller using SVM algorithm is carried out using the elastic cantilever beam test rig and the inverted cantilever beam test rig. The states estimation using SVM-based observer of the elastic cantilever beam test rig is successful and accurate compared to a Kalman-Bucy observer. Modeling of the elastic cantilever beam using the SVM algorithm shows good accuracy. The performance of controller is tested on the inverted cantilever beam test rig. The results show that required performance objective can be realized using this control strategy