Fault detection, isolation, and identification for nonlinear systems using a hybrid approach

This thesis presents a novel integrated hybrid approach for fault diagnosis (FD) of nonlinear systems; taking advantage of both system's mathematical model and the adaptive nonlinear approximation capability of computational intelligence techniques. Unlike most FD techniques, the proposed solution simultaneously accomplishes fault detection, isolation, and identification (FDII) within a unified diagnostic module. At the core of this solution are a bank of adaptive neural parameter estimators (NPE) and a set of single-parameterized fault models. The NPEs continuously estimate unknown fault parameters (FP) that are indicators of faults in the system. In view of the availability of full-state measurements, two NPE structures, namely series-parallel and parallel, are developed with their exclusive set of desirable attributes. The parallel scheme is extremely robust to measurement noise and possesses a simpler, yet more solid, fault isolation logic. On the contrary, the series-parallel scheme displays short FD delays and is robust to closed-loop system transients due to changes in control commands. Simple neural network architecture and update laws make both schemes suitable for real-time implementations. A fault tolerant observer (FTO) is then designed to extend the FDII schemes to systems with partial-state measurement. The proposed FTO is a neural state estimator that can estimate unmeasured states even in presence of faults. The estimated and the measured states then comprise the inputs to the FDII schemes. Simulation results for FDII of reaction wheels of a 3-axis stabilized satellite in presence of disturbances and noise demonstrate the effectiveness of the proposed FDII solution under both full and partial-state measurements

Approximate Gaussian conjugacy: parametric recursive filtering under nonlinearity, multimodality, uncertainty, and constraint, and beyond

Since the landmark work of R. E. Kalman in the 1960s, considerable efforts have been devoted to time series state space models for a large variety of dynamic estimation problems. In particular, parametric filters that seek analytical estimates based on a closed-form Markov–Bayes recursion, e.g., recursion from a Gaussian or Gaussian mixture (GM) prior to a Gaussian/GM posterior (termed ‘Gaussian conjugacy’ in this paper), form the backbone for a general time series filter design. Due to challenges arising from nonlinearity, multimodality (including target maneuver), intractable uncertainties (such as unknown inputs and/or non-Gaussian noises) and constraints (including circular quantities), etc., new theories, algorithms, and technologies have been developed continuously to maintain such a conjugacy, or to approximate it as close as possible. They had contributed in large part to the prospective developments of time series parametric filters in the last six decades. In this paper, we review the state of the art in distinctive categories and highlight some insights that may otherwise be easily overlooked. In particular, specific attention is paid to nonlinear systems with an informative observation, multimodal systems including Gaussian mixture posterior and maneuvers, and intractable unknown inputs and constraints, to fill some gaps in existing reviews and surveys. In addition, we provide some new thoughts on alternatives to the first-order Markov transition model and on filter evaluation with regard to computing complexity

Feasible, Robust and Reliable Automation and Control for Autonomous Systems

The Special Issue book focuses on highlighting current research and developments in the automation and control field for autonomous systems as well as showcasing state-of-the-art control strategy approaches for autonomous platforms. The book is co-edited by distinguished international control system experts currently based in Sweden, the United States of America, and the United Kingdom, with contributions from reputable researchers from China, Austria, France, the United States of America, Poland, and Hungary, among many others. The editors believe the ten articles published within this Special Issue will be highly appealing to control-systems-related researchers in applications typified in the fields of ground, aerial, maritime vehicles, and robotics as well as industrial audiences

Fault Diagnosis Of Sensor And Actuator Faults In Multi-Zone Hvac Systems

Globally, the buildings sector accounts for 30% of the energy consumption and more than 55% of the electricity demand. Specifically, the Heating, Ventilation, and Air Conditioning (HVAC) system is the most extensively operated component and it is responsible alone for 40% of the final building energy usage. HVAC systems are used to provide healthy and comfortable indoor conditions, and their main objective is to maintain the thermal comfort of occupants with minimum energy usage. HVAC systems include a considerable number of sensors, controlled actuators, and other components. They are at risk of malfunctioning or failure resulting in reduced efficiency, potential interference with the execution of supervision schemes, and equipment deterioration. Hence, Fault Diagnosis (FD) of HVAC systems is essential to improve their reliability, efficiency, and performance, and to provide preventive maintenance. In this thesis work, two neural network-based methods are proposed for sensor and actuator faults in a 3-zone HVAC system. For sensor faults, an online semi-supervised sensor data validation and fault diagnosis method using an Auto-Associative Neural Network (AANN) is developed. The method is based on the implementation of Nonlinear Principal Component Analysis (NPCA) using a Back-Propagation Neural Network (BPNN) and it demonstrates notable capability in sensor fault and inaccuracy correction, measurement noise reduction, missing sensor data replacement, and in both single and multiple sensor faults diagnosis. In addition, a novel on-line supervised multi-model approach for actuator fault diagnosis using Convolutional Neural Networks (CNNs) is developed for single actuator faults. It is based a data transformation in which the 1-dimensional data are configured into a 2-dimensional representation without the use of advanced signal processing techniques. The CNN-based actuator fault diagnosis approach demonstrates improved performance capability compared with the commonly used Machine Learning-based algorithms (i.e., Support Vector Machine and standard Neural Networks). The presented schemes are compared with other commonly used HVAC fault diagnosis methods for benchmarking and they are proven to be superior, effective, accurate, and reliable. The proposed approaches can be applied to large-scale buildings with additional zones

Fault Diagnosis and Estimation of Dynamical Systems with Application to Gas Turbines

This thesis contributes and provides solutions to the problem of fault diagnosis and estimation from three different perspectives which are i) fault diagnosis of nonlinear systems using nonlinear multiple model approach, ii) inversion-based fault estimation in linear systems, and iii) data-driven fault diagnosis and estimation in linear systems. The above contributions have been demonstrated to the gas turbines as one of the most important engineering systems in the power and aerospace industries. The proposed multiple model approach is essentially a hierarchy of nonlinear Kalman filters utilized as detection filters. A nonlinear mathematical model for a gas turbines is developed and verified. The fault vector is defined using the Gas Path Analysis approach. The nonlinear Kalman filters that correspond to the defined single or concurrent fault modes provide the conditional probabilities associated with each fault mode using the Bayes' law. The current fault mode is then determined based on the maximum probability criteria. The performance of both Extended Kalman Filters (EKF) and Unscented Kalman Filters (UKF) are investigated and compared which demonstrates that the UKF outperforms the EKF for this particular application. The problem of fault estimation is increasingly receiving more attention due to its practical importance. Fault estimation is closely related to the problem of linear systems inversion. This thesis includes two contributions for the stable inversion of non-minimum phase systems. First, a novel methodology is proposed for direct estimation of unknown inputs by using only measurements of either minimum or non-minimum phase systems as well as systems with transmission zeros on the unit circle. A dynamic filter is then identified whose poles coincide with the transmission zeros of the system. A feedback is then introduced to stabilize the above filter dynamics as well as provide an unbiased estimation of the unknown input. The methodology is then applied to the problem of fault estimation and has been shown that the proposed inversion filter is unbiased for certain categories of faults. Second, a solution for unbiased reconstruction of general inputs is proposed. It is based on designing an unknown input observer (UIO) that provides unbiased estimation of the minimum phase states of the system. The reconstructed minimum phase states serve then as inputs for reconstruction of the non-minimum phase states. The reconstruction error for non-minimum phase states exponentially decrease as the estimation delay is increased. Therefore, an almost perfect reconstruction can be achieved by selecting the delay to be sufficiently large. The proposed inversion scheme is then applied to the output-tracking control problem. An important practical challenge is the fact that engineers rarely have a detailed and accurate mathematical model of complex engineering systems such as gas turbines. Consequently, one can find a trend towards data-driven approaches in many disciplines, including fault diagnosis. In this thesis, explicit state-space based fault detection, isolation and estimation filters are proposed that are directly identified from only the system input-output (I/O) measurements and through the system Markov parameters. The proposed procedures do not involve a reduction step and do not require identification of the system extended observability matrix or its left null space. Therefore, the performance of the proposed filters is directly connected to and linearly dependent on the errors in the Markov parameters estimation process. The estimation error dynamics is then derived in terms of the Markov parameters identification errors and directly synthesized from the healthy system I/O data. Consequently, the estimation errors have been effectively compensated for. The proposed data-driven scheme requires the persistently exciting condition for healthy input data which is not practical for certain real life applications and in particular to gas turbine engines. To address this issue, a robust methodology for Markov parameters estimation using frequency response data is developed. Finally, the performance of the proposed data-driven approach is comprehensively evaluated for the fault diagnosis and estimation problems in the gas turbine engines

Robust sensor fault detection and isolation of gas turbine engines

An effective fault detection and isolation (FDI) technology can play a crucial role in improving the system availability, safety and reliability as well as reducing the risks of catastrophic failures. In this thesis, the robust sensor FDI problem of gas turbine engines is investigated and different novel techniques are developed to address the effects of parameter uncertainties, disturbances as well as process and measurement noise on the performance of FDI strategies. The efficiencies of proposed techniques are investigated through extensive simulation studies for the single spool gas turbine engine that is previously developed and validated using the GSP software. The gas turbine engine health degradation is considered in various forms in this thesis. First, it is considered as a part of the engine dynamics that is estimated off-line and updated periodically for the on-board engine model. Second, it is modeled as the time-varying norm-bounded parameter uncertainty that affects all the system state-space matrices and third as an unknown nonlinear dynamic that is approximated by the use of a dynamic recurrent neural network. In the first part of the thesis, we propose a hybrid Kalman filter (HKF) scheme that consists of a single nonlinear on-board engine model (OBEM) augmented with piecewise linear (PWL) models constituting as the multiple model (MM) based estimators to cover the entire engine operating regime. We have integrated the generalized likelihood ratio (GLR)-based method with our MM-based scheme to estimate the sensor fault severity under various single and concurrent fault scenarios. In order to ensure the reliability of our proposed HKF-based FDI scheme during the engine life cycle, it is assumed that the reference baselines are periodically updated for the OBEM health parameters. In the second part of the thesis, a novel robust sensor FDI strategy using the MM-based approach is proposed that remains robust with respect to both time-varying parameter uncertainties and process and measurement noise. The scheme is composed of robust Kalman filters (RKF) that are constructed for multiple PWL models. The parameter uncertainty is modeled by using a time-varying norm bounded admissible structure that affects all the PWL state space matrices. The robust Kalman filter gain matrices are designed by solving two algebraic Riccati equations (ARE) that are expressed as two linear matrix inequality (LMI) feasibility conditions. The main objective is to propose a robust filter that satisfies the overall performance requirements and is not affected by system perturbations. The requirements include a quadratically stable filter that ensures bounded estimation error variances having predefined values. In the third part of the thesis, a novel hybrid approach is proposed to improve the robustness of FDI scheme with respect to different sources of uncertainties. For this purpose, a dynamic recurrent neural network (DRNN) is designed to approximate the gas turbine engine uncertainty due to the health degradations. The proposed DRNN is trained offline by using the extended Kalman filter (EKF) algorithm for an engine with different levels of uncertainty, but with healthy sensors. The convergence of EKF-based DRNN training algorithm is also investigated. Then, the trained DRNN with the fixed parameters and topology is integrated with our online model-based FDI algorithm to approximate the uncertainty terms of the real engine. In this part, the previously proposed HKF and RKF are integrated with the trained DRNN to construct the hybrid FDI structure

A Review: Prognostics and Health Management in Automotive and Aerospace

Prognostics and Health Management (PHM) attracts increasing interest of many researchers due to its potentially important applications in diverse disciplines and industries. In general, PHM systems use real-time and historical state information of subsystems and components of the operating systems to provide actionable information, enabling intelligent decision-making for improved performance, safety, reliability, and maintainability. Every year, a substantial number of papers in this area including theory and practical applications, appear in academic journals, conference proceedings and technical reports. This paper aims to summarize and review researches, developments and recent contributions in PHM for automotive- and aerospace industries. It can also be considered as the starting point for researchers and practitioners in general to assist them through PHM implementation and help them to accomplish their work more easily.Algorithms and the Foundations of Software technolog

Statistical modelling and analysis of traffic: a dynamic approach

In both developed and emerging-economies, major cities continue to experience increasing traffic congestion. To address this issue, complex Traffic Management Systems (TMS) are employed in recent years to help manage traffic. These systems fuse traffic-surveillance-related information from a variety of sensors deployed across traffic networks. A TMS requires real-time information to make effective control decisions and to deliver trustworthy information to users, such as travel time, congestion level, etc. There are three fundamental inputs required by TMS, namely, traffic volume, vehicular speed, and traffic density. Using conventional traffic loop detectors one can directly measure flow and velocity. However, traffic density is more difficult to measure. The situation becomes more difficult for multi-lane motorways due to drivers lane-change behaviour. This research investigates statistical modelling and analysis of traffic flow. It contributes to the literature of transportation and traffic management and research in several aspects. First, it takes into account lane-changes in traffic modelling through incorporating a Markov chain model to describe the drivers lane-change behaviour. Secondly, the lane change probabilities between two adjacent lanes are not assumed to be fixed but rather they depend on the current traffic condition. A discrete choice model is used to capture drivers lane choice behaviour. The drivers choice probabilities are modelled by several traffic-condition related attributes such as vehicle time headway, traffic density and speed. This results in a highly nonlinear state equation for traffic density. To address the issue of high nonlinearity of the state space model, the EKF and UKF is used to estimate the traffic density recursively. In addition, a new transformation approach has been proposed to transform the observation equation from a nonlinear form to a linear one so that the potential approximation in the EKF & UKF can be avoided. Numerical studies have been conducted to investigate the performance of the developed method. The proposed method outperformed the existing methods for traffic density estimation in simulation studies. Furthermore, it is shown that the computational cost for updating the estimate of traffic densities for a multi-lane motorway is kept at a minimum so that online applications are feasible in practice. Consequently the traffic densities can be monitored and the relevant information can be fed into the traffic management system of interest

Entwurf eines Beobachterbasierten Robusten Nichtlinearen Reglers

Due to observers ability in the estimation of internal system states, observers play an important role in the field of control and monitoring of dynamical systems. In reality, using sensors to measure the desired system states may be costly and/or affects the reliability of technical systems. Besides, some signals are impractical or inaccessible to be measured and using of sensors leads to significant errors such as stochastic noise. The solution of using observers is well-known since 1964. Besides the estimation of system states, some observers are able to estimate unknown inputs affecting the system dynamics such as disturbance forces or torques. These features are helpful for supervision and fault diagnosis tasks by monitoring the sensors and system components or for advanced control purposes by realizing observer-based control for practical systems. Among the state and disturbance observers, Proportional-Integral-Observer (PIO) is highly appreciated because of its simple structure and design procedure. Furthermore, using sufficiently high gain PIO, a robust estimation of system states and unknown inputs can be achieved. Besides taking the advantages of high gain design, the disadvantages of large overshoot and strong influence from measurement noise (as typical drawbacks of high gain utilization) in the control and estimation performance can not be neglected. Recently, some researches have been done to overcome the disadvantages of high gain observers and to adaptively adjust the gain of observer based on the resulting actual performance. Considering the advantages and disadvantages of high gain PIO besides the recent developments, it is evident that there are still open problems and questions to be solved in the area of optimal design of PIO and robust nonlinear control approaches based on PIO. On the other hand, the PI-Observer can be used in combination with linear/nonlinear control approaches (due to its simple structure and capability to estimate the system states and disturbances) to improve the performance and robustness of the closed-loop control results. Therefore, this thesis focuses on development and improvement of high gain Proportional-Integral-Observer as well as utilization of this observer in combination with well-known robust control approaches for possible general application in nonlinear systems. The Modified Advanced PIO (MAPIO) is introduced in this work as the extended version of Advanced PIO (APIO) to tune the gain of PIO according to the current situation. A cost function is defined so that the estimation performance and the related energy can be evaluated. Comparison between advanced observer design approaches has been done in the task of reconstructing the nonlinear characteristics and estimating the external inputs (contact forces) acting to elastic mechanical structures. Simulation results in open-loop and closed-loop cases verified that the performance of MAPIO in the task of unknown input estimation is more robust to different levels of measurement noise in comparison to previous methods e.g. APIO and standard high/low gain PIO. Furthermore, a new gain design approach of Proportional-Integral-Observer is proposed to overcome the disadvantages of high gain PIO and to realize the estimation of fast dynamical behaviors like unknown impact force. The dynamics of this force input is assumed as unknown. The idea of funnel control is taking into consideration to design the PIO gain. The important advantage of the proposed approach compared to previously published PIO gain design is the self-adjustment of observer gains according to the actual estimation situation inside the predefined funnel area. In this thesis it is shown that the proposed funnel PI-Observer algorithm allows adaptive PIO gain calculation, being able to be situatively adjusted even in the presence of measurement noise. Stability proof of funnel PI-Observer is investigated according to the switching observer condition and Lyapunov theory. The effectiveness of the proposed method is evaluated by simulation and experimental results using an elastic beam test rig. Furthermore, a nonlinear MIMO mechanical system is used to verify the effectiveness of the proposed method in the closed-loop context. Additionally, this thesis provides two new PI-Observer-based robust controllers as PIO-based sliding mode control and PIO-based backstepping control to improve the position tracking performance of a hydraulic differential cylinder system in the presence of uncertainties e.g. modeling errors, disturbances, and measurement noise. To use the linear PIO for estimation of system states and unknown inputs, the input-output feedback linearization approach is used to linearize the nonlinear model of hydraulic differential cylinder system. Thereupon the result of state and unknown input estimation is integrated into the structure of robust control design (here SMC and backstepping control) to eliminate the effects of uncertainties and disturbances. The introduced PIO-based robust controllers guarantee the ultimate boundness of the tracking error in the presence of uncertainties. The closed-loop stability is proved using Lyapunov theory in both cases. The proposed methods are experimentally validated and the results are compared with the standard SMC and industrial standard approach P-Controller in the presence of measurement noise, model uncertainties, and external disturbances. A general comparison of SMC and backstepping control approaches is provided in the last part of this work.Die Regelung und Überwachung dynamischer Systeme kann voraussetzen, dass Informationen über interne Systemzustände bekannt sind. Die Verwendung von Sensoren zur Erfassung aller Systemzustände kann erhöhte Kosten zur Folge haben und die Systemzuverlässigkeit negativ beeinflussen. Weitere Probleme ergeben sich dadurch, dass ggf. nicht jeder Systemzustand sensorisch erfasst werden kann. Der Beobachter erlaubt die Rekonstruktion aller Systemzustände auf Grundlage weniger Messungen. Neben Systemzuständen können externe Eingangsgrößen wie Reibmomente und Störungen geschätzt werden. Als Konsequenz ermöglicht der Beobachter eine gegenüber Störungen robuste Regelung und Fehlerdiagnose technischer Systeme. Der Proportional-Integral-Observer (PIO) kann mittels bestehender Entwurfsverfahren einfach implementiert werden. Durch Anpassen der Rückkopplungsmatrix eignet sich der PIO zur kombinierten Schätzung von Zuständen und unbekannten Eingangsgrößen. In diesem Zusammenhang spielt die Wahl einer betragsmäßig großen Rückkopplungsverstärkungsmatrix, als sogenannter High Gain Ansatz, eine entscheidende Rolle. Weiterhin hängt die Performance des PIO von der unbekannten Charakteristik der zu schätzenden Eingangsgröße ab. Diese Arbeit befasst sich mit der Entwicklung optimierter Entwurfsverfahren für den Proportional-Integral-Observer und der Entwicklung und Anwendung beobachterbasierter Konzepte zur robusten Regelung nichtlinearer Systeme. In dieser Arbeit wird der modifizierte Advanced PIO (MAPIO) als erweiterte Version des Advanced PIO (APIO) eingeführt. Der Schätzfehler von MAPIO wird über ein Gütefunktional abgebildet. Das Gütefunktional wird durch Anpassung der Rückkopplungsverstärkungsmatrix an die Charakteristik der unbekannten Eingangsgröße minimiert. Die Performance der modifizierten Beobachterentwurfsansätze wird anhand eines praktischen Beispiels bewertet. Geschätzt wird eine unbekannte Kontaktkraft mit nichtlinearer Charakteristik, die auf ein mechanisches System wirkt. Anhand eines Simulationsbeispiels im offenen und geschlossenen Regelkreis wird die Performance von MAPIO gegenüber vorherigen Verfahren APIO und PIO verifiziert. Basierend auf der Idee des Funnel Reglers wird ein neuartiges Entwurfskonzept für den Proportional-Integral-Observer vorgestellt. Die Nachteile des PIO-Konzeptes mit hohem Verstärkungsfaktor können überwunden werden und Schätzungen schneller dynamischer Verhaltensweisen lassen sich realisieren. Der Vorteil der neuartigen Funnel PIO Methode ist, dass der Schätzfehler in einem definierten Bereich, der sogenannten Funnel-Area, verbleibt. In dieser Arbeit wird gezeigt, dass der vorgeschlagene Funnel PIO Algorithmus eine adaptive PIO Verstärkungsberechnung ermöglicht, die auch in Gegenwart von Messrauschen situativ eingestellt werden kann. Der Stabilitätsnachweis von Funnel PIO wird mittels der Lyapunov Theorie untersucht. Die Wirksamkeit der vorgeschlagenen Methode wird durch Simulation und experimentelle Ergebnisse validiert. Eine auf einen elastischen Balken wirkende äußere Kraft mit nichtlinearer Charakteristik wird geschätzt. Ein nichtlineares MIMO System wird verwendet, um die Wirksamkeit der vorgeschlagenen Methode im geschlossenen Regelkreis zu verifizieren. In dieser Arbeit werden zwei neue PI-Observer basierte robuste Regelungen (PIO-basierte Sliding Mode und PIO-basierte Backstepping Regelung) vorgestellt. Die Positionsregelung eines hydraulischen Differentialzylinders in Gegenwart von Modellunsicherheiten, Störungen und Messrauschen wird untersucht. Zur Anwendung der PIO-basierten Störgrößenschätzung wird eine Ein-/Ausgangs-Linearisierung des nichtlinearen Modells vorgenommen. Die Stabilität des geschlossenen Regelkreises wird in beiden Fällen mit der Lyapunov Theorie bewiesen. Die vorgeschlagenen Methoden werden experimentell validiert und die Ergebnisse werden mit dem Standard Sliding Mode Regler und einem P-Regler in Gegenwart von Messrauschen, Modellunsicherheiten und externen Störungen verglichen