A Review of Kernel Methods for Feature Extraction in Nonlinear Process Monitoring

Kernel methods are a class of learning machines for the fast recognition of nonlinear patterns in any data set. In this paper, the applications of kernel methods for feature extraction in industrial process monitoring are systematically reviewed. First, we describe the reasons for using kernel methods and contextualize them among other machine learning tools. Second, by reviewing a total of 230 papers, this work has identified 12 major issues surrounding the use of kernel methods for nonlinear feature extraction. Each issue was discussed as to why they are important and how they were addressed through the years by many researchers. We also present a breakdown of the commonly used kernel functions, parameter selection routes, and case studies. Lastly, this review provides an outlook into the future of kernel-based process monitoring, which can hopefully instigate more advanced yet practical solutions in the process industries

Autonomously Reconfigurable Artificial Neural Network on a Chip

Artificial neural network (ANN), an established bio-inspired computing paradigm, has proved very effective in a variety of real-world problems and particularly useful for various emerging biomedical applications using specialized ANN hardware. Unfortunately, these ANN-based systems are increasingly vulnerable to both transient and permanent faults due to unrelenting advances in CMOS technology scaling, which sometimes can be catastrophic. The considerable resource and energy consumption and the lack of dynamic adaptability make conventional fault-tolerant techniques unsuitable for future portable medical solutions. Inspired by the self-healing and self-recovery mechanisms of human nervous system, this research seeks to address reliability issues of ANN-based hardware by proposing an Autonomously Reconfigurable Artificial Neural Network (ARANN) architectural framework. Leveraging the homogeneous structural characteristics of neural networks, ARANN is capable of adapting its structures and operations, both algorithmically and microarchitecturally, to react to unexpected neuron failures. Specifically, we propose three key techniques --- Distributed ANN, Decoupled Virtual-to-Physical Neuron Mapping, and Dual-Layer Synchronization --- to achieve cost-effective structural adaptation and ensure accurate system recovery. Moreover, an ARANN-enabled self-optimizing workflow is presented to adaptively explore a "Pareto-optimal" neural network structure for a given application, on the fly. Implemented and demonstrated on a Virtex-5 FPGA, ARANN can cover and adapt 93% chip area (neurons) with less than 1% chip overhead and O(n) reconfiguration latency. A detailed performance analysis has been completed based on various recovery scenarios

Failure Diagnosis and Prognosis of Safety Critical Systems: Applications in Aerospace Industries

Many safety-critical systems such as aircraft, space crafts, and large power plants are required to operate in a reliable and efficient working condition without any performance degradation. As a result, fault diagnosis and prognosis (FDP) is a research topic of great interest in these systems. FDP systems attempt to use historical and current data of a system, which are collected from various measurements to detect faults, diagnose the types of possible failures, predict and manage failures in advance. This thesis deals with FDP of safety-critical systems. For this purpose, two critical systems including a multifunctional spoiler (MFS) and hydro-control value system are considered, and some challenging issues from the FDP are investigated. This research work consists of three general directions, i.e., monitoring, failure diagnosis, and prognosis. The proposed FDP methods are based on data-driven and model-based approaches. The main aim of the data-driven methods is to utilize measurement data from the system and forecast the remaining useful life (RUL) of the faulty components accurately and efficiently. In this regard, two dierent methods are developed. A modular FDP method based on a divide and conquer strategy is presented for the MFS system. The modular structure contains three components:1) fault diagnosis unit, 2) failure parameter estimation unit and 3) RUL unit. The fault diagnosis unit identifies types of faults based on an integration of neural network (NN) method and discrete wavelet transform (DWT) technique. Failure parameter estimation unit observes the failure parameter via a distributed neural network. Afterward, the RUL of the system is predicted by an adaptive Bayesian method. In another work, an innovative data-driven FDP method is developed for hydro-control valve systems. The idea is to use redundancy in multi-sensor data information and enhance the performance of the FDP system. Therefore, a combination of a feature selection method and support vector machine (SVM) method is applied to select proper sensors for monitoring of the hydro-valve system and isolate types of fault. Then, adaptive neuro-fuzzy inference systems (ANFIS) method is used to estimate the failure path. Similarly, an online Bayesian algorithm is implemented for forecasting RUL. Model-based methods employ high-delity physics-based model of a system for prognosis task. In this thesis, a novel model-based approach based on an integrated extended Kalman lter (EKF) and Bayesian method is introduced for the MFS system. To monitor the MFS system, a residual estimation method using EKF is performed to capture the progress of the failure. Later, a transformation is utilized to obtain a new measure to estimate the degradation path (DP). Moreover, the recursive Bayesian algorithm is invoked to predict the RUL. Finally, relative accuracy (RA) measure is utilized to assess the performance of the proposed methods

Aircraft Jet Engine Health Monitoring Through System Identification Using Ensemble Neural Networks

In this thesis a new approach for jet engine Fault Detection and Isolation (FDI) is proposed using ensemble neural networks. Ensemble methods combine various model predictions to reduce the modeling error and increase the prediction accuracy. By combining individual models, more robust and accurate representations are almost always achievable without the need of ad-hoc fine tunings that are required for single model-based solutions. For the purpose of jet engine health monitoring, the model of the jet engine dynamics is represented using three different stand-alone or individual neural network learning algorithms. Specifically, a dynamic multi-layer perceptron (MLP), a dynamic radial-basis function (RBF) neural network, and a dynamic support vector machine (SVM) are trained to individually model the jet engine dynamics. The accuracy of each stand-alone model in identification of the jet engine dynamics is evaluated. Next, three ensemble-based techniques are employed to represent jet engine dynamics. Namely, two heterogenous ensemble models (an ensemble model is heterogeneous when different learning algorithms (neural networks) are used for training its members) and a homogeneous ensemble model (all the models are generated using the same learning algorithm (neural network)). It is concluded that the ensemble models improve the modeling accuracy when compared to stand-alone solutions. The best selected stand-alone model (i.e the dynamic radial-basis function neural network in this application) and the best selected ensemble model (i.e. a heterogenous ensemble) in term of the jet engine modeling accuracy are selected for performing the FDI study. Engine residual signals are generated using both single model-based and ensemble-based solutions under various engine health conditions. The obtained residuals are evaluated in order to detect engine faults. Our simulation results demonstrate that the fault detection task using residuals that are obtained from the ensemble model results in more accurate performance. The fault isolation task is performed by evaluating variations in residual signals (before and after a fault detection flag) using a neural network classifier. As in the fault detection results, it is observed that the ensemble-based fault isolation task results in a more promising performance

Malfunction diagnosis in industrial process systems using data mining for knowledge discovery

The determination of abnormal behavior at process industries gains increasing interest as strict regulations and highly competitive operation conditions are regularly applied at the process systems. A synergetic approach in exploring the behavior of industrial processes is proposed, targeting at the discovery of patterns and implement fault detection (malfunction) diagnosis. The patterns are based on highly correlated time series. The concept is based on the fact that if independent time series are combined based on rules, we can extract scenarios of functional and non-functional situations so as to monitor hazardous procedures occurring in workplaces. The selected methods combine and apply actions on historically stored, experimental data from a chemical pilot plant, located at CERTH/CPERI. The implementation of the clustering and classification methods showed promising results of determining with great accuracy (97%) the potential abnormal situations

Automated On-line Diagnosis and Control Configuration in Robotic Systems Using Model Based Analytical Redundancy

Because of the increasingly demanding tasks that robotic systems are asked to perform, there is a need to make them more reliable, intelligent, versatile and self-sufficient. Furthermore, throughout the robotic system?s operation, changes in its internal and external environments arise, which can distort trajectory tracking, slow down its performance, decrease its capabilities, and even bring it to a total halt. Changes in robotic systems are inevitable. They have diverse characteristics, magnitudes and origins, from the all-familiar viscous friction to Coulomb/Sticktion friction, and from structural vibrations to air/underwater environmental change. This thesis presents an on-line environmental Change, Detection, Isolation and Accommodation (CDIA) scheme that provides a robotic system the capabilities to achieve demanding requirements and manage the ever-emerging changes. The CDIA scheme is structured around a priori known dynamic models of the robotic system and the changes (faults). In this approach, the system monitors its internal and external environments, detects any changes, identifies and learns them, and makes necessary corrections into its behavior in order to minimize or counteract their effects. A comprehensive study is presented that deals with every stage, aspect, and variation of the CDIA process. One of the novelties of the proposed approach is that the profile of the change may be either time or state-dependent. The contribution of the CDIA scheme is twofold as it provides robustness with respect to unmodeled dynamics and with respect to torque-dependent, state-dependent, structural and external environment changes. The effectiveness of the proposed approach is verified by the development of the CDIA scheme for a SCARA robot. Results of this extensive numerical study are included to verify the applicability of the proposed scheme

Meta-heuristic algorithms in car engine design: a literature survey

Meta-heuristic algorithms are often inspired by natural phenomena, including the evolution of species in Darwinian natural selection theory, ant behaviors in biology, flock behaviors of some birds, and annealing in metallurgy. Due to their great potential in solving difficult optimization problems, meta-heuristic algorithms have found their way into automobile engine design. There are different optimization problems arising in different areas of car engine management including calibration, control system, fault diagnosis, and modeling. In this paper we review the state-of-the-art applications of different meta-heuristic algorithms in engine management systems. The review covers a wide range of research, including the application of meta-heuristic algorithms in engine calibration, optimizing engine control systems, engine fault diagnosis, and optimizing different parts of engines and modeling. The meta-heuristic algorithms reviewed in this paper include evolutionary algorithms, evolution strategy, evolutionary programming, genetic programming, differential evolution, estimation of distribution algorithm, ant colony optimization, particle swarm optimization, memetic algorithms, and artificial immune system