Validating a neural network-based online adaptive system

Neural networks are popular models used for online adaptation to accommodate system faults and recuperate against environmental changes in real-time automation and control applications. However, the adaptivity limits the applicability of conventional verification and validation (V&V) techniques to such systems. We investigated the V&V of neural network-based online adaptive systems and developed a novel validation approach consisting of two important methods. (1) An independent novelty detector at the system input layer detects failure conditions and tracks abnormal events/data that may cause unstable learning behavior. (2) At the system output layer, we perform a validity check on the network predictions to validate its accommodation performance.;Our research focuses on the Intelligent Flight Control System (IFCS) for NASA F-15 aircraft as an example of online adaptive control application. We utilized Support Vector Data Description (SVDD), a one-class classifier to examine the data entering the adaptive component and detect potential failures. We developed a decompose and combine strategy to drastically reduce its computational cost, from O(n 3) down to O( n32 log n) such that the novelty detector becomes feasible in real-time.;We define a confidence measure, the validity index, to validate the predictions of the Dynamic Cell Structure (DCS) network in IFCS. The statistical information is collected during adaptation. The validity index is computed to reflect the trustworthiness associated with each neural network output. The computation of validity index in DCS is straightforward and efficient.;Through experimentation with IFCS, we demonstrate that: (1) the SVDD tool detects system failures accurately and provides validation inferences in a real-time manner; (2) the validity index effectively indicates poor fitting within regions characterized by sparse data and/or inadequate learning. The developed methods can be integrated with available online monitoring tools and further generalized to complete a promising validation framework for neural network based online adaptive systems

Intelligent failure-tolerant control

An overview of failure-tolerant control is presented, beginning with robust control, progressing through parallel and analytical redundancy, and ending with rule-based systems and artificial neural networks. By design or implementation, failure-tolerant control systems are 'intelligent' systems. All failure-tolerant systems require some degrees of robustness to protect against catastrophic failure; failure tolerance often can be improved by adaptivity in decision-making and control, as well as by redundancy in measurement and actuation. Reliability, maintainability, and survivability can be enhanced by failure tolerance, although each objective poses different goals for control system design. Artificial intelligence concepts are helpful for integrating and codifying failure-tolerant control systems, not as alternatives but as adjuncts to conventional design methods

Simulation, Application, and Resilience of an Organic Neuromorphic Architecture, Made with Organic Bistable Devices and Organic Field Effect Transistors

This thesis presents work done simulating a type of organic neuromorphic architecture, modeled after Artificial Neural Network, and termed Synthetic Neural Network, or SNN. The first major contribution of this thesis is development of a single-transistor-single-organic-bistable-device-per-input circuit that approximates behavior of an artificial neuron. The efficacy of this design is validated by comparing the behavior of a single synthetic neuron to that of an artificial neuron as well as two examples involving a network of synthetic neurons. The analysis utilizes electrical characteristics of polymer electronic elements, namely Organic Bistable Device and Organic Field Effect Transistor, created in the laboratory at University of Denver. Polymer electronics is a new branch of electronics that is based on conductive and semi-conductive polymers. These new elements hold a great advantage over the inorganic electronics in the form of physical flexibility and low cost of fabrication. However, their device variability between individual devices is also much greater. Therefore the second major contribution of this thesis is the analysis of resilience of neural networks subjected to physical damage and other manufacturing faults

Fractional Order Fault Tolerant Control - A Survey

In this paper, a comprehensive review of recent advances and trends regarding Fractional Order Fault Tolerant Control (FOFTC) design is presented. This novel robust control approach has been emerging in the last decade and is still gathering great research efforts mainly because of its promising results and outcomes. The purpose of this study is to provide a useful overview for researchers interested in developing this interesting solution for plants that are subject to faults and disturbances with an obligation for a maintained performance level. Throughout the paper, the various works related to FOFTC in literature are categorized first by considering their research objective between fault detection with diagnosis and fault tolerance with accommodation, and second by considering the nature of the studied plants depending on whether they are modelized by integer order or fractional order models. One of the main drawbacks of these approaches lies in the increase in complexity associated with introducing the fractional operators, their approximation and especially during the stability analysis. A discussion on the main disadvantages and challenges that face this novel fractional order robust control research field is given in conjunction with motivations for its future development. This study provides a simulation example for the application of a FOFTC against actuator faults in a Boeing 747 civil transport aircraft is provided to illustrate the efficiency of such robust control strategies

Machine learning methods for fault classification

With the constant evolution and ever-increasing transistor densities in semiconductor technology, error rates are on the rise. Errors that occur on semiconductor chips can be attributed to permanent, transient or intermittent faults. Out of these errors, once permanent errors appear, they do not go away and once intermittent faults appear on chips, the probability that they will occur again is high, making these two types of faults critical. Transient faults occur very rarely, making them non-critical. Incorrect classification during manufacturing tests in case of critical faults, may result in failure of the chip during operational lifetime or decrease in product quality, whereas discarding chips with non-critical faults may result in unnecessary yield loss. Existing mechanisms to distinguish between the fault types are mostly rule-based, and as fault types start manifesting similarly as we move to lower technology nodes, these rules become obsolete over time. Hence, rules need to be updated every time the technology is changed. Machine learning approaches have shown that the uncertainty can be compensated with previous experience. In our case, the ambiguity of classification rules can be compensated by storing past classification decisions and learn from those for accurate classification. This thesis presents an effective solution to the problem of fault classification in VLSI chips using Support Vector Machine (SVM) based machine learning techniques

A Matlab Tool for Analyzing and Improving Fault Tolerance of Artificial Neural Networks

Abstract: FTSET is a software tool that deals with fault tolerance of Artificial Neural Networks. This tool is capable of evaluating the fault tolerance degree of a previously trained Artificial Neural Network given its inputs ranges, the weights and the architecture. The FTSET is also capable of improving the fault tolerance by applying a technique of splitting the connections of the network that are more important to form the output. This technique improves fault tolerance without changing the network's output. The paper is concluded by two examples that show the application of the FTSET to different Artificial Neural Networks and the improvement of the fault tolerance obtained

On-line estimation approaches to fault-tolerant control of uncertain systems

This thesis is concerned with fault estimation in Fault-Tolerant Control (FTC) and as such involves the joint problem of on-line estimation within an adaptive control system. The faults that are considered are significant uncertainties affecting the control variables of the process and their estimates are used in an adaptive control compensation mechanism. The approach taken involves the active FTC, as the faults can be considered as uncertainties affecting the control system. The engineering (application domain) challenges that are addressed are: (1) On-line model-based fault estimation and compensation as an FTC problem, for systems with large but bounded fault magnitudes and for which the faults can be considered as a special form of dynamic uncertainty. (2) Fault-tolerance in the distributed control of uncertain inter-connected systems The thesis also describes how challenge (1) can be used in the distributed control problem of challenge (2). The basic principle adopted throughout the work is that the controller has two components, one involving the nominal control action and the second acting as an adaptive compensation for significant uncertainties and fault effects. The fault effects are a form of uncertainty which is considered too large for the application of passive FTC methods. The thesis considers several approaches to robust control and estimation: augmented state observer (ASO); sliding mode control (SMC); sliding mode fault estimation via Sliding Mode Observer (SMO); linear parameter-varying (LPV) control; two-level distributed control with learning coordination

Optimal Strategy in Predicting Equipment Sensor Failure Using Genetic Programming and Histogram of Residual

Detecting sensor abnormality is challenging because the data are normally acquired using IoT approach and stored offline in a dedicated server (data logs). The objectives of this research are to device an approach to detect sensor abnormality and perform this in a ”white box” approach. In the proposed approach, the compressor sensor output is modelled as a function of other sensors using static approach, comparing regression results of Genetic Programming (GP) with Multiple Linear Regression (MLR) and Neural Network Regression (ANN). Subsequently, the model output is used for detecting abnormality by observing the residuals