Detecting anomalies in multivariate time series from automotive systems

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.In the automotive industry test drives are conducted during the development of new vehicle models or as a part of quality assurance for series vehicles. During the test drives, data is recorded for the use of fault analysis resulting in millions of data points. Since multiple vehicles are tested in parallel, the amount of data that is to be analysed is tremendous. Hence, manually analysing each recording is not feasible. Furthermore the complexity of vehicles is ever-increasing leading to an increase of the data volume and complexity of the recordings. Only by effective means of analysing the recordings, one can make sure that the effort put in the conducting of test drives pays off. Consequently, effective means of test drive analysis can become a competitive advantage. This Thesis researches ways to detect unknown or unmodelled faults in recordings from test drives with the following two aims: (1) in a data base of recordings, the expert shall be pointed to potential errors by reporting anomalies, and (2) the time required for the manual analysis of one recording shall be shortened. The idea to achieve the first aim is to learn the normal behaviour from a training set of recordings and then to autonomously detect anomalies. The one-class classifier “support vector data description” (SVDD) is identified to be most suitable, though it suffers from the need to specify parameters beforehand. One main contribution of this Thesis is a new autonomous parameter tuning approach, making SVDD applicable to the problem at hand. Another vital contribution is a novel approach enhancing SVDD to work with multivariate time series. The outcome is the classifier “SVDDsubseq” that is directly applicable to test drive data, without the need for expert knowledge to configure or tune the classifier. The second aim is achieved by adapting visual data mining techniques to make the manual analysis of test drives more efficient. The methods of “parallel coordinates” and “scatter plot matrices” are enhanced by sophisticated filter and query operations, combined with a query tool that allows to graphically formulate search patterns. As a combination of the autonomous classifier “SVDDsubseq” and user-driven visual data mining techniques, a novel, data-driven, semi-autonomous approach to detect unmodelled faults in recordings from test drives is proposed and successfully validated on recordings from test drives. The methodologies in this Thesis can be used as a guideline when setting up an anomaly detection system for own vehicle data

Multivariate hydrometeorological extreme events and their impacts on vegetation: potential methods and applications

Trockenheiten und Hitzewellen beeinflussen unsere Gesellschaft und die Vegetation. Insbesondere im Zusammenhang mit dem Klimawandel sind die Auswirkungen auf die Vegetation von besonderer Bedeutung. Im globalen Kohlenstoffkreislauf sind terrestrische Ökosysteme normalerweise Senken von Kohlenstoffdioxid, können sich aber während und nach Klimaextremereignissen in Kohlenstoffquellen verwandeln. Ein entscheidender Aspekt hierbei ist die Rolle verschiedener Pflanzenarten und Vegetationstypen auf verschiedenen Skalen, die die Auswirkungen auf den Kohlenstoffkreislauf beeinflussen. Obwohl durch physiologische Unterschiede zwischen verschiedenen Pflanzenarten unterschiedliche Reaktionen auf Extremereignisse naheliegen, sind diese Unterschiede auf globaler Ebene nicht systematisch ausgewertet und vollständig verstanden. Ein weiter Aspekt ist, dass Klimaextremereignissen von Natur aus multivariat sind. Beispielsweise kann heiße Luft mehr Wasser aufnehmen als kalte Luft. Extremereignisse mit starken Auswirkungen waren in der Vergangenheit häufig multivariat, wie beispielsweise in Europa 2003, Russland 2012, oder den USA 2012. Diese multivariate Natur von Klimaextremen erfordert eine multivariate Perspektive auf diese Ereignisse. Bisher werden meistens einzelne Variablen zu Detektion von Extremereignissen genutzt und keine Kovariation oder Nichtlinearitäten berücksichtigt. Neue generische Workflows, die solche multivariaten Strukturen berücksichtigen, müssen erst entwickelt oder aus anderen Disziplinen übertragen werden, um uns eine multivariate Perspektive auf Klimaextreme zu bieten. Das übergeordnete Ziel der Dissertation ist es, die Erkennung und das Verständnis von Klimaextremen und deren Auswirkungen auf die Vegetation zu verbessern, indem eine breitere multivariate Perspektive ermöglicht wird, die bisherige Ansätze zur Erkennung von Extremereignissen ergänzt

Cyber Security and Critical Infrastructures 2nd Volume

The second volume of the book contains the manuscripts that were accepted for publication in the MDPI Special Topic "Cyber Security and Critical Infrastructure" after a rigorous peer-review process. Authors from academia, government and industry contributed their innovative solutions, consistent with the interdisciplinary nature of cybersecurity. The book contains 16 articles, including an editorial that explains the current challenges, innovative solutions and real-world experiences that include critical infrastructure and 15 original papers that present state-of-the-art innovative solutions to attacks on critical systems

Process Modeling in Pyrometallurgical Engineering

The Special Issue presents almost 40 papers on recent research in modeling of pyrometallurgical systems, including physical models, first-principles models, detailed CFD and DEM models as well as statistical models or models based on machine learning. The models cover the whole production chain from raw materials processing through the reduction and conversion unit processes to ladle treatment, casting, and rolling. The papers illustrate how models can be used for shedding light on complex and inaccessible processes characterized by high temperatures and hostile environment, in order to improve process performance, product quality, or yield and to reduce the requirements of virgin raw materials and to suppress harmful emissions

Data-Driven Fault Detection and Reasoning for Industrial Monitoring

This open access book assesses the potential of data-driven methods in industrial process monitoring engineering. The process modeling, fault detection, classification, isolation, and reasoning are studied in detail. These methods can be used to improve the safety and reliability of industrial processes. Fault diagnosis, including fault detection and reasoning, has attracted engineers and scientists from various fields such as control, machinery, mathematics, and automation engineering. Combining the diagnosis algorithms and application cases, this book establishes a basic framework for this topic and implements various statistical analysis methods for process monitoring. This book is intended for senior undergraduate and graduate students who are interested in fault diagnosis technology, researchers investigating automation and industrial security, professional practitioners and engineers working on engineering modeling and data processing applications. This is an open access book

Modeling and Communicating Flexibility in Smart Grids Using Artificial Neural Networks as Surrogate Models

Increasing shares of renewable energies and the transition towards electric vehicles pose major challenges to the energy system. In order to tackle these in an economically sensible way, the flexibility of distributed energy resources (DERs), such as battery energy storage systems, combined heat and power plants, and heat pumps, needs to be exploited. Modeling and communicating this flexibility is a fundamental step when trying to achieve control over DERs. The literature proposes and makes use of many different approaches, not only for the exploitation itself, but also in terms of models. In the first step, this thesis presents an extensive literature review and a general framework for classifying exploitation approaches and the communicated models. Often, the employed models only apply to specific types of DERs, or the models are so abstract that they neglect constraints and only roughly outline the true flexibility. Surrogate models, which are learned from data, can pose as generic DER models and may potentially be trained in a fully automated process. In this thesis, the idea of encoding the flexibility of DERs into ANNs is systematically investigated. Based on the presented framework, a set of ANN-based surrogate modeling approaches is derived and outlined, of which some are only applicable for specific use cases. In order to establish a baseline for the approximation quality, one of the most versatile identified approaches is evaluated in order to assess how well a set of reference models is approximated. If this versatile model is able to capture the flexibility well, a more specific model can be expected to do so even better. The results show that simple DERs are very closely approximated, and for more complex DERs and combinations of multiple DERs, a high approximation quality can be achieved by introducing buffers. Additionally, the investigated approach has been tested in scheduling tasks for multiple different DERs, showing that it is indeed possible to use ANN-based surrogates for the flexibility of DERs to derive load schedules. Finally, the computational complexity of utilizing the different approaches for controlling DERs is compared

Data-Driven Fault Detection and Reasoning for Industrial Monitoring

This open access book assesses the potential of data-driven methods in industrial process monitoring engineering. The process modeling, fault detection, classification, isolation, and reasoning are studied in detail. These methods can be used to improve the safety and reliability of industrial processes. Fault diagnosis, including fault detection and reasoning, has attracted engineers and scientists from various fields such as control, machinery, mathematics, and automation engineering. Combining the diagnosis algorithms and application cases, this book establishes a basic framework for this topic and implements various statistical analysis methods for process monitoring. This book is intended for senior undergraduate and graduate students who are interested in fault diagnosis technology, researchers investigating automation and industrial security, professional practitioners and engineers working on engineering modeling and data processing applications. This is an open access book

Information Theory and Its Application in Machine Condition Monitoring

Condition monitoring of machinery is one of the most important aspects of many modern industries. With the rapid advancement of science and technology, machines are becoming increasingly complex. Moreover, an exponential increase of demand is leading an increasing requirement of machine output. As a result, in most modern industries, machines have to work for 24 hours a day. All these factors are leading to the deterioration of machine health in a higher rate than before. Breakdown of the key components of a machine such as bearing, gearbox or rollers can cause a catastrophic effect both in terms of financial and human costs. In this perspective, it is important not only to detect the fault at its earliest point of inception but necessary to design the overall monitoring process, such as fault classification, fault severity assessment and remaining useful life (RUL) prediction for better planning of the maintenance schedule. Information theory is one of the pioneer contributions of modern science that has evolved into various forms and algorithms over time. Due to its ability to address the non-linearity and non-stationarity of machine health deterioration, it has become a popular choice among researchers. Information theory is an effective technique for extracting features of machines under different health conditions. In this context, this book discusses the potential applications, research results and latest developments of information theory-based condition monitoring of machineries

Proceedings of the 18th Irish Conference on Artificial Intelligence and Cognitive Science

These proceedings contain the papers that were accepted for publication at AICS-2007, the 18th Annual Conference on Artificial Intelligence and Cognitive Science, which was held in the Technological University Dublin; Dublin, Ireland; on the 29th to the 31st August 2007. AICS is the annual conference of the Artificial Intelligence Association of Ireland (AIAI)

A Predictive maintenance model for heterogeneous industrial refrigeration systems

The automatic assessment of the degradation state of industrial refrigeration systems is becoming increasingly important and constitutes a key-role within predictive maintenance approaches. Lately, data-driven methods especially became the focus of research in this respect. As they only rely on historical data in the development phase, they offer great advantages in terms of flexibility and generalisability by circumventing the need for specific domain knowledge. While most scientific contributions employ methods emerging from the field of machine learning (ML), only very few consider their applicability amongst different heterogeneous systems. In fact, the majority of existing contributions in this field solely apply supervised ML models, which assume the availability of labelled fault data for each system respectively. However, this places restrictions on the overall applicability, as data labelling is mostly conducted by humans and therefore constitutes a non-negligible cost and time factor. Moreover, such methods assume that all considered fault types occurred in the past, a condition that may not always be guaranteed to be satisfied. Therefore, this dissertation proposes a predictive maintenance model for industrial refrigeration systems by especially addressing its transferability onto different but related heterogeneous systems. In particular, it aims at solving a sub-problem known as condition-based maintenance (CBM) to automatically assess the system’s state of degradation. To this end, the model does not only estimate how far a possible malfunction has progressed, but also determines the fault type being present. As will be described in greater detail throughout this dissertation, the proposed model also utilises techniques from the field of ML but rather bypasses the strict assumptions accompanying supervised ML. Accordingly, it assumes the data of the target system to be primarily unlabelled while a few labelled samples are expected to be retrievable from the fault-free operational state, which can be obtained at low cost. Yet, to enable the model’s intended functionality, it additionally employs data from only one fully labelled source dataset and, thus, allows the benefits of data-driven approaches towards predictive maintenance to be further exploited. After the introduction, the dissertation at hand introduces the related concepts as well as the terms and definitions and delimits this work from other fields of research. Furthermore, the scope of application is further introduced and the latest scientific work is presented. This is then followed by the explanation of the open research gap, from which the research questions are derived. The third chapter deals with the main principles of the model, including the mathematical notations and the individual concepts. It furthermore delivers an overview about the variety of problems arising in this context and presents the associated solutions from a theoretical point of view. Subsequently, the data acquisition phase is described, addressing both the data collection procedure and the outcome of the test cases. In addition, the considered fault characteristics are presented and compared with the ones obtained from the related publicly available dataset. In essence, both datasets form the basis for the model validation, as discussed in the following chapter. This chapter then further comprises the results obtained from the model, which are compared with the ones retrieved from several baseline models derived from the literature. This work then closes with a summary and the conclusions drawn from the model results. Lastly, an outlook of the presented dissertation is provide