A Bayesian Approach to Control Loop Performance Diagnosis Incorporating Background Knowledge of Response Information

To isolate the problem source degrading the control loop performance, this work focuses on how to incorporate background knowledge into Bayesian inference. In an effort to reduce dependence on the amount of historical data available, we consider a general kind of background knowledge which appears in many applications. The knowledge, known as response information, is about what faults can possibly affect each of the monitors. We show how this knowledge can be translated to constraints on the underlying probability distributions and introduced in the Bayesian diagnosis. In this way, the dimensionality of the observation space is reduced and thus the diagnosis can be more reliable. Furthermore, for the judgments to be consistent, the set of posterior probabilities of each possible abnormality that are computed from different observation subspaces is synthesized to obtain the partially ordered posteriors. The eigenvalue formulation is used on the pairwise comparison matrix. The proposed approach is applied to a diagnosis problem on an oil sand solids handling system, where it is shown how the combination of background knowledge and data enhances the control performance diagnosis even when the abnormality data are sparse in the historical database

Autonomic care platform for optimizing query performance

Background: As the amount of information in electronic health care systems increases, data operations get more complicated and time-consuming. Intensive Care platforms require a timely processing of data retrievals to guarantee the continuous display of recent data of patients. Physicians and nurses rely on this data for their decision making. Manual optimization of query executions has become difficult to handle due to the increased amount of queries across multiple sources. Hence, a more automated management is necessary to increase the performance of database queries. The autonomic computing paradigm promises an approach in which the system adapts itself and acts as self-managing entity, thereby limiting human interventions and taking actions. Despite the usage of autonomic control loops in network and software systems, this approach has not been applied so far for health information systems. Methods: We extend the COSARA architecture, an infection surveillance and antibiotic management service platform for the Intensive Care Unit (ICU), with self-managed components to increase the performance of data retrievals. We used real-life ICU COSARA queries to analyse slow performance and measure the impact of optimizations. Each day more than 2 million COSARA queries are executed. Three control loops, which monitor the executions and take action, have been proposed: reactive, deliberative and reflective control loops. We focus on improvements of the execution time of microbiology queries directly related to the visual displays of patients' data on the bedside screens. Results: The results show that autonomic control loops are beneficial for the optimizations in the data executions in the ICU. The application of reactive control loop results in a reduction of 8.61% of the average execution time of microbiology results. The combined application of the reactive and deliberative control loop results in an average query time reduction of 10.92% and the combination of reactive, deliberative and reflective control loops provides a reduction of 13.04%. Conclusions: We found that by controlled reduction of queries' executions the performance for the end-user can be improved. The implementation of autonomic control loops in an existing health platform, COSARA, has a positive effect on the timely data visualization for the physician and nurse

In silico assessment of biomedical products: the conundrum of rare but not so rare events in two case studies

In silico clinical trials, defined as “The use of individualized computer simulation in the development or regulatory evaluation of a medicinal product, medical device, or medical intervention,” have been proposed as a possible strategy to reduce the regulatory costs of innovation and the time to market for biomedical products. We review some of the the literature on this topic, focusing in particular on those applications where the current practice is recognized as inadequate, as for example, the detection of unexpected severe adverse events too rare to be detected in a clinical trial, but still likely enough to be of concern. We then describe with more details two case studies, two successful applications of in silico clinical trial approaches, one relative to the University of Virginia/Padova simulator that the Food and Drug Administration has accepted as possible replacement for animal testing in the preclinical assessment of artificial pancreas technologies, and the second, an investigation of the probability of cardiac lead fracture, where a Bayesian network was used to combine in vivo and in silico observations, suggesting a whole new strategy of in silico-augmented clinical trials, to be used to increase the numerosity where recruitment is impossible, or to explore patients’ phenotypes that are unlikely to appear in the trial cohort, but are still frequent enough to be of concern

Contribution to reliable control of dynamic systems

Aplicat embargament des de la data de defensa fins al maig 2020This thesis presents sorne contributions to the field of Health-Aware Control (HAC) of dynamic systems. In the first part of this thesis, a review of the concepts and methodologies related to reliability versus degradation and fault tolerant control versus health-aware control is presented. Firstly, in an attempt to unify concepts, an overview of HAC, degradation, and reliability modeling including some of the most relevant theoretical and applied contributions is given. Moreover, reliability modeling is formalized and exemplified using the structure function, Bayesian networks (BNs) and Dynamic Bayesian networks (DBNs) as modeling tools in reliability analysis. In addition, some Reliability lmportance Measures (RIMs) are presented. In particular, this thesis develops BNs models for overall system reliability analysis through the use of Bayesian inference techniques. Bayesian networks are powerful tools in system reliability assessment due to their flexibility in modeling the reliability structure of complex systems. For the HAC scheme implementation, this thesis presents and discusses the integration of actuators health information by means of RIMs and degradation in Model Predictive Control (MPC) and Linear Quadratic Regulator algorithms. In the proposed strategies, the cost function parameters are tuned using RIMs. The methodology is able to avoid the occurrence of catastrophic and incipient faults by monitoring the overall system reliability. The proposed HAC strategies are applied to a Drinking Water Network (DWN) and a multirotor UAV system. Moreover, a third approach, which uses MPC and restricts the degradation of the system components is applied to a twin rotor system. Finally, this thesis presents and discusses two reliability interpretations. These interpretations, namely instantaneous and expected, differ in the manner how reliability is evaluated and how its evolution along time is considered. This comparison is made within a HAC framework and studies the system reliability under both approaches.Aquesta tesi presenta algunes contribucions al camp del control basat en la salut dels components "Health-Aware Control" (HAC) de sistemes dinàmics. A la primera part d'aquesta tesi, es presenta una revisió dels conceptes i metodologies relacionats amb la fiabilitat versus degradació, el control tolerant a fallades versus el HAC. En primer lloc, i per unificar els conceptes, s'introdueixen els conceptes de degradació i fiabilitat, models de fiabilitat i de HAC incloent algunes de les contribucions teòriques i aplicades més rellevants. La tesi, a més, el modelatge de la fiabilitat es formalitza i exemplifica utilitzant la funció d'estructura del sistema, xarxes bayesianes (BN) i xarxes bayesianes dinamiques (DBN) com a eines de modelat i anàlisi de la fiabilitat com també presenta algunes mesures d'importància de la fiabilitat (RIMs). En particular, aquesta tesi desenvolupa models de BNs per a l'anàlisi de la fiabilitat del sistema a través de l'ús de tècniques d'inferència bayesiana. Les xarxes bayesianes són eines poderoses en l'avaluació de la fiabilitat del sistema gràcies a la seva flexibilitat en el modelat de la fiabilitat de sistemes complexos. Per a la implementació de l?esquema de HAC, aquesta tesi presenta i discuteix la integració de la informació sobre la salut i degradació dels actuadors mitjançant les RIMs en algoritmes de control predictiu basat en models (MPC) i control lineal quadràtic (LQR). En les estratègies proposades, els paràmetres de la funció de cost s'ajusten utilitzant els RIMs. Aquestes tècniques de control fiable permetran millorar la disponibilitat i la seguretat dels sistemes evitant l'aparició de fallades a través de la incorporació d'aquesta informació de la salut dels components en l'algoritme de control. Les estratègies de HAC proposades s'apliquen a una xarxa d'aigua potable (DWN) i a un sistema UAV multirrotor. A més, un tercer enfocament fent servir la degradació dels actuadors com a restricció dins l'algoritme de control MPC s'aplica a un sistema aeri a dos graus de llibertat (TRMS). Finalment, aquesta tesi també presenta i discuteix dues interpretacions de la fiabilitat. Aquestes interpretacions, nomenades instantània i esperada, difereixen en la forma en què s'avalua la fiabilitat i com es considera la seva evolució al llarg del temps. Aquesta comparació es realitza en el marc del control HAC i estudia la fiabilitat del sistema en tots dos enfocaments.Esta tesis presenta algunas contribuciones en el campo del control basado en la salud de los componentes “Health-Aware Control” (HAC) de sistemas dinámicos. En la primera parte de esta tesis, se presenta una revisión de los conceptos y metodologíasrelacionados con la fiabilidad versus degradación, el control tolerante a fallos versus el HAC. En primer lugar, y para unificar los conceptos, se introducen los conceptos de degradación y fiabilidad, modelos de fiabilidad y de HAC incluyendo algunas de las contribuciones teóricas y aplicadas más relevantes. La tesis, demás formaliza y ejemplifica el modelado de fiabilidad utilizando la función de estructura del sistema, redes bayesianas (BN) y redes bayesianas diná-micas (DBN) como herramientas de modelado y análisis de fiabilidad como también presenta algunas medidas de importancia de la fiabilidad (RIMs). En particular, esta tesis desarrolla modelos de BNs para el análisis de la fiabilidad del sistema a través del uso de técnicas de inferencia bayesiana. Las redes bayesianas son herramientas poderosas en la evaluación de la fiabilidad del sistema gracias a su flexibilidad en el modelado de la fiabilidad de sistemas complejos. Para la implementación del esquema de HAC, esta tesis presenta y discute la integración de la información sobre la salud y degradación de los actuadores mediante las RIMs en algoritmos de control predictivo basado en modelos (MPC) y del control cuadrático lineal (LQR). En las estrategias propuestas, los parámetros de la función de coste se ajustan utilizando las RIMs. Estas técnicas de control fiable permitirán mejorar la disponibilidad y la seguridad de los sistemas evitando la aparición de fallos a través de la incorporación de la información de la salud de los componentes en el algoritmo de control. Las estrategias de HAC propuestas se aplican a una red de agua potable (DWN) y a un sistema UAV multirotor. Además, un tercer enfoque que usa la degradación de los actuadores como restricción en el algoritmo de control MPC se aplica a un sistema aéreo con dos grados de libertad (TRMS). Finalmente, esta tesis también presenta y discute dos interpretaciones de la fiabilidad. Estas interpretaciones, llamadas instantánea y esperada, difieren en la forma en que se evalúa la fiabilidad y cómo se considera su evolución a lo largo del tiempo. Esta comparación se realiza en el marco del control HAC y estudia la fiabilidad del sistema en ambos enfoques.Postprint (published version

Contribution to reliable control of dynamic systems

This thesis presents sorne contributions to the field of Health-Aware Control (HAC) of dynamic systems. In the first part of this thesis, a review of the concepts and methodologies related to reliability versus degradation and fault tolerant control versus health-aware control is presented. Firstly, in an attempt to unify concepts, an overview of HAC, degradation, and reliability modeling including some of the most relevant theoretical and applied contributions is given. Moreover, reliability modeling is formalized and exemplified using the structure function, Bayesian networks (BNs) and Dynamic Bayesian networks (DBNs) as modeling tools in reliability analysis. In addition, some Reliability lmportance Measures (RIMs) are presented. In particular, this thesis develops BNs models for overall system reliability analysis through the use of Bayesian inference techniques. Bayesian networks are powerful tools in system reliability assessment due to their flexibility in modeling the reliability structure of complex systems. For the HAC scheme implementation, this thesis presents and discusses the integration of actuators health information by means of RIMs and degradation in Model Predictive Control (MPC) and Linear Quadratic Regulator algorithms. In the proposed strategies, the cost function parameters are tuned using RIMs. The methodology is able to avoid the occurrence of catastrophic and incipient faults by monitoring the overall system reliability. The proposed HAC strategies are applied to a Drinking Water Network (DWN) and a multirotor UAV system. Moreover, a third approach, which uses MPC and restricts the degradation of the system components is applied to a twin rotor system. Finally, this thesis presents and discusses two reliability interpretations. These interpretations, namely instantaneous and expected, differ in the manner how reliability is evaluated and how its evolution along time is considered. This comparison is made within a HAC framework and studies the system reliability under both approaches.Aquesta tesi presenta algunes contribucions al camp del control basat en la salut dels components "Health-Aware Control" (HAC) de sistemes dinàmics. A la primera part d'aquesta tesi, es presenta una revisió dels conceptes i metodologies relacionats amb la fiabilitat versus degradació, el control tolerant a fallades versus el HAC. En primer lloc, i per unificar els conceptes, s'introdueixen els conceptes de degradació i fiabilitat, models de fiabilitat i de HAC incloent algunes de les contribucions teòriques i aplicades més rellevants. La tesi, a més, el modelatge de la fiabilitat es formalitza i exemplifica utilitzant la funció d'estructura del sistema, xarxes bayesianes (BN) i xarxes bayesianes dinamiques (DBN) com a eines de modelat i anàlisi de la fiabilitat com també presenta algunes mesures d'importància de la fiabilitat (RIMs). En particular, aquesta tesi desenvolupa models de BNs per a l'anàlisi de la fiabilitat del sistema a través de l'ús de tècniques d'inferència bayesiana. Les xarxes bayesianes són eines poderoses en l'avaluació de la fiabilitat del sistema gràcies a la seva flexibilitat en el modelat de la fiabilitat de sistemes complexos. Per a la implementació de l?esquema de HAC, aquesta tesi presenta i discuteix la integració de la informació sobre la salut i degradació dels actuadors mitjançant les RIMs en algoritmes de control predictiu basat en models (MPC) i control lineal quadràtic (LQR). En les estratègies proposades, els paràmetres de la funció de cost s'ajusten utilitzant els RIMs. Aquestes tècniques de control fiable permetran millorar la disponibilitat i la seguretat dels sistemes evitant l'aparició de fallades a través de la incorporació d'aquesta informació de la salut dels components en l'algoritme de control. Les estratègies de HAC proposades s'apliquen a una xarxa d'aigua potable (DWN) i a un sistema UAV multirrotor. A més, un tercer enfocament fent servir la degradació dels actuadors com a restricció dins l'algoritme de control MPC s'aplica a un sistema aeri a dos graus de llibertat (TRMS). Finalment, aquesta tesi també presenta i discuteix dues interpretacions de la fiabilitat. Aquestes interpretacions, nomenades instantània i esperada, difereixen en la forma en què s'avalua la fiabilitat i com es considera la seva evolució al llarg del temps. Aquesta comparació es realitza en el marc del control HAC i estudia la fiabilitat del sistema en tots dos enfocaments.Esta tesis presenta algunas contribuciones en el campo del control basado en la salud de los componentes “Health-Aware Control” (HAC) de sistemas dinámicos. En la primera parte de esta tesis, se presenta una revisión de los conceptos y metodologíasrelacionados con la fiabilidad versus degradación, el control tolerante a fallos versus el HAC. En primer lugar, y para unificar los conceptos, se introducen los conceptos de degradación y fiabilidad, modelos de fiabilidad y de HAC incluyendo algunas de las contribuciones teóricas y aplicadas más relevantes. La tesis, demás formaliza y ejemplifica el modelado de fiabilidad utilizando la función de estructura del sistema, redes bayesianas (BN) y redes bayesianas diná-micas (DBN) como herramientas de modelado y análisis de fiabilidad como también presenta algunas medidas de importancia de la fiabilidad (RIMs). En particular, esta tesis desarrolla modelos de BNs para el análisis de la fiabilidad del sistema a través del uso de técnicas de inferencia bayesiana. Las redes bayesianas son herramientas poderosas en la evaluación de la fiabilidad del sistema gracias a su flexibilidad en el modelado de la fiabilidad de sistemas complejos. Para la implementación del esquema de HAC, esta tesis presenta y discute la integración de la información sobre la salud y degradación de los actuadores mediante las RIMs en algoritmos de control predictivo basado en modelos (MPC) y del control cuadrático lineal (LQR). En las estrategias propuestas, los parámetros de la función de coste se ajustan utilizando las RIMs. Estas técnicas de control fiable permitirán mejorar la disponibilidad y la seguridad de los sistemas evitando la aparición de fallos a través de la incorporación de la información de la salud de los componentes en el algoritmo de control. Las estrategias de HAC propuestas se aplican a una red de agua potable (DWN) y a un sistema UAV multirotor. Además, un tercer enfoque que usa la degradación de los actuadores como restricción en el algoritmo de control MPC se aplica a un sistema aéreo con dos grados de libertad (TRMS). Finalmente, esta tesis también presenta y discute dos interpretaciones de la fiabilidad. Estas interpretaciones, llamadas instantánea y esperada, difieren en la forma en que se evalúa la fiabilidad y cómo se considera su evolución a lo largo del tiempo. Esta comparación se realiza en el marco del control HAC y estudia la fiabilidad del sistema en ambos enfoques

Predictive response-relevant clustering of expression data provides insights into disease processes

This article describes and illustrates a novel method of microarray data analysis that couples model-based clustering and binary classification to form clusters of ;response-relevant' genes; that is, genes that are informative when discriminating between the different values of the response. Predictions are subsequently made using an appropriate statistical summary of each gene cluster, which we call the ;meta-covariate' representation of the cluster, in a probit regression model. We first illustrate this method by analysing a leukaemia expression dataset, before focusing closely on the meta-covariate analysis of a renal gene expression dataset in a rat model of salt-sensitive hypertension. We explore the biological insights provided by our analysis of these data. In particular, we identify a highly influential cluster of 13 genes-including three transcription factors (Arntl, Bhlhe41 and Npas2)-that is implicated as being protective against hypertension in response to increased dietary sodium. Functional and canonical pathway analysis of this cluster using Ingenuity Pathway Analysis implicated transcriptional activation and circadian rhythm signalling, respectively. Although we illustrate our method using only expression data, the method is applicable to any high-dimensional datasets

Interactive Exploration of Multitask Dependency Networks

Scientists increasingly depend on machine learning algorithms to discover patterns in complex data. Two examples addressed in this dissertation are identifying how information sharing among regions of the brain develops due to learning; and, learning dependency networks of blood proteins associated with cancer. Dependency networks, or graphical models, are learned from the observed data in order to make comparisons between the sub-populations of the dataset. Rarely is there sufficient data to infer robust individual networks for each sub-population. The multiple networks must be considered simultaneously; exploding the hypothesis space of the learning problem. Exploring this complex solution space requires input from the domain scientist to refine the objective function. This dissertation introduces a framework to incorporate domain knowledge in transfer learning to facilitate the exploration of solutions. The framework is a generalization of existing algorithms for multiple network structure identification. Solutions produced with human input narrow down the variance of solutions to those that answer questions of interest to domain scientists. Patterns, such as identifying differences between networks, are learned with higher confidence using transfer learning than through the standard method of bootstrapping. Transfer learning may be the ideal method for making comparisons among dependency networks, whether looking for similarities or differences. Domain knowledge input and visualization of solutions are combined in an interactive tool that enables domain scientists to explore the space of solutions efficiently

AI-enabled modeling and monitoring of data-rich advanced manufacturing systems

The infrastructure of cyber-physical systems (CPS) is based on a meta-concept of cybermanufacturing systems (CMS) that synchronizes the Industrial Internet of Things (IIoTs), Cloud Computing, Industrial Control Systems (ICSs), and Big Data analytics in manufacturing operations. Artificial Intelligence (AI) can be incorporated to make intelligent decisions in the day-to-day operations of CMS. Cyberattack spaces in AI-based cybermanufacturing operations pose significant challenges, including unauthorized modification of systems, loss of historical data, destructive malware, software malfunctioning, etc. However, a cybersecurity framework can be implemented to prevent unauthorized access, theft, damage, or other harmful attacks on electronic equipment, networks, and sensitive data. The five main cybersecurity framework steps are divided into procedures and countermeasure efforts, including identifying, protecting, detecting, responding, and recovering. Given the major challenges in AI-enabled cybermanufacturing systems, three research objectives are proposed in this dissertation by incorporating cybersecurity frameworks. The first research aims to detect the in-situ additive manufacturing (AM) process authentication problem using high-volume video streaming data. A side-channel monitoring approach based on an in-situ optical imaging system is established, and a tensor-based layer-wise texture descriptor is constructed to describe the observed printing path. Subsequently, multilinear principal component analysis (MPCA) is leveraged to reduce the dimension of the tensor-based texture descriptor, and low-dimensional features can be extracted for detecting attack-induced alterations. The second research work seeks to address the high-volume data stream problems in multi-channel sensor fusion for diverse bearing fault diagnosis. This second approach proposes a new multi-channel sensor fusion method by integrating acoustics and vibration signals with different sampling rates and limited training data. The frequency-domain tensor is decomposed by MPCA, resulting in low-dimensional process features for diverse bearing fault diagnosis by incorporating a Neural Network classifier. By linking the second proposed method, the third research endeavor is aligned to recovery systems of multi-channel sensing signals when a substantial amount of missing data exists due to sensor malfunction or transmission issues. This study has leveraged a fully Bayesian CANDECOMP/PARAFAC (FBCP) factorization method that enables to capture of multi-linear interaction (channels × signals) among latent factors of sensor signals and imputes missing entries based on observed signals