Decision-Making with Heterogeneous Sensors - A Copula Based Approach

Statistical decision making has wide ranging applications, from communications and signal processing to econometrics and finance. In contrast to the classical one source-one receiver paradigm, several applications have been identified in the recent past that require acquiring data from multiple sources or sensors. Information from the multiple sensors are transmitted to a remotely located receiver known as the fusion center which makes a global decision. Past work has largely focused on fusion of information from homogeneous sensors. This dissertation extends the formulation to the case when the local sensors may possess disparate sensing modalities. Both the theoretical and practical aspects of multimodal signal processing are considered. The first and foremost challenge is to \u27adequately\u27 model the joint statistics of such heterogeneous sensors. We propose the use of copula theory for this purpose. Copula models are general descriptors of dependence. They provide a way to characterize the nonlinear functional relationships between the multiple modalities, which are otherwise difficult to formalize. The important problem of selecting the `best\u27 copula function from a given set of valid copula densities is addressed, especially in the context of binary hypothesis testing problems. Both, the training-testing paradigm, where a training set is assumed to be available for learning the copula models prior to system deployment, as well as generalized likelihood ratio test (GLRT) based fusion rule for the online selection and estimation of copula parameters are considered. The developed theory is corroborated with extensive computer simulations as well as results on real-world data. Sensor observations (or features extracted thereof) are most often quantized before their transmission to the fusion center for bandwidth and power conservation. A detection scheme is proposed for this problem assuming unifom scalar quantizers at each sensor. The designed rule is applicable for both binary and multibit local sensor decisions. An alternative suboptimal but computationally efficient fusion rule is also designed which involves injecting a deliberate disturbance to the local sensor decisions before fusion. The rule is based on Widrow\u27s statistical theory of quantization. Addition of controlled noise helps to \u27linearize\u27 the higly nonlinear quantization process thus resulting in computational savings. It is shown that although the introduction of external noise does cause a reduction in the received signal to noise ratio, the proposed approach can be highly accurate when the input signals have bandlimited characteristic functions, and the number of quantization levels is large. The problem of quantifying neural synchrony using copula functions is also investigated. It has been widely accepted that multiple simultaneously recorded electroencephalographic signals exhibit nonlinear and non-Gaussian statistics. While the existing and popular measures such as correlation coefficient, corr-entropy coefficient, coh-entropy and mutual information are limited to being bivariate and hence applicable only to pairs of channels, measures such as Granger causality, even though multivariate, fail to account for any nonlinear inter-channel dependence. The application of copula theory helps alleviate both these limitations. The problem of distinguishing patients with mild cognitive impairment from the age-matched control subjects is also considered. Results show that the copula derived synchrony measures when used in conjunction with other synchrony measures improve the detection of Alzheimer\u27s disease onset

Multimodal Image Fusion and Its Applications.

Image fusion integrates different modality images to provide comprehensive information of the image content, increasing interpretation capabilities and producing more reliable results. There are several advantages of combining multi-modal images, including improving geometric corrections, complementing data for improved classification, and enhancing features for analysis...etc. This thesis develops the image fusion idea in the context of two domains: material microscopy and biomedical imaging. The proposed methods include image modeling, image indexing, image segmentation, and image registration. The common theme behind all proposed methods is the use of complementary information from multi-modal images to achieve better registration, feature extraction, and detection performances. In material microscopy, we propose an anomaly-driven image fusion framework to perform the task of material microscopy image analysis and anomaly detection. This framework is based on a probabilistic model that enables us to index, process and characterize the data with systematic and well-developed statistical tools. In biomedical imaging, we focus on the multi-modal registration problem for functional MRI (fMRI) brain images which improves the performance of brain activation detection.PhDElectrical Engineering: SystemsUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/120701/1/yuhuic_1.pd

Heterogeneous Sensor Signal Processing for Inference with Nonlinear Dependence

Inferring events of interest by fusing data from multiple heterogeneous sources has been an interesting and important topic in recent years. Several issues related to inference using heterogeneous data with complex and nonlinear dependence are investigated in this dissertation. We apply copula theory to characterize the dependence among heterogeneous data. In centralized detection, where sensor observations are available at the fusion center (FC), we study copula-based fusion. We design detection algorithms based on sample-wise copula selection and mixture of copulas model in different scenarios of the true dependence. The proposed approaches are theoretically justified and perform well when applied to fuse acoustic and seismic sensor data for personnel detection. Besides traditional sensors, the access to the massive amount of social media data provides a unique opportunity for extracting information about unfolding events. We further study how sensor networks and social media complement each other in facilitating the data-to-decision making process. We propose a copula-based joint characterization of multiple dependent time series from sensors and social media. As a proof-of-concept, this model is applied to the fusion of Google Trends (GT) data and stock/flu data for prediction, where the stock/flu data serves as a surrogate for sensor data. In energy constrained networks, local observations are compressed before they are transmitted to the FC. In these cases, conditional dependence and heterogeneity complicate the system design particularly. We consider the classification of discrete random signals in Wireless Sensor Networks (WSNs), where, for communication efficiency, only local decisions are transmitted. We derive the necessary conditions for the optimal decision rules at the sensors and the FC by introducing a hidden random variable. An iterative algorithm is designed to search for the optimal decision rules. Its convergence and asymptotical optimality are also proved. The performance of the proposed scheme is illustrated for the distributed Automatic Modulation Classification (AMC) problem. Censoring is another communication efficient strategy, in which sensors transmit only informative observations to the FC, and censor those deemed uninformative . We design the detectors that take into account the spatial dependence among observations. Fusion rules for censored data are proposed with continuous and discrete local messages, respectively. Their computationally efficient counterparts based on the key idea of injecting controlled noise at the FC before fusion are also investigated. In this thesis, with heterogeneous and dependent sensor observations, we consider not only inference in parallel frameworks but also the problem of collaborative inference where collaboration exists among local sensors. Each sensor forms coalition with other sensors and shares information within the coalition, to maximize its inference performance. The collaboration strategy is investigated under a communication constraint. To characterize the influence of inter-sensor dependence on inference performance and thus collaboration strategy, we quantify the gain and loss in forming a coalition by introducing the copula-based definitions of diversity gain and redundancy loss for both estimation and detection problems. A coalition formation game is proposed for the distributed inference problem, through which the information contained in the inter-sensor dependence is fully explored and utilized for improved inference performance

Detection and diagnostic of freeplay induced limit cycle oscillation in the flight control system of a civil aircraft

This research study is the result of a 3 years CIFRE PhD thesis between the Airbus design office(Aircraft Control domain) and TéSA laboratory in Toulouse. The main goal is to propose, developand validate a software solution for the detection and diagnosis of a specific type of elevator andrudder vibration, called limit cycle oscillation (LCO), based on existing signals available in flightcontrol computers on board in-series aircraft. LCO is a generic mathematical term defining aninitial condition-independent periodic mode occurring in nonconservative nonlinear systems. Thisstudy focuses on the LCO phenomenon induced by mechanical freeplays in the control surface ofa civil aircraft. The LCO consequences are local structural load augmentation, flight handlingqualities deterioration, actuator operational life reduction, cockpit and cabin comfort deteriorationand maintenance cost augmentation. The state-of-the-art for freeplay induced LCO detection anddiagnosis is based on the pilot sensitivity to vibration and to periodic freeplay check on the controlsurfaces. This study is thought to propose a data-driven solution to help LCO and freeplaydiagnosis. The goal is to improve even more aircraft availability and reduce the maintenance costsby providing to the airlines a condition monitoring signal for LCO and freeplays. For this reason,two algorithmic solutions for vibration and freeplay diagnosis are investigated in this PhD thesis. Areal time detector for LCO diagnosis is first proposed based on the theory of the generalized likeli hood ratio test (GLRT). Some variants and simplifications are also proposed to be compliantwith the industrial constraints. In a second part of this work, a mechanical freeplay detector isintroduced based on the theory of Wiener model identification. Parametric (maximum likelihoodestimator) and non parametric (kernel regression) approaches are investigated, as well as somevariants to well-known nonparametric methods. In particular, the problem of hysteresis cycleestimation (as the output nonlinearity of a Wiener model) is tackled. Moreover, the constrainedand unconstrained problems are studied. A theoretical, numerical (simulator) and experimental(flight data and laboratory) analysis is carried out to investigate the performance of the proposeddetectors and to identify limitations and industrial feasibility. The obtained numerical andexperimental results confirm that the proposed GLR test (and its variants/simplifications) is a very appealing method for LCO diagnostic in terms of performance, robustness and computationalcost. On the other hand, the proposed freeplay diagnostic algorithm is able to detect relativelylarge freeplay levels, but it does not provide consistent results for relatively small freeplay levels. Moreover, specific input types are needed to guarantee repetitive and consistent results. Further studies should be carried out in order to compare the GLRT results with a Bayesian approach and to investigate more deeply the possibilities and limitations of the proposed parametric method for Wiener model identification

Analyse hiérarchique d'images multimodales

There is a growing interest in the development of adapted processing tools for multimodal images (several images acquired over the same scene with different characteristics). Allowing a more complete description of the scene, multimodal images are of interest in various image processing fields, but their optimal handling and exploitation raise several issues. This thesis extends hierarchical representations, a powerful tool for classical image analysis and processing, to multimodal images in order to better exploit the additional information brought by the multimodality and improve classical image processing techniques. %when applied to real applications. This thesis focuses on three different multimodalities frequently encountered in the remote sensing field. We first investigate the spectral-spatial information of hyperspectral images. Based on an adapted construction and processing of the hierarchical representation, we derive a segmentation which is optimal with respect to the spectral unmixing operation. We then focus on the temporal multimodality and sequences of hyperspectral images. Using the hierarchical representation of the frames in the sequence, we propose a new method to achieve object tracking and apply it to chemical gas plume tracking in thermal infrared hyperspectral video sequences. Finally, we study the sensorial multimodality, being images acquired with different sensors. Relying on the concept of braids of partitions, we propose a novel methodology of image segmentation, based on an energetic minimization framework.Il y a un intérêt grandissant pour le développement d’outils de traitements adaptés aux images multimodales (plusieurs images de la même scène acquises avec différentes caractéristiques). Permettant une représentation plus complète de la scène, ces images multimodales ont de l'intérêt dans plusieurs domaines du traitement d'images, mais les exploiter et les manipuler de manière optimale soulève plusieurs questions. Cette thèse étend les représentations hiérarchiques, outil puissant pour le traitement et l’analyse d’images classiques, aux images multimodales afin de mieux exploiter l’information additionnelle apportée par la multimodalité et améliorer les techniques classiques de traitement d’images. Cette thèse se concentre sur trois différentes multimodalités fréquemment rencontrées dans le domaine de la télédétection. Nous examinons premièrement l’information spectrale-spatiale des images hyperspectrales. Une construction et un traitement adaptés de la représentation hiérarchique nous permettent de produire une carte de segmentation de l'image optimale vis-à-vis de l'opération de démélange spectrale. Nous nous concentrons ensuite sur la multimodalité temporelle, traitant des séquences d’images hyperspectrales. En utilisant les représentations hiérarchiques des différentes images de la séquence, nous proposons une nouvelle méthode pour effectuer du suivi d’objet et l’appliquons au suivi de nuages de gaz chimique dans des séquences d’images hyperspectrales dans le domaine thermique infrarouge. Finalement, nous étudions la multimodalité sensorielle, c’est-à-dire les images acquises par différents capteurs. Nous appuyant sur le concept des tresses de partitions, nous proposons une nouvelle méthodologie de segmentation se basant sur un cadre de minimisation d’énergie

‘Powellsnakes’, a fast Bayesian approach to discrete object detection in multi-frequency astronomical data sets

In this work we introduce a fast Bayesian algorithm designed for detecting compact objects immersed in a diffuse background. A general methodology is presented in terms of formal correctness and optimal use of all the available information in a consistent unified framework, where no distinction is made between point sources (unresolved objects), SZ clusters, single or multi-channel detection. An emphasis is placed on the necessity of a multi-frequency, multi-model detection algorithm in order to achieve optimality. We have chosen to use the Bayes/Laplace probability theory as it grants a fully consistent extension of formal deductive logic to a more general inferential system with optimal inclusion of all ancillary information [Jaynes, 2004]. Nonetheless, probability theory only informs us about the plausibility, a ‘degree-of-belief ’, of a proposition given the data, the model that describes it and all ancillary (prior) information. However, detection or classification is mostly about making educated choices and a wrong decision always carries a cost/loss. Only resorting to ‘Decision Theory’, supported by probability theory, one can take the best decisions in terms of maximum yield at minimal cost. Despite the rigorous and formal approach employed, practical efficiency and applicability have always been kept as primary design goals. We have attempted to select and employ the relevant tools to explore a likelihood form and its manifold symmetries to achieve the very high computational performance required not only by our ‘decision machine’ but mostly to tackle large realistic contemporary cosmological data sets. As an illustration, we successfully applied the methodology to ESA’s (European Space Agency) Planck satellite data [Planck Collaboration et al., 2011d]. This data set is large, complex and typical of the contemporary precision observational cosmology state-of-the-art. Two catalogue products are already released: (i) A point sources catalogue [Planck Collaboration et al., 2011e], (ii) A catalogue of galaxy clusters [Planck Collaboration et al., 2011f]. Many other contributions, in science products, as an estimation device, have recently been issued [Planck et al., 2012; Planck Collaboration et al., 2011g,i, 2012a,b,c]. This new method is called ‘PowellSnakes’ (PwS)

MODEL-BASED APPROACH TO THE UTILIZATION OF HETEROGENEOUS NON-OVERLAPPING DATA IN THE OPTIMIZATION OF COMPLEX AIRPORT SYSTEMS

Simulation and optimization have been widely used in air transportation, particularly when it comes to determining how flight operations might evolve. However, with regards to passengers and the services provided to them, this is not the case in large part because the data required for such analysis is harder to collect, requiring the timely use of surveys and significant human labor. The ubiquity of always--connected smart devices and the rise of inexpensive smart devices has made it possible to continuously collect passenger information for passenger-centric solutions such as the automatic mitigation of passenger traffic. Using these devices, it is possible to capture dwell times, transit times, and delays directly from the customers. The data; however, is often sparse and heterogeneous, both spatially and temporally. For instance, the observations come at different times and have different levels of accuracy depending on the location, making it challenging to develop a precise network model of airport operations. The objective of this research is to provide online methods to sequentially correct the estimates of the dynamics of a system of queues despite noisy, quickly changing, and incomplete information. First, a sequential change point detection scheme based on a generalized likelihood ratio test is developed to detect a change in the dynamics of a single queue by using a combination of waiting times, time spent in queue, and queue-length measurements. A trade-off is made between the accuracy of the tests, the speed of the tests, the costs of the tests, and the value of utilizing the observations jointly or separately. The contribution is a robust detection methodology that quickly detects a change in queue dynamics from correlated measurements. In the second part of the work, a model-based estimation tool is developed to update the service rate distribution for a single queue from sparse and noisy airport operations data. Model Reference Adaptive Sampling is used in-the-loop to update a generalized gamma distribution for the service rates within a simulation of the queue at an airport’s immigration center. The contribution is a model predictive tool to optimize the service rates based on waiting time information. The two frameworks allow for the analysis of heterogeneous passenger data sources to enable the tactical mitigation of airport passenger traffic delays.Ph.D