Attentive monitoring of multiple video streams driven by a Bayesian foraging strategy

In this paper we shall consider the problem of deploying attention to subsets of the video streams for collating the most relevant data and information of interest related to a given task. We formalize this monitoring problem as a foraging problem. We propose a probabilistic framework to model observer's attentive behavior as the behavior of a forager. The forager, moment to moment, focuses its attention on the most informative stream/camera, detects interesting objects or activities, or switches to a more profitable stream. The approach proposed here is suitable to be exploited for multi-stream video summarization. Meanwhile, it can serve as a preliminary step for more sophisticated video surveillance, e.g. activity and behavior analysis. Experimental results achieved on the UCR Videoweb Activities Dataset, a publicly available dataset, are presented to illustrate the utility of the proposed technique.Comment: Accepted to IEEE Transactions on Image Processin

Two-layer particle filter for multiple target detection and tracking

This paper deals with the detection and tracking of an unknown number of targets using a Bayesian hierarchical model with target labels. To approximate the posterior probability density function, we develop a two-layer particle filter. One deals with track initiation, and the other with track maintenance. In addition, the parallel partition method is proposed to sample the states of the surviving targets

Deterministic Bayesian Information Fusion and the Analysis of its Performance

This paper develops a mathematical and computational framework for analyzing the expected performance of Bayesian data fusion, or joint statistical inference, within a sensor network. We use variational techniques to obtain the posterior expectation as the optimal fusion rule under a deterministic constraint and a quadratic cost, and study the smoothness and other properties of its classification performance. For a certain class of fusion problems, we prove that this fusion rule is also optimal in a much wider sense and satisfies strong asymptotic convergence results. We show how these results apply to a variety of examples with Gaussian, exponential and other statistics, and discuss computational methods for determining the fusion system's performance in more general, large-scale problems. These results are motivated by studying the performance of fusing multi-modal radar and acoustic sensors for detecting explosive substances, but have broad applicability to other Bayesian decision problems

Scalable Approach to Uncertainty Quantification and Robust Design of Interconnected Dynamical Systems

Development of robust dynamical systems and networks such as autonomous aircraft systems capable of accomplishing complex missions faces challenges due to the dynamically evolving uncertainties coming from model uncertainties, necessity to operate in a hostile cluttered urban environment, and the distributed and dynamic nature of the communication and computation resources. Model-based robust design is difficult because of the complexity of the hybrid dynamic models including continuous vehicle dynamics, the discrete models of computations and communications, and the size of the problem. We will overview recent advances in methodology and tools to model, analyze, and design robust autonomous aerospace systems operating in uncertain environment, with stress on efficient uncertainty quantification and robust design using the case studies of the mission including model-based target tracking and search, and trajectory planning in uncertain urban environment. To show that the methodology is generally applicable to uncertain dynamical systems, we will also show examples of application of the new methods to efficient uncertainty quantification of energy usage in buildings, and stability assessment of interconnected power networks

Decision-Making for Search and Classification using Multiple Autonomous Vehicles over Large-Scale Domains

This dissertation focuses on real-time decision-making for large-scale domain search and object classification using Multiple Autonomous Vehicles (MAV). In recent years, MAV systems have attracted considerable attention and have been widely utilized. Of particular interest is their application to search and classification under limited sensory capabilities. Since search requires sensor mobility and classification requires a sensor to stay within the vicinity of an object, search and classification are two competing tasks. Therefore, there is a need to develop real-time sensor allocation decision-making strategies to guarantee task accomplishment. These decisions are especially crucial when the domain is much larger than the field-of-view of a sensor, or when the number of objects to be found and classified is much larger than that of available sensors. In this work, the search problem is formulated as a coverage control problem, which aims at collecting enough data at every point within the domain to construct an awareness map. The object classification problem seeks to satisfactorily categorize the property of each found object of interest. The decision-making strategies include both sensor allocation decisions and vehicle motion control. The awareness-, Bayesian-, and risk-based decision-making strategies are developed in sequence. The awareness-based approach is developed under a deterministic framework, while the latter two are developed under a probabilistic framework where uncertainty in sensor measurement is taken into account. The risk-based decision-making strategy also analyzes the effect of measurement cost. It is further extended to an integrated detection and estimation problem with applications in optimal sensor management. Simulation-based studies are performed to confirm the effectiveness of the proposed algorithms