Active Classification for POMDPs: a Kalman-like State Estimator

The problem of state tracking with active observation control is considered for a system modeled by a discrete-time, finite-state Markov chain observed through conditionally Gaussian measurement vectors. The measurement model statistics are shaped by the underlying state and an exogenous control input, which influence the observations' quality. Exploiting an innovations approach, an approximate minimum mean-squared error (MMSE) filter is derived to estimate the Markov chain system state. To optimize the control strategy, the associated mean-squared error is used as an optimization criterion in a partially observable Markov decision process formulation. A stochastic dynamic programming algorithm is proposed to solve for the optimal solution. To enhance the quality of system state estimates, approximate MMSE smoothing estimators are also derived. Finally, the performance of the proposed framework is illustrated on the problem of physical activity detection in wireless body sensing networks. The power of the proposed framework lies within its ability to accommodate a broad spectrum of active classification applications including sensor management for object classification and tracking, estimation of sparse signals and radar scheduling.Comment: 38 pages, 6 figure

Bibliographic Review on Distributed Kalman Filtering

In recent years, a compelling need has arisen to understand the effects of distributed information structures on estimation and filtering. In this paper, a bibliographical review on distributed Kalman filtering (DKF) is provided.\ud The paper contains a classification of different approaches and methods involved to DKF. The applications of DKF are also discussed and explained separately. A comparison of different approaches is briefly carried out. Focuses on the contemporary research are also addressed with emphasis on the practical applications of the techniques. An exhaustive list of publications, linked directly or indirectly to DKF in the open literature, is compiled to provide an overall picture of different developing aspects of this area

Variance-constrained filtering for uncertain stochastic systems with missing measurements

Copyright [2003] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.In this note, we consider a new filtering problem for linear uncertain discrete-time stochastic systems with missing measurements. The parameter uncertainties are allowed to be norm-bounded and enter into the state matrix. The system measurements may be unavailable (i.e., missing data) at any sample time, and the probability of the occurrence of missing data is assumed to be known. The purpose of this problem is to design a linear filter such that, for all admissible parameter uncertainties and all possible incomplete observations, the error state of the filtering process is mean square bounded, and the steady-state variance of the estimation error of each state is not more than the individual prescribed upper bound. It is shown that, the addressed filtering problem can effectively be solved in terms of the solutions of a couple of algebraic Riccati-like inequalities or linear matrix inequalities. The explicit expression of the desired robust filters is parameterized, and an illustrative numerical example is provided to demonstrate the usefulness and flexibility of the proposed design approach

Event-based recursive distributed filtering over wireless sensor networks

In this technical note, the distributed filtering problem is investigated for a class of discrete time-varying systems with an event-based communication mechanism. Each intelligent sensor node transmits the data to its neighbors only when the local innovation violates a predetermined Send-on-Delta (SoD) data transmission condition. The aim of the proposed problem is to construct a distributed filter for each sensor node subject to sporadic communications over wireless networks. In terms of an event indicator variable, the triggering information is utilized so as to reduce the conservatism in the filter analysis. An upper bound for the filtering error covariance is obtained in form of Riccati-like difference equations by utilizing the inductive method. Subsequently, such an upper bound is minimized by appropriately designing the filter parameters iteratively, where a novel matrix simplification technique is developed to handle the challenges resulting from the sparseness of the sensor network topology and filter structure preserving issues. The effectiveness of the proposed strategy is illustrated by a numerical simulation.This work is supported by National Basic Research Program of China (973 Program) under Grant 2010CB731800, National Natural Science Foundation of China under Grants 61210012, 61290324, 61473163 and 61273156, and Jiangsu Provincial Key Laboratory of E-business at Nanjing University of Jiangsu and Economics of China under Grant JSEB201301

State Estimation for Distributed and Hybrid Systems

This thesis deals with two aspects of recursive state estimation: distributed estimation and estimation for hybrid systems. In the first part, an approximate distributed Kalman filter is developed. Nodes update their state estimates by linearly combining local measurements and estimates from their neighbors. This scheme allows nodes to save energy, thus prolonging their lifetime, compared to centralized information processing. The algorithm is evaluated experimentally as part of an ultrasound based positioning system. The first part also contains an example of a sensor-actuator network, where a mobile robot navigates using both local sensors and information from a sensor network. This system was implemented using a component-based framework. The second part develops, a recursive joint maximum a posteriori state estimation scheme for Markov jump linear systems. The estimation problem is reformulated as dynamic programming and then approximated using so called relaxed dynamic programming. This allows the otherwise exponential complexity to be kept at manageable levels. Approximate dynamic programming is also used to develop a sensor scheduling algorithm for linear systems. The algorithm produces an offline schedule that when used together with a Kalman filter minimizes the estimation error covariance