736 research outputs found
Distributionally Robust Quickest Change Detection using Wasserstein Uncertainty Sets
The problem of quickest detection of a change in the distribution of a
sequence of independent observations is considered. It is assumed that the
pre-change distribution is known (accurately estimated), while the only
information about the post-change distribution is through a (small) set of
labeled data. This post-change data is used in a data-driven minimax robust
framework, where an uncertainty set for the post-change distribution is
constructed using the Wasserstein distance from the empirical distribution of
the data. The robust change detection problem is studied in an asymptotic
setting where the mean time to false alarm goes to infinity, for which the
least favorable post-change distribution within the uncertainty set is the one
that minimizes the Kullback-Leibler divergence between the post- and the
pre-change distributions. It is shown that the density corresponding to the
least favorable distribution is an exponentially tilted version of the
pre-change density and can be calculated efficiently. A Cumulative Sum (CuSum)
test based on the least favorable distribution, which is referred to as the
distributionally robust (DR) CuSum test, is then shown to be asymptotically
robust. The results are extended to the case where the post-change uncertainty
set is a finite union of multiple Wasserstein uncertainty sets, corresponding
to multiple post-change scenarios, each with its own labeled data. The proposed
method is validated using synthetic and real data examples
Data-Efficient Minimax Quickest Change Detection with Composite Post-Change Distribution
The problem of quickest change detection is studied, where there is an
additional constraint on the cost of observations used before the change point
and where the post-change distribution is composite. Minimax formulations are
proposed for this problem. It is assumed that the post-change family of
distributions has a member which is least favorable in some sense. An algorithm
is proposed in which on-off observation control is employed using the least
favorable distribution, and a generalized likelihood ratio based approach is
used for change detection. Under the additional condition that either the
post-change family of distributions is finite, or both the pre- and post-change
distributions belong to a one parameter exponential family, it is shown that
the proposed algorithm is asymptotically optimal, uniformly for all possible
post-change distributions.Comment: Submitted to IEEE Transactions on Info. Theory, Oct 2014. Preliminary
version presented at ISIT 2014 at Honolulu, Hawai
Robust Quickest Change Detection for Unnormalized Models
Detecting an abrupt and persistent change in the underlying distribution of
online data streams is an important problem in many applications. This paper
proposes a new robust score-based algorithm called RSCUSUM, which can be
applied to unnormalized models and addresses the issue of unknown post-change
distributions. RSCUSUM replaces the Kullback-Leibler divergence with the Fisher
divergence between pre- and post-change distributions for computational
efficiency in unnormalized statistical models and introduces a notion of the
``least favorable'' distribution for robust change detection. The algorithm and
its theoretical analysis are demonstrated through simulation studies.Comment: Accepted for the 39th Conference on Uncertainty in Artificial
Intelligence (UAI 2023). arXiv admin note: text overlap with arXiv:2302.0025
- …