50 research outputs found
Detection of Electromagnetic Seismic Precursors from Swarm Data by Enhanced Martingale Analytics
The detection of seismic activity precursors as part of an alarm system will provide opportunities for minimization of the social and economic impact caused by earthquakes. It has long been envisaged, and a growing body of empirical evidence suggests that the Earth’s electromagnetic field could contain precursors to seismic events. The ability to capture and monitor electromagnetic field activity has increased in the past years as more sensors and methodologies emerge. Missions such as Swarm have enabled researchers to access near-continuous observations of electromagnetic activity at second intervals, allowing for more detailed studies on weather and earthquakes. In this paper, we present an approach designed to detect anomalies in electromagnetic field data from Swarm satellites. This works towards developing a continuous and effective monitoring system of seismic activities based on SWARM measurements. We develop an enhanced form of a probabilistic model based on the Martingale theories that allow for testing the null hypothesis to indicate abnormal changes in electromagnetic field activity. We evaluate this enhanced approach in two experiments. Firstly, we perform a quantitative comparison on well-understood and popular benchmark datasets alongside the conventional approach. We find that the enhanced version produces more accurate anomaly detection overall. Secondly, we use three case studies of seismic activity (namely, earthquakes in Mexico, Greece, and Croatia) to assess our approach and the results show that our method can detect anomalous phenomena in the electromagnetic data
Change detection in streaming data analytics: a comparison of Bayesian online and martingale approaches
On line change detection is a key activity in streaming analytics, which aims to determine whether the current observation in a time series marks a change point in some important characteristic of the data, given the sequence of data observed so far. It can be a challenging task when monitoring complex systems, which are generating streaming data of significant volume and velocity. While applicable to diverse problem domains, it is highly relevant to monitoring high value and critical engineering assets. This paper presents an empirical evaluation of two algorithmic approaches for streaming data change detection. These are a modified martingale and a Bayesian online detection algorithm. Results obtained with both synthetic and real world data sets are presented and relevant advantages and limitations are discussed
Processing multiple image streams for real-time monitoring of parking lots
We present a system to detect parked vehicles in a typical parking complex using multiple streams of images captured through IP connected devices. Compared to traditional object detection techniques and machine learning methods, our approach is significantly faster in detection speed in the presence of multiple image streams. It is also capable of comparable accuracy when put to test against existing methods. And this is achieved without the need to train the system that machine learning methods require. Our approach uses a combination of psychological insights obtained from human detection and an algorithm replicating the outcomes of a SVM learner but without the noise that compromises accuracy in the normal learning process. Performance enhancements are made on the algorithm so that it operates well in the context of multiple image streams. The result is faster detection with comparable accuracy. Our experiments on images captured from a local test site shows very promising results for an implementation that is not only effective and low cost but also opens doors to new parking applications when combined with other technologies.<br /
Class Distribution Monitoring for Concept Drift Detection
We introduce Class Distribution Monitoring (CDM), an effective concept-drift detection scheme that monitors the class-conditional distributions of a datastream. In particular, our solution leverages multiple instances of an online and nonparametric change-detection algorithm based on QuantTree. CDM reports a concept drift after detecting a distribution change in any class, thus identifying which classes are affected by the concept drift. This can be precious information for diagnostics and adaptation. Our experiments on synthetic and real-world datastreams show that when the concept drift affects a few classes, CDM outperforms algorithms monitoring the overall data distribution, while achieving similar detection delays when the drift affects all the classes. Moreover, CDM outperforms comparable approaches that monitor the classification error, particularly when the change is not very apparent. Finally, we demonstrate that CDM inherits the properties of the underlying change detector, yielding an effective control over the expected time before a false alarm, or Average Run Length (ARL0)
Online Distribution Shift Detection via Recency Prediction
When deploying modern machine learning-enabled robotic systems in high-stakes
applications, detecting distribution shift is critical. However, most existing
methods for detecting distribution shift are not well-suited to robotics
settings, where data often arrives in a streaming fashion and may be very
high-dimensional. In this work, we present an online method for detecting
distribution shift with guarantees on the false positive rate - i.e., when
there is no distribution shift, our system is very unlikely (with probability
) to falsely issue an alert; any alerts that are issued should
therefore be heeded. Our method is specifically designed for efficient
detection even with high dimensional data, and it empirically achieves up to
11x faster detection on realistic robotics settings compared to prior work
while maintaining a low false negative rate in practice (whenever there is a
distribution shift in our experiments, our method indeed emits an alert). We
demonstrate our approach in both simulation and hardware for a visual servoing
task, and show that our method indeed issues an alert before a failure occurs
Quickest Anomaly Detection in Sensor Networks With Unlabeled Samples
The problem of quickest anomaly detection in networks with unlabeled samples
is studied. At some unknown time, an anomaly emerges in the network and changes
the data-generating distribution of some unknown sensor. The data vector
received by the fusion center at each time step undergoes some unknown and
arbitrary permutation of its entries (unlabeled samples). The goal of the
fusion center is to detect the anomaly with minimal detection delay subject to
false alarm constraints. With unlabeled samples, existing approaches that
combines local cumulative sum (CuSum) statistics cannot be used anymore.
Several major questions include whether detection is still possible without the
label information, if so, what is the fundamental limit and how to achieve
that. Two cases with static and dynamic anomaly are investigated, where the
sensor affected by the anomaly may or may not change with time. For the two
cases, practical algorithms based on the ideas of mixture likelihood ratio
and/or maximum likelihood estimate are constructed. Their average detection
delays and false alarm rates are theoretically characterized. Universal lower
bounds on the average detection delay for a given false alarm rate are also
derived, which further demonstrate the asymptotic optimality of the two
algorithms
Nonparametric and Online Change Detection in Multivariate Datastreams Using QuantTree
We address the problem of online change detection in multivariate datastreams, and we introduce QuantTree Exponentially Weighted Moving Average (QT-EWMA), a nonparametric change-detection algorithm that can control the expected time before a false alarm, yielding a desired Average Run Length (ARL
0
). Controlling false alarms is crucial in many applications and is rarely guaranteed by online change-detection algorithms that can monitor multivariate datastreams without knowing the data distribution. Like many change-detection algorithms, QT-EWMA builds a model of the data distribution, in our case a QuantTree histogram, from a stationary training set. To monitor datastreams even when the training set is extremely small, we propose QT-EWMA-update, which incrementally updates the QuantTree histogram during monitoring, always keeping the ARL0 under control. Our experiments, performed on synthetic and real-world datastreams, demonstrate that QT-EWMA and QT-EWMA-update control the ARL0 and the false alarm rate better than state-of-the-art methods operating in similar conditions, achieving lower or comparable detection delays