31 research outputs found
TODS: An Automated Time Series Outlier Detection System
We present TODS, an automated Time Series Outlier Detection System for
research and industrial applications. TODS is a highly modular system that
supports easy pipeline construction. The basic building block of TODS is
primitive, which is an implementation of a function with hyperparameters. TODS
currently supports 70 primitives, including data processing, time series
processing, feature analysis, detection algorithms, and a reinforcement module.
Users can freely construct a pipeline using these primitives and perform end-
to-end outlier detection with the constructed pipeline. TODS provides a
Graphical User Interface (GUI), where users can flexibly design a pipeline with
drag-and-drop. Moreover, a data-driven searcher is provided to automatically
discover the most suitable pipelines given a dataset. TODS is released under
Apache 2.0 license at https://github.com/datamllab/tods.Comment: Accepted by AAAI'21 demo trac
Deep Baseline Network for Time Series Modeling and Anomaly Detection
Deep learning has seen increasing applications in time series in recent
years. For time series anomaly detection scenarios, such as in finance,
Internet of Things, data center operations, etc., time series usually show very
flexible baselines depending on various external factors. Anomalies unveil
themselves by lying far away from the baseline. However, the detection is not
always easy due to some challenges including baseline shifting, lacking of
labels, noise interference, real time detection in streaming data, result
interpretability, etc. In this paper, we develop a novel deep architecture to
properly extract the baseline from time series, namely Deep Baseline Network
(DBLN). By using this deep network, we can easily locate the baseline position
and then provide reliable and interpretable anomaly detection result. Empirical
evaluation on both synthetic and public real-world datasets shows that our
purely unsupervised algorithm achieves superior performance compared with
state-of-art methods and has good practical applications
Moving Metric Detection and Alerting System at eBay
At eBay, there are thousands of product health metrics for different domain
teams to monitor. We built a two-phase alerting system to notify users with
actionable alerts based on anomaly detection and alert retrieval. In the first
phase, we developed an efficient anomaly detection algorithm, called Moving
Metric Detector (MMD), to identify potential alerts among metrics with
distribution agnostic criteria. In the second alert retrieval phase, we built
additional logic with feedbacks to select valid actionable alerts with
point-wise ranking model and business rules. Compared with other trend and
seasonality decomposition methods, our decomposer is faster and better to
detect anomalies in unsupervised cases. Our two-phase approach dramatically
improves alert precision and avoids alert spamming in eBay production.Comment: The work is oral presented on the AAAI-20 Workshop on Cloud
Intelligence, 202
How Far Should We Look Back to Achieve Effective Real-Time Time-Series Anomaly Detection?
Anomaly detection is the process of identifying unexpected events or
ab-normalities in data, and it has been applied in many different areas such as
system monitoring, fraud detection, healthcare, intrusion detection, etc.
Providing real-time, lightweight, and proactive anomaly detection for time
series with neither human intervention nor domain knowledge could be highly
valuable since it reduces human effort and enables appropriate countermeasures
to be undertaken before a disastrous event occurs. To our knowledge, RePAD
(Real-time Proactive Anomaly Detection algorithm) is a generic approach with
all above-mentioned features. To achieve real-time and lightweight detection,
RePAD utilizes Long Short-Term Memory (LSTM) to detect whether or not each
upcoming data point is anomalous based on short-term historical data points.
However, it is unclear that how different amounts of historical data points
affect the performance of RePAD. Therefore, in this paper, we investigate the
impact of different amounts of historical data on RePAD by introducing a set of
performance metrics that cover novel detection accuracy measures, time
efficiency, readiness, and resource consumption, etc. Empirical experiments
based on real-world time series datasets are conducted to evaluate RePAD in
different scenarios, and the experimental results are presented and discussed.Comment: 12 pages, 5 figures, and 9 tables, Proceedings of the 35th
International Conference on Advanced Information Network-ing and Applications
(AINA 2021
ReRe: A Lightweight Real-time Ready-to-Go Anomaly Detection Approach for Time Series
Anomaly detection is an active research topic in many different fields such
as intrusion detection, network monitoring, system health monitoring, IoT
healthcare, etc. However, many existing anomaly detection approaches require
either human intervention or domain knowledge, and may suffer from high
computation complexity, consequently hindering their applicability in
real-world scenarios. Therefore, a lightweight and ready-to-go approach that is
able to detect anomalies in real-time is highly sought-after. Such an approach
could be easily and immediately applied to perform time series anomaly
detection on any commodity machine. The approach could provide timely anomaly
alerts and by that enable appropriate countermeasures to be undertaken as early
as possible. With these goals in mind, this paper introduces ReRe, which is a
Real-time Ready-to-go proactive Anomaly Detection algorithm for streaming time
series. ReRe employs two lightweight Long Short-Term Memory (LSTM) models to
predict and jointly determine whether or not an upcoming data point is
anomalous based on short-term historical data points and two long-term
self-adaptive thresholds. Experiments based on real-world time-series datasets
demonstrate the good performance of ReRe in real-time anomaly detection without
requiring human intervention or domain knowledge.Comment: 10 pages, 9 figures, COMPSAC 202