3 research outputs found
Supervised Anomaly Detection based on Deep Autoregressive Density Estimators
We propose a supervised anomaly detection method based on neural density
estimators, where the negative log likelihood is used for the anomaly score.
Density estimators have been widely used for unsupervised anomaly detection. By
the recent advance of deep learning, the density estimation performance has
been greatly improved. However, the neural density estimators cannot exploit
anomaly label information, which would be valuable for improving the anomaly
detection performance. The proposed method effectively utilizes the anomaly
label information by training the neural density estimator so that the
likelihood of normal instances is maximized and the likelihood of anomalous
instances is lower than that of the normal instances. We employ an
autoregressive model for the neural density estimator, which enables us to
calculate the likelihood exactly. With the experiments using 16 datasets, we
demonstrate that the proposed method improves the anomaly detection performance
with a few labeled anomalous instances, and achieves better performance than
existing unsupervised and supervised anomaly detection methods
Anomaly Detection in Trajectory Data with Normalizing Flows
The task of detecting anomalous data patterns is as important in practical
applications as challenging. In the context of spatial data, recognition of
unexpected trajectories brings additional difficulties, such as high
dimensionality and varying pattern lengths. We aim to tackle such a problem
from a probability density estimation point of view, since it provides an
unsupervised procedure to identify out of distribution samples. More
specifically, we pursue an approach based on normalizing flows, a recent
framework that enables complex density estimation from data with neural
networks. Our proposal computes exact model likelihood values, an important
feature of normalizing flows, for each segment of the trajectory. Then, we
aggregate the segments' likelihoods into a single coherent trajectory anomaly
score. Such a strategy enables handling possibly large sequences with different
lengths. We evaluate our methodology, named aggregated anomaly detection with
normalizing flows (GRADINGS), using real world trajectory data and compare it
with more traditional anomaly detection techniques. The promising results
obtained in the performed computational experiments indicate the feasibility of
the GRADINGS, specially the variant that considers autoregressive normalizing
flows.Comment: Accepted as a conference paper at 2020 International Joint Conference
on Neural Networks (IJCNN 2020), part of 2020 IEEE World Congress on
Computational Intelligence (IEEE WCCI 2020
Semi-supervised Anomaly Detection on Attributed Graphs
We propose a simple yet effective method for detecting anomalous instances on
an attribute graph with label information of a small number of instances.
Although with standard anomaly detection methods it is usually assumed that
instances are independent and identically distributed, in many real-world
applications, instances are often explicitly connected with each other,
resulting in so-called attributed graphs. The proposed method embeds nodes
(instances) on the attributed graph in the latent space by taking into account
their attributes as well as the graph structure based on graph convolutional
networks (GCNs). To learn node embeddings specialized for anomaly detection, in
which there is a class imbalance due to the rarity of anomalies, the parameters
of a GCN are trained to minimize the volume of a hypersphere that encloses the
node embeddings of normal instances while embedding anomalous ones outside the
hypersphere. This enables us to detect anomalies by simply calculating the
distances between the node embeddings and hypersphere center. The proposed
method can effectively propagate label information on a small amount of nodes
to unlabeled ones by taking into account the node's attributes, graph
structure, and class imbalance. In experiments with five real-world attributed
graph datasets, we demonstrate that the proposed method achieves better
performance than various existing anomaly detection methods.Comment: 10 page