Anomaly detection and characterization in smart card logs using NMF and Tweets

International audienceThis article describes a novel approach to detect anomalies in smart card logs. In this study, we chose to work on a 24h base for every station in the Parisian metro network. We also consider separately the 7 days of the week. We first build a robust averaged reference for (day,station) couples and then, we focus on the difference between particular situations and references. All experiments are conducted both on the raw data and using an NMF denoised approximation of the log flow. We demonstrate the interest and the robustness of the latter strategy. Then we mine RATP Twitter account to obtain ground truth information about operating incidents. This synchronized flow is used to evaluate our models

Anomaly detection and characterization in smart card logs using NMF and Tweets

International audienceThis article describes a novel approach to detect anomalies in smart card logs. In this study, we chose to work on a 24h base for every station in the Parisian metro network. We also consider separately the 7 days of the week. We first build a robust averaged reference for (day,station) couples and then, we focus on the difference between particular situations and references. All experiments are conducted both on the raw data and using an NMF denoised approximation of the log flow. We demonstrate the interest and the robustness of the latter strategy. Then we mine RATP Twitter account to obtain ground truth information about operating incidents. This synchronized flow is used to evaluate our models