Adapted K-Nearest Neighbors for Detecting Anomalies on Spatio–Temporal Traffic Flow

Outlier detection is an extensive research area, which has been intensively studied in several domains such as biological sciences, medical diagnosis, surveillance, and traffic anomaly detection. This paper explores advances in the outlier detection area by finding anomalies in spatio-temporal urban traffic flow. It proposes a new approach by considering the distribution of the flows in a given time interval. The flow distribution probability (FDP) databases are first constructed from the traffic flows by considering both spatial and temporal information. The outlier detection mechanism is then applied to the coming flow distribution probabilities, the inliers are stored to enrich the FDP databases, while the outliers are excluded from the FDP databases. Moreover, a k-nearest neighbor for distance-based outlier detection is investigated and adopted for FDP outlier detection. To validate the proposed framework, real data from Odense traffic flow case are evaluated at ten locations. The results reveal that the proposed framework is able to detect the real distribution of flow outliers. Another experiment has been carried out on Beijing data, the results show that our approach outperforms the baseline algorithms for high-urban traffic flow

A Survey on Urban Traffic Anomalies Detection Algorithms

© 2019 IEEE. This paper reviews the use of outlier detection approaches in urban traffic analysis. We divide existing solutions into two main categories: flow outlier detection and trajectory outlier detection. The first category groups solutions that detect flow outliers and includes statistical, similarity and pattern mining approaches. The second category contains solutions where the trajectory outliers are derived, including off-line processing for trajectory outliers and online processing for sub-trajectory outliers. Solutions in each of these categories are described, illustrated, and discussed, and open perspectives and research trends are drawn. Compared to the state-of-the-art survey papers, the contribution of this paper lies in providing a deep analysis of all the kinds of representations in urban traffic data, including flow values, segment flow values, trajectories, and sub-trajectories. In this context, we can better understand the intuition, limitations, and benefits of the existing outlier urban traffic detection algorithms. As a result, practitioners can receive some guidance for selecting the most suitable methods for their particular case

Automatic detection of traffic lights, street crossings and urban roundabouts combining outlier detection and deep learning classification techniques based on GPS traces while driving

The automatic generation of street networks is attracting the attention of research and industry communities in areas such as routable map generation. This paper presents a novel mechanism that focuses on the automatic detection of street elements such as traffic lights, street crossings and roundabouts which could be used to generate street maps and populate them with traffic influencing infrastructural elements such as traffic lights. In order to minimize the system requirements and simplify the data collection from many users with minimal impact for them, only traces of GPS data from a mobile device while driving are used. Speed and acceleration time series are derived from the GPS data. An outlier detection algorithm is used first in order to detect abnormal driving locations (which can be due to infrastructural elements or particular traffic conditions). Using deep learning, speed and acceleration patterns are automatically analyzed at each outlier in order to extract relevant features which are then classified into a traffic light, street crossing, urban roundabout or other element. The classification results are enhanced by adding the degree of atypicity for each point calculated as the percentage of times that a particular location is detected as an outlier in several drives. The proposed algorithm achieves a combined recall of 0.89 and a combined precision of 0.88 for classification.The research leading to these results has received funding from the “HERMES-SMART DRIVER” project TIN2013-46801-C4-2-R (MINECO), funded by the Spanish Agencia Estatal de Investigación (AEI), and the “ANALYTICS USING SENSOR DATA FOR FLATCITY” project TIN2016-77158-C4-1-R (MINECO/ ERDF, EU) funded by the Spanish Agencia Estatal de Investigación (AEI) and the European Regional Development Fund (ERDF)

Outlier Detection in Urban Air Quality Sensor Networks

Low-cost urban air quality sensor networks are increasingly used to study the spatio-temporal variability in air pollutant concentrations. Recently installed low-cost urban sensors, however, are more prone to result in erroneous data than conventional monitors, e.g., leading to outliers. Commonly applied outlier detection methods are unsuitable for air pollutant measurements that have large spatial and temporal variations as occur in urban areas. We present a novel outlier detection method based upon a spatio-temporal classification, focusing on hourly NO2 concentrations. We divide a full year’s observations into 16 spatio-temporal classes, reflecting urban background vs. urban traffic stations, weekdays vs. weekends, and four periods per day. For each spatio-temporal class, we detect outliers using the mean and standard deviation of the normal distribution underlying the truncated normal distribution of the NO2 observations. Applying this method to a low-cost air quality sensor network in the city of Eindhoven, the Netherlands, we found 0.1–0.5% of outliers. Outliers could reflect measurement errors or unusual high air pollution events. Additional evaluation using expert knowledge is needed to decide on treatment of the identified outliers. We conclude that our method is able to detect outliers while maintaining the spatio-temporal variability of air pollutant concentrations in urban areas

Parameter estimation for stochastic hybrid model applied to urban traffic flow estimation

This study proposes a novel data-based approach for estimating the parameters of a stochastic hybrid model describing the traffic flow in an urban traffic network with signalized intersections. The model represents the evolution of the traffic flow rate, measuring the number of vehicles passing a given location per time unit. This traffic flow rate is described using a mode-dependent first-order autoregressive (AR) stochastic process. The parameters of the AR process take different values depending on the mode of traffic operation – free flowing, congested or faulty – making this a hybrid stochastic process. Mode switching occurs according to a first-order Markov chain. This study proposes an expectation-maximization (EM) technique for estimating the transition matrix of this Markovian mode process and the parameters of the AR models for each mode. The technique is applied to actual traffic flow data from the city of Jakarta, Indonesia. The model thus obtained is validated by using the smoothed inference algorithms and an online particle filter. The authors also develop an EM parameter estimation that, in combination with a time-window shift technique, can be useful and practical for periodically updating the parameters of hybrid model leading to an adaptive traffic flow state estimator

Data mining on urban sound sensor networks

ICA 2016, 22nd International Congress on Acoustics, BUENOS AIRES, ARGENTINE, 05-/09/2016 - 09/09/2016Urban sound sensor networks deliver megabytes of data on a daily basis so the question on how to extract useful knowledge from this overwhelming dataset is eminent. This paper presents and compares two extremely different approaches. The first approach uses as much as possible expert knowledge on how people perceive the sonic environment, the second approach simply considers the spectra obtained every time step as meaningless numbers yet tries to structure them in a meaningful way. The approach based on expert knowledge starts by extracting features that a human listener might use to detect salient sounds and to recognize these sounds. These features are then fed to a recurrent neural network that learns in an unsupervised way to structure and group these features based on co-occurrence and typical sequences. The network is constructed to mimic human auditory processing and includes inhibition and adaptation processes. The outcome of this network is the activation of a set of several hundred neurons. The second approach collects a sequence of one minute of sound spectra (1/8 second time step) and summarizes it using Gaussian mixture models in the frequency-amplitude space. Mean and standard deviation of the set of Gaussians are used for further analysis. In both cases, the outcome is clustered to analyze similarities over space and time as well as to detect outliers. Both approaches are applied on a dataset obtained from 25 measurement nodes during approximately one and a half year in Paris, France. Although the approach based on human listening models is expected to be much more precise when it comes to analyzing and clustering soundscapes, it is also much slower than the blind data analysis