A stigmergy-based analysis of city hotspots to discover trends and anomalies in urban transportation usage

A key aspect of a sustainable urban transportation system is the effectiveness of transportation policies. To be effective, a policy has to consider a broad range of elements, such as pollution emission, traffic flow, and human mobility. Due to the complexity and variability of these elements in the urban area, to produce effective policies remains a very challenging task. With the introduction of the smart city paradigm, a widely available amount of data can be generated in the urban spaces. Such data can be a fundamental source of knowledge to improve policies because they can reflect the sustainability issues underlying the city. In this context, we propose an approach to exploit urban positioning data based on stigmergy, a bio-inspired mechanism providing scalar and temporal aggregation of samples. By employing stigmergy, samples in proximity with each other are aggregated into a functional structure called trail. The trail summarizes relevant dynamics in data and allows matching them, providing a measure of their similarity. Moreover, this mechanism can be specialized to unfold specific dynamics. Specifically, we identify high-density urban areas (i.e hotspots), analyze their activity over time, and unfold anomalies. Moreover, by matching activity patterns, a continuous measure of the dissimilarity with respect to the typical activity pattern is provided. This measure can be used by policy makers to evaluate the effect of policies and change them dynamically. As a case study, we analyze taxi trip data gathered in Manhattan from 2013 to 2015.Comment: Preprin

Adapted K-Nearest Neighbors for Detecting Anomalies on Spatio–Temporal Traffic Flow

Outlier detection is an extensive research area, which has been intensively studied in several domains such as biological sciences, medical diagnosis, surveillance, and traffic anomaly detection. This paper explores advances in the outlier detection area by finding anomalies in spatio-temporal urban traffic flow. It proposes a new approach by considering the distribution of the flows in a given time interval. The flow distribution probability (FDP) databases are first constructed from the traffic flows by considering both spatial and temporal information. The outlier detection mechanism is then applied to the coming flow distribution probabilities, the inliers are stored to enrich the FDP databases, while the outliers are excluded from the FDP databases. Moreover, a k-nearest neighbor for distance-based outlier detection is investigated and adopted for FDP outlier detection. To validate the proposed framework, real data from Odense traffic flow case are evaluated at ten locations. The results reveal that the proposed framework is able to detect the real distribution of flow outliers. Another experiment has been carried out on Beijing data, the results show that our approach outperforms the baseline algorithms for high-urban traffic flow

Doctor of Philosophy

dissertationData-driven analytics has been successfully utilized in many experience-oriented areas, such as education, business, and medicine. With the profusion of traffic-related data from Internet of Things and development of data mining techniques, data-driven analytics is becoming increasingly popular in the transportation industry. The objective of this research is to explore the application of data-driven analytics in transportation research to improve the traffic management and operations. Three problems in the respective areas of transportation planning, traffic operation, and maintenance management have been addressed in this research, including exploring the impact of dynamic ridesharing system in a multimodal network, quantifying non-recurrent congestion impact on freeway corridors, and developing infrastructure sampling method for efficient maintenance activities. First, the impact of dynamic ridesharing in a multimodal network is studied with agent-based modeling. The competing mechanism between dynamic ridesharing system and public transit is analyzed. The model simulates the interaction between travelers and the environment and emulates travelers' decision making process with the presence of competing modes. The model is applicable to networks with varying demographics. Second, a systematic approach is proposed to quantify Incident-Induced Delay on freeway corridors. There are two particular highlights in the study of non-recurrent congestion quantification: secondary incident identification and K-Nearest Neighbor pattern matching. The proposed methodology is easily transferable to any traffic operation system that has access to sensor data at a corridor level. Lastly, a high-dimensional clustering-based stratified sampling method is developed for infrastructure sampling. The stratification process consists of two components: current condition estimation and high-dimensional cluster analysis. High-dimensional cluster analysis employs Locality-Sensitive Hashing algorithm and spectral sampling. The proposed method is a potentially useful tool for agencies to effectively conduct infrastructure inspection and can be easily adopted for choosing samples containing multiple features. These three examples showcase the application of data-driven analytics in transportation research, which can potentially transform the traffic management mindset into a model of data-driven, sensing, and smart urban systems. The analytic

Real-time Traffic Flow Detection and Prediction Algorithm: Data-Driven Analyses on Spatio-Temporal Traffic Dynamics

Traffic flows over time and space. This spatio-temporal dependency of traffic flow should be considered and used to enhance the performance of real-time traffic detection and prediction capabilities. This characteristic has been widely studied and various applications have been developed and enhanced. During the last decade, great attention has been paid to the increases in the number of traffic data sources, the amount of data, and the data-driven analysis methods. There is still room to improve the traffic detection and prediction capabilities through studies on the emerging resources. To this end, this dissertation presents a series of studies on real-time traffic operation for highway facilities focusing on detection and prediction.First, a spatio-temporal traffic data imputation approach was studied to exploit multi-source data. Different types of kriging methods were evaluated to utilize the spatio-temporal characteristic of traffic data with respect to two factors, including missing patterns and use of secondary data. Second, a short-term traffic speed prediction algorithm was proposed that provides accurate prediction results and is scalable for a large road network analysis in real time. The proposed algorithm consists of a data dimension reduction module and a nonparametric multivariate time-series analysis module. Third, a real-time traffic queue detection algorithm was developed based on traffic fundamentals combined with a statistical pattern recognition procedure. This algorithm was designed to detect dynamic queueing conditions in a spatio-temporal domain rather than detect a queue and congestion directly from traffic flow variables. The algorithm was evaluated by using various real congested traffic flow data. Lastly, gray areas in a decision-making process based on quantifiable measures were addressed to cope with uncertainties in modeling outputs. For intersection control type selection, the gray areas were identified and visualized

Patterns of mobility in a smart city

Transportation data in smart cities is becoming increasingly available. This data allows building meaningful, intelligent solutions for city residents and city management authorities, the so-called Intelligent Transportation Systems. Our research focused on Lisbon mobility data, provided by Lisbon municipality. The main research objective was to address mobility problems, interdependence, and cascading effects solutions for the city of Lisbon. We developed a data-driven approach based on historical data with a strong focus on visualization methods and dashboard creation. Also, we applied a method based on time series to do prediction based on the traffic congestion data provided. A CRISP-DM approach was applied, integrating different data sources, using Python. Hence, understand traffic patterns, and help the city authorities in the decision-making process, namely more preparedness, adaptability, responsiveness to events.Os dados de transporte, no âmbito das cidades inteligentes, estão cada vez mais disponíveis. Estes dados permitem a construção de soluções inteligentes com impacto significativo na vida dos residentes e nos mecanismos das autoridades de gestão da cidade, os chamados Sistemas de Transporte Inteligentes. A nossa investigação incidiu sobre os dados de mobilidade urbana da cidade de Lisboa, disponibilizados pelo município. O principal objetivo da pesquisa foi abordar os problemas de mobilidade, interdependência e soluções de efeitos em cascata para a cidade de Lisboa. Para alcançar este objetivo foi desenvolvida uma metodologia baseada nos dados históricos do transito no centro urbano da cidade e principais acessos, com uma forte componente de visualização. Foi também aplicado um método baseado em series temporais para fazer a previsão das ocorrências de transito na cidade de Lisboa. Foi aplicada uma abordagem CRISP-DM, integrando diferentes fontes de dados, utilizando Python. Esta tese tem como objetivo identificar padrões de mobilidade urbana com análise e visualização de dados, de forma a auxiliar as autoridades municipais no processo de tomada de decisão, nomeadamente estar mais preparada, adaptada e responsiva