Enhanced Methods for Utilization of Data to Support Multi-Scenario Analysis and Multi-Resolution Modeling

The success of analysis and simulation in transportation systems depends on the availability, quality, reliability, and consistency of real-world data and the methods for utilizing the data. Additional data and data requirements are needed to support advanced analysis and simulation strategies such as multi-resolution modeling (MRM) and multi-scenario analysis. This study has developed, demonstrated, and assessed a systematic approach for the use of data to support MRM and multi-scenario analysis. First, the study developed and examined approaches for selecting one or more representative days for the analysis, considering the variability in travel conditions throughout the year based on cluster analysis. Second, this study developed and analyzed methods for using crowdsourced data vii to estimate origin-destination demands and link-level volumes for use as part of an MRM with consideration of the modeling scenario(s). The assessment of the methods to select the representative day(s) utilizes statistical measures, in addition to measures and visualization techniques that are specific to traffic operations. The results of the assessment indicate that the utilization of the K-means clustering algorithm with four clusters and spatio-temporal segregation of the variables demonstrated superior performance over other tested approaches, such as the use of the Gaussian Mixture clustering algorithm and the use of different segregation levels. The study assessed methods for the use of third-party crowdsourced data from StreetLight (SL) as part of the Origin-Destination Matrix Estimation (ODME), which identifies the method resulting in the closest origin-destination demands to the original seed matrices and real-world link counts. The results of the study indicate that Method 3(b) produced the best performance, which utilized combined data from demand forecasting models, crowdsourced data, and traffic counts. Additionally, this study examined regression models between crowdsourced data and count station data developed for link-level estimation of the volumes. This study also examined the accuracy and transferability of the link-level estimation of the volumes to determine if the crowdsourced data combined with available volume data at several locations can be used to predict missing or unavailable volumes in different locations on different days and times within the network. Regression models produced low errors than the default SL estimates when hourly or daily traffic volumes were taken into account. For similar traffic conditions, the models predicted directional traffic volume close to the real-world value

Role based behavior analysis

Tese de mestrado, Segurança Informática, Universidade de Lisboa, Faculdade de Ciências, 2009Nos nossos dias, o sucesso de uma empresa depende da sua agilidade e capacidade de se adaptar a condições que se alteram rapidamente. Dois requisitos para esse sucesso são trabalhadores proactivos e uma infra-estrutura ágil de Tecnologias de Informacão/Sistemas de Informação (TI/SI) que os consiga suportar. No entanto, isto nem sempre sucede. Os requisitos dos utilizadores ao nível da rede podem nao ser completamente conhecidos, o que causa atrasos nas mudanças de local e reorganizações. Além disso, se não houver um conhecimento preciso dos requisitos, a infraestrutura de TI/SI poderá ser utilizada de forma ineficiente, com excessos em algumas áreas e deficiências noutras. Finalmente, incentivar a proactividade não implica acesso completo e sem restrições, uma vez que pode deixar os sistemas vulneráveis a ameaças externas e internas. O objectivo do trabalho descrito nesta tese é desenvolver um sistema que consiga caracterizar o comportamento dos utilizadores do ponto de vista da rede. Propomos uma arquitectura de sistema modular para extrair informação de fluxos de rede etiquetados. O processo é iniciado com a criação de perfis de utilizador a partir da sua informação de fluxos de rede. Depois, perfis com características semelhantes são agrupados automaticamente, originando perfis de grupo. Finalmente, os perfis individuais são comprados com os perfis de grupo, e os que diferem significativamente são marcados como anomalias para análise detalhada posterior. Considerando esta arquitectura, propomos um modelo para descrever o comportamento de rede dos utilizadores e dos grupos. Propomos ainda métodos de visualização que permitem inspeccionar rapidamente toda a informação contida no modelo. O sistema e modelo foram avaliados utilizando um conjunto de dados reais obtidos de um operador de telecomunicações. Os resultados confirmam que os grupos projectam com precisão comportamento semelhante. Além disso, as anomalias foram as esperadas, considerando a população subjacente. Com a informação que este sistema consegue extrair dos dados em bruto, as necessidades de rede dos utilizadores podem sem supridas mais eficazmente, os utilizadores suspeitos são assinalados para posterior análise, conferindo uma vantagem competitiva a qualquer empresa que use este sistema.In our days, the success of a corporation hinges on its agility and ability to adapt to fast changing conditions. Proactive workers and an agile IT/IS infrastructure that can support them is a requirement for this success. Unfortunately, this is not always the case. The user’s network requirements may not be fully understood, which slows down relocation and reorganization. Also, if there is no grasp on the real requirements, the IT/IS infrastructure may not be efficiently used, with waste in some areas and deficiencies in others. Finally, enabling proactivity does not mean full unrestricted access, since this may leave the systems vulnerable to outsider and insider threats. The purpose of the work described on this thesis is to develop a system that can characterize user network behavior. We propose a modular system architecture to extract information from tagged network flows. The system process begins by creating user profiles from their network flows’ information. Then, similar profiles are automatically grouped into clusters, creating role profiles. Finally, the individual profiles are compared against the roles, and the ones that differ significantly are flagged as anomalies for further inspection. Considering this architecture, we propose a model to describe user and role network behavior. We also propose visualization methods to quickly inspect all the information contained in the model. The system and model were evaluated using a real dataset from a large telecommunications operator. The results confirm that the roles accurately map similar behavior. The anomaly results were also expected, considering the underlying population. With the knowledge that the system can extract from the raw data, the users network needs can be better fulfilled, the anomalous users flagged for inspection, giving an edge in agility for any company that uses it

Estimating city-wide hourly bicycle flow using a hybrid LSTM MDN

Cycling can reduce greenhouse gas emissions and air pollution and increase public health. With this in mind, policy-makers in cities worldwide seek to improve the bicycle mode-share. However, they often struggle against the fear and the perceived riskiness of cycling. Efforts to increase the bicycle's mode-share involve many measures, one of them being the improvement of cycling safety. This requires the analysis of the factors surrounding accidents and the outcome. However, meaningful analysis of cycling safety requires accurate bicycle flow data that is generally sparse or not even available at a segment level. Therefore, safety engineers often rely on aggregated variables or calibration factors that fail to account for variations in the cycling traffic caused by external factors. This paper fills this gap by presenting a Deep Learning based approach, the Long Short-Term Memory Mixture Density Network (LSTMMDN), to estimate hourly bicycle flow in Copenhagen, conditional on weather, temporal and road conditions at the segment level. This method addresses the shortcomings in the calibration factor method and results in 66-77\% more accurate bicycle traffic estimates. To quantify the impact of more accurate bicycle traffic estimates in cycling safety analysis, we estimate bicycle crash risk models to evaluate bicycle crashes in Copenhagen. The models are identical except for the exposure variables being used. One model is estimated using the LSTMMDN estimates, one using the calibration-based estimates, and one using yearly mean traffic estimates. The results show that investing in more advanced methods for obtaining bicycle volume estimates can benefit the quality, mitigating efforts by improving safety analyses and other performance measures

The Impact of Built Environment on Pedestrian Crashes and the Identification of Crash Clusters on an Urban University Campus

Objectives: Motor vehicle-pedestrian crash is a significant public health concern. The urban campus of Georgia State University poses unique challenges due to a large number of students and university employees. The objectives of this study are twofold: (1) to examine the correlation between specific features of the built environment on and around the University campus and pedestrian crashes; and (2) to identify crash clusters in the study area using network-based geospatial techniques.Methods: We obtained pedestrian crash data (n=119) from 2003 to 2007 from Georgia Department of Transportation and evaluated environmental features pertaining to the road infrastructure, pedestrian infrastructure and streetscape for each road segment and intersection. Prevalence rate of each feature with pedestrian crashes present was calculated. We used network-based Kernel Density Estimation to identify the high density road segments and intersections, then used network-based K-function to examine the clustering of pedestrian crashes.Results: Over 50% of the crosswalk signs, pedestrian signals, public transit, and location branding signs (more than three) at intersections involved pedestrian crashes. More than half of wider streets (greater than 29 feet), two-way streets, and streets in good condition had pedestrian crashes present. Crashes occurred more frequently in road segments with strong street compactness and mixed land use present and were significantly (p<0.05) clustered in these high-density zones.Conclusions: Findings can be used to understand the correlation between built environment and pedestrian safety, to prioritize the high-density zones for intervention efforts, and to formulate research hypotheses for investigating pedestrian crashes. [West J Emerg Med. 2010; 11(3): 295-302.

Road transport and emissions modelling in England and Wales: A machine learning modelling approach using spatial data

An expanding street network coupled with an increasing number of vehicles testifies to the significance and reliance on road transportation of modern economies. Unfortunately, the use of road transport comes with drawbacks such as its contribution to greenhouse gases (GHG) and air pollutant emissions, therefore becoming an obstacle to countries’ objectives to improve air quality and a barrier to the ambitious targets to reduce Greenhouse Gas emissions. Unsurprisingly, traffic forecasting, its environmental impacts and potential future configurations of road transport are some of the topics which have received a great deal of attention in the literature. However, traffic forecasting and the assessment of its determinants have been commonly restricted to specific, normally urban, areas while road transport emission studies do not take into account a large part of the road network, as they usually focus on major roads. This research aimed to contribute to the field of road transportation, by firstly developing a model to accurately estimate traffic across England and Wales at a granular (i.e., street segment) level, secondly by identifying the role of factors associated with road transportation and finally, by estimating CO2 and air pollutant emissions, known to be responsible for climate change as well as negative impacts on human health and ecosystems. The thesis identifies potential emissions abatement from the adoption of novel road vehicles technologies and policy measures. This is achieved by analysing transport scenarios to assess future impacts on air quality and CO2 emissions. The thesis concludes with a comparison of my estimates for road emissions with those from DfT modelling to assess the methodological robustness of machine learning algorithms applied in this research. The traffic modelling outputs reveal traffic patterns across urban and rural areas, while traffic estimation is achieved with high accuracy for all road classes. In addition, specific socioeconomic and roadway characteristics associated with traffic across all vehicle types and road classes are identified. Finally, CO2 and air pollution hot spots as well as the impact of open spaces on pollutants emissions and air quality are explored. Potential emission reduction with the employment of new vehicle technologies and policy implementation is also assessed, so as the results can support urban planning and inform policies related to transport congestion and environmental impacts mitigation. Considering the disaggregated approach, the methodology can be used to facilitate policy making for both local and national aggregated levels

On the Distribution of Probe Traffic Volume Estimated from Their Footprints

Collecting traffic volume data is a vital but costly piece of transportation engineering and urban planning. In recent years, efforts have been made to estimate traffic volumes using passively collected probe data that contain spatiotemporal information. However, the feasibility and underlying principles of traffic volume estimation based on probe data without pseudonyms have not been examined thoroughly. In this paper, we present the exact distribution of the estimated probe traffic volume passing through a road segment based on probe point data without trajectory reconstruction. The distribution of the estimated probe traffic volume can exhibit multimodality, without necessarily being line-symmetric with respect to the actual probe traffic volume. As more probes are present, the distribution approaches a normal distribution. The conformity of the distribution was demonstrated through numerical and microscopic traffic simulations. Theoretically, with a well-calibrated probe penetration rate, traffic volumes in a road segment can be estimated using probe point data with high precision even at a low probe penetration rate. Furthermore, sometimes there is a local optimum cordon length that maximises estimation precision. The theoretical variance of the estimated probe traffic volume can address heteroscedasticity in the modelling of traffic volume estimates.Comment: 17 pages, 10 figure