The use of real-time connected vehicles and HERE data in developing an automated freeway incident detection algorithm

Traffic incidents cause severe problems on roadways. About 6.3 million highway crashes are reported annually only in the United States, among which more than 32,000 are fatal crashes. Reducing the risk of traffic incidents is key to effective traffic incident management (TIM). Quick detection of unexpected traffic incidents on roadways contribute to quick clearance and hence improve safety. Existing techniques for the detection of freeway incidents are not reliable. This study focuses on exploring the potential of emerging connected vehicles (CV) technology in automated freeway incident detection in the mixed traffic environment. The study aims at developing an automated freeway incident detection algorithm that will take advantage of the CV technology in providing fast and reliable incident detection. Lee Roy Selmon Expressway was chosen for this study because of the THEA CV data availability. The findings of the study show that emerging CV technology generates data that are useful for automated freeway incident detection, although the market penetration rate was low (6.46%). The algorithm performance in terms of detection rate (DR) and false alarm rate (FAR) indicated that CV data resulted into 31.71% DR and zero FAR while HERE yielded a 70.95% DR and 9.02% FAR. Based on Pearson’s correlation analysis, the incidents detected by the CV data were found to be similar to the ones detected by the HERE data. The statistical comparison by ANOVA shows that there is a difference in the algorithm’s detection time when using CV data and HERE data. 17.07% of all incidents were detected quicker when using CV data compared to HERE data, while 7.32% were detected quicker when using HERE data compared to CV data

Incorporating General Incident Knowledge into Automatic Incident Detection: A Markov Logic Network Method

Automatic incident detection (AID) algorithms have been studied for more than 50 years. However, due to the development in some competing technologies such as cell phone call based detection, video detection, the importance of AID in traffic management has been decreasing over the years. In response to such trend, AID researchers introduced new universal and transferability requirements in addition to the traditional performance measures. Based on these requirements, the recent effort of AID research has been focused on applying new artificial intelligence (AI) models into incident detection and significant performance improvement has been observed comparing to earlier models. To fully address the new requirements, the existing AI models still have some limitations including 1) the black-box characteristics, 2) the overfitting issue, and 3) the requirement for clean, large, and accurate training data. Recently, Bayesian network (BN) based AID algorithm showed promising potentials in partially overcoming the above limitations with its open structure and explicit stochastic interpretation of incident knowledge. But BN still has its limitations such as the enforced cause-effect relationship among BN nodes and its Bayesian type of logic inference. In 2006, another more advanced statistical inference network, Markov Logic Network (MLN), was proposed in computer science, which can effectively overcome some limitations of BN and also bring the flexibility of applying various knowledge. In this study, an MLN-based AID algorithm is proposed. The proposed algorithm can interpret general types of traffic flow knowledge, not necessarily causality relationships. Meanwhile, a calibration method is also proposed to effective train the MLN. The algorithm is evaluated based on field data, collected at I-894 corridor in Milwaukee, WI. The results indicate promising potentials of the application of MLN in incident detection

Methodological evolution and frontiers of identifying, modeling and preventing secondary crashes on highways

© 2018 Elsevier Ltd Secondary crashes (SCs) or crashes that occur within the boundaries of the impact area of prior, primary crashes are one of the incident types that frequently affect highway traffic operations and safety. Existing studies have made great efforts to explore the underlying mechanisms of SCs and relevant methodologies have been e volving over the last two decades concerning the identification, modeling, and prevention of these crashes. So far there is a lack of a detailed examination on the progress, lessons, and potential opportunities regarding existing achievements in SC-related studies. This paper provides a comprehensive investigation of the state-of-the-art approaches; examines their strengths and weaknesses; and provides guidance in exploiting new directions in SC-related research. It aims to support researchers and practitioners in understanding well-established approaches so as to further explore the frontiers. Published studies focused on SCs since 1997 have been identified, reviewed, and summarized. Key issues concentrated on the following aspects are discussed: (i) static/dynamic approaches to identify SCs; (ii) parametric/non-parametric models to analyze SC risk, and (iii) deployable countermeasures to prevent SCs. Based on the examined issues, needs, and challenges, this paper further provides insights into potential opportunities such as: (a) fusing data from multiple sources for SC identification, (b) using advanced learning algorithms for real-time SC analysis, and (c) deploying connected vehicles for SC prevention in future research. This paper contributes to the research community by providing a one-stop reference for research on secondary crashes

A data-centric weak supervised learning for highway traffic incident detection

Using the data from loop detector sensors for near-real-time detection of traffic incidents in highways is crucial to averting major traffic congestion. While recent supervised machine learning methods offer solutions to incident detection by leveraging human-labeled incident data, the false alarm rate is often too high to be used in practice. Specifically, the inconsistency in the human labeling of the incidents significantly affects the performance of supervised learning models. To that end, we focus on a data-centric approach to improve the accuracy and reduce the false alarm rate of traffic incident detection on highways. We develop a weak supervised learning workflow to generate high-quality training labels for the incident data without the ground truth labels, and we use those generated labels in the supervised learning setup for final detection. This approach comprises three stages. First, we introduce a data preprocessing and curation pipeline that processes traffic sensor data to generate high-quality training data through leveraging labeling functions, which can be domain knowledge-related or simple heuristic rules. Second, we evaluate the training data generated by weak supervision using three supervised learning models -- random forest, k-nearest neighbors, and a support vector machine ensemble -- and long short-term memory classifiers. The results show that the accuracy of all of the models improves significantly after using the training data generated by weak supervision. Third, we develop an online real-time incident detection approach that leverages the model ensemble and the uncertainty quantification while detecting incidents. Overall, we show that our proposed weak supervised learning workflow achieves a high incident detection rate (0.90) and low false alarm rate (0.08)

Designing the next generation intelligent transportation sensor system using big data driven machine learning techniques

Accurate traffic data collection is essential for supporting advanced traffic management system operations. This study investigated a large-scale data-driven sequential traffic sensor health monitoring (TSHM) module that can be used to monitor sensor health conditions over large traffic networks. Our proposed module consists of three sequential steps for detecting different types of abnormal sensor issues. The first step detects sensors with abnormally high missing data rates, while the second step uses clustering anomaly detection to detect sensors reporting abnormal records. The final step introduces a novel Bayesian changepoint modeling technique to detect sensors reporting abnormal traffic data fluctuations by assuming a constant vehicle length distribution based on average effective vehicle length (AEVL). Our proposed method is then compared with two benchmark algorithms to show its efficacy. Results obtained by applying our method to the statewide traffic sensor data of Iowa show it can successfully detect different classes of sensor issues. This demonstrates that sequential TSHM modules can help transportation agencies determine traffic sensors’ exact problems, thereby enabling them to take the required corrective steps. The second research objective will focus on the traffic data imputation after we discard the anomaly/missing data collected from failure traffic sensors. Sufficient high-quality traffic data are a crucial component of various Intelligent Transportation System (ITS) applications and research related to congestion prediction, speed prediction, incident detection, and other traffic operation tasks. Nonetheless, missing traffic data are a common issue in sensor data which is inevitable due to several reasons, such as malfunctioning, poor maintenance or calibration, and intermittent communications. Such missing data issues often make data analysis and decision-making complicated and challenging. In this study, we have developed a generative adversarial network (GAN) based traffic sensor data imputation framework (TSDIGAN) to efficiently reconstruct the missing data by generating realistic synthetic data. In recent years, GANs have shown impressive success in image data generation. However, generating traffic data by taking advantage of GAN based modeling is a challenging task, since traffic data have strong time dependency. To address this problem, we propose a novel time-dependent encoding method called the Gramian Angular Summation Field (GASF) that converts the problem of traffic time-series data generation into that of image generation. We have evaluated and tested our proposed model using the benchmark dataset provided by Caltrans Performance Management Systems (PeMS). This study shows that the proposed model can significantly improve the traffic data imputation accuracy in terms of Mean Absolute Error (MAE) and Root Mean Squared Error (RMSE) compared to state-of-the-art models on the benchmark dataset. Further, the model achieves reasonably high accuracy in imputation tasks even under a very high missing data rate (\u3e50%), which shows the robustness and efficiency of the proposed model. Besides the loop and radar sensors, traffic cameras have shown great ability to provide insightful traffic information using the image and video processing techniques. Therefore, the third and final part of this work aimed to introduce an end to end real-time cloud-enabled traffic video analysis (IVA) framework to support the development of the future smart city. As Artificial intelligence (AI) growing rapidly, Computer vision (CV) techniques are expected to significantly improve the development of intelligent transportation systems (ITS), which are anticipated to be a key component of future Smart City (SC) frameworks. Powered by computer vision techniques, the converting of existing traffic cameras into connected ``smart sensors called intelligent video analysis (IVA) systems has shown the great capability of producing insightful data to support ITS applications. However, developing such IVA systems for large-scale, real-time application deserves further study, as the current research efforts are focused more on model effectiveness instead of model efficiency. Therefore, we have introduced a real-time, large-scale, cloud-enabled traffic video analysis framework using NVIDIA DeepStream, which is a streaming analysis toolkit for AI-based video and image analysis. In this study, we have evaluated the technical and economic feasibility of our proposed framework to help traffic agency to build IVA systems more efficiently. Our study shows that the daily operating cost for our proposed framework on Google Cloud Platform (GCP) is less than $0.14 per camera, and that, compared with manual inspections, our framework achieves an average vehicle-counting accuracy of 83.7% on sunny days

Measuring traffic lane-changing by converting video into space–time still images

Empirical data is needed in order to extend our knowledge of traffic behavior. Video recordings are used to enrich typical data from loop detectors. In this context, data extraction from videos becomes a challenging task. Setting automatic video processing systems is costly, complex, and the accuracy achieved is usually not enough to improve traffic flow models. In contrast “visual” data extraction by watching the recordings requires extensive human intervention. A semiautomatic video processing methodology to count lane-changing in freeways is proposed. The method allows counting lane changes faster than with the visual procedure without falling into the complexities and errors of full automation. The method is based on converting the video into a set of space–time still images, from where to visually count. This methodology has been tested at several freeway locations near Barcelona (Spain) with good results. A user-friendly implementation of the method is available on http://bit.ly/2yUi08M.Peer ReviewedPostprint (published version

Intelligent Transportation Related Complex Systems and Sensors

Building around innovative services related to different modes of transport and traffic management, intelligent transport systems (ITS) are being widely adopted worldwide to improve the efficiency and safety of the transportation system. They enable users to be better informed and make safer, more coordinated, and smarter decisions on the use of transport networks. Current ITSs are complex systems, made up of several components/sub-systems characterized by time-dependent interactions among themselves. Some examples of these transportation-related complex systems include: road traffic sensors, autonomous/automated cars, smart cities, smart sensors, virtual sensors, traffic control systems, smart roads, logistics systems, smart mobility systems, and many others that are emerging from niche areas. The efficient operation of these complex systems requires: i) efficient solutions to the issues of sensors/actuators used to capture and control the physical parameters of these systems, as well as the quality of data collected from these systems; ii) tackling complexities using simulations and analytical modelling techniques; and iii) applying optimization techniques to improve the performance of these systems. It includes twenty-four papers, which cover scientific concepts, frameworks, architectures and various other ideas on analytics, trends and applications of transportation-related data

Real-time crash prediction models: State-of-the-art, design pathways and ubiquitous requirements

Proactive traffic safety management systems can monitor traffic conditions in real-time, identify the formation of unsafe traffic dynamics, and implement suitable interventions to bring unsafe conditions back to normal traffic situations. Recent advancements in artificial intelligence, sensor fusion and algorithms have brought about the introduction of a proactive safety management system closer to reality. The basic prerequisite for developing such a system is to have a reliable crash prediction model that takes real-time traffic data as input and evaluates their association with crash risk. Since the early 21st century, several studies have focused on developing such models. Although the idea has considerably matured over time, the endeavours have been quite discrete and fragmented at best because the fundamental aspects of the overall modelling approach substantially vary. Therefore, a number of transitional challenges have to be identified and subsequently addressed before a ubiquitous proactive safety management system can be formulated, designed and implemented in real-world scenarios. This manuscript conducts a comprehensive review of existing real-time crash prediction models with the aim of illustrating the state-of-the-art and systematically synthesizing the thoughts presented in existing studies in order to facilitate its translation from an idea into a ready to use technology. Towards that journey, it conducts a systematic review by applying various text mining methods and topic modelling. Based on the findings, this paper ascertains the development pathways followed in various studies, formulates the ubiquitous design requirements of such models from existing studies and knowledge of similar systems. Finally, this study evaluates the universality and design compatibility of existing models. This paper is, therefore, expected to serve as a one stop knowledge source for facilitating a faster transition from the idea of real-time crash prediction models to a real-world operational proactive traffic safety management system