Navigating Occluded Intersections with Autonomous Vehicles using Deep Reinforcement Learning

Providing an efficient strategy to navigate safely through unsignaled intersections is a difficult task that requires determining the intent of other drivers. We explore the effectiveness of Deep Reinforcement Learning to handle intersection problems. Using recent advances in Deep RL, we are able to learn policies that surpass the performance of a commonly-used heuristic approach in several metrics including task completion time and goal success rate and have limited ability to generalize. We then explore a system's ability to learn active sensing behaviors to enable navigating safely in the case of occlusions. Our analysis, provides insight into the intersection handling problem, the solutions learned by the network point out several shortcomings of current rule-based methods, and the failures of our current deep reinforcement learning system point to future research directions.Comment: IEEE International Conference on Robotics and Automation (ICRA 2018

Risk analysis of autonomous vehicle and its safety impact on mixed traffic stream

In 2016, more than 35,000 people died in traffic crashes, and human error was the reason for 94% of these deaths. Researchers and automobile companies are testing autonomous vehicles in mixed traffic streams to eliminate human error by removing the human driver behind the steering wheel. However, recent autonomous vehicle crashes while testing indicate the necessity for a more thorough risk analysis. The objectives of this study were (1) to perform a risk analysis of autonomous vehicles and (2) to evaluate the safety impact of these vehicles in a mixed traffic stream. The overall research was divided into two phases: (1) risk analysis and (2) simulation of autonomous vehicles. Risk analysis of autonomous vehicles was conducted using the fault tree method. Based on failure probabilities of system components, two fault tree models were developed and combined to predict overall system reliability. It was found that an autonomous vehicle system could fail 158 times per one-million miles of travel due to either malfunction in vehicular components or disruption from infrastructure components. The second phase of this research was the simulation of an autonomous vehicle, where change in crash frequency after autonomous vehicle deployment in a mixed traffic stream was assessed. It was found that average travel time could be reduced by about 50%, and 74% of conflicts, i.e., traffic crashes, could be avoided by replacing 90% of the human drivers with autonomous vehicles

Driver Behaviour at Signalized Intersection Literature Review

Traffic accidents are one of the highest causes of death in the world, with human behavior being the most dominant factor. Therefore, it is necessary to understand driver behavior as a traffic accident mitigation strategy. This paper aims to understand the behavior of drivers at signaled intersections and to overcome the deviant behavior. The behavior of the driver at the intersection is to stop or cross the intersection. Crossing at an intersection at a red light is deviant behavior. This deviation can occur as violation due to driver aggression or error due to a dilemma when the light is yellow. The influencing factors are personal, speed, acceleration, distance, the presence of other vehicles, and others. The main countermeasure for deviant behavior at intersections is law enforcement, such as the installation of red light cameras. In addition, the behavior of drivers at intersections can be used as a reference in the design of safer intersections

DATA-DRIVEN BAYESIAN METHOD-BASED TRAFFIC CRASH DRIVER INJURY SEVERITY FORMULATION, ANALYSIS, AND INFERENCE

Traffic crashes have resulted in significant cost to society in terms of life and economic losses, and comprehensive examination of crash injury outcome patterns is of practical importance. By inferring the parameters of interest from prior information and studied datasets, Bayesian models are efficient methods in data analysis with more accurate results, but their applications in traffic safety studies are still limited. By examining the driver injury severity patterns, this research is proposed to systematically examine the applicability of Bayesian methods in traffic crash driver injury severity prediction in traffic crashes. In this study, three types of Bayesian models are defined: hierarchical Bayesian regression model, Bayesian non-regression model and knowledge-based Bayesian non-parametric model, and a conceptual framework is developed for selecting the appropriate Bayesian model based on discrete research purposes. Five Bayesian models are applied accordingly to test their effectiveness in traffic crash driver injury severity prediction and variable impact estimation: hierarchical Bayesian binary logit model, hierarchical Bayesian ordered logit model, hierarchical Bayesian random intercept model with cross-level interactions, multinomial logit (MNL)-Bayesian Network (BN) model, and decision table/na\xefve Bayes (DTNB) model. A complete dataset containing all crashes occurring on New Mexico roadways in 2010 and 2011 is used for model analyses. The studied dataset is composed of three major sub-datasets: crash dataset, vehicle dataset and driver dataset, and all included variables are therefore divided into two hierarchical levels accordingly: crash-level variables and vehicle/driver variables. From all these five models, the model performance and analysis results have shown promising performance on injury severity prediction and variable influence analysis, and these results underscore the heterogeneous impacts of these significant variables on driver injury severity outcomes. The performances of these models are also compared among these methods or with traditional traffic safety models. With the analyzed results, tentative suggestions regarding countermeasures and further research efforts to reduce crash injury severity are proposed. The research results enhance the understandings of the applicability of Bayesian methods in traffic safety analysis and the mechanisms of crash injury severity outcomes, and provide beneficial inference to improve safety performance of the transportation system

Dynamic Dilemma Zone Protection System: A Smart Machine Learning Based Approach to Countermeasure Drivers\u27s Yellow Light Dilemma

Drivers’ indecisions within the dilemma zone (DZ) during the yellow interval is a major safety concern of a roadway network. The present study develops a systematic framework of a machine learning (ML) based dynamic dilemma zone protection (DZP) system to protect drivers from potential intersection crashes due to such indecisions. For this, the present study first develops effective methods of quantifying DZ using important site-specific characteristics of signalized intersections. By this method, high-risk intersections in terms of DZ crashes could be identified using readily available intersection site-specific characteristics. Afterward, the present study develops an innovative framework for predicting driver behavior under varying DZ conditions using ML methods. The framework utilizes multiple ML techniques to process vehicle attribute data (e.g., speed, location, and time-of-arrival) collected at the onset of the yellow indication, and eventually predict drivers’ stop-or-go decisions based on the data. The DZP system discussed in the present study has two major components that work with synergy to ensure the total safety of a DZ affected vehicle: dynamic green extension (DGE), and dynamic green protection (DRP) system. Based on the continuous vehicle tracking data, the DGE system uninterruptedly monitors vehicle within the DZ and xiv predict vehicles that may face the decision dilemma if there is a sudden transition from green signal to yellow. After detecting such vehicles, the DGE system provides an exact amount of extended green time so that the detected vehicles could safely clear the intersection without any hesitation. There could be some vehicles that may end up running the red light due to various limitations. In this case, the DRP system provides an extended amount of all-red extensions after predicting potential red light running vehicles to nullify the likelihood of any intersection crashes. After the development, the DZP system is then implemented in several selected intersections in Alabama. Performance assessments are accomplished for the to see the safety and operation impact of the DZP system in implemented sites. The comprehensive assessment of the DGE system is accomplished with ten performance measures, which include percent green arrivals, percent yellow arrivals, percent red arrivals, dilemma zone length, and red-light running vehicles before and after the system implementation. Results show that the DGE system could significantly improve the overall intersection safety and efficiency. A short-term study on performance assessment of DRP systems shows that such a driver behavior prediction method could effectively predict 100% red-light-runners as well as efficiently provide the required amount of clearance time without hampering overall intersection efficiency. Based on the outcomes from the performance assessments of the DGE and DRP systems, it is safe to say the machine learning based DZP system would be able to promote intersection safety by protecting the dilemma zone impacted vehicles from potential intersection crashes as well as enhance the operational performance of intersections by intelligently allocate exact right-of-way to the vehicles and reducing the overall delays

Vehicular Fog Computing Enabled Real-time Collision Warning via Trajectory Calibration

Vehicular fog computing (VFC) has been envisioned as a promising paradigm for enabling a variety of emerging intelligent transportation systems (ITS). However, due to inevitable as well as non-negligible issues in wireless communication, including transmission latency and packet loss, it is still challenging in implementing safety-critical applications, such as real-time collision warning in vehicular networks. In this paper, we present a vehicular fog computing architecture, aiming at supporting effective and real-time collision warning by offloading computation and communication overheads to distributed fog nodes. With the system architecture, we further propose a trajectory calibration based collision warning (TCCW) algorithm along with tailored communication protocols. Specifically, an application-layer vehicular-to-infrastructure (V2I) communication delay is fitted by the Stable distribution with real-world field testing data. Then, a packet loss detection mechanism is designed. Finally, TCCW calibrates real-time vehicle trajectories based on received vehicle status including GPS coordinates, velocity, acceleration, heading direction, as well as the estimation of communication delay and the detection of packet loss. For performance evaluation, we build the simulation model and implement conventional solutions including cloud-based warning and fog-based warning without calibration for comparison. Real-vehicle trajectories are extracted as the input, and the simulation results demonstrate that the effectiveness of TCCW in terms of the highest precision and recall in a wide range of scenarios