Integration of multiagent crossing controllers for measure-oriented traffic control

In this paper we will present an integration of multiagent crossing controllers for measureoriented traffic control. It is the basis for the future multiagent traffic control system which uses measure oriented approach to control traffic. This integrated architecture gives us the possibility to react to the dynamic changes of traffic thanks to the data it can gather with its sensors

A self-learning intersection control system for connected and automated vehicles

This study proposes a Decentralized Sparse Coordination Learning System (DSCLS) based on Deep Reinforcement Learning (DRL) to control intersections under the Connected and Automated Vehicles (CAVs) environment. In this approach, roadway sections are divided into small areas; vehicles try to reserve their desired area ahead of time, based on having a common desired area with other CAVs; the vehicles would be in an independent or coordinated state. Individual CAVs are set accountable for decision-making at each step in both coordinated and independent states. In the training process, CAVs learn to minimize the overall delay at the intersection. Due to the chain impact of taking random actions in the training course, the trained model can deal with unprecedented volume circumstances, the main challenge in intersection management. Application of the model to a single-lane intersection with no turning movement as a proof-of-concept test reveals noticeable improvements in traffic measures compared to three other intersection control systems. A Spring Mass Damper (SMD) model is developed to control platooning behavior of CAVs. In the SMD model, each vehicle is assumed as a mass, coupled with its preceding vehicle with a spring and a damper. The spring constant and damper coefficient control the interaction between vehicles. Limitations on communication range and the number of vehicles in each platoon are applied in this model, and the SMD model controls intra-platoon and inter-platoon interactions. The simulation result for a regular highway section reveals that the proposed platooning algorithm increases the maximum throughput by 29% and 63% under 50% and 100% market penetration rate of CAVs. A merging section with different volume combinations on the main section and merging section and different market penetration rates of CAVs is also modeled to test inter-platoon spacing performance in accommodating merging vehicles. Noticeable travel time reduction is observed in both mainline and merging lanes and under all volume combinations in 80% and higher MPR of CAVs. For a more reliable assessment of the DSCLS, the model is applied to a more realistic intersection, including three approaching lanes in each direction and turning movements. The proposed algorithm decreases delay by 58%, 19%, and 13% in moderate, high, and extreme volume regimes, improving travel time accordingly. Comparison of safety measures reveals 28% improvement in Post Encroachment Time (PET) in the extreme volume regime and minor improvements in high and moderate volume regimes. Due to the limited acceleration and deceleration rates, the proposed model does not show a better performance in environmental measures, including fuel consumption and CO2 emission, compared to the conventional control systems. However, the DSCLS noticeably outperforms the other pixel-reservation counterpart control system, with limited acceleration and deceleration rates. The application of the model to a corridor of four interactions shows the same trends in traffic, safety, and environmental measures as the single intersection experiment. An automated intersection control system for platooning CAVs is developed by combining the two proposed models, which remarkably improves traffic and safety measures, specifically in extreme volume regimes compared to the regular DSCLS model

A comprehensive survey on cooperative intersection management for heterogeneous connected vehicles

Nowadays, with the advancement of technology, world is trending toward high mobility and dynamics. In this context, intersection management (IM) as one of the most crucial elements of the transportation sector demands high attention. Today, road entities including infrastructures, vulnerable road users (VRUs) such as motorcycles, moped, scooters, pedestrians, bicycles, and other types of vehicles such as trucks, buses, cars, emergency vehicles, and railway vehicles like trains or trams are able to communicate cooperatively using vehicle-to-everything (V2X) communications and provide traffic safety, efficiency, infotainment and ecological improvements. In this paper, we take into account different types of intersections in terms of signalized, semi-autonomous (hybrid) and autonomous intersections and conduct a comprehensive survey on various intersection management methods for heterogeneous connected vehicles (CVs). We consider heterogeneous classes of vehicles such as road and rail vehicles as well as VRUs including bicycles, scooters and motorcycles. All kinds of intersection goals, modeling, coordination architectures, scheduling policies are thoroughly discussed. Signalized and semi-autonomous intersections are assessed with respect to these parameters. We especially focus on autonomous intersection management (AIM) and categorize this section based on four major goals involving safety, efficiency, infotainment and environment. Each intersection goal provides an in-depth investigation on the corresponding literature from the aforementioned perspectives. Moreover, robustness and resiliency of IM are explored from diverse points of view encompassing sensors, information management and sharing, planning universal scheme, heterogeneous collaboration, vehicle classification, quality measurement, external factors, intersection types, localization faults, communication anomalies and channel optimization, synchronization, vehicle dynamics and model mismatch, model uncertainties, recovery, security and privacy

Zero-Shot Autonomous Vehicle Policy Transfer: From Simulation to Real-World via Adversarial Learning

In this article, we demonstrate a zero-shot transfer of an autonomous driving policy from simulation to University of Delaware's scaled smart city with adversarial multi-agent reinforcement learning, in which an adversary attempts to decrease the net reward by perturbing both the inputs and outputs of the autonomous vehicles during training. We train the autonomous vehicles to coordinate with each other while crossing a roundabout in the presence of an adversary in simulation. The adversarial policy successfully reproduces the simulated behavior and incidentally outperforms, in terms of travel time, both a human-driving baseline and adversary-free trained policies. Finally, we demonstrate that the addition of adversarial training considerably improves the performance \eat{stability and robustness} of the policies after transfer to the real world compared to Gaussian noise injection.Comment: 6 pages, 4 figure

Smart Vehicles, Technologies and Main Applications in Vehicular Ad hoc Networks

Vehicular Ad hoc NETworks (VANETs) belong to a subcategory of traditional Mobile Ad hoc NETworks (MANETs). The main feature of VANETs is that mobile nodes are vehicles endowed with sophisticated “on-board” equipments, traveling on constrained paths (i.e., roads and lanes), and communicating each other for message exchange via Vehicle-to-Vehicle (V2V) communication protocols, as well as between vehicles and fixed road-side Access Points (i.e., wireless and cellular network infrastructure), in case of Vehicle-to-Infrastructure (V2I) communications. In this chapter we will introduce the state-of-the-art of recent technologies used in vehicular networks, specifically for smart vehicles, which require novel functionalities such as data communications, accurate positioning, control and decision monitoring

Ecological Control and Coordination of Connected and Automated PHEVs at Roundabouts under Uncertainty

During the last decade, comprehensive research efforts were concentrated on autonomous driving. Annually, many car accidents happen as a result of human faults. Extreme traffic congestion prolongs commute time, increase air pollution and cause other transportation inefficiencies. Consequently, using advanced technologies to make vehicles less dependent on human drivers enable more efficient use of time for passengers and decrease car accidents. Connectivity between vehicles and automation provides a spectacular opportunity to improve traffic flow, safety, and efficiency. There are different main active research subjects under the broad domain of autonomous driving, one of them is intersection control for connected and automated vehicles (CAVs) which can be categorized into centralized and decentralized approaches. The environmental and strict regulatory demands require automotive companies to reduce Carbon Dioxide emissions by investing more in Electric Vehicles (EVs) and Plug-in Hybrid Electric vehicles (PHEVs). A PHEV equipped with connectivity and automation looks more interesting to automobile consumers since they can have advantages of both fewer emissions and enhanced abilities. Since the powertrain of PHEVs consists of different sources of power, advanced control techniques such as Model Predictive Control (MPC) is needed. Coordination of vehicles at roundabouts is a demanding problem especially by knowing that the chance of both lateral and longitudinal collision exists. To this end, first, we proposed a centralized nonlinear MPC-based controller to adhere to calculated priorities for connected and automated PHEVs (CA-PHEVs). We further continued this research by proposing an approach for solving nonlinear multi-objective optimal control problem of decentralized coordination of CA-PHEVs at roundabouts with consideration of fuel economy. It was found that the proposed controller can calculate priority based on a navigation function and provide a safe gap between vehicles. A novel priority calculation logic based on optimal control is proposed as well and its performance is compared with the navigation function approach. In addition to the decentralized control approach, we considered a more realistic robust tube-based nonlinear MPC decentralized approach to solve this problem in the presence of uncertainties. We used simulations to test the controller and a Toyota Prius PHEV high-fidelity model is used in this thesis for simulations. Simulation results show that the addition of robustness, and energy economy to performance index can improve the fuel consumption of the vehicle. One of the major concerns in designing a controller for automotive applications is real-time implementation. The results of hardware-in-the-loop experiments show the real-time implementation of the controllers

3D-in-2D Displays for ATC.

This paper reports on the efforts and accomplishments of the 3D-in-2D Displays for ATC project at the end of Year 1. We describe the invention of 10 novel 3D/2D visualisations that were mostly implemented in the Augmented Reality ARToolkit. These prototype implementations of visualisation and interaction elements can be viewed on the accompanying video. We have identified six candidate design concepts which we will further research and develop. These designs correspond with the early feasibility studies stage of maturity as defined by the NASA Technology Readiness Level framework. We developed the Combination Display Framework from a review of the literature, and used it for analysing display designs in terms of display technique used and how they are combined. The insights we gained from this framework then guided our inventions and the human-centered innovation process we use to iteratively invent. Our designs are based on an understanding of user work practices. We also developed a simple ATC simulator that we used for rapid experimentation and evaluation of design ideas. We expect that if this project continues, the effort in Year 2 and 3 will be focus on maturing the concepts and employment in a operational laboratory settings

Development and evaluation of cooperative intersection management algorithm under connected vehicles environment

Recent technological advancements in the automotive and transportation industry established a firm foundation for development and implementation of various automated and connected vehicle (C/AV) solutions around the globe. Wireless communication technologies such as the dedicated short-range communication (DSRC) protocol are enabling instantaneous information exchange between vehicles and infrastructure. Such information exchange produces tremendous benefits with the possibility to automate conventional traffic streams and enhance existing signal control strategies. While many promising studies in the area of signal control under connected vehicle (CV) environment have been introduced, they mainly offer solutions designed to operate a single isolated intersection or they require high technology penetration rates to operate in a safe and efficient manner. Applications designed to operate on a signalized corridor with imperfect market penetration rates of connected vehicle technology represent a bridge between conventional traffic control paradigm and fully automated corridors of the future. Assuming utilization of the connected vehicle environment and vehicle to infrastructure (V2I) technology, all vehicular and signal-related parameters are known and can be shared with the control agent to control automated vehicles while improving the mobility of the signalized corridor. This dissertation research introduces an intersection management strategy for a corridor with automated vehicles utilizing vehicular trajectory-driven optimization method. The Trajectory-driven Optimization for Automated Driving (TOAD) provides an optimal trajectory for automated vehicles while maintaining safe and uninterrupted movement of general traffic, consisting of regular unequipped vehicles. Signal status parameters such as cycle length and splits are continuously captured. At the same time, vehicles share their position information with the control agent. Both inputs are then used by the control algorithm to provide optimal trajectories for automated vehicles, resulting in the reduction of vehicle delay along the signalized corridor with fixed-time signal control. To determine the most efficient trajectory for automated vehicles, an evolutionary-based optimization is utilized. Influence of the prevailing traffic conditions is incorporated into a control algorithm using conventional data collection methods such as loop detectors, Bluetooth or Wi-Fi sensors to collect vehicle counts, travel time on corridor segments, and spot speed. Moreover, a short-term, artificial intelligence prediction model is developed to achieve reasonable deployment of data collection devices and provide accurate vehicle delay predictions producing realistic and highly-efficient longitudinal vehicle trajectories. The concept evaluation through microsimulation reveals significant mobility improvements compared to contemporary corridor management approach. The results for selected test-bed locations on signalized arterials in New Jersey reveals up to 19.5 % reduction in overall corridor travel time depending on different market penetration and lane configuration scenario. It is also discovered that operational scenarios with a possibility of utilizing reserved lanes for movement of automated vehicles further increases the effectiveness of the proposed algorithm. In addition, the proposed control algorithm is feasible under imperfect C/AV market penetrations showing mobility improvements even with low market penetration rates