Coordination and Analysis of Connected and Autonomous Vehicles in Freeway On-Ramp Merging Areas

Freeway on-ramps are typical bottlenecks in the freeway network, where the merging maneuvers of ramp vehicles impose frequent disturbances on the traffic flow and cause negative impacts on traffic safety and efficiency. The emerging Connected and Autonomous Vehicles (CAVs) hold the potential for regulating the behaviors of each individual vehicle and are expected to substantially improve the traffic operation at freeway on-ramps. The aim of this research is to explore the possibilities of optimally facilitating freeway on-ramp merging operation through the coordination of CAVs, and to discuss the impacts of CAVs on the traffic performance at on-ramp merging.In view of the existing research efforts and gaps in the field of CAV on-ramp merging operation, a novel CAV merging coordination strategy is proposed by creating large gaps on the main road and directing the ramp vehicles into the created gaps in the form of platoon. The combination of gap creation and platoon merging jointly facilitates the mainline and ramp traffic and targets at the optimal performance at the traffic flow level. The coordination consists of three components: (1) mainline vehicles proactively decelerate to create large merging gaps; (2) ramp vehicles form platoons before entering the main road; (3) the gaps created on the main road and the platoons formed on the ramp are coordinated with each other in terms of size, speed, and arrival time. The coordination is analytically formulated as an optimization problem, incorporating the macroscopic and microscopic traffic flow models. The model uses traffic state parameters as inputs and determines the optimal coordination plan adaptive to real-time traffic conditions.The impacts of CAV coordination strategies on traffic efficiency are investigated through illustrative case studies conducted on microscopic traffic simulation platforms. The results show substantial improvements in merging efficiency, throughput, and traffic flow stability. In addition, the safety benefits of CAVs in the absence of specially designed cooperation strategies are investigated to reveal the CAV’s ability to eliminate critical human factors in the ramp merging process

Deep Reinforcement Learning Approach for Lagrangian Control: Improving Freeway Bottleneck Throughput Via Variable Speed Limit

Connected vehicles (CVs) will enable new applications to improve traffic flow. The focus of this dissertation is to investigate how reinforcement learning (RL) control for the variable speed limit (VSL) through CVs can be generalized to improve traffic flow at different freeway bottlenecks. Three different bottlenecks are investigated: A sag curve, where the gradient changes from negative to positive values causes a reduction in the roadway capacity and congestion; a lane reduction, where three lanes merge to two lanes and cause congestion, and finally, an on-ramp, where increase in demand on a multilane freeway causes capacity drop. An RL algorithm is developed and implemented in a simulation environment for controlling a VSL in the upstream to manipulate the inflow of vehicles to the bottleneck on a freeway to minimize delays and increase the throughput. CVs are assumed to receive VSL messages through Infrastructure-to-Vehicle (I2V) communications technologies. Asynchronous Advantage Actor-Critic (A3C) algorithms are developed for each bottleneck to determine optimal VSL policies. Through these RL control algorithms, the speed of CVs are manipulated in the upstream of the bottleneck to avoid or minimize congestion. Various market penetration rates for CVs are considered in the simulations. It is demonstrated that the RL algorithm is able to adapt to stochastic arrivals of CVs and achieve significant improvements even at low market penetration rates of CVs, and the RL algorithm is able to find solution for all three bottlenecks. The results also show that the RL-based solutions outperform feedback-control-based solutions

A Corridor Level GIS-Based Decision Support Model to Evaluate Truck Diversion Strategies

Increased urbanization, population growth, and economic development within the U.S. have led to an increased demand for freight travel to meet the needs of individuals and businesses. Consequently, freight transportation has grown significantly over time and has expanded beyond the capacity of infrastructure, which has caused new challenges in many regions. To maintain quality of life and enhance public safety, more effort must be dedicated to investigating and planning in the area of traffic management and to assessing the impact of trucks on highway systems. Traffic diversion is an effective strategy to reduce the impact of incident-induced congestion, but alternative routes for truck traffic must be carefully selected based on a route\u27s restrictions on the size and weight of commercial vehicles, route\u27s operational characteristics, and safety considerations. This study presents a diversion decision methodology that integrates the network analyst tool package of the ArcGIS platform with regression analysis to determine optimal alternative routes for trucks under nonrecurrent delay conditions. When an incident occurs on a limited-access road, the diversion algorithm can be initiated. The algorithm is embedded with an incident clearance prediction model that estimates travel time on the current route based on a number of factors including incident severity; capacity reduction; number of lanes closed; type of incident; traffic characteristics; temporal characteristics; responders; and reporting, response, and clearance times. If travel time is expected to increase because of the event, a truck alternative route selection module is activated. This module evaluates available routes for diversion based on predefined criteria including roadway characteristics (number of lanes and lane width), heavy vehicle restrictions (vertical clearance, bridge efficiency ranking, bridge design load, and span limitations), traffic conditions (level of service and speed limit), and neighborhood impact (proximity to schools and hospitals and the intensity of commercial and residential development). If any available alternative routes reduce travel time, the trucks are provided with a diversion strategy. The proposed decision-making tool can assist transportation planners in making truck diversion decisions based on observed conditions. The results of a simulation and a feasibility analysis indicate that the tool can improve the safety and efficiency of the overall traffic network

Changes in freeway level of service with the introduction of autonomous and connected vehicles

Connected and Autonomous vehicles (CAVs) have risen in popularity in recent years and are expected to bring with them many changes including driver safety, expansion of ridership from people currently unable to drive, and more travel miles from long trip commuters. From an engineering standpoint, CAVs are expected to bring with them an increase in highway capacities because of their ability to react faster than human drivers and produce shorter time headways between successive vehicles. CAVs are not anticipated to dominate the traffic stream until another 20 to 40 years and are expected to be introduced gradually into the transportation system. Shorter time headways suggest that freeways may be positively affected by the new technology and new procedures will need to be established in order to analyze highway capacities in the future. The 6th Edition Highway Capacity Manual is one of the main sources that is used by the engineering community to estimate capacities of freeway segments. This study documents a new simulation tool to discover the capacity implications for a basic freeway segment of different CAV market penetrations and reduced time headwaysCivil, Architectural, and Environmental Engineerin

강화학습을 활용한 고속도로 가변제한속도 및 램프미터링 전략 개발

학위논문(석사) -- 서울대학교대학원 : 공과대학 건설환경공학부, 2022.2. 김동규.Recently, to resolve societal problems caused by traffic congestion, traffic control strategies have been developed to operate freeways efficiently. The representative strategies to effectively manage freeway flow are variable speed limit (VSL) control and the coordinated ramp metering (RM) strategy. This paper aims to develop a dynamic VSL and RM control algorithm to obtain efficient traffic flow on freeways using deep reinforcement learning (DRL). The traffic control strategies applying the deep deterministic policy gradient (DDPG) algorithm are tested through traffic simulation in the freeway section with multiple VSL and RM controls. The results show that implementing the strategy alleviates the congestion in the on-ramp section and shifts to the overall sections. For most cases, the VSL or RM strategy improves the overall flow rates by reducing the density and improving the average speed of the vehicles. However, VSL or RM control may not be appropriate, particularly at the high level of traffic flow. It is required to introduce the selective application of the integrated control strategies according to the level of traffic flow. It is found that the integrated strategy can be used when including the relationship between each state detector in multiple VSL sections and lanes by applying the adjacency matrix in the neural network layer. The result of this study implies the effectiveness of DRL-based VSL and the RM strategy and the importance of the spatial correlation between the state detectors.최근에는 교통혼잡으로 인한 사회적 문제를 해결하기 위해 고속도로를 효율적으로 운영하기 위한 교통통제 전략이 다양하게 개발되고 있다. 고속도로 교통류를 효과적으로 관리하기 위한 대표적인 전략으로는 차로별 제한속도를 다르게 적용하는 가변 속도 제한(VSL) 제어와 진입 램프에서 신호를 통해 차량을 통제하는 램프 미터링(RM) 전략 등이 있다. 본 연구의 목표는 심층 강화 학습(deep reinforcement learning)을 활용하여 고속도로의 효율적인 교통 흐름을 얻기 위해 동적 VSL 및 RM 제어 알고리즘을 개발하는 것이다. 고속도로의 여러 VSL과 RM 구간에서 시뮬레이션을 통해 심층 강화학습 알고리즘 중 하나인 deep deterministic policy gradient (DDPG) 알고리즘을 적용한 교통류 제어 전략을 검증한다. 실험 결과, 강화학습 기반 VSL 또는 RM 전략을 적용하는 것이 램프 진입로 구간의 혼잡을 완화하고 나아가 전체 구간의 혼잡을 줄이는 것으로 나타났다. 대부분의 경우 VSL이나 RM 전략은 본선과 진입로 구간의 밀도를 줄이고 차량의 평균 통행 속도를 증가시켜 전체 교통 흐름을 향상시킨다. VSL 또는 RM 전략들은 높은 수준의 교통류에서 적절하지 않을 수 있어 교통류 수준에 따른 전략의 선택적 도입이 필요하다. 또한 검지기간 지리적 거리와 관련한 인접 행렬을 포함하는 graph neural network layer이 여러 지점 검지기의 공간적 상관 관계를 감지하는 데 이용될 수 있다. 본 연구의 결과는 강화학습 기반 VSL과 RM 전략 도입의 필요성과 지점 검지기 간의 공간적 상관관계의 중요성을 반영하는 전략 도입의 효과를 시사한다.Chapter 1. Introduction 1 Chapter 2. Literature Review 4 Chapter 3. Methods 8 3.1. Study Area and the Collection of Data 8 3.2. Simulation Framework 11 3.3. Trip Generation and Route Choice 13 3.4. Deep Deterministic Policy Gradient (DDPG) Algorithm 14 3.5. Graph Convolution Network (GCN) Layer 17 3.6. RL Formulation 18 Chapter 4. Results 20 4.1. VSL and RM 20 4.2. Efficiency according to the flow rate 28 4.3. Effectiveness of the GCN Layer 33 Chapter 5. Conclusion 34 Bibliography 37 Abstract in Korean 44석

The state of the art of cooperative and connected autonomous vehicles from the future mobility management perspective:a systematic review

© 2022 The Authors. Published by MDPI. This is an open access article available under a Creative Commons licence. The published version can be accessed at the following link on the publisher’s website: https://doi.org/10.3390/futuretransp2030032Cooperative and connected autonomous vehicles (CCAVs) are considered to be a promising solution for addressing congestion and other operational deficiencies, as part of a holistic future mobility management framework. As a result, a significant number of studies have recently been published on this topic. From the perspective of future mobility management, this review paper discusses three themes, which are traffic management, network performance, and mobility management, including congestion, and incident detection using the PRISMA methodology. Three databases were considered for this study, and peer-reviewed primary studies were selected that were published within the last 10 years in the English language, focusing on CCAV in the context of the future transportation and mobility management perspective. For synthesis and interpretation, like-for-like comparisons were made among studies; it was found that extensive research-supported information is required to ensure a smooth transition from conventional vehicles to the CCAVs regime, to achieve the projected traffic and environmental benefits. Research investigations are ongoing to optimize these benefits and associated goals via the setting of different models and simulations. The tools and technologies for the testing and simulation of CCAV were found to have limited capacity. Following the review of the current state-of-the-art, recommendations for future research have been discussed. The most notable is the need for large-scale simulations to understand the impact of CCAVs beyond corridor-based and small-scale networks, the need for understanding the interactions between the drivers of CCAVs and traffic management centers, and the need to assess the technological transition, as far as infrastructure systems are concerned, that is necessary for the progressive penetration of CCAVs into traffic streams.This research was funded by European Union’s Horizon 2020 research and innovation program, grant number 955317.Published onlin