Vision-Based Lane-Changing Behavior Detection Using Deep Residual Neural Network

Accurate lane localization and lane change detection are crucial in advanced driver assistance systems and autonomous driving systems for safer and more efficient trajectory planning. Conventional localization devices such as Global Positioning System only provide road-level resolution for car navigation, which is incompetent to assist in lane-level decision making. The state of art technique for lane localization is to use Light Detection and Ranging sensors to correct the global localization error and achieve centimeter-level accuracy, but the real-time implementation and popularization for LiDAR is still limited by its computational burden and current cost. As a cost-effective alternative, vision-based lane change detection has been highly regarded for affordable autonomous vehicles to support lane-level localization. A deep learning-based computer vision system is developed to detect the lane change behavior using the images captured by a front-view camera mounted on the vehicle and data from the inertial measurement unit for highway driving. Testing results on real-world driving data have shown that the proposed method is robust with real-time working ability and could achieve around 87% lane change detection accuracy. Compared to the average human reaction to visual stimuli, the proposed computer vision system works 9 times faster, which makes it capable of helping make life-saving decisions in time

The State-of-the-art of Coordinated Ramp Control with Mixed Traffic Conditions

Ramp metering, a traditional traffic control strategy for conventional vehicles, has been widely deployed around the world since the 1960s. On the other hand, the last decade has witnessed significant advances in connected and automated vehicle (CAV) technology and its great potential for improving safety, mobility and environmental sustainability. Therefore, a large amount of research has been conducted on cooperative ramp merging for CAVs only. However, it is expected that the phase of mixed traffic, namely the coexistence of both human-driven vehicles and CAVs, would last for a long time. Since there is little research on the system-wide ramp control with mixed traffic conditions, the paper aims to close this gap by proposing an innovative system architecture and reviewing the state-of-the-art studies on the key components of the proposed system. These components include traffic state estimation, ramp metering, driving behavior modeling, and coordination of CAVs. All reviewed literature plot an extensive landscape for the proposed system-wide coordinated ramp control with mixed traffic conditions.Comment: 8 pages, 1 figure, IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE - ITSC 201

Development of Eco-Friendly Ramp Control for Connected and Automated Electric Vehicles

With on-board sensors such as camera, radar, and Lidar, connected and automated vehicles (CAVs) can sense the surrounding environment and be driven autonomously and safely by themselves without colliding into other objects on the road. CAVs are also able to communicate with each other and roadside infrastructure via vehicle-to-vehicle and vehicle-to-infrastructure communications, respectively, sharing information on the vehicles’ states, signal phase and timing (SPaT) information, enabling CAVs to make decisions in a collaborative manner. As a typical scenario, ramp control attracts wide attention due to the concerns of safety and mobility in the merging area. In particular, if the line-of-the-sight is blocked (because of grade separation), then neither mainline vehicles nor on-ramp vehicles may well adapt their own dynamics to perform smoothed merging maneuvers. This may lead to speed fluctuations or even shockwave propagating upstream traffic along the corridor, thus potentially increasing the traffic delays and excessive energy consumption. In this project, the research team proposed a hierarchical ramp merging system that not only allowed microscopic cooperative maneuvers for connected and automated electric vehicles on the ramp to merge into mainline traffic flow, but also had controllability of ramp inflow rate, which enabled macroscopic traffic flow control. A centralized optimal control-based approach was proposed to both smooth the merging flow and improve the system-wide mobility of the network. Linear quadratic trackers in both finite horizon and receding horizon forms were developed to solve the optimization problem in terms of path planning and sequence determination, and a microscopic electric vehicle (EV) energy consumption model was applied to estimate the energy consumption. The simulation results confirmed that under the regulated inflow rate, the proposed system was able to avoid potential traffic congestion and improve the mobility (in terms of average speed) as much as 115%, compared to the conventional ramp metering and the ramp without any control approach. Interestingly, for EVs (connected and automated EVs in this study), the improved mobility may not necessarily result in the reduction of energy consumption. The “sweet spot” of average speed ranges from 27–34 mph for the EV models in this study.View the NCST Project Webpag

Cooperative Traffic Control Solution for Vehicle Transition from Autonomous to Manual Mode exploiting Cellular Vehicle-to-Everything (C-V2X) Technology

Nowadays, automated vehicles represent a promising technology to face the stringent requirements for safety and traffic efficiency in the automotive environment. Driving responsibilities will be gradually addressed to the machine, and the role of human pilots will be progressively reduced to passengers. The interaction between passengers and the automated system will create different risks that have not been considered in the past. In particular, the transition between autonomous and manual mode is understood as a risky situation. During the transition, the driver manifests driving irregularities and loss of situation awareness that may endanger himself and other participants on the road. Hence, the vehicle transitioning needs a higher quantity of space around it to be considered safe. However, no effective solution has been developed yet. This thesis aims to design a cooperative traffic control solution that will manage the movements of the group of vehicles to increase the free space around the one transitioning. It will exploit another tool that will play a fundamental role in the future of the automotive industry: connected vehicles technology. C-V2X technology will create a medium for vehicles to exchange information and cooperate. A controller managing the cooperation between vehicles has been developed to help a smooth and safe vehicle repositioning. The controller will be positioned in a centralized computing facility and it will communicate with all the vehicles. The controller defines rules to move vehicles together and enlarge the free space around the vehicle transitioning without collisions. The rules are modeled by a spring-mass-damper system, that can be exploited to control the longitudinal behavior of automated vehicles. In particular, the spring-mass-damper system can manage smooth migration between vehicle dispositions without oscillations. A computer simulation is used to test the performance of the proposed traffic control system. The simulation environment is constituted by three main components: traffic flow, controller and communication network. It has been tested with the software VEINS, which provides interaction between a network simulator (OMNeT++) and a traffic simulator (SUMO). The traffic flow represents the interactions between vehicles. The controller analyzes the data and sends control messages to all vehicles. The communication network will share the data concerning vehicles’ position and speed and control messages. The proposed cooperative vehicle control system demonstrated to reduce the risks of the transition with the smooth motion of vehicles. The controller is able to achieve the safety requirements without reducing the level of comfortability of vehicles’ passengers

A Rule Based Control Algorithm for on-Ramp Merge With Connected and Automated Vehicles

One of the designs for future highways with the flow of Connected Automated Vehicles (CAVs) cars will be a dedicated lane for the CAVs to form platoons and travel with higher speeds and lower headways. The connectivity will enable the formation of platoons of CAVs traveling beside non-platoon lanes. The advent of connectivity between vehicles and the infrastructure will enable advanced control strategies ̶ improving the performance of the traffic ̶ to be incorporated in the traffic system. The merge area in a multilane highway with CAVs is one of the sections which can be enhanced by the operation of a control system. In this research, a model is developed for investigating the effects of a Rule Based control strategy yielding a more efficient and systematic method for the vehicles joining the highway mainlines comprised of platoon and non-platoon lanes. The actions tested for assisting the merge process included deceleration in the mainlines and lane change to join a platoon in the platoon lane. The model directs every CAV entering a multi-lane highway from an on-ramp, to the rightmost lane of the highway based on the appropriate action which is selected according to the traffic demand conditions and location of the on-ramp vehicle. To account for car following behavior, the vehicles in the platoon lanes are assumed to have a simplified CACC (cooperative adaptive cruise control) and those in the non-platoon lanes the IDM+ car-following model. The IDM+ car following model is modified with additional controls to incorporate the current technologies of Advanced Driver Assistant Systems (ADAS). The results of this study showed that the proposed car following model can increase the throughput of the non-platoon lane from approximately 2000 vehicle per hour (vph) to 3400 vph while the platoon lanes each had an average throughput of 3500 vph. The merge model enabled higher merging throughput for the merge area compared to current day conditions and displayed the potential for improved traffic performance in a connected environment comprised of platoon and non-platoon lanes. The results of this research will help in the design and development of advanced systems for controlling on-ramp merge sections in the future with CAVs

Multi-Agent Reinforcement Learning for Connected and Automated Vehicles Control: Recent Advancements and Future Prospects

Connected and automated vehicles (CAVs) have emerged as a potential solution to the future challenges of developing safe, efficient, and eco-friendly transportation systems. However, CAV control presents significant challenges, given the complexity of interconnectivity and coordination required among the vehicles. To address this, multi-agent reinforcement learning (MARL), with its notable advancements in addressing complex problems in autonomous driving, robotics, and human-vehicle interaction, has emerged as a promising tool for enhancing the capabilities of CAVs. However, there is a notable absence of current reviews on the state-of-the-art MARL algorithms in the context of CAVs. Therefore, this paper delivers a comprehensive review of the application of MARL techniques within the field of CAV control. The paper begins by introducing MARL, followed by a detailed explanation of its unique advantages in addressing complex mobility and traffic scenarios that involve multiple agents. It then presents a comprehensive survey of MARL applications on the extent of control dimensions for CAVs, covering critical and typical scenarios such as platooning control, lane-changing, and unsignalized intersections. In addition, the paper provides a comprehensive review of the prominent simulation platforms used to create reliable environments for training in MARL. Lastly, the paper examines the current challenges associated with deploying MARL within CAV control and outlines potential solutions that can effectively overcome these issues. Through this review, the study highlights the tremendous potential of MARL to enhance the performance and collaboration of CAV control in terms of safety, travel efficiency, and economy