4,170 research outputs found
Learning Negotiating Behavior Between Cars in Intersections using Deep Q-Learning
This paper concerns automated vehicles negotiating with other vehicles,
typically human driven, in crossings with the goal to find a decision algorithm
by learning typical behaviors of other vehicles. The vehicle observes distance
and speed of vehicles on the intersecting road and use a policy that adapts its
speed along its pre-defined trajectory to pass the crossing efficiently. Deep
Q-learning is used on simulated traffic with different predefined driver
behaviors and intentions. The results show a policy that is able to cross the
intersection avoiding collision with other vehicles 98% of the time, while at
the same time not being too passive. Moreover, inferring information over time
is important to distinguish between different intentions and is shown by
comparing the collision rate between a Deep Recurrent Q-Network at 0.85% and a
Deep Q-learning at 1.75%.Comment: 6 pages, 7 figures, Accepted to IEEE International Conference on
Intelligent Transportation Systems (ITSC) 201
Learning Negotiating Behavior Between Cars in Intersections using Deep Q-Learning
This paper concerns automated vehicles negotiating with other vehicles, typically human driven, in crossings with the goal to find a decision algorithm by learning typical behaviors of other vehicles. The vehicle observes distance and speed of vehicles on the intersecting road and use a policy that adapts its speed along its pre-defined trajectory to pass the crossing efficiently. Deep Q-learning is used on simulated traffic with different predefined driver behaviors and intentions. The results show a policy that is able to cross the intersection avoiding collision with other vehicles 98% of the time, while at the same time not being too passive. Moreover, inferring information over time is important to distinguish between different intentions and is shown by comparing the collision rate between a Deep Recurrent Q-Network at 0.85% and a Deep Q-learning at 1.75%
Comprehensive Training and Evaluation on Deep Reinforcement Learning for Automated Driving in Various Simulated Driving Maneuvers
Developing and testing automated driving models in the real world might be
challenging and even dangerous, while simulation can help with this, especially
for challenging maneuvers. Deep reinforcement learning (DRL) has the potential
to tackle complex decision-making and controlling tasks through learning and
interacting with the environment, thus it is suitable for developing automated
driving while not being explored in detail yet. This study carried out a
comprehensive study by implementing, evaluating, and comparing the two DRL
algorithms, Deep Q-networks (DQN) and Trust Region Policy Optimization (TRPO),
for training automated driving on the highway-env simulation platform.
Effective and customized reward functions were developed and the implemented
algorithms were evaluated in terms of onlane accuracy (how well the car drives
on the road within the lane), efficiency (how fast the car drives), safety (how
likely the car is to crash into obstacles), and comfort (how much the car makes
jerks, e.g., suddenly accelerates or brakes). Results show that the TRPO-based
models with modified reward functions delivered the best performance in most
cases. Furthermore, to train a uniform driving model that can tackle various
driving maneuvers besides the specific ones, this study expanded the
highway-env and developed an extra customized training environment, namely,
ComplexRoads, integrating various driving maneuvers and multiple road scenarios
together. Models trained on the designed ComplexRoads environment can adapt
well to other driving maneuvers with promising overall performance. Lastly,
several functionalities were added to the highway-env to implement this work.
The codes are open on GitHub at https://github.com/alaineman/drlcarsim-paper.Comment: 6 pages, 3 figures, accepted by the 26th IEEE International
Conference on Intelligent Transportation Systems (ITSC 2023
- …