11,844 research outputs found
Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Research
Simulation is an essential tool to develop and benchmark autonomous vehicle
planning software in a safe and cost-effective manner. However, realistic
simulation requires accurate modeling of nuanced and complex multi-agent
interactive behaviors. To address these challenges, we introduce Waymax, a new
data-driven simulator for autonomous driving in multi-agent scenes, designed
for large-scale simulation and testing. Waymax uses publicly-released,
real-world driving data (e.g., the Waymo Open Motion Dataset) to initialize or
play back a diverse set of multi-agent simulated scenarios. It runs entirely on
hardware accelerators such as TPUs/GPUs and supports in-graph simulation for
training, making it suitable for modern large-scale, distributed machine
learning workflows. To support online training and evaluation, Waymax includes
several learned and hard-coded behavior models that allow for realistic
interaction within simulation. To supplement Waymax, we benchmark a suite of
popular imitation and reinforcement learning algorithms with ablation studies
on different design decisions, where we highlight the effectiveness of routes
as guidance for planning agents and the ability of RL to overfit against
simulated agents
ScenarioNet: Open-Source Platform for Large-Scale Traffic Scenario Simulation and Modeling
Large-scale driving datasets such as Waymo Open Dataset and nuScenes
substantially accelerate autonomous driving research, especially for perception
tasks such as 3D detection and trajectory forecasting. Since the driving logs
in these datasets contain HD maps and detailed object annotations which
accurately reflect the real-world complexity of traffic behaviors, we can
harvest a massive number of complex traffic scenarios and recreate their
digital twins in simulation. Compared to the hand-crafted scenarios often used
in existing simulators, data-driven scenarios collected from the real world can
facilitate many research opportunities in machine learning and autonomous
driving. In this work, we present ScenarioNet, an open-source platform for
large-scale traffic scenario modeling and simulation. ScenarioNet defines a
unified scenario description format and collects a large-scale repository of
real-world traffic scenarios from the heterogeneous data in various driving
datasets including Waymo, nuScenes, Lyft L5, and nuPlan datasets. These
scenarios can be further replayed and interacted with in multiple views from
Bird-Eye-View layout to realistic 3D rendering in MetaDrive simulator. This
provides a benchmark for evaluating the safety of autonomous driving stacks in
simulation before their real-world deployment. We further demonstrate the
strengths of ScenarioNet on large-scale scenario generation, imitation
learning, and reinforcement learning in both single-agent and multi-agent
settings. Code, demo videos, and website are available at
https://metadriverse.github.io/scenarionet
Long-term Microscopic Traffic Simulation with History-Masked Multi-agent Imitation Learning
A realistic long-term microscopic traffic simulator is necessary for
understanding how microscopic changes affect traffic patterns at a larger
scale. Traditional simulators that model human driving behavior with heuristic
rules often fail to achieve accurate simulations due to real-world traffic
complexity. To overcome this challenge, researchers have turned to neural
networks, which are trained through imitation learning from human driver
demonstrations. However, existing learning-based microscopic simulators often
fail to generate stable long-term simulations due to the \textit{covariate
shift} issue. To address this, we propose a history-masked multi-agent
imitation learning method that removes all vehicles' historical trajectory
information and applies perturbation to their current positions during
learning. We apply our approach specifically to the urban traffic simulation
problem and evaluate it on the real-world large-scale pNEUMA dataset, achieving
better short-term microscopic and long-term macroscopic similarity to
real-world data than state-of-the-art baselines.Comment: updat
An Agent-based Modelling Framework for Driving Policy Learning in Connected and Autonomous Vehicles
Due to the complexity of the natural world, a programmer cannot foresee all
possible situations, a connected and autonomous vehicle (CAV) will face during
its operation, and hence, CAVs will need to learn to make decisions
autonomously. Due to the sensing of its surroundings and information exchanged
with other vehicles and road infrastructure, a CAV will have access to large
amounts of useful data. While different control algorithms have been proposed
for CAVs, the benefits brought about by connectedness of autonomous vehicles to
other vehicles and to the infrastructure, and its implications on policy
learning has not been investigated in literature. This paper investigates a
data driven driving policy learning framework through an agent-based modelling
approaches. The contributions of the paper are two-fold. A dynamic programming
framework is proposed for in-vehicle policy learning with and without
connectivity to neighboring vehicles. The simulation results indicate that
while a CAV can learn to make autonomous decisions, vehicle-to-vehicle (V2V)
communication of information improves this capability. Furthermore, to overcome
the limitations of sensing in a CAV, the paper proposes a novel concept for
infrastructure-led policy learning and communication with autonomous vehicles.
In infrastructure-led policy learning, road-side infrastructure senses and
captures successful vehicle maneuvers and learns an optimal policy from those
temporal sequences, and when a vehicle approaches the road-side unit, the
policy is communicated to the CAV. Deep-imitation learning methodology is
proposed to develop such an infrastructure-led policy learning framework
- …