42 research outputs found
Model Predictive Control for Autonomous Driving Based on Time Scaled Collision Cone
In this paper, we present a Model Predictive Control (MPC) framework based on
path velocity decomposition paradigm for autonomous driving. The optimization
underlying the MPC has a two layer structure wherein first, an appropriate path
is computed for the vehicle followed by the computation of optimal forward
velocity along it. The very nature of the proposed path velocity decomposition
allows for seamless compatibility between the two layers of the optimization. A
key feature of the proposed work is that it offloads most of the responsibility
of collision avoidance to velocity optimization layer for which computationally
efficient formulations can be derived. In particular, we extend our previously
developed concept of time scaled collision cone (TSCC) constraints and
formulate the forward velocity optimization layer as a convex quadratic
programming problem. We perform validation on autonomous driving scenarios
wherein proposed MPC repeatedly solves both the optimization layers in receding
horizon manner to compute lane change, overtaking and merging maneuvers among
multiple dynamic obstacles.Comment: 6 page
Safe Multi-Agent Interaction through Robust Control Barrier Functions with Learned Uncertainties
Robots operating in real world settings must navigate and maintain safety while interacting with many heterogeneous agents and obstacles. Multi-Agent Control Barrier Functions (CBF) have emerged as a computationally efficient tool to guarantee safety in multi-agent environments, but they assume perfect knowledge of both the robot dynamics and other agents' dynamics. While knowledge of the robot's dynamics might be reasonably well known, the heterogeneity of agents in real-world environments means there will always be considerable uncertainty in our prediction of other agents' dynamics. This work aims to learn high-confidence bounds for these dynamic uncertainties using Matrix-Variate Gaussian Process models, and incorporates them into a robust multi-agent CBF framework. We transform the resulting min-max robust CBF into a quadratic program, which can be efficiently solved in real time. We verify via simulation results that the nominal multi-agent CBF is often violated during agent interactions, whereas our robust formulation maintains safety with a much higher probability and adapts to learned uncertainties
Towards Optimally Decentralized Multi-Robot Collision Avoidance via Deep Reinforcement Learning
Developing a safe and efficient collision avoidance policy for multiple
robots is challenging in the decentralized scenarios where each robot generate
its paths without observing other robots' states and intents. While other
distributed multi-robot collision avoidance systems exist, they often require
extracting agent-level features to plan a local collision-free action, which
can be computationally prohibitive and not robust. More importantly, in
practice the performance of these methods are much lower than their centralized
counterparts.
We present a decentralized sensor-level collision avoidance policy for
multi-robot systems, which directly maps raw sensor measurements to an agent's
steering commands in terms of movement velocity. As a first step toward
reducing the performance gap between decentralized and centralized methods, we
present a multi-scenario multi-stage training framework to find an optimal
policy which is trained over a large number of robots on rich, complex
environments simultaneously using a policy gradient based reinforcement
learning algorithm. We validate the learned sensor-level collision avoidance
policy in a variety of simulated scenarios with thorough performance
evaluations and show that the final learned policy is able to find time
efficient, collision-free paths for a large-scale robot system. We also
demonstrate that the learned policy can be well generalized to new scenarios
that do not appear in the entire training period, including navigating a
heterogeneous group of robots and a large-scale scenario with 100 robots.
Videos are available at https://sites.google.com/view/drlmac