Socially Aware Motion Planning with Deep Reinforcement Learning

For robotic vehicles to navigate safely and efficiently in pedestrian-rich environments, it is important to model subtle human behaviors and navigation rules (e.g., passing on the right). However, while instinctive to humans, socially compliant navigation is still difficult to quantify due to the stochasticity in people's behaviors. Existing works are mostly focused on using feature-matching techniques to describe and imitate human paths, but often do not generalize well since the feature values can vary from person to person, and even run to run. This work notes that while it is challenging to directly specify the details of what to do (precise mechanisms of human navigation), it is straightforward to specify what not to do (violations of social norms). Specifically, using deep reinforcement learning, this work develops a time-efficient navigation policy that respects common social norms. The proposed method is shown to enable fully autonomous navigation of a robotic vehicle moving at human walking speed in an environment with many pedestrians.Comment: 8 page

Motion control for autonomous tugger vehicles in dynamic factory floors shared with human operators

We present a motion controller that generates collision free trajectories for autonomous Tugger vehicles operating in dynamic factory environments, where human operators may coexist. The controller is formalized as a dynamic system of path velocity and heading direction, whose vector fields change as sensory information varies. By design the parameters are tuned so that the control variables are close to an attractor of the resultant dynamics most of the time. This contributes to the overall asymptotically stability of the system and makes it robust against perturbations. We present several experiments, in a real factory environment, that highlight different innovative features of the navigation system - flexible and safe solutions for human-aware autonomous navigation in dynamic and cluttered environments. This means, besides generating online collision free trajectories between via points, the system detects the presence of humans, interact with them showing awareness of their presence, and generate adequate motor behavior.This work has been supported by National Funds through FCT -Fundacao para a Ciencia e Tecnologia within the Project Scope: UID/CEC/00319/2019, and by European Structural and Investment Funds in the FEDER component, through the Operational Competitiveness and Internationalization Programme (COMPETE 2020) [Project n degrees 002814; Funding Reference: POCI-01-0247-FEDER-002814]