5,843 research outputs found
Crowd behavioural simulation via multi-agent reinforcement learning
A dissertation submitted to the Faculty of Science, University of the Witwatersrand, Johannesburg, in fulfilment of requirements for the degree of Master of Science. Johannesburg, 2015.Crowd simulation can be thought of as a group of entities interacting with one another. Traditionally,
an animated entity would require precise scripts so that it can function in a virtual
environment autonomously. Previous studies on crowd simulation have been used in real world
applications but these methods are not learning agents and are therefore unable to adapt and
change their behaviours. The state of the art crowd simulation methods include flow based, particle
and strategy based models. A reinforcement learning agent could learn how to navigate,
behave and interact in an environment without explicit design. Then a group of reinforcement
learning agents should be able to act in a way that simulates a crowd. This thesis investigates
the believability of crowd behavioural simulation via three multi-agent reinforcement learning
methods. The methods are Q-learning in multi-agent markov decision processes model, joint
state action Q-learning and joint state value iteration algorithm. The three learning methods are
able to produce believable and realistic crowd behaviours
Role Playing Learning for Socially Concomitant Mobile Robot Navigation
In this paper, we present the Role Playing Learning (RPL) scheme for a mobile
robot to navigate socially with its human companion in populated environments.
Neural networks (NN) are constructed to parameterize a stochastic policy that
directly maps sensory data collected by the robot to its velocity outputs,
while respecting a set of social norms. An efficient simulative learning
environment is built with maps and pedestrians trajectories collected from a
number of real-world crowd data sets. In each learning iteration, a robot
equipped with the NN policy is created virtually in the learning environment to
play itself as a companied pedestrian and navigate towards a goal in a socially
concomitant manner. Thus, we call this process Role Playing Learning, which is
formulated under a reinforcement learning (RL) framework. The NN policy is
optimized end-to-end using Trust Region Policy Optimization (TRPO), with
consideration of the imperfectness of robot's sensor measurements. Simulative
and experimental results are provided to demonstrate the efficacy and
superiority of our method
- …