Affordance-map: A map for context-aware path planning

'Context-awareness' could be one of the most desired fundamental abilities that a robot should have when sharing a workspace with humans co-workers. Arguably, a robot with appropriate context-awareness could lead to a better human robot interaction. In this paper, we address the problem of combining contextawareness with robotic path planning. Our approach is based on affordance-map, which involves mapping latent human actions in a given environment by looking at geometric features of the environment. This enables us to learn human context in an given environment without observing real human behaviours which themselves are a non-trivial task to detect. Once learned, affordance-map allows us to assign an affordance cost value for each grid location of the map. These cost maps are later used to develop a context-aware global path planning strategy by using the well known A∗ algorithm. The proposed method was tested in a real office environment and proved our algorithm is capable of moving a robot in a path that minimises the distractions to human co-workers

Learning Social Affordance Grammar from Videos: Transferring Human Interactions to Human-Robot Interactions

In this paper, we present a general framework for learning social affordance grammar as a spatiotemporal AND-OR graph (ST-AOG) from RGB-D videos of human interactions, and transfer the grammar to humanoids to enable a real-time motion inference for human-robot interaction (HRI). Based on Gibbs sampling, our weakly supervised grammar learning can automatically construct a hierarchical representation of an interaction with long-term joint sub-tasks of both agents and short term atomic actions of individual agents. Based on a new RGB-D video dataset with rich instances of human interactions, our experiments of Baxter simulation, human evaluation, and real Baxter test demonstrate that the model learned from limited training data successfully generates human-like behaviors in unseen scenarios and outperforms both baselines.Comment: The 2017 IEEE International Conference on Robotics and Automation (ICRA