A kinect-based gesture recognition approach for a natural human robot interface

In this paper, we present a gesture recognition system for the development of a human-robot interaction (HRI) interface. Kinect cameras and the OpenNI framework are used to obtain real-time tracking of a human skeleton. Ten different gestures, performed by different persons, are defined. Quaternions of joint angles are first used as robust and significant features. Next, neural network (NN) classifiers are trained to recognize the different gestures. This work deals with different challenging tasks, such as the real-time implementation of a gesture recognition system and the temporal resolution of gestures. The HRI interface developed in this work includes three Kinect cameras placed at different locations in an indoor environment and an autonomous mobile robot that can be remotely controlled by one operator standing in front of one of the Kinects. Moreover, the system is supplied with a people re-identification module which guarantees that only one person at a time has control of the robot. The system's performance is first validated offline, and then online experiments are carried out, proving the real-time operation of the system as required by a HRI interface

Robust and efficient people detection with 3-D range data using shape matching

Information about the location of a person is a necessity for Human-Robot Interaction (HRI) as it enables the robot to make human aware decisions and facilitates the extraction of further useful information; such as low-level gestures and gaze. This paper presents a robust method for person detection with 3-D range data using shape matching. Projections of the 3-D data onto 2-D planes are exploited to effectively and efficiently represent the data for scene segmentation and shape extraction. Fourier descriptors (FD) are used to describe the shapes and are subsequently classified with a Support Vector Machine (SVM). A database of 25 people was collected and used to test this approach. The results show that the computationally efficient shape features can be used to robustly detect the location of people