Applying teeline shorthand using leap motion controller

A hand gesture recognition program was developed to recognize users’ Teeline shorthand gestures as English letters, words and sentences using Leap Motion Controller. The program is intended to provide a novel way for the users to interact with electronics by waving gestures in the air to input texts instead of using keyboards. In the recognition mode, the dynamic time warping algorithm is used to compare the similarities between different templates and gesture inputs and summarize the recognition results; in the edit process, users are able to build their own gestures to customize the commands. A series of experiment results show that the program can achieve a considerable recognition accuracy, and it has consistent performance in face of different user groups.Master of Science (MSc) in Computational Science

Hand gesture recognition with jointly calibrated Leap Motion and depth sensor

Novel 3D acquisition devices like depth cameras and the Leap Motion have recently reached the market. Depth cameras allow to obtain a complete 3D description of the framed scene while the Leap Motion sensor is a device explicitly targeted for hand gesture recognition and provides only a limited set of relevant points. This paper shows how to jointly exploit the two types of sensors for accurate gesture recognition. An ad-hoc solution for the joint calibration of the two devices is firstly presented. Then a set of novel feature descriptors is introduced both for the Leap Motion and for depth data. Various schemes based on the distances of the hand samples from the centroid, on the curvature of the hand contour and on the convex hull of the hand shape are employed and the use of Leap Motion data to aid feature extraction is also considered. The proposed feature sets are fed to two different classifiers, one based on multi-class SVMs and one exploiting Random Forests. Different feature selection algorithms have also been tested in order to reduce the complexity of the approach. Experimental results show that a very high accuracy can be obtained from the proposed method. The current implementation is also able to run in real-time

A Sign Language to Text Converter Using Leap Motion

This paper presents a prototype that can convert sign language into text. A Leap Motion controller was utilised as an interface for hand motion tracking without the need of wearing any external instruments. Three recognition techniques were employed to measure the performance of the prototype, namely the Geometric Template Matching, Artificial Neural Network and Cross Correlation. 26 alphabets from American Sign Language were chosen for training and testing the proposed prototype. The experimental results showed that Geometric Template Matching achieved the highest recognition accuracy compared to the other recognition techniques

Contactless medium scale industrial robot collaboration

The growing cost of High-Value/Mix and Low Volume (HMLV) industries like Aerospace is heavily based on industrial robots and manual operations done by operators [1]. Robots are excellent in repeatability by HMLV industries need changes with every single product. On the other hand human workforce is good at variability and intelligence but cost a lot as production rate is not comparable to robots and machines. There are flexible systems which have been specifically introduced for this type of industry FLEXA is one of them. But still there is need of collaboration between human and robot to get the flexible and cost effective solution [2]. A comprehensive survey has been conducted specifically on the issue of Human Robot collaboration [3] which laid out many advantages of this approach includes flexibility, cost-effectiveness and use of robot as intelligent assistant. There are several attempts have been made for Human Robot Collaboration for HMLV industry and Chen et al. attempt is one of them