A Real Time Hand Gesture Recognition System Based on DFT and SVM

[[abstract]]Vision based band gesture recognition provides a more nature and powerful means for human-computer interaction. A fast detection process of hand gesture and an effective feature extraction process are presented. The proposed a hand gesture recognition algorithm comprises four main steps. First use Cam-shift algorithm to track skin color after closing process. Second, in order to extract feature, we use BEA to extract the boundary of the hand. Third, the benefits of Fourier descriptor are invariance to the starting point of the boundary, deformation, and rotation, and therefore transform the starting point of the boundary by Fourier transformation. Finally, outline feature for the nonlinear non-separable type of data was classified by using SVM. Experimental results showed the accuracy is 93.4% in average and demonstrated the feasibility of proposed system.[[incitationindex]]EI[[booktype]]電子版[[booktype]]紙

A New Re-synchronization Method based Multi-modal Fusion for Automatic Continuous Cued Speech Recognition

Cued Speech (CS) is an augmented lip reading complemented by hand coding, and it is very helpful to the deaf people. Automatic CS recognition can help communications between the deaf people and others. Due to the asynchronous nature of lips and hand movements, fusion of them in automatic CS recognition is a challenging problem. In this work, we propose a novel re-synchronization procedure for multi-modal fusion, which aligns the hand features with lips feature. It is realized by delaying hand position and hand shape with their optimal hand preceding time which is derived by investigating the temporal organizations of hand position and hand shape movements in CS. This re-synchronization procedure is incorporated into a practical continuous CS recognition system that combines convolutional neural network (CNN) with multi-stream hidden markov model (MSHMM). A significant improvement of about 4.6% has been achieved retaining 76.6% CS phoneme recognition correctness compared with the state-of-the-art architecture (72.04%), which did not take into account the asynchrony issue of multi-modal fusion in CS. To our knowledge, this is the first work to tackle the asynchronous multi-modal fusion in the automatic continuous CS recognition

Cued Speech Gesture Recognition: A First Prototype Based on Early Reduction

International audienceCued Speech is a specific linguistic code for hearing-impaired people. It is based on both lip reading and manual gestures. In the context of THIMP (Telephony for the Hearing-IMpaired Project), we work on automatic cued speech translation. In this paper, we only address the problem of automatic cued speech manual gesture recognition. Such a gesture recognition issue is really common from a theoretical point of view, but we approach it with respect to its particularities in order to derive an original method. This method is essentially built around a bioinspired method called early reduction. Prior to a complete analysis of each image of a sequence, the early reduction process automatically extracts a restricted number of key images which summarize the whole sequence. Only the key images are studied from a temporal point of view with lighter computation than the complete sequenc

Software Interface for Intelligent Household

Import 04/07/2011Práce se zabývá návrhem vhodného softwaru pro systém ovládání spotřebičů v domácnosti s pouţitím embedded zařízení. Projekt je navrţen tak, aby co nejvíc ulehčil ţivot fyzicky postiţeným lidem. Cílem je návrh a implementace řešení, které by bylo levné, robustní a rozšiřitelné. Tato diplomová práce navazuje na práci Bc. Patrika Dubce, který navrhnul pro dané řešení hardware. V této práci je pak softwarová analýza projektu, návrh prezentační vrstvy a logické vrstvy. Práce je zakončena nasazení a vyhodnocením uţivatelské spokojenosti.The paper describes the design of suitable software for controlling home appliances using embedded devices. The project is designed to make life much easier for physically disabled people. The aim is to design and implement a solution that would be cheap, robust and scalable. This thesis builds on the work of Patrick Bachelor Dubeč, who designed the hardware for the solution. In this thesis, we work with the software project analysis, design of presentation layer and logic layer. The work ends with the deployment and evaluation of user satisfaction.460 - Katedra informatikyvelmi dobř

Cued Speech hand gestures recognition tool

International audienceAutomatic real-time translation of gestured languages for hearing-impaired would be a major advance on disabled integration path. In this paper, we present a demonstrator on Cued Speech hand gesture recognition. Cued Speech is a specific visual coding that comple-ments oral languages lip-reading. Its nature provides a sim-ple gestures set which is likely to be automatically and relia-bly recognized in rather little constraint conditions. A first PC-demonstrator illustrates the recognition proc-ess