Gesture in Human-Machine Communication: capture, analysis-synthesis, recognition, semantics

International audienc

Toward an annotation software for video of Sign Language, including image processing tools and signing space modelling

Several French national projects have been achieved last years, allowing linguist and computer scientists working on French Sign Language (FSL) to establish a permanent collaboration. During these projects, several video FSL corpora have been realised. One of the research orientations induced by these projects relates to multi-disciplinary annotation. From the computer scientist s side, the aim is to develop an annotation software integrating different kind of tools based on image processing and 3d modelling that will be used to automatically annotate both lexical and syntactic information. This article presents several of these components. A first version of the annotation software integrating these components is under development. 1

GREFIT: Visual Recognition of Hand Postures

Nölker C, Ritter H. GREFIT: Visual Recognition of Hand Postures. In: Braffort A, Gherbi R, Gibet S, Richardson J, Teil D, eds. Gesture-Based Communication in Human-Computer Interaction: International GestureWorkshop, GW’99. Lecture Notes in Computer Science. Vol 1739. Berlin: Springer; 1999: 61-72.In this paper, we present GREFIT (Gesture REcognition based on FInger Tips) which is able to extract the 3-dimensional hand posture from video images of the human hand. GREFIT uses a two-stage approach to solve this problem. This paper is based on earlier presented results of a system to locate the 2-D positions of the fingertips in images. We now describe the second stage, where the 2-D position information is transformed by an artificial neural net into an estimate of the 3-D configuration of an articulated hand model, which is also used for visualization. This model is designed according to the dimensions and movement possibilities of a natural human hand. The virtual hand imitates the user’s hand to an astonishing accuracy and can track postures from grey scale images at a speed of 10 Hz

TOWARD AN ANNOTATION SOFTWARE FOR VIDEO OF SIGN LANGUAGE, INCLUDING IMAGE PROCESSING TOOLS AND SIGNING SPACE MODELLING

International audienceSeveral French national projects have been achieved last years, allowing linguist and computer scientists working on French Sign Language (FSL) to establish a permanent collaboration. During these projects, several video FSL corpora have been realised. One of the research orientations induced by these projects relates to multidisciplinary annotation. From the computer scientist s side, the aim is to develop an annotation software integrating different kind of tools based on image processing and 3d modelling that will be used to automatically annotate both lexical and syntactic information. This article presents several of these components. A first version of the annotation software integrating these components is under development

The dicta-sign Wiki: Enabling web communication for the deaf

The paper provides a report on the user-centred showcase prototypes of the DICTA-SIGN project (http://www.dictasign.eu/), an FP7-ICT project which ended in January 2012. DICTA-SIGN researched ways to enable communication between Deaf individuals through the development of human-computer interfaces (HCI) for Deaf users, by means of Sign Language. Emphasis is placed on the Sign-Wiki prototype that demonstrates the potential of sign languages to participate in contemporary Web 2.0 applications where user contributions are editable by an entire community and sign language users can benefit from collaborative editing facilities. © 2012 Springer-Verlag