The design of a generic signing avatar animation system

Thesis (MScIng)--University of Stellenbosch, 2006.ENGLISH ABSTRACT: We designed a generic avatar animator for use in sign language related projects. The animator is capable of animating any given avatar that is compliant with the H-Anim standard for humanoid animation. The system was designed with the South African Sign Language Machine Translation (SASL-MT) project in mind, but can easily be adapted to other sign language projects due to its generic design. An avatar that is capable of accurately performing sign language gestures is a special kind of avatar and is referred to as a signing avatar. In this thesis we investigate the special characteristics of signing avatars and address the issue of finding a generic design for the animation of such an avatar.AFRIKAANSE OPSOMMING: Ons het ’n generiese karakteranimasiestelsel ontwikkel vir gebruik in gebaretaal verwante projekte. Die animasiestelsel het die vermo¨e om enige karaktermodel wat met die H-Anim standaard versoenbaar is, te animeer. Die animasiestelsel is ontwerp met die oog op gebruik in die South African Sign Language Machine Translation (SASL-MT) projek, maar kan maklik aangepas word vir ander gebaretaalprojekte te danke aan die generiese ontwerp. ’n Karaktermodel wat in staat is om gebare akkuraat te maak is ’n spesiale tipe karaktermodel wat bekend staan as ’n gebaretaal avatar (Engels : signing avatar). In hierdie tesis ondersoek ons die spesiale eienskappe van ’n gebaretaal avatar en beskou die soektog na ’n generiese ontwerp vir die animering van so ’n karaktermodel

Virtual human modelling and animation for real-time sign language visualisation

>Magister Scientiae - MScThis thesis investigates the modelling and animation of virtual humans for real-time sign language visualisation. Sign languages are fully developed natural languages used by Deaf communities all over the world. These languages are communicated in a visual-gestural modality by the use of manual and non-manual gestures and are completely di erent from spoken languages. Manual gestures include the use of hand shapes, hand movements, hand locations and orientations of the palm in space. Non-manual gestures include the use of facial expressions, eye-gazes, head and upper body movements. Both manual and nonmanual gestures must be performed for sign languages to be correctly understood and interpreted. To e ectively visualise sign languages, a virtual human system must have models of adequate quality and be able to perform both manual and non-manual gesture animations in real-time. Our goal was to develop a methodology and establish an open framework by using various standards and open technologies to model and animate virtual humans of adequate quality to e ectively visualise sign languages. This open framework is to be used in a Machine Translation system that translates from a verbal language such as English to any sign language. Standards and technologies we employed include H-Anim, MakeHuman, Blender, Python and SignWriting. We found it necessary to adapt and extend H-Anim to e ectively visualise sign languages. The adaptations and extensions we made to H-Anim include imposing joint rotational limits, developing exible hands and the addition of facial bones based on the MPEG-4 Facial De nition Parameters facial feature points for facial animation. By using these standards and technologies, we found that we could circumvent a few di cult problems, such as: modelling high quality virtual humans; adapting and extending H-Anim; creating a sign language animation action vocabulary; blending between animations in an action vocabulary; sharing animation action data between our virtual humans; and e ectively visualising South African Sign Language.South Afric

Paths to politeness: Exploring how professional interpreters develop an understanding of politeness norms in British Sign Language and English

BerlinRachel Mapson - ORCID 0000-0003-0400-6576 https://orcid.org/0000-0003-0400-6576This chapter explores how bimodal bilinguals acquire and develop their awareness of politeness in British Sign Language (BSL). Drawing on data collected through semi-structured group discussions involving eight highly experienced BSL/English interpreters the chapter focuses on how the participants learned about linguistic politeness in BSL and how this contrasts with their acquisition of English politeness norms. The data indicate how different paths to the acquisition of linguistic politeness might affect understanding of it. The experience of interpreters from Deaf family backgrounds, who acquired BSL as their first language, contrasts with those who learned BSL formally, as an additional language, as adults. Although both groups of participants acquired knowledge of politeness in similar arenas, the languages they were exposed to in these environments differed and intra-group experiences were heterogeneous. The data highlight the difficulty of learning politeness norms in an L2, with participants reporting a lack of explicit focus on politeness in BSL classes and interpreter training programmes. This may reflect the lack of literature on politeness in signed language, and on BSL in particular. Both groups of interpreters reported experiences involving the negative transfer of L1 politeness norms. Data indicate that the different modalities of BSL and English may facilitate transferability rather than restrict it, with one affordance being the ‘blended transfer’ of non-manual politeness features associated with BSL which may be performed simultaneously with spoken English.caslpub4749pu

Enabling sign language instruction with technology: the case of developing a computerized learning tool for Ghanaian Sign Language (GhSL)

Thesis submitted to the Department of Business Administration, Ashesi University College, in partial fulfillment of Bachelor of Science degree in Business Administration, April 2012Ghanaian Sign Language (GhSL) is a developing language in the sense that not much is known about it within or outside Ghana. The fact that GhSL is closely-related to American Sign Language (ASL) means that, knowledge of ASL can help one communicate with the Ghanaian Deaf. However, there exist Ghanaian-specific signs that are not available in ASL. This paper presents the Ghanaian Interactive Sign Language (GISL) Tutor, the first computer-based tutor for GhSL designed to teach GhSL vocabulary of Ghanaian-specific signs. Ghanaians who tested the tutor during its iteration stage expressed that they want more Ghanaian signs to be available on the tutor. The purpose of the GISL Tutor is therefore to make Ghanaian-specific signs accessible to anyone interested in learning GhSL for reception and expression

The Role of Emotional and Facial Expression in Synthesised Sign Language Avatars

This thesis explores the role that underlying emotional facial expressions might have in regards to understandability in sign language avatars. Focusing specifically on Irish Sign Language (ISL), we examine the Deaf community’s requirement for a visual-gestural language as well as some linguistic attributes of ISL which we consider fundamental to this research. Unlike spoken language, visual-gestural languages such as ISL have no standard written representation. Given this, we compare current methods of written representation for signed languages as we consider: which, if any, is the most suitable transcription method for the medical receptionist dialogue corpus. A growing body of work is emerging from the field of sign language avatar synthesis. These works are now at a point where they can benefit greatly from introducing methods currently used in the field of humanoid animation and, more specifically, the application of morphs to represent facial expression. The hypothesis underpinning this research is: augmenting an existing avatar (eSIGN) with various combinations of the 7 widely accepted universal emotions identified by Ekman (1999) to deliver underlying facial expressions, will make that avatar more human-like. This research accepts as true that this is a factor in improving usability and understandability for ISL users. Using human evaluation methods (Huenerfauth, et al., 2008) the research compares an augmented set of avatar utterances against a baseline set with regards to 2 key areas: comprehension and naturalness of facial configuration. We outline our approach to the evaluation including our choice of ISL participants, interview environment, and evaluation methodology. Remarkably, the results of this manual evaluation show that there was very little difference between the comprehension scores of the baseline avatars and those augmented withEFEs. However, after comparing the comprehension results for the synthetic human avatar “Anna” against the caricature type avatar “Luna”, the synthetic human avatar Anna was the clear winner. The qualitative feedback allowed us an insight into why comprehension scores were not higher in each avatar and we feel that this feedback will be invaluable to the research community in the future development of sign language avatars. Other questions asked in the evaluation focused on sign language avatar technology in a more general manner. Significantly, participant feedback in regard to these questions indicates a rise in the level of literacy amongst Deaf adults as a result of mobile technology

Content-prioritised video coding for British Sign Language communication.

Video communication of British Sign Language (BSL) is important for remote interpersonal communication and for the equal provision of services for deaf people. However, the use of video telephony and video conferencing applications for BSL communication is limited by inadequate video quality. BSL is a highly structured, linguistically complete, natural language system that expresses vocabulary and grammar visually and spatially using a complex combination of facial expressions (such as eyebrow movements, eye blinks and mouth/lip shapes), hand gestures, body movements and finger-spelling that change in space and time. Accurate natural BSL communication places specific demands on visual media applications which must compress video image data for efficient transmission. Current video compression schemes apply methods to reduce statistical redundancy and perceptual irrelevance in video image data based on a general model of Human Visual System (HVS) sensitivities. This thesis presents novel video image coding methods developed to achieve the conflicting requirements for high image quality and efficient coding. Novel methods of prioritising visually important video image content for optimised video coding are developed to exploit the HVS spatial and temporal response mechanisms of BSL users (determined by Eye Movement Tracking) and the characteristics of BSL video image content. The methods implement an accurate model of HVS foveation, applied in the spatial and temporal domains, at the pre-processing stage of a current standard-based system (H.264). Comparison of the performance of the developed and standard coding systems, using methods of video quality evaluation developed for this thesis, demonstrates improved perceived quality at low bit rates. BSL users, broadcasters and service providers benefit from the perception of high quality video over a range of available transmission bandwidths. The research community benefits from a new approach to video coding optimisation and better understanding of the communication needs of deaf people

A Descriptive Grammar of Morphosyntactic Constructions in Ugandan Sign Language (UgSL)

The Ugandan Deaf Community, consisting of approximately 25,000 sign language users, has seen significant developments in its recent history. Government recognition of sign language, establishment of schools for the deaf, and the beginnings of research into Ugandan Sign Language (UgSL) have been important milestones. While Deaf Ugandans are entering university level education for the first time, a number of challenges to the community remain. The aim of this thesis is to investigate the linguistic structures of UgSL in order to produce a description of the language’s morphosyntax. There is a close relationship between word (or sign) properties and syntactic expressions, so UgSL is described here in terms of its morphosyntactic constructions, rather than a differentiation between morphological and syntactic features (cf. Croft 2001; Wilkinson 2013:260). While a substantial number of such descriptions exist for languages outside of Africa, this thesis is the first attempt at describing the morphosyntax of an African sign language. Many African sign languages are severely under-documented, and some are endangered. This study uses an inductive approach and a corpus-based methodology, examining how UgSL signers construct utterances of morphosyntactic complexity. The thesis is in three parts: part I is an introduction and overview of UgSL and also provides the theoretical and methodological background; part II provides a preliminary survey of UgSL grammar to provide a sider context for subsequent chapters; and part III is a detailed survey of five morphosyntactic domains of UgSL. The author is a native Deaf user of UgSL and a member of the Ugandan Deaf Community, as well as being fluent in several other sign languages and participating in international communities of Deaf people

Sign language varieties of Indonesia: A linguistic and sociolinguistic investigation.

Until now there has been no robust (socio)linguistic documentation of urban sign language varieties in Indonesia, and given the size of the Indonesian archipelago, it might be expected that these varieties are very different from each other. In this kind of situation, sign linguists have often applied lexicostatistical methods, but two such studies in Indonesia have recently produced contradictory results. Instead, this investigation uses conceptual and methodological approaches from linguistic typology and Variationist Sociolinguistics, contextualised by a sociohistorical account of the Indonesian sign community. The grammatical domains of completion and negation are analysed using a corpus of spontaneous data from two urban centres, Solo and Makassar. Four completive particles occur in both varieties, alongside clitics and the expression of completion through mouthings alone. The realisations of two variables, one lexical and one grammatical, are predicted by factors including the syntactic and functional properties of the variant, and younger Solonese signers are found to favour completive clitics. The reasons for intra-individual persistence and variation are also discussed. Negation is expressed through particles, clitics, suppletives, and the simultaneous mouthing of predicates with negative particles. These paradigmatic variants occur in both varieties, with small differences in the sets of particles and suppletives for each variety. The realisations of four variables are found to be conditioned by factors including predicate type, sub-function, and the use of constructed dialogue. The gender of the signer is found to correlate with the syntactic order of negative and predicate; younger Solonese signers are also found to favour negative clitics and suppletives. The similarities revealed between the Solo and Makassar varieties are discussed with reference to the history of contact between sign sub-communities across the archipelago. The investigation concludes with a discussion of factors that favour and disfavour the convergence of urban sign language varieties