Building a sign language corpus for use in machine translation

In recent years data-driven methods of machine translation (MT) have overtaken rule-based approaches as the predominant means of automatically translating between languages. A pre-requisite for such an approach is a parallel corpus of the source and target languages. Technological developments in sign language (SL) capturing, analysis and processing tools now mean that SL corpora are becoming increasingly available. With transcription and language analysis tools being mainly designed and used for linguistic purposes, we describe the process of creating a multimedia parallel corpus specifically for the purposes of English to Irish Sign Language (ISL) MT. As part of our larger project on localisation, our research is focussed on developing assistive technology for patients with limited English in the domain of healthcare. Focussing on the first point of contact a patient has with a GP’s office, the medical secretary, we sought to develop a corpus from the dialogue between the two parties when scheduling an appointment. Throughout the development process we have created one parallel corpus in six different modalities from this initial dialogue. In this paper we discuss the multi-stage process of the development of this parallel corpus as individual and interdependent entities, both for our own MT purposes and their usefulness in the wider MT and SL research domains

Reading The Silences Within Critical Feminist Theory

This paper reviews the literature produced on gender and critical literacy, particularly research which has drawn on Kristeva's (1986) three tier model of women's work to inform critical feminist literacy curriculum. It examines the strengths and limitations (silences) in this literature, and then proposes an alternative reading of Kristeva which draws on the work of postcolonial theorists. A postcolonial interpretation of Kristeva's (1986) theory of how the sign or representation of `woman' is constructed enables an analysis of the `difference' within the category `woman' not only the relational `difference' symbolically constructed between `man' and `woman'. Kristeva (1986) proposes that in the space of the postmodern nation, such as Australia, symbolic representation in the form of the sign of `woman' is constituted in and through three temporal relations. Kristeva's three temporal relations can be described as: (1) Monumental time (eternity), (2) Cyclic time, and (3) Linear or cursive time. From this perspective, the present of women's time (monumental, cyclical and linear) is a zone of representational instability. That is, the representation of women in and through the sign `woman' becomes the site of continual challenge and reconstruction. It is from this instability of cultural signification that the literary canon comes to be articulated as a dialectic of various temporalities - modern, colonial, postcolonial, feminist, post feminist, poststructural feminism(s), `native', traditional - that cannot be a knowledge that is stablized in enunciation. In this time, `woman' does not signify the female body as an a priori historical presence, a discursive object; but a discursive subject constructed in the performance of the narrative

Directional adposition use in English, Swedish and Finnish

Directional adpositions such as to the left of describe where a Figure is in relation to a Ground. English and Swedish directional adpositions refer to the location of a Figure in relation to a Ground, whether both are static or in motion. In contrast, the Finnish directional adpositions edellä (in front of) and jäljessä (behind) solely describe the location of a moving Figure in relation to a moving Ground (Nikanne, 2003). When using directional adpositions, a frame of reference must be assumed for interpreting the meaning of directional adpositions. For example, the meaning of to the left of in English can be based on a relative (speaker or listener based) reference frame or an intrinsic (object based) reference frame (Levinson, 1996). When a Figure and a Ground are both in motion, it is possible for a Figure to be described as being behind or in front of the Ground, even if neither have intrinsic features. As shown by Walker (in preparation), there are good reasons to assume that in the latter case a motion based reference frame is involved. This means that if Finnish speakers would use edellä (in front of) and jäljessä (behind) more frequently in situations where both the Figure and Ground are in motion, a difference in reference frame use between Finnish on one hand and English and Swedish on the other could be expected. We asked native English, Swedish and Finnish speakers’ to select adpositions from a language specific list to describe the location of a Figure relative to a Ground when both were shown to be moving on a computer screen. We were interested in any differences between Finnish, English and Swedish speakers. All languages showed a predominant use of directional spatial adpositions referring to the lexical concepts TO THE LEFT OF, TO THE RIGHT OF, ABOVE and BELOW. There were no differences between the languages in directional adpositions use or reference frame use, including reference frame use based on motion. We conclude that despite differences in the grammars of the languages involved, and potential differences in reference frame system use, the three languages investigated encode Figure location in relation to Ground location in a similar way when both are in motion. Levinson, S. C. (1996). Frames of reference and Molyneux’s question: Crosslingiuistic evidence. In P. Bloom, M.A. Peterson, L. Nadel & M.F. Garrett (Eds.) Language and Space (pp.109-170). Massachusetts: MIT Press. Nikanne, U. (2003). How Finnish postpositions see the axis system. In E. van der Zee & J. Slack (Eds.), Representing direction in language and space. Oxford, UK: Oxford University Press. Walker, C. (in preparation). Motion encoding in language, the use of spatial locatives in a motion context. Unpublished doctoral dissertation, University of Lincoln, Lincoln. United Kingdo

An example-based approach to translating sign language

Users of sign languages are often forced to use a language in which they have reduced competence simply because documentation in their preferred format is not available. While some research exists on translating between natural and sign languages, we present here what we believe to be the first attempt to tackle this problem using an example-based (EBMT) approach. Having obtained a set of English–Dutch Sign Language examples, we employ an approach to EBMT using the ‘Marker Hypothesis’ (Green, 1979), analogous to the successful system of (Way & Gough, 2003), (Gough & Way, 2004a) and (Gough & Way, 2004b). In a set of experiments, we show that encouragingly good translation quality may be obtained using such an approach

ATLAS: A flexible and extensible architecture for linguistic annotation

We describe a formal model for annotating linguistic artifacts, from which we derive an application programming interface (API) to a suite of tools for manipulating these annotations. The abstract logical model provides for a range of storage formats and promotes the reuse of tools that interact through this API. We focus first on ``Annotation Graphs,'' a graph model for annotations on linear signals (such as text and speech) indexed by intervals, for which efficient database storage and querying techniques are applicable. We note how a wide range of existing annotated corpora can be mapped to this annotation graph model. This model is then generalized to encompass a wider variety of linguistic ``signals,'' including both naturally occuring phenomena (as recorded in images, video, multi-modal interactions, etc.), as well as the derived resources that are increasingly important to the engineering of natural language processing systems (such as word lists, dictionaries, aligned bilingual corpora, etc.). We conclude with a review of the current efforts towards implementing key pieces of this architecture.Comment: 8 pages, 9 figure

“... to grasp the native's point of view ...” — A plea for a holistic documentation of the Trobriand Islanders' language, culture and cognition

In his famous introduction to his monograph “Argonauts of the Western Pacific” Bronislaw Malinowski (1922: 24f.) points out that a “collection of ethnographic statements, characteristic narratives, typical utterances, items of folk-lore and magical formulae has to be given as a corpus inscriptionum, as documents of native mentality”. This is one of the prerequisites to “grasp the native's point of view, his relation to life, to realize his vision of his world”. Malinowski managed to document a “Corpus Inscriptionum Agriculturae Quriviniensis” in his second volume of “Coral Gardens and their Magic” (1935 Vol II: 79-342). But he himself did not manage to come up with a holistic corpus inscriptionum for the Trobriand Islanders. One of the main aims I have been pursuing in my research on the Trobriand Islanders' language, culture, and cognition has been to fill this ethnolinguistic niche. In this essay, I report what I had to do to carry out this complex and ambitious project, what forms and kinds of linguistic and cultural competence I had to acquire, and how I planned my data collection during 16 long- and short-term field trips to the Trobriand Islands between 1982 and 2012. The paper ends with a critical assessment of my Trobriand endeavor