ANGELICA : choice of output modality in an embodied agent

The ANGELICA project addresses the problem of modality choice in information presentation by embodied, humanlike agents. The output modalities available to such agents include both language and various nonverbal signals such as pointing and gesturing. For each piece of information to be presented by the agent it must be decided whether it should be expressed using language, a nonverbal signal, or both. In the ANGELICA project a model of the different factors influencing this choice will be developed and integrated in a natural language generation system. The application domain is the presentation of route descriptions by an embodied agent in a 3D environment. Evaluation and testing form an integral part of the project. In particular, we will investigate the effect of different modality choices on the effectiveness and naturalness of the generated presentations and on the user's perception of the agent's personality

The production of prosodic focus and contour in dialogue

Computer programs designed to converse with humans in natural language provide a framework against which to test supra-sentential theories of language production and interpretation. This thesis seeks to flesh out, in terms of a computer model, two basic assumptions concerning prosody-that speakers use intonation to convey intention, or attitude, and that prosodic prominence serves to convey conceptual prommence. A model of an information-providing agent in is proposed, based on an analysis of a corpus of spontaneous dialogues. This uses an architecture of communicating processes, which perform interpretation, application-specific planning, repair, and the production of output. Dialogue acts are then defined as feature bundles corresponding to significant events. A corpus of read dialogues is analysed in terms of these features, and using conventional intonational labelling. Correlations between the two are examined. Prosodic prominence is examined at three levels. At the level of surface encoding, re-use of substrings and structural parallelism can reduce processing for the speaker, and the listener. At the level of conceptual planning, similar benefits exist, given that speakers and listeners assume a common discourse model wherever possible. At these levels use is made of a short-term buffer of recent forms. A speaker may additionally use contrastive prominence to draw the listener's attention to disparities. Finally, at the level of intentions, a speaker wish to highlight certain information, regardless of accessibility. Prosodic focus is represented relationally, rather than via a simple binary-valued feature. This has the advantage of facilitating the mapping between levels; it also renders straightforward the notion of focus as the product of a number of potentially conflicting influences. Those parts of the theory concerned with discourse representation, language generation, and prosodic focus have been implemented as part of the Sundial dialogue system. In this system, discoursal and pragmatic decisions affecting prosody are converted to annotations on a text string, for realisation by a rule-based synthesizer

The influence of a native english speaking environment on the pronunciation of efl brazilian speakers :: a study of the suprasegmentals /

Tese (Doutorado) - Universidade Federal de Santa Catarina, Centro de Comunicação e Expressão

Information structure and the referential status of linguistic expression : workshop as part of the 23th annual meetings of the Deutsche Gesellschaft für Sprachwissenschaft in Leipzig, Leipzig, February 28 - March 2, 2001

This volume comprises papers that were given at the workshop Information Structure and the Referential Status of Linguistic Expressions, which we organized during the Deutsche Gesellschaft für Sprachwissenschaft (DGfS) Conference in Leipzig in February 2001. At this workshop we discussed the connection between information structure and the referential interpretation of linguistic expressions, a topic mostly neglected in current linguistics research. One common aim of the papers is to find out to what extent the focus-background as well as the topic-comment structuring determine the referential interpretation of simple arguments like definite and indefinite NPs on the one hand and sentences on the other

FOUND IN SPACE: A CROSS-LINGUISTIC ANALYSIS OF SECOND LANGUAGE LEARNERS IN ENGLISH MAP TASK PERFORMANCE

Understanding the relationship between first and second language use in the area of spatial language has broader implications for our understanding of language learning and consequences for the construction of bilingual assessment instruments for second language learners. This study shows that observing and interpreting the task of map drawing and the related behavior of explaining maps can be a way to explore the linguistic emergence of the conceptualization of spatial language (at a moment of simultaneous and synchronized incarnation). Altogether, 50 dyads (pairs) participated in the New Mexico Map Task Project; the project included native speakers of English, Russian, Japanese, Navajo, and Spanish. In an examination of how the grammatical constructions used for spatial descriptions in a speaker\u27s first language carry over into the usage of this speaker\u27s second language, new observations include the intra-subject comparison of dyadic map task performances. Each non-native English-speaking dyad participates in two map task performances: one in their native language and one in their second language, English. Evidence was generated through morphosyntactic, phonological, and pragmatic analyses performed on the sound files of the transcripts. This evidence confirms the connection between the participants\u27 productions of tokens of selected landmark names both in their native language and their second language. Combining the results of linguistic analyses with educational assessment frameworks predicts the development of an instrument for use with immigrant and refugee students from areas of conflict

Stochastic suprasegmentals: relationships between redundancy, prosodic structure and care of articulation in spontaneous speech

Within spontaneous speech there are wide variations in the articulation of the same word by the same speaker. This paper explores two related factors which influence variation in articulation, prosodic structure and redundancy. We argue that the constraint of producing robust communication while efficiently expending articulatory effort leads to an inverse relationship between language redundancy and care of articulation. The inverse relationship improves robustness by spreading the information more evenly across the speech signal leading to a smoother signal redundancy profile. We argue that prosodic prominence is a linguistic means of achieving smooth signal redundancy. Prosodic prominence increases care of articulation and coincides with unpredictable sections of speech. By doing so, prosodic prominence leads to a smoother signal redundancy. Results confirm the strong relationship between prosodic prominence and care of articulation as well as an inverse relationship between langu..

Analysing British sign language through the lens of systemic functional linguistics

Approaches to understanding language via Systemic Functional Linguistics (SFL) have resulted in a compendium of literature focussing on language as a ‘social semiotic.’ One such area of this literature comprises systemic functional grammars: descriptions of various languages and the way in which they create meaning. Despite the application of SFL to numerous languages and the creation of systemic functional grammars, a common thread is that of modality: SFL has been applied to numerous languages in the spoken and written modalities, but not in any detail to languages in the visual-spatial modality.My thesis presents an initial attempt at analysing British Sign Language (BSL) through the systemic functional lens. Calling on various theories and methods found in sign linguistics and SFL, I perform an analysis on a sample of BSL clauses (N = 1,375) from three perspectives: how BSL manages exchanges of communication (the interpersonal metafunction); how BSL encodes aspects of experience and reality (the experiential metafunction); and how BSL may be organised to produce a coherent text with variance in information prominence (the textual metafunction). As a result, I present three sets of system networks based on these three metafunctions, complete with realisation statements and examples.This thesis provides considerable impact. From an academic perspective, this is the first in-depth systemic functional description of a language in the visual-spatial modality, providing insight both into how such languages function, and how analyses of these languages may feed back into those of spoken and written languages. From a social perspective, the BSL system networks can assist language learners of any level as a point of reference in clause construction. Furthermore, intermediate and higher BSL qualifications stipulate knowledge of sign linguistics as a required component, yet these assessments are based on resources that have not been updated in nearly twenty years. As such, the products of this thesis may go towards informing future BSL assessments

An exploration of the rhythm of Malay

In recent years there has been a surge of interest in speech rhythm. However we still lack a clear understanding of the nature of rhythm and rhythmic differences across languages. Various metrics have been proposed as means for measuring rhythm on the phonetic level and making typological comparisons between languages (Ramus et al, 1999; Grabe & Low, 2002; Dellwo, 2006) but the debate is ongoing on the extent to which these metrics capture the rhythmic basis of speech (Arvaniti, 2009; Fletcher, in press). Furthermore, cross linguistic studies of rhythm have covered a relatively small number of languages and research on previously unclassified languages is necessary to fully develop the typology of rhythm. This study examines the rhythmic features of Malay, for which, to date, relatively little work has been carried out on aspects rhythm and timing. The material for the analysis comprised 10 sentences produced by 20 speakers of standard Malay (10 males and 10 females). The recordings were first analysed using rhythm metrics proposed by Ramus et. al (1999) and Grabe & Low (2002). These metrics (∆C, %V, rPVI, nPVI) are based on durational measurements of vocalic and consonantal intervals. The results indicated that Malay clustered with other so-called syllable-timed languages like French and Spanish on the basis of all metrics. However, underlying the overall findings for these metrics there was a large degree of variability in values across speakers and sentences, with some speakers having values in the range typical of stressed-timed languages like English. Further analysis has been carried out in light of Fletcher’s (in press) argument that measurements based on duration do not wholly reflect speech rhythm as there are many other factors that can influence values of consonantal and vocalic intervals, and Arvaniti’s (2009) suggestion that other features of speech should also be considered in description of rhythm to discover what contributes to listeners’ perception of regularity. Spectrographic analysis of the Malay recordings brought to light two parameters that displayed consistency and regularity for all speakers and sentences: the duration of individual vowels and the duration of intervals between intensity minima. This poster presents the results of these investigations and points to connections between the features which seem to be consistently regulated in the timing of Malay connected speech and aspects of Malay phonology. The results are discussed in light of current debate on the descriptions of rhythm

Production, perception and online processing of prominence in the post-focal domain

This dissertation presents a fundamentally new and in-depth investigation of the distribution of prominence in different focal structures in two varieties of Italian (the one spoken in Udine and the one spoken in Bari), by means of the implementation of a categorical analysis with the continuous prosodic parameters related to F0 and periodic energy. Results provide evidence of the fact that prominence in these varieties of Italian is conveyed by both a categorical three-way distinction and a gradual modulation: absence or presence of pitch movement in the distinction between background (post-focal position) and the focal conditions, and a gradual modification of energy and duration. The degree of prominence of words occurring in different focal structures was also investigated in perception. The reportedly different distribution of prominence found in questions for the variety of Italian spoken in Bari is shown to have an influence in the degree of perceived prominence. This influence is found in the comparison between prominence’s ratings of Bari and Udine native speakers, as well as of Bari native speakers and German native speakers, with Italian as L2. Furthermore, the present dissertation tests the real-time processing of the pitch excursion registered in the post-focal region of questions in the Bari variety. Findings confirmed that the fine-grained changes in prominence are processed in real time. Moreover, results indicate that top-down expectations play a crucial role in modulating general cognitive processes. Overall, this thesis supports the view of prosodic prominence as characterised by a bundle of cues, probabilistically distributed in the listener’s perceptual space, which form top-down expectations that play a role both in offline perception and in online processing. Signal-based factors also play a role in perception and online processing, but can however be overridden by expectations