Automatic prosodic analysis for computer aided pronunciation teaching

Correct pronunciation of spoken language requires the appropriate modulation of acoustic characteristics of speech to convey linguistic information at a suprasegmental level. Such prosodic modulation is a key aspect of spoken language and is an important component of foreign language learning, for purposes of both comprehension and intelligibility. Computer aided pronunciation teaching involves automatic analysis of the speech of a non-native talker in order to provide a diagnosis of the learner's performance in comparison with the speech of a native talker. This thesis describes research undertaken to automatically analyse the prosodic aspects of speech for computer aided pronunciation teaching. It is necessary to describe the suprasegmental composition of a learner's speech in order to characterise significant deviations from a native-like prosody, and to offer some kind of corrective diagnosis. Phonological theories of prosody aim to describe the suprasegmental composition of speech..

Phonological issues in the production of prosody by francophone and sinophone learners of english as a second language

Un accent de non-natif peut mener à une incompréhension ou à la perception de degrés différents d'accent d'étrangeté. La prosodie, qui est maintenant reconnue comme un élément important de l'impression d'étrangeté, est relativement peu abordée en recherche en acquisition des langues étrangères. Ceci contraste avec l'intérêt grandissant envers la prosodie en tant qu'élément de la langue maternelle. Dans cette thèse, la recherche phonologique est évaluée quant à sa pertinence dans la recherche sur la prosodie des langues étrangères. Deux aspects de la théorie phonologique sont étudiés: la typologie et l'organisation phonologique. Ce choix est justifié par la présomption générale que l'étrangeté prosodique est créée soit par une différence de typologie entre langue maternelle (L1) et langue étrangère (L2) soit par un transfert de traits prosodiques de la L1. La critique de la recherche en typologie phonologique conclut que, à ce stade, aucun modèle de classification prosodique n'est applicable à l'acquisition d'une L2. En particulier, l'étude démontre que certaines typologies, en particulier la théorie de l'isochronie accentuelle/l'isochronie syllabique de Pike, devraient être exclues parce qu'elles entravent les progrès en recherche sur l'acquisition et la production de la prosodie des langues étrangères. Le second aspect de la théorie phonologique étudié dans cette thèse est l'organisation phonologique. La prémisse est que les différences sous-jacentes à l'organisation prosodique plutôt que les différences phonologiques de surface sont transférées de L1 à L2. Les analyses approfondies de l'anglais nord américain, le français et le chinois standard révèlent d'importantes différences phonologiques entre l'anglais nord américain et les deux autres langues. Quatre expériences évaluent certaines de ces différences. La prosodie de l'anglais produite par des locuteurs natifs du français est analysée dans des phrases rythmiquement simples et des phrases rythmiquement plus complexes. Les résultats démontrent que l'accentuation lexicale est moins problématique que l'accentuation prosodique supra-lexicale. En particulier, il est démontré que les montées de fréquence fondamentale (F0) de début et de fin de syntagme accentuel (SA), typiques du français, sont source d'erreur dans la prosodie de l'anglais langue seconde. Il est cependant montré que cette erreur, bien que remarquée par les locuteurs natifs de l'anglais, n'affecte pas la perception de placement d'accentuation par ces derniers. La prosodie de l'anglais produite par des locuteurs natifs du chinois est analysée en termes de transfert de ton et d'alignement de pic de F0. Les résultats indiquent que les locuteurs du chinois utilisent les tons chinois quand ils produisent des tons accentuels de l'anglais; plus spécifiquement, la majorité des locuteurs utilisent le ton 2 (ton montant) quand ils produisent un ton accentuel montant. La dernière expérience révèle que les locuteurs natifs du chinois alignent le ton accentuel avec la syllabe accentuée à laquelle elle correspond de manière plus stricte que les locuteurs natifs de l'anglais nord américain le font. Les résultats de cette thèse génèrent un aperçu de la progression de la performance de la prosodie d'une langue étrangère. Les conclusions comportent des implications sur le contenu pédagogique et le format de l'enseignement de la prononciation. ______________________________________________________________________________ MOTS-CLÉS DE L’AUTEUR : Phonologie, Phonétique, Phonologie prosodique, Prosodie, Rythme, ESL, Français du Québec, Français de France, Chinois

Cross-Linguistic Perception and Learning of Japanese Lexical Prosody by English Listeners

xviii, 216 p. : ill. (some col.)The focus of this dissertation is on how language experience shapes perception of a non-native prosodic contrast. In Tokyo Japanese, fundamental frequency (F0) peak and fall are acoustic cues to lexically contrastive pitch patterns, in which a word may be accented on a particular syllable or unaccented (e.g., tsúru 'a crane', tsurú 'a vine', tsuru 'to fish'). In English, lexical stress is obligatory, and it may be reinforced by F0 in higher-level prosodic groupings. Here I investigate whether English listeners can attend to F0 peaks as well as falls in contrastive pitch patterns and whether training can facilitate the learning of prosodic categories. In a series of categorization and discrimination experiments, where F0 peak and fall were manipulated in one-word utterances, the judgments of prominence by naïve English listeners and native Japanese listeners were compared. The results indicated that while English listeners had phonetic sensitivity to F0 fall in a same-different discrimination task, they could not consistently use the F0 fall to categorize F0 patterns. The effects of F0 peak location and F0 fall on prominence judgments were always larger for Japanese listeners than for English listeners. Furthermore, the interaction between these acoustic cues affected perception of the contrast by Japanese, but not English, listeners. This result suggests that native, but not non-native, listeners have complex and integrated processing of these cues. The training experiment assessed improvement in categorization of Japanese pitch patterns with exposure and feedback. The results suggested that training improved identification of the accented patterns, which also generalized to new words and new contexts. Identification of the unaccented pattern, on the other hand, showed no improvement. Error analysis indicated that native English listeners did not learn to attend specifically to the lack of the F0 fall. To conclude, language experience influences perception of prosodic categories. Although there is some sensitivity to F0 fall in non-native listeners, they rely mostly on F0 peak location in language-like tasks such as categorization of pitch patterns. Learning of new prosodic categories is possible. However, not all categories are learned equally well, which suggests that first language attentional biases affect second language acquisition in the prosodic domain.Committee in charge: Susan Guion Anderson, Chairperson; Melissa A. Redford, Member; Vsevolod Kapatsinki, Member; Kaori Idemaru, Outside Membe

Jeddah Arabic intonation : an autosegmental-metrical approach

IPhD ThesisThis thesis is a theoretical and instrumental investigation of intonation in Jeddah Arabic, an urban Arabic variety spoken in west Saudi Arabia. The study is carried out in an attempt to establish the dialect’s prosodic properties and to widen the scope and volume of the literature on Arabic prosody that would in turn aid in the cross-dialectal comparison of prosodic and intonational patterns. The investigation is carried out in light of the Auto-Segmental Metrical theory of intonation- a theory that has been reported to account for the intonational patterns of many languages. In AM theory, intonation is manifested via prominent F0 behaviour in interaction with phonological structure, hence maintains a close relationship between accent distribution and phonological/metrical structure. This F0 behaviour is examined acoustically through pitch level, range and excursion size, in the form of increased peak height and excursion, pitch compression or absence thereof to mark intonational structure. In addition to pitch, other acoustic correlates such as duration and amplitude are examined as well. The thesis includes the examination of the different tunes, postlexical phrasing, and accent categories (contour shapes) that occur in the dialect. Moreover, and as an integral part of AM analysis, the thesis closely examines both theoretically and acoustically the concepts of tonal alignment and accentuation and information structure in this Arabic dialect. Data for the study were collected from 20 native male and female speakers of Jeddah Arabic. Data were then semiautomatically segmented and manually transcribed using a modified TOBI system for Arabic. It is found that JA speakers rely on both qualitative and quantitative detail to enhance intonationally important material that is conveyed prosodically. The results also point to that JA is a stress-accent language that is although similar to other languages in this group, contributes differently to the general cross-language prosodic variation. The dialect demonstrates prominent pitch accents that faithfully associate and align with stressed syllables and are distributed in two intonational levels above the prosodic word: the intermediate phrase and the intonational phrase. Those two intonational levels are found to be marked by both tonal and non-tonal correlates. Experimental evidence shows that contrary to the typical reported correlates of those prosodic constituents, in JA intermediate phrases boundaries demonstrate longer pre-boundary units than intonational phrases. This non-tonal pattern in intermediate phrase boundaries correlates with later alignment of the tone with respect to the onset of the stressed syllable

Multiple prosodic meanings are conveyed through separate pitch ranges: Evidence from perception of focus and surprise in Mandarin Chinese

F0 variation is a crucial feature in speech prosody, which can convey linguistic information such as focus and paralinguistic meanings such as surprise. How can multiple layers of information be represented with F0 in speech: are they divided into discrete layers of pitch or overlapped without clear divisions? We investigated this question by assessing pitch perception of focus and surprise in Mandarin Chinese. Seventeen native Mandarin listeners rated the strength of focus and surprise conveyed by the same set of synthetically manipulated sentences. An fMRI experiment was conducted to assess neural correlates of the listeners’ perceptual response to the stimuli. The results showed that behaviourally, the perceptual threshold for focus was 3 semitones and that for surprise was 5 semitones above the baseline. Moreover, the pitch range of 5-12 semitones above the baseline signalled both focus and surprise, suggesting a considerable overlap between the two types of prosodic information within this range. The neuroimaging data positively correlated with the variations in behavioural data. Also, a ceiling effect was found as no significant behavioural differences or neural activities were shown after reaching a certain pitch level for the perception of focus and surprise respectively. Together, the results suggest that different layers of prosodic information are represented in F0 through different pitch ranges: paralinguistic information is represented at a pitch range beyond that used by linguistic information. Meanwhile, the representation of paralinguistic information is achieved without obscuring linguistic prosody, thus allowing F0 to represent the two layers of information in parallel

Discourse structure and information structure : interfaces and prosodic realization

In this paper we review the current state of research on the issue of discourse structure (DS) / information structure (IS) interface. This field has received a lot of attention from discourse semanticists and pragmatists, and has made substantial progress in recent years. In this paper we summarize the relevant studies. In addition, we look at the issue of DS/ISinteraction at a different level—that of phonetics. It is known that both information structure and discourse structure can be realized prosodically, but the issue of phonetic interaction between the prosodic devices they employ has hardly ever been discussed in this context. We think that a proper consideration of this aspect of DS/IS-interaction would enrich our understanding of the phenomenon, and hence we formulate some related research-programmatic positions

Right Dislocation and Afterthought in German - Investigations on Multiple Levels

When investigating the right sentence periphery in German, two constructions are encountered that appear to be rather similar at first glance: right dislocation and afterthought. Irrespective of this superficial similarity, right dislocation and afterthought can be distinguished at multiple levels of linguistic description. This thesis aims at providing a more nuanced understanding of right dislocation and afterthought by providing empirical investigations, both qualitative and quantitative in nature, employing analyses of experimentally acquired data as well as corpus analyses. It is shown that right dislocation and afterthought are best defined on the basis of the functions they take in discourse rather than on the basis of their prosodic realisations, and that their functional differences are reflected in a number of linguistic parameters, such as their morpho-syntactic con¬straints as well as their degree of syntactic integratedness, their prosodic features, and even their punctuation in written texts

Transitivity and Intonation: A Preliminary Account of Transitive Lowering

Are subjects produced differently based on the transitivity of the clause they are embedded in? Based on data from a narrative reading experiment, it is shown that transitive subjects are produced with a lower f0 than intransitive subjects and that this difference is statistically significant (p∠0.05). It is suggested that the purpose for such a difference originates from a propensity for English speakers to accent new referents, which are common in the object position. By lowering the f0 of the subject, speakers increase the efficacy of an accent on a new object later in the clause. Finally, the read narrative procedure is evaluated for its strict control of stimuli, while also reproducing known intonational phenomena