Chapter 2: The Original ToBI System and the Evolution of the ToBI Framework

In this chapter, the authors will try to identify the essential properties of a ToBI framework annotation system by describing the development and design of the original ToBI conventions. In this description, the authors will overview the general phonological theory and the specific theory of Mainstream American English intonation and prosody that the authors decided to incorporate in the original ToBI tags. The authors will also state the practical principles that led us to make the decisions that the authors did. The chapter is organised as follows. Section 2.2 briefly chronicles how the MAE_ToBI system came into being. Section 2.3 briefly describes the consensus account of English intonation and prosody on which the MAE_ToBI system is based. Section 2.4 catalogues the different components of a MAE_ToBI transcription and lists the salient rules which constrain the relationships between different components. This section also expands upon the theoretical foundations and practical consequences of adopting the general structure of multiple labelling tiers, and particularly the separation of the labels for tones from the labels for indexing prosodic boundary strength. Section 2.5 then describes some of the extensions of the basic ToBI tiers that have been adopted by some sites. This section also compares our decisions about the number of tiers and about inter-tier constraints with the analogous decisions for some of the other ToBI systems described in this book. Section 2.6 discusses the status of the symbolic labels relative to the continuous phonetic records that are also an obligatory component of the MAE_ToBI transcription. Section 2.7 then closes by listing several open research questions that the authors would like to see addressed by MAE_ToBI users and the larger ToBI community

The Pitch Range of Italians and Americans. A Comparative Study

Linguistic experiments have investigated the nature of F0 span and level in cross-linguistic comparisons. However, only few studies have focused on the elaboration of a general-agreed methodology that may provide a unifying approach to the analysis of pitch range (Ladd, 1996; Patterson and Ladd, 1999; Daly and Warren, 2001; Bishop and Keating, 2010; Mennen et al. 2012). Pitch variation is used in different languages to convey different linguistic and paralinguistic meanings that may range from the expression of sentence modality to the marking of emotional and attitudinal nuances (Grice and Baumann, 2007). A number of factors have to be taken into consideration when determining the existence of measurable and reliable differences in pitch values. Daly and Warren (2001) demonstrated the importance of some independent variables such as language, age, body size, speaker sex (female vs. male), socio-cultural background, regional accents, speech task (read sentences vs. spontaneous dialogues), sentence type (questions vs. statements) and measure scales (Hertz, semitones, ERB etc.). Coherently with the model proposed by Mennen et al. (2012), my analysis of pitch range is based on the investigation of LTD (long-term distributional) and linguistic measures. LTD measures deal with the F0 distribution within a speaker’s contour (e.g. F0 minimum, F0 maximum, F0 mean, F0 median, standard deviation, F0 span) while linguistic measures are linked to specific targets within the contour, such as peaks and valleys (e.g. high and low landmarks) and preserve the temporal sequences of pitch contours. This investigation analyzed the characteristics of pitch range production and perception in English sentences uttered by Americans and Italians. Four experiments were conducted to examine different phenomena: i) the contrast between measures of F0 level and span in utterances produced by Americans and Italians (experiments 1-2); ii) the contrast between the pitch range produced by males and females in L1 and L2 (experiment 1); iii) the F0 patterns in different sentence types, that is, yes-no questions, wh-questions, and exclamations (experiment 2); iv) listeners’ evaluations of pitch span in terms of ±interesting, ±excited, ±credible, ±friendly ratings of different sentence types (experiments 3-4); v) the correlation between pitch span of the sentences and the evaluations given by American and Italian listeners (experiment 3); vi) the listeners’ evaluations of pitch span values in manipulated stimuli, whose F0 span was re-synthesized under three conditions: narrow span, original span, and wide span (experiment 4); vii) the different evaluations given to the sentences by male and female listeners. The results of this investigation supported the following generalizations. First, pitch span more than level was found to be a cue for non-nativeness, because L2 speakers of English used a narrower span, compared to the native norm. What is more, the experimental data in the production studies indicated that the mode of sentences was better captured by F0 span than level. Second, the Italian learners of English were influenced by their L1 and transferred L1 pitch range variation into their L2. The English sentences produced by the Italians had overall higher pitch levels and narrower pitch span than those produced by the Americans. In addition, the Italians used overall higher pitch levels when speaking Italian and lower levels when speaking English. Conversely, their pitch span was generally higher in English and lower in Italian. When comparing productions in English, the Italian females used higher F0 levels than the American females; vice versa, the Italian males showed slightly lower F0 levels than the American males. Third, there was a systematic relation between pitch span values and the listeners’ evaluations of the sentences. The two groups of listeners (the Americans and the Italians) rated the stimuli with larger pitch span as more interesting, exciting and credible than the stimuli with narrower pitch span. Thus, the listeners relied on the perceived pitch span to differentiate among the stimuli. Fourth, both the American and the Italian speakers were considered more friendly when the pitch span of their sentences was widened (wide span manipulation) and less friendly when the pitch span was narrowed (narrow span manipulation). This happened in all the stimuli regardless of the native language of the speakers (American vs. Italian)

Influence of syllable-coda voicing on the acoustic properties of syllable-onset /l/ in English

International audienceProperties of syllable onset /l/ that depend on the voicing of the syllable coda were measured for four speakers, representing different nonrhotic British English accents that differ in their phonetic realization of onset /l/ and in their system of phonological contrast involving onset /l/ and /r/. Onset /l/ was longer before voiced than voiceless codas for all four speakers, and darker for two of them as measured by lower F2 frequency, and for these two and one other as measured by spectral center of gravity (COG). There were no coda-dependent differences in f0 in the /l/, and F1 frequency differed only for the fourth speaker. The vowel was also longer for all four speakers when the coda was voiced (as expected), while F1 was lower and F2 normally higher. One speaker provided data with fricative or affricate onsets: fricated segments were longer before voiced codas, but no coda-dependent COG differences were found. At least when the onset includes /l/, phonological voicing of the coda seems to be reflected in complex acousticphonetic properties distributed across the whole syllable, some properties being localized, others not. We describe these properties as variations in a brightsomber dimension. In most accents, when the coda is voiceless, the syllable is relatively bright: small proportions of periodic energy which is relatively high frequency at the syllable edges, and a high proportion of silence or aperiodic energy. When the coda is voiced, the syllable is relatively somber: a high proportion of periodic energy which is relatively low frequency at the syllable edges, and relatively small amounts of silence and aperiodic energy. Other accents use other combinations, dependent on the phonetic and phonological properties of liquids in the particular accent. The association of onset darkness and coda voicing does not seem to be ascribable to anticipatory coarticulation of features essential to voicing itself; this observation provides support for nonsegmental models of speech perception in which fine phonetic detail is mapped directly to linguistic structure without reference to phoneme-sized segments

Selected aspects in the acquisition of English phonology by Polish learners - segments and prosody

This work has been partly supported by a grant from Polish Ministry of Science and Higher Education (0576/B/H03/2010/38) to both authors.Rozdział poświęcony jest przyswajaniu systemu fonologicznego języka angielskiego przez polskich uczniów. Omówiono w nim typowe problemy występujące w procesie uczenia się wymowy angielskiej, szczególnie te wynikające z interferencji, a więc spowodowane różnicami pomiędzy systemem języka ojczystego a językiem obcym. W wypadku ucznia polskiego, w zakresie fonetyki segmentalnej, są to przede wszystkim fonemiczne kontrasty samogłoskowe, różnice w realizacji kontrastu pomiędzy samogłoskami dźwięcznymi a bezdźwięcznymi (np. aspiracja i skracanie samogłoski przed spółgłoską bezdźwięczną), wymowa szczelinowych spółgłosek zębowych oraz procesy związane z realizacją wariantów pozycyjnych spółgłosek wybuchowych, płynnych i nosowych. W zakresie prozodii skoncentrowano się przede wszystkim na sposobach realizacji akcentu wyrazowego i zdaniowego, funkcjach intonacji w komunikacji werbalnej oraz relacjach czasowych i rytmie wypowiedzi. Podkreślono również ścisły związek i wzajemne zależności pomiędzy fonetyką segmentalną i suprasegmentalną, które nader często rozpatrywane są jako zagadnienia odrębne z punktu widzenia dydaktyki wymowy. W odniesieniu do wspomnianych problemów przedstawione zostały metodologiczne aspekty współczesnych badań empirycznych z wykorzystaniem akustycznej analizy mowy, aktualny stan rozwoju badań w omawianych dziedzinach, jak również literatura zalecana dla słuchaczy studiów filologicznych zainteresowanych problematyką przyswajania wymowy języka angielskiego przez Polaków.Polish Ministry of Science and Higher Educatio

Speech rhythm: the language-specific integration of pitch and duration

Experimental phonetic research on speech rhythm seems to have reached an impasse. Recently, this research field has tended to investigate produced (rather than perceived) rhythm, focussing on timing, i.e. duration as an acoustic cue, and has not considered that rhythm perception might be influenced by native language. Yet evidence from other areas of phonetics, and other disciplines, suggests that an investigation of rhythm is needed which (i) focuses on listeners’ perception, (ii) acknowledges the role of several acoustic cues, and (iii) explores whether the relative significance of these cues differs between languages. This thesis, the originality of which derives from its adoption of these three perspectives combined, indicates new directions for progress. A series of perceptual experiments investigated the interaction of duration and f0 as perceptual cues to prosody in languages with different prosodic structures – Swiss German, Swiss French, and French (i.e. from France). The first experiment demonstrated that a dynamic f0 increases perceived syllable duration in contextually isolated pairs of monosyllables, for all three language groups. The second experiment found that dynamic f0 and increased duration interact as cues to rhythmic groups in series of monosyllabic digits and letters; the two cues were significantly more effective than one when heard simultaneously, but significantly less effective than one when heard in conflicting positions around the rhythmic-group boundary location, and native language influenced whether f0 or duration was the more effective cue. These two experiments laid the basis for the third, which directly addressed rhythm. Listeners were asked to judge the rhythmicality of sentences with systematic duration and f0 manipulations; the results provide evidence that duration and f0 are interdependent cues in rhythm perception, and that the weighting of each cue varies in different languages. A fourth experiment applied the perceptual results to production data, to develop a rhythm metric which captures the multi-dimensional and language-specific nature of perceived rhythm in speech production. These findings have the important implication that if future phonetic research on rhythm follows these new perspectives, it may circumvent the impasse and advance our knowledge and model of speech rhythm.This work was funded by an AHRC doctoral award to the author

Phonological issues in the production of prosody by francophone and sinophone learners of english as a second language

Un accent de non-natif peut mener à une incompréhension ou à la perception de degrés différents d'accent d'étrangeté. La prosodie, qui est maintenant reconnue comme un élément important de l'impression d'étrangeté, est relativement peu abordée en recherche en acquisition des langues étrangères. Ceci contraste avec l'intérêt grandissant envers la prosodie en tant qu'élément de la langue maternelle. Dans cette thèse, la recherche phonologique est évaluée quant à sa pertinence dans la recherche sur la prosodie des langues étrangères. Deux aspects de la théorie phonologique sont étudiés: la typologie et l'organisation phonologique. Ce choix est justifié par la présomption générale que l'étrangeté prosodique est créée soit par une différence de typologie entre langue maternelle (L1) et langue étrangère (L2) soit par un transfert de traits prosodiques de la L1. La critique de la recherche en typologie phonologique conclut que, à ce stade, aucun modèle de classification prosodique n'est applicable à l'acquisition d'une L2. En particulier, l'étude démontre que certaines typologies, en particulier la théorie de l'isochronie accentuelle/l'isochronie syllabique de Pike, devraient être exclues parce qu'elles entravent les progrès en recherche sur l'acquisition et la production de la prosodie des langues étrangères. Le second aspect de la théorie phonologique étudié dans cette thèse est l'organisation phonologique. La prémisse est que les différences sous-jacentes à l'organisation prosodique plutôt que les différences phonologiques de surface sont transférées de L1 à L2. Les analyses approfondies de l'anglais nord américain, le français et le chinois standard révèlent d'importantes différences phonologiques entre l'anglais nord américain et les deux autres langues. Quatre expériences évaluent certaines de ces différences. La prosodie de l'anglais produite par des locuteurs natifs du français est analysée dans des phrases rythmiquement simples et des phrases rythmiquement plus complexes. Les résultats démontrent que l'accentuation lexicale est moins problématique que l'accentuation prosodique supra-lexicale. En particulier, il est démontré que les montées de fréquence fondamentale (F0) de début et de fin de syntagme accentuel (SA), typiques du français, sont source d'erreur dans la prosodie de l'anglais langue seconde. Il est cependant montré que cette erreur, bien que remarquée par les locuteurs natifs de l'anglais, n'affecte pas la perception de placement d'accentuation par ces derniers. La prosodie de l'anglais produite par des locuteurs natifs du chinois est analysée en termes de transfert de ton et d'alignement de pic de F0. Les résultats indiquent que les locuteurs du chinois utilisent les tons chinois quand ils produisent des tons accentuels de l'anglais; plus spécifiquement, la majorité des locuteurs utilisent le ton 2 (ton montant) quand ils produisent un ton accentuel montant. La dernière expérience révèle que les locuteurs natifs du chinois alignent le ton accentuel avec la syllabe accentuée à laquelle elle correspond de manière plus stricte que les locuteurs natifs de l'anglais nord américain le font. Les résultats de cette thèse génèrent un aperçu de la progression de la performance de la prosodie d'une langue étrangère. Les conclusions comportent des implications sur le contenu pédagogique et le format de l'enseignement de la prononciation. ______________________________________________________________________________ MOTS-CLÉS DE L’AUTEUR : Phonologie, Phonétique, Phonologie prosodique, Prosodie, Rythme, ESL, Français du Québec, Français de France, Chinois

An integrated dialect analysis tool using phonetics and acoustics

This study aimed to verify a computational phonetic and acoustic analysis tool created in the MATLAB environment. A dataset was obtained containing 3 broad American dialects (Northern, Western and New England) from the TIMIT database using words that also appeared in the Swadesh list. Each dialect consisted of 20 speakers uttering 10 sentences. Verification using phonetic comparisons between dialects was made by calculating the Levenshtein distance in Gabmap and the proposed software tool. Agreement between the linguistic distances using each analysis method was found. Each tool showed increasing linguistic distance as a function of increasing geographic distance, in a similar shape to Seguy's curve. The proposed tool was then further developed to include acoustic characterisation capability of inter dialect dynamics. Significant variation between dialects was found for the pitch, trajectory length and spectral rate of change for 7 of the phonetic vowels investigated. Analysis of the vowel area using the 4 corner vowels indicated that for male speakers, geographically closer dialects have smaller variations in vowel space area than those further apart. The female utterances did not show a similar pattern of linguistic distance likely due to the lack of one corner vowel /u/, making the vowel space a triangle

Comparative analysis of majority language influence on North Sámi prosody using WaveNet-based modeling

The Finnmark North Sami is a variety of North Sami language, an indigenous, endangered minority language spoken in the northernmost parts of Norway and Finland. The speakers of this language are bilingual, and regularly speak the majority language (Finnish or Norwegian) as well as their own North Sami variety. In this paper we investigate possible influences of these majority languages on prosodic characteristics of Finnmark North Sami, and associate them with prosodic patterns prevalent in the majority languages. We present a novel methodology that: (a) automatically finds the portions of speech (words) where the prosodic differences based on majority languages are most robustly manifested; and (b) analyzes the nature of these differences in terms of intonational patterns. For the first step, we trained convolutional WaveNet speech synthesis models on North Sami speech material, modified to contain purely prosodic information, and used conditioning embeddings to find words with the greatest differences between the varieties. The subsequent exploratory analysis suggests that the differences in intonational patterns between the two Finnmark North Sami varieties are not manifested uniformly across word types (based on part-of-speech category). Instead, we argue that the differences reflect phrase-level prosodic characteristics of the majority languages.Peer reviewe

Relative Salience of Speech Rhythm and Speech Rate on Perceived Foreign Accent in a Second Language

We investigated the independent contribution of speech rate and speech rhythm to perceived foreign accent. To address this issue we used a resynthesis technique that allows neutralizing segmental and tonal idiosyncrasies between identical sentences produced by French learners of English at different proficiency levels and maintaining the idiosyncrasies pertaining to prosodic timing patterns. We created stimuli that (1) preserved the idiosyncrasies in speech rhythm while controlling for the differences in speech rate between the utterances; (2) preserved the idiosyncrasies in speech rate while controlling for the differences in speech rhythm between the utterances; and (3) preserved the idiosyncrasies both in speech rate and speech rhythm. All the stimuli were created in intoned (with imposed intonational contour) and flat (with monotonized, constant F0) conditions. The original and the resynthesized sentences were rated by native speakers of English for degree of foreign accent. We found that both speech rate and speech rhythm influence the degree of perceived foreign accent, but the effect of speech rhythm is larger than that of speech rate. We also found that intonation enhances the perception of fine differences in rhythmic patterns but reduces the perceptual salience of fine differences in speech rate