Speech Communication

Contains reports on eight research projects.C.J. LeBel FellowshipSystems Development FoundationNational Institutes of Health (Grant 5 T32 NS07040)National Institutes of Health (Grant 5 R01 NS04332)National Science Foundation (Grant 1ST 80-17599)U.S. Navy - Office of Naval Research (Contract N00014-82-K-0727

Chapter 2: The Original ToBI System and the Evolution of the ToBI Framework

In this chapter, the authors will try to identify the essential properties of a ToBI framework annotation system by describing the development and design of the original ToBI conventions. In this description, the authors will overview the general phonological theory and the specific theory of Mainstream American English intonation and prosody that the authors decided to incorporate in the original ToBI tags. The authors will also state the practical principles that led us to make the decisions that the authors did. The chapter is organised as follows. Section 2.2 briefly chronicles how the MAE_ToBI system came into being. Section 2.3 briefly describes the consensus account of English intonation and prosody on which the MAE_ToBI system is based. Section 2.4 catalogues the different components of a MAE_ToBI transcription and lists the salient rules which constrain the relationships between different components. This section also expands upon the theoretical foundations and practical consequences of adopting the general structure of multiple labelling tiers, and particularly the separation of the labels for tones from the labels for indexing prosodic boundary strength. Section 2.5 then describes some of the extensions of the basic ToBI tiers that have been adopted by some sites. This section also compares our decisions about the number of tiers and about inter-tier constraints with the analogous decisions for some of the other ToBI systems described in this book. Section 2.6 discusses the status of the symbolic labels relative to the continuous phonetic records that are also an obligatory component of the MAE_ToBI transcription. Section 2.7 then closes by listing several open research questions that the authors would like to see addressed by MAE_ToBI users and the larger ToBI community

Native Speaker Perceptions of Accented Speech: The English Pronunciation of Macedonian EFL Learners

The paper reports on the results of a study that aimed to describe the vocalic and consonantal features of the English pronunciation of Macedonian EFL learners as perceived by native speakers of English and to find out whether native speakers who speak different standard variants of English perceive the same segments as non-native. A specially designed computer web application was employed to gather two types of data: a) quantitative (frequency of segment variables and global foreign accent ratings on a 5-point scale), and b) qualitative (open-ended questions). The result analysis points out to three most frequent markers of foreign accent in the English speech of Macedonian EFL learners: final obstruent devoicing, vowel shortening and substitution of English dental fricatives with Macedonian dental plosives. It also reflects additional phonetic aspects poorly explained in the available reference literature such as allophonic distributional differences between the two languages and intonational mismatch

Symbol Emergence in Robotics: A Survey

Humans can learn the use of language through physical interaction with their environment and semiotic communication with other people. It is very important to obtain a computational understanding of how humans can form a symbol system and obtain semiotic skills through their autonomous mental development. Recently, many studies have been conducted on the construction of robotic systems and machine-learning methods that can learn the use of language through embodied multimodal interaction with their environment and other systems. Understanding human social interactions and developing a robot that can smoothly communicate with human users in the long term, requires an understanding of the dynamics of symbol systems and is crucially important. The embodied cognition and social interaction of participants gradually change a symbol system in a constructive manner. In this paper, we introduce a field of research called symbol emergence in robotics (SER). SER is a constructive approach towards an emergent symbol system. The emergent symbol system is socially self-organized through both semiotic communications and physical interactions with autonomous cognitive developmental agents, i.e., humans and developmental robots. Specifically, we describe some state-of-art research topics concerning SER, e.g., multimodal categorization, word discovery, and a double articulation analysis, that enable a robot to obtain words and their embodied meanings from raw sensory--motor information, including visual information, haptic information, auditory information, and acoustic speech signals, in a totally unsupervised manner. Finally, we suggest future directions of research in SER.Comment: submitted to Advanced Robotic

Konsonandikeskne vältesüsteem eesti ja inarisaami keeles

Väitekirja elektrooniline versioon ei sisalda publikatsiooneKolme pikkuskategooriaga konsonandikeskne vältesüsteem esineb väga vähestes keeltes, teadaolevalt ainult soome-ugri keeltes: eesti, liivi ja inarisaami keeles ning veel mõningates saami keeltes. Doktoritöö keskendub neist kahele – eesti ja inarisaami keelele, millest esimene kuulub soome-ugri keelte läänemeresoome ja teine saami keelterühma. Eesti keeles esineb keerukas kolmevältesüsteem, kus vastandus moodustatakse nii vokaalide, konsonantide kui ka mõlema põhjal. Inarisaami keeles leiab kolm pikkuskategooriat vaid konsonantide puhul, vokaalidel esineb kahene vastandus. Eksperimentaalfoneetiline väitekiri uurib, kuidas kolmene konsonandikeskne kvantiteedisüsteem nendes keeltes foneetiliselt avaldub kõnetaktis. Vaadeldakse omadusi, mis kolme väldet üksteisest eristavad. Teise suurema teemana käsitleb doktoritöö segmentaalse konteksti rolli eesti keele konsonandivälte avaldumisel. Töö tulemused näitavad, et kolme konsonandikeskset väldet eristab nii eesti kui ka inarisaami keeles konsonandi enda kestus, mis on suuremas vältes pikem. Keeltevahelised erinevused tulevad välja kategooriate omavaheliste kestussuhete kaudu: eesti keeles eristuvad teineteisest rohkem esimene ja teine välde, inarisaamis aga teine ja kolmas välde. Kui eesti keeles lüheneb konsonandile järgnev rõhutu silbi vokaal vastavalt konsonandivälte kasvades, siis inarisaamis lühenevad mõlemad, nii konsonandile eelnev rõhulise silbi vokaal kui ka sellele järgnev rõhutu silbi vokaal. Põhitoonikontuurid inarisaami eri struktuuriga kahesilbilistes sõnades märkimisväärselt ei varieeru, kuid konsonandivälte kasvades intensiivsuse väärtuste erinevus esimese ja teise silbi vokaali vahel suureneb. Samas eri vältes oleva vokaalidevahelise helilise konsonandi enda intensiivsus ei muutu. Põhitoon on eesti keeles oluline teise ja kolmanda välte eristamisel, kuid klusiilide puhul, kus põhitooni liikumist jälgida ei saa, on ka leitud, et välte tajumiseks piisab kestuslikest tunnustest. Doktoritöö eesti keele artikulatsioonikatse tulemused näitavad, et kolmese konsonandikeskse välte avaldumisel on oluline osa segmentaalsel kontekstil. Kui mõningate artikulatoorsete liigutuste puhul saab näha vältega seotud kolmeseid mustreid (huulte sulgemisliigutuse kestuses konsonandi hääldamisel, keeleliigutuste kestuses üleminekul konsonandile eelnevalt vokaalilt järgnevale), siis erineva sõnaalgulise konsonandi ja ümbritseva vokaalikonteksti tõttu esineb varieerumist, kus esimene ja teine välde vastanduvad kolmandale või vastandub esimene välde teisele ja kolmandale. Ka spontaankõne materjali põhjal tehtud akustiline analüüs näitas, et erinevate konsonantide puhul realiseerub kolmene välde mõnevõrra erinevalt ning sealjuures on oluline seos konsonandi ja seda ümbritsevate vokaalide omaduste vahel.Quantity systems with three length categories for consonants can be found in a small number of languages, all of which belong to the Finno-Ugric languages: Estonian, Livonian, Inari Saami, and some other Saami languages. The focus of this dissertation is on two of them, Estonian and Inari Saami, the former belonging to the Finnic and the latter to the Saamic branch. Estonian exhibits a complex quantity system forming ternary length categories with vowels, consonants, or combinations of both. In Inari Saami, ternary length distinction is found for consonants, while vocalic quantity shows binary oppositions. This thesis comprises experimental phonetic studies answering two main questions: how is ternary consonantal quantity in Estonian and Inari Saami realized phonetically, and how does quantity interact with segmental context. The results showed that, in both languages, the three-way consonantal quantity is manifested in consonant durations that are longer in higher quantity degrees. While Estonian first and second quantity are further apart from each other, in Inari Saami second and third quantity are more distinct. Cross-linguistic differences also appear in the relations between intervocalic consonants and neighboring vowels. In Estonian, the vowel following the consonant is shorter after a long and overlong consonant than after a short one. Quantity differences in Inari Saami are realized in shorter durations of both vowels in terms of increasing consonantal quantity. Fundamental frequency contours in Inari Saami are roughly the same in words with different structures. Intensity measures, however, show greater differences between the vowels surrounding the consonant when the quantity of the consonant increases. The intensity of the sonorant consonant does not change in different quantities. The results of the articulatory study of this thesis show variation in quantity manifestations in Estonian geminate consonants due to varied segmental context. Some articulatory movements exhibit three-way patterns associated with quantity categories (in the duration of the lip closing gesture for the consonant and tongue transition gesture from the preceding vowel to the following vowel); for others the first and second quantity are opposed to the third quantity or the first quantity degree is opposed to the second and third ones. Similar patters were found in the acoustic data from spontaneous speech. The durational properties of ternary quantity are realized differently for different intervocalic consonants, and variation is also caused by coarticulatory effects of the surrounding vowels.https://www.ester.ee/record=b524109