Gesture-speech coupling in L2 lexical stress production: A pre-registration of a speech acoustic and gesture kinematic study

The prosody of a second language (L2) is notoriously difficult to acquire. It requires the mastery of a range of nested multimodal systems, including articulatory but also gestural signals, as hand gestures are produced in close synchrony with spoken prosody. It remains unclear how easily the articulatory and gestural systems acquire new prosodic patterns in the L2 and how the two systems interact, especially when L1 patterns interfere. This interdisciplinary pre-registered study investigates how Dutch learners of Spanish produce multimodal lexical stress in Spanish-Dutch cognates (e.g., Spanish profeSOR vs. Dutch proFESsor). Acoustic analyses assess whether gesturing helps L2 speakers to place stress on the correct syllable; and whether gesturing boosts the acoustic correlates of stress through biomechanic coupling. Moreover, motion-tracking and time-series analyses test whether gesture-prosody synchrony is enhanced for stress-matching vs. stress-mismatching cognate pairs, perhaps revealing that gestural timing is biased in the L1 (or L2) direction (e.g., Spanish profeSOR with the gesture biased towards Dutch stressed syllable -fes). Thus, we will uncover how speakers deal with manual, articulatory, and cognitive constraints that need to be brought in harmony for efficient speech production, bearing implications for theories on gesture-speech interaction and multimodal L2 acquisition

Methods and Effects of Shadowing Using Online Authentic Videos on L2 Acquisition of Mandarin Chinese Tones

Mandarin Chinese tones are notoriously difficult for second language (L2) learners. Previous research focuses on tone training methods that can help learners produce monosyllabic lexical tones, and studies about the production of multisyllabic lexical tones at the sentence level in spontaneous speech are limited. This study applies shadowing—a method where the learners repeat what they heard with as little delay as possible—to tone training and compares the effects of using authentic videos and textbook audios as shadowing materials for beginner L2 Mandarin learners’ tone improvement at the sentence level. Fourteen students in elementary Chinese classes at an American university participated in the tone training activity for four weeks. The participants in the “authentic video” group received authentic videos as their training materials, while the “textbook audio” group was trained with textbook audios. The participants shadowed the materials twice a week, six times per session, at home in their free time. Tone accuracy was rated by Mandarin native speakers according to the pre-test and the post-test consisting of a read-aloud task and a one-on-one conversation. Qualitative and quantitative surveys were conducted to analyze learners’ attitudes toward the shadowing activity and the materials. The results indicate that learners in both groups showed significant improvements in their accuracy in spontaneous speech with no significant differences between the two groups. As for learners’ attitudes, although the participants reported overall positive feedback on the shadowing activity regardless of the materials, authentic materials generated great interest from the participants and were more appealing to the learners. A strong correlation between learners’ confidence in speaking and flexibility of the activity was also found. Based on the finding, pedagogical implications are discussed, including how to select suitable materials and shadowing instructions. For example, educators could introduce textbook audios first and gradually add authentic materials. The findings provide Mandarin Chinese instructors an effective and engaging way to improve learners’ tone production in spontaneous speaking. Incorporating shadowing activities into class has great potential to encourage learners’ autonomy without occupying precious class time. The findings not only contribute to research on teaching Chinese as a second language and the related pedagogy but also shed light on the use of authentic materials in second language teaching and learning

European Approaches to Japanese Language and Linguistics

In this volume European specialists of Japanese language present new and original research into Japanese over a wide spectrum of topics which include descriptive, sociolinguistic, pragmatic and didactic accounts. The articles share a focus on contemporary issues and adopt new approaches to the study of Japanese that often are specific to European traditions of language study. The articles address an audience that includes both Japanese Studies and Linguistics. They are representative of the wide range of topics that are currently studied in European universities, and they address scholars and students alike

A Sound Approach to Language Matters: In Honor of Ocke-Schwen Bohn

The contributions in this Festschrift were written by Ocke’s current and former PhD-students, colleagues and research collaborators. The Festschrift is divided into six sections, moving from the smallest building blocks of language, through gradually expanding objects of linguistic inquiry to the highest levels of description - all of which have formed a part of Ocke’s career, in connection with his teaching and/or his academic productions: “Segments”, “Perception of Accent”, “Between Sounds and Graphemes”, “Prosody”, “Morphology and Syntax” and “Second Language Acquisition”. Each one of these illustrates a sound approach to language matters

Akustické vlastnosti slovního přízvuku ve čtené české anglictině

klíčová slova: česká angličtina, cizí přízvuk, slovní přízvuk, přízvučná slabika, trvání, f0, akustické vlastnosti. Tato studie zkoumá akustické vlastnosti slovního přízvuku v české angličtině. První kapitola vysvětluje problém cizího přízvuku z různých úhlů pohledu. Dále se zabývá různými vlivy na pociťovanou sílu cizího přízvuku. Závěrem je, že chybná realizace slovního přízvuku má jistě negativní vliv jak na hodnocení mluvčího tak na srozumitelnost řeči (Benrabah, 1997; Hahn, 2004; Cutler, 1984). V druhé kapitole porovnáváme výsledky studií, které zkoumaly mluvčí různých jazyků a předkládáme všeobecnou teorii osvojování akustických vlastností slovního přízvuku. Zajímají nás především f0 a trvání. Tato teorie, založená na hypotéze rysů (feature hypothesis) (McAllister et al., 2002 v Lee, Guion & Harada, 2006), říká, že jazyky, jejichž systém slovního přízvuku se podobá angličtině (např. holandština a arabština), používají akustické vlastnosti užívané v jejich rodném jazyce. Oproti tomu mluvčí jazyků s nekontrastivním slovním přízvukem (např. vietnamština a čeština) dávají přednost těm akustickým vlastnostem, které jsou v jejich rodném jazyce fonologicky aktivní na úrovni segmentů. Mluvčí vietnamštiny, tónového jazyka, preferují f0 před trváním vokálu (Nguyen, 2003), takže pro mluvčí češtiny,...key words: Czech English, foreign accent, word stress, word accent, stressed syllable, duration, f0, acoustic cues. This study investigates the acoustic properties of word stress in Czech English. The notion of foreign accent is introduced and its drawbacks are presented. Further on the various influences on the perceived degree, or strength, of foreign accent are discussed. Faulty realization of word stress is identified as one of the factors that contribute to unintelligibility of non-native speech (Benrabah, 1997; Hahn, 2004; Cutler, 1984). In Chapter 2 we compare the results of studies that used speakers of a variety of languages and form a basic theory on the acquisition of acoustic cues to word stress. We are mostly interested in f0 and duration. This theory, based on the feature hypothesis (McAllister et al., 2002 in Lee, Guion & Harada, 2006), states that languages that have a similar stress system to that of English (Dutch, Arabic) use their native cues to signal word stress, while non-contrastive languages (Vietnamese, Czech) prefer cue/s that are phonologically active on segmental level in their native language. Speakers of Vietnamese, a tone language, were found to prefer f0 over duration (Nguyen, 2003), so for Czech, a language that uses phonological vowel duration, it is expected that...Institute of PhoneticsFonetický ústavFaculty of ArtsFilozofická fakult

Self oriented learning of pronunciation through Youtube videos : a description of students’ learning experience and pronunciation improvement

This thesis aimed to investigate the learning experience and pronunciation improvement of students who engaged in their self-oriented learning. The participants were eight students of fourth semester of English Education Department of Universitas Islam Negeri Walisongo in the year 2021/2022. This study was a descriptive qualitative study in which the main data were obtained from interviews. The data analyses in this study includes the stages of data reduction, data display, and drawing conclusions. This study concludes that the students’ experience on self-oriented learning showed aspects in pronunciation improvement that is listening carefully and practice such as imitating or shadowing. Moreover, the preferred accent affected the participants on choosing video contents. The participants also have difficulty in comprehension and producing of the English sounds. Furthermore, the participants need other tools such as U-dictionary apps, Cambridge dictionary etc. The participants’ pronunciation improvement is just a little bit. The significance improvement is on their accent and intonation. The other parts of pronunciation such as connected speech, spelling and word stress just improved barely

Learners’ perspectives and outcomes towards native and non-native instruction with respect to pronunciation

La enseñanza del componente hablado del inglés ha estado en constante debate y cambio para decidir seguir, ya sea, una pronunciación similar a la nativa o una extranjera inteligible. Consecuentemente, esta síntesis de investigación apuntó a establecer, con la ayuda de 16 estudios primarios, si los educadores nativos o no-nativo hablantes son los modelos más apropiados para la enseñanza de la pronunciación en el estado actual del idioma inglés. Los resultados demuestran una discrepancia en lo que está aclarado en investigaciones con lo que realmente es percibido en escenarios reales de educación. No obstante, existe actualmente una clara mejora del estatus de los docentes no-nativo hablantes para enseñar pronunciación inglesa que sea comprensible para cualquier hablante del idioma, en vez de generar en los estudiantes una imitación de una pronunciación nativa. Los resultados de esta investigación ayudan también a establecer una idea más clara sobre los futuros objetivos y percepciones de la enseñanza de la pronunciación y de sus modelos, como también puntos de discusión para completar brechas de conocimiento sobre el tema, especialmente en nuestro contexto.The speaking component of the English language has been in constant debate and change to decide following either a native-like or an intelligible-foreign pronunciation. Consequently, this research synthesis aimed to establish, with the aid of 16 primary studies, whether Native or Nonnative Speaking Teachers are the most appropriate models for pronunciation teaching in the current state of the English language. The results demonstrate a discrepancy of what is stated in papers to what is actually perceived in real educational scenarios. Nevertheless, there is nowadays a clear raise of status for non-native speaking teachers to teach an English pronunciation that is comprehensible for any speaker of English, rather than making students imitate a native pronunciation. The findings of this research also help to establish a clear perspective of what are the future goals and perceptions for pronunciation teaching and their models as well as several discussion points to fill certain gaps of knowledge about the topic, especially in our context.Licenciado en Pedagogía del Idioma InglésCuenc

Speech verification for computer assisted pronunciation training

Computer assisted pronunciation training (CAPT) is an approach that uses computer technology and computer-based resources in teaching and learning pronunciation. It is also part of computer assisted language learning (CALL) technology that has been widely applied to online learning platforms in the past years. This thesis deals with one of the central tasks in CAPT, i.e. speech veri- fication. The goal is to provide a framework that identifies pronunciation errors in speech data of second language (L2) learners and generates feedback with information and instruction for error correction. Furthermore, the framework is supposed to support the adaptation to new L1-L2 language pairs with minimal adjustment and modification. The central result is a novel approach to L2 speech verification, which combines both modern language technologies and linguistic expertise. For pronunciation verification, we select a set of L2 speech data, create alias phonemes from the errors annotated by linguists, then train an acoustic model with mixed L2 and gold standard data and perform HTK phoneme recognition to identify the error phonemes. For prosody verification, FD-PSOLA and Dynamic time warping are both applied to verify the differences in duration, pitch and stress. Feedback is generated for both verifications. Our feedback is presented to learners not only visually as with other existing CAPT systems, but also perceptually by synthesizing the learner’s own audio, e.g. for prosody verification, the gold standard prosody is transplanted onto the learner’s own voice. The framework is self-adaptable under semi-supervision, and requires only a certain amount of mixed gold standard and annotated L2 speech data for boot- strapping. Verified speech data is validated by linguists, annotated in case of wrong verification, and used in the next iteration of training. Mary Annotation Tool (MAT) is developed as an open-source component of MARYTTS for both annotating and validating. To deal with uncertain pauses and interruptions in L2 speech, the silence model in HTK is also adapted, and used in all components of the framework where forced alignment is required. Various evaluations are conducted that help us obtain insights into the applicability and potential of our CAPT system. The pronunciation verification shows high accuracy in both precision and recall, and encourages us to acquire more error-annotated L2 speech data to enhance the trained acoustic model. To test the effect of feedback, a progressive evaluation is carried out and it shows that our perceptual feedback helps learners realize their errors, which they could not otherwise observe from visual feedback and textual instructions. In order to im- prove the user interface, a questionnaire is also designed to collect the learners’ experiences and suggestions.Computer Assisted Pronunciation Training (CAPT) ist ein Ansatz, der mittels Computer und computergestützten Ressourcen das Erlernen der korrekten Aussprache im Fremdsprachenunterricht erleichtert. Dieser Ansatz ist ein Teil der Computer Assisted Language Learning (CALL) Technologie, die seit mehreren Jahren auf Online-Lernplattformen häufig zum Einsatz kommt. Diese Arbeit ist der Sprachverifikation gewidmet, einer der zentralen Aufgaben innerhalb des CAPT. Das Ziel ist, ein Framework zur Identifikation von Aussprachefehlern zu entwickeln fürMenschen, die eine Fremdsprache (L2-Sprache) erlernen. Dabei soll Feedback mit fehlerspezifischen Informationen und Anweisungen für eine richtige Aussprache erzeugt werden. Darüber hinaus soll das Rahmenwerk die Anpassung an neue Sprachenpaare (L1-L2) mit minimalen Adaptationen und Modifikationen unterstützen. Das zentrale Ergebnis ist ein neuartiger Ansatz für die L2-Sprachprüfung, der sowohl auf modernen Sprachtechnologien als auch auf corpuslinguistischen Ansätzen beruht. Für die Ausspracheüberprüfung erstellen wir Alias-Phoneme aus Fehlern, die von Linguisten annotiert wurden. Dann trainieren wir ein akustisches Modell mit gemischten L2- und Goldstandarddaten und führen eine HTK-Phonemerkennung3 aus, um die Fehlerphoneme zu identifizieren. Für die Prosodieüberprüfung werden sowohl FD-PSOLA4 und Dynamic Time Warping angewendet, um die Unterschiede in der Dauer, Tonhöhe und Betonung zwischen dem Gesprochenen und dem Goldstandard zu verifizieren. Feedbacks werden für beide Überprüfungen generiert und den Lernenden nicht nur visuell präsentiert, so wie in anderen vorhandenen CAPT-Systemen, sondern auch perzeptuell vorgestellt. So wird unter anderem für die Prosodieverifikation die Goldstandardprosodie auf die eigene Stimme des Lernenden übergetragen. Zur Anpassung des Frameworks an weitere L1-L2 Sprachdaten muss das System über Maschinelles Lernen trainiert werden. Da es sich um ein semi-überwachtes Lernverfahren handelt, sind nur eine gewisseMenge an gemischten Goldstandardund annotierten L2-Sprachdaten für das Bootstrapping erforderlich. Verifizierte Sprachdaten werden von Linguisten validiert, im Falle einer falschen Verifizierung nochmals annotiert, und bei der nächsten Iteration des Trainings verwendet. Für die Annotation und Validierung wurde das Mary Annotation Tool (MAT) als Open-Source-Komponente von MARYTTS entwickelt. Um mit unsicheren Pausen und Unterbrechungen in der L2-Sprache umzugehen, wurde auch das sogenannte Stillmodell in HTK angepasst und in allen Komponenten des Rahmenwerks verwendet, in denen Forced Alignment erforderlich ist. Unterschiedliche Evaluierungen wurden durchgeführt, um Erkenntnisse über die Anwendungspotenziale und die Beschränkungen des Systems zu gewinnen. Die Ausspracheüberprüfung zeigt eine hohe Genauigkeit sowohl bei der Präzision als auch beim Recall. Dadurch war es möglich weitere fehlerbehaftete L2-Sprachdaten zu verwenden, um somit das trainierte akustische Modell zu verbessern. Um die Wirkung des Feedbacks zu testen, wird eine progressive Auswertung durchgeführt. Das Ergebnis zeigt, dass perzeptive Feedbacks dabei helfen, dass die Lernenden sogar Fehler erkennen, die sie nicht aus visuellen Feedbacks und Textanweisungen beobachten können. Zudem wurden mittels Fragebogen die Erfahrungen und Anregungen der Benutzeroberfläche der Lernenden gesammelt, um das System künftig zu verbessern. 3 Hidden Markov Toolkit 4 Pitch Synchronous Overlap and Ad