Choosing a threshold for silent pauses to measure second language fluency

Second language (L2) research often involves analyses of acoustic measures of fluency. The studies investigating fluency, however, have been difficult to compare because the measures of fluency that were used differed widely. One of the differences between studies concerns the lower cut-off point for silent pauses, which has been set anywhere between 100 ms and 1000 ms. The goal of this paper is to find an optimal cut-off point. We calculate acoustic measures of fluency using different pause thresholds and then relate these measures to a measure of L2 proficiency and to ratings on fluency

Fluency in dialogue: Turn‐taking behavior shapes perceived fluency in native and nonnative speech

Fluency is an important part of research on second language learning, but most research on language proficiency typically has not included oral fluency as part of interaction, even though natural communication usually occurs in conversations. The present study considered aspects of turn-taking behavior as part of the construct of fluency and investigated whether these aspects differentially influence perceived fluency ratings of native and non-native speech. Results from two experiments using acoustically manipulated speech showed that, in native speech, too ‘eager’ (interrupting a question with a fast answer) and too ‘reluctant’ answers (answering slowly after a long turn gap) negatively affected fluency ratings. However, in non-native speech, only too ‘reluctant’ answers led to lower fluency ratings. Thus, we demonstrate that acoustic properties of dialogue are perceived as part of fluency. By adding to our current understanding of dialogue fluency, these lab-based findings carry implications for language teaching and assessmen

認知的流暢性と発話的流暢性の関連性に関する鈴木とKormosの調査のレビューと評価 : 第二言語口頭流暢性の多次元性

本稿では，日本人英語第二言語学習者128名を対象に，流暢性の多次元性を検討したSuzuki & Kormos (2022) の研究成果を紹介する。本研究では，「スピーキング課題デザイン」を用いて，認知的流暢性（CF）と発話流暢性（UF）の関係を明らかにし，どの言語的側面がCF とUF に最も大きく寄与しているかをより明確にすることを意図している。 彼らは，4つの異なるスピーキング課題（i. 論証，ii. 絵物語，iii. 読み聞かせ，iv. 読み聞かせ）と，幅広い言語知識と流暢さの測定（i. 語彙量，ii. 語彙検索速度，iii. 文構成能力，iv. 文法性判断，v.調音速度）を用いてこの分析を行っている。Suzuki & Kormos (2022) は，構造方程式モデリング（SEM）を用いて，「CF とUF の多次元性と発話課題のタイプとの間の複雑な相互作用」を明らかにした。UF に対する処理速度の寄与は発話課題によらず一貫していることがわかったが，速度と修復流暢性については課題間で有意なばらつきが見られた。 本総説では，まず，Suzuki & Kormos (2022) の研究概要を簡単に説明し，次に重要な知見を概説する。次に，この研究の最も強固な結果について考察し，その後，研究の弱い側面について解説を行う。最後に，流暢性研究の広い分野でのこのような研究の役割について短い議論を行い，この研究がどのように改善され得るかについての提案を行い，この研究の様々な教育的含意を提示することで終わる。With this article, I investigate a 2022 study by Suzuki and Kormos that explores the multidimensionality of oral fluency among a group of 128 Japanese second-language learners of English. This study intends to use “speaking task design” to elucidate the relationships between cognitive fluency (CF) and utterance fluency (UF), and more clearly delineate which linguistic aspects contribute most significantly to CF and UF. Suzuki and Kormos undertake this analysis by employing four different speaking tasks (argumentative, picture narrative, reading-to-speaking, reading-while-listening-to-speaking) and a broad range of linguistic knowledge and fluency measures (vocabulary size, lexical retrieval speed, sentence construction skills, grammaticality judgments, articulatory speed). Through their use of structural equation modeling (SEM), Suzuki and Kormos’ main finding highlights the “complex interplay between the multidimensionality of CF and UF and speaking task types.” Although the contribution of processing speed for UF was found to be consistent regardless of speaking task, significant variation across tasks was found for speed and repair fluency. This review article begins with a short overview of the Suzuki and Kormos (2022) study, followed by an outline of the critical findings. Consideration is then given to the study’s most robust results, followed by commentary on the weaker aspects of the research. I then close with a short discussion on the role of such a study within the broader field of fluency research and suggestions on how this study may be improved upon, and present various pedagogical implications of the research

Foneettinen sujuvuus suomessa toisena kielenä: Lukiolaisten spontaanin puheen akustinen analyysi

Speaking fluently is an important goal for second language (L2) learners. In L2 research, fluency is often studied by measuring temporal features in speech. These features include speed (rate of speech), breakdown (use of silent and filled pauses), and repair (self-corrections and repetitions) phenomena. Fluent speakers generally have a higher rate of speech and fewer hesitations and interruptions than beginner language learners. In this thesis, phonetic fluency of high school students’ L2 Finnish speech is studied in relation to human ratings of fluency and overall proficiency. The topic is essential for the development of automated assessment of L2 speech, as phonetic fluency measures can be used for predicting a speaker’s fluency and proficiency level automatically. Although the effect of different fluency measures on perceived fluency level has been widely studied during the last decades, research on phonetic fluency in Finnish as L2 is still limited. Phonetic fluency in high school students’ speech in L2 Finnish has not been studied before. The speech samples and ratings used in this thesis are a part of a larger dataset collected in the DigiTala research project. The analyzed data contained spontaneous speech samples in L2 Finnish from 53 high school students of different language backgrounds. All samples were assessed by expert raters for fluency and overall proficiency. The speech samples were annotated by marking intervals containing silent pauses, filled pauses, corrections and repetitions, and individual words. Several phonetic fluency measures were calculated for each sample from the durations of the annotated intervals. The contribution of phonetic fluency measures to human ratings of fluency and proficiency was studied using simple and multiple linear regression models. Speech rate was found to be the strongest predictor for both fluency and proficiency ratings in simple linear regression. Articulation rate, portion of long silent pauses, mean duration of long silent pauses, mean duration of breaks between utterances, and rate of short silent pauses per minute were also statistically significant predictors of both fluency and proficiency ratings. Multiple linear regression models improved the simple models for both fluency and proficiency: for fluency, a model with a combination of articulation rate and the portion of long silent pauses performed the best, and for proficiency, a model with a combination of speech rate and mean duration of short silent pauses. Perceived fluency level is often affected by a combination of different phonetic fluency measures, and it seems that human raters ground their assessments on this combination, although some phonetic fluency measures might be more important on their own than others. The findings of this thesis expand previous knowledge on phonetic fluency in L2 Finnish and can benefit both language learners and teachers, as well as developers of automatic assessment of L2 speech.Sujuvaa puhetaitoa pidetään tärkeänä tavoitteena toisen kielen (L2) oppimisessa. L2-puheen tutkimuksissa sujuvuutta tutkitaan usein puheesta mitattavilla temporaalisilla piirteillä, joita ovat esimerkiksi puheen nopeus, tauot, korjaukset ja toistot. Nopea, vähän epäröintiä ja keskeytyksiä sisältävä puhe mielletään usein sujuvaksi, ja toisen kielen oppimisen alkuvaiheessa puhe on epäsujuvampaa. Tässä tutkielmassa tutkitaan lukiolaisten L2-suomen foneettista sujuvuutta puheesta mitattavien foneettisten sujuvuuspiirteiden sekä sujuvuus- ja taitotasoarvioiden avulla. Tutkimusaihe liittyy myös puheen automaattisen arvioinnin kehittämiseen, sillä kielenoppijan sujuvuus- ja taitotasoa voidaan ennustaa automaattisesti foneettisten sujuvuuspiirteiden avulla. Vaikka sujuvuuspiirteiden ja arviointien välistä yhteyttä on tutkittu melko paljon viime vuosikymmeninä, L2-suomen foneettiseen sujuvuuteen liittyviä tutkimuksia on yhä vähän. Lukiolaisten L2-suomen foneettista sujuvuutta ei ole aiemmin tutkittu. Tutkielmassa käytetty puhe- ja arviointiaineisto on osa suurempaa aineistoa, joka on kerätty DigiTala-tutkimusprojektissa. Analysoitu aineisto sisälsi 53 spontaania puhenäytettä lukiolaisilta, jotka puhuvat suomea toisena kielenä. Lisäksi jokaisen puhenäytteen sujuvuus ja yleinen taitotaso oli arvioitu. Puhenäytteisiin annotoitiin hiljaiset ja täytetyt tauot, korjaukset ja toistot sekä yksittäiset sanat. Annotoitujen intervallien kestoista laskettiin useita foneettisia sujuvuuspiirteitä jokaiselle puhenäytteelle. Foneettisten sujuvuuspiirteiden vaikutusta ihmisarvioihin tutkittiin lineaaristen regressiomallien avulla. Puhenopeus ennusti yhden selittävän muuttujan malleissa sekä sujuvuus- että taitotasoarvioita parhaiten. Tämän lisäksi artikulaationopeus, pitkien hiljaisten taukojen osuus, pitkien hiljaisten taukojen keskimääräinen kesto, yhtenäisten puhejaksojen välisten keskeytysten keskimääräinen kesto ja lyhyiden hiljaisten taukojen suhteellinen lukumäärä olivat tilastollisesti merkitseviä ennustajia yhden selittävän muuttujan malleissa. Useamman selittävän muuttujan mallit paransivat aiempien mallien selitysvoimaa sekä sujuvuus- että taitotasoarvioissa: artikulaationopeuden ja pitkien hiljaisten taukojen osuuden yhdistelmä ennusti sujuvuusarvioita parhaiten, ja puhenopeuden ja lyhyiden hiljaisten taukojen keskimääräisen keston yhdistelmä taitotasoarvioita. Puheen havaittuun sujuvuuteen vaikuttaa usein yhdistelmä erilaisia sujuvuuspiirteitä, vaikka yksittäisten piirteiden vaikutukset voivat olla keskenään erilaisia. Tutkielman tulokset lisäävät tietoa L2-suomen foneettisesta sujuvuudesta, ja ne ovat tarpeellisia niin kielenoppijoille, -opettajille kuin puheen automaattisten arviointityökalujen kehittäjille

Does having good articulatory skills lead to more fluent speech in first and second languages?

Speaking fluently requires three main processes to run smoothly: conceptualization, formulation, and articulation. This study investigates to what extent fluency in spontaneous speech in both first (L1) and second (L2) languages can be explained by individual differences in articulatory skills. A group of L2 English learners (n = 51) performed three semi spontaneous speaking tasks in their L1 Spanish and in their L2 English. In addition, participants performed articulatory skill tasks that measured the speed at which their articulatory speech plans could be initiated (delayed picture naming) and the rate and accuracy at which their articulatory gestures could be executed (diadochokinetic production). The results showed that fluency in spontaneous L2 speech can be predicted by L1 fluency, replicating earlier studies and showing that L2 fluency measures are, to a large degree, measures of personal speaking style. Articulatory skills were found to contribute modestly to explaining variance in both L1 and L2 fluency

Adult ESL Oral Reading Fluency and Silent Reading Comprehension

A descriptive study of second language adults studying ESL at the beginning, intermediate, and advanced levels in a post-secondary academic program revealed that their oral reading fluency had a significant, low-to-moderate correlation with scores on a measure of silent reading comprehension. The correlation was slightly stronger for measures of accuracy than speed, and strongest for miscue ratio. The correlation increased as proficiency level increased. Among different first language groups, the correlation was highest for Hispanic learners, and lowest for Chinese. Furthermore, all fluency measures correlated better with a listening measure than with the silent reading comprehension measure. When a system of using words correct per minute was contrasted with a fluency rubric using descriptive measures of expressive reading, the correlation with silent reading was found to be almost the same, but the system of words correct per minute had higher reliability. A miscue analysis of seven intermediate learners\u27 oral reading indicated that speed does not necessarily increase as silent reading proficiency increases, but accuracy does; Chinese students are a special case who do not fit the profile of the other language groups; and the value of miscue analysis with this population is somewhat limited because of the foreign accent problem. It was also found that the fluency tools mirrored overall progress in proficiency level, and listening comprehension predicted silent reading comprehension better than any fluency measure or combination of measures, with little increase in predictive power by adding fluency measures

Pause behaviour within reformulations and the proficiency level of second language learners of English

This research reports on a quantitative analysis of the combination of two types of disfluency, reformulations and pauses, in the speech of lower intermediate and advanced speakers of English as a second language (L2). The present study distinguishes between corrections and false starts within the category of reformulations as well as between silent and filled pauses. It focuses on the extent to which pause behavior within reformulations varies according to the stage of L2 development and the type of reformulation used. An analysis wasmade of 56 L2 speakers’ 2-min monologues. The results showed that lower intermediate and advanced speakers differed on the frequency of silent pauses inserted in corrections but not on their frequency in false starts. This suggests that false starts depend less on proficiency level, and may reflect temporary problems with conceptual encoding or extralinguistic factors that contribute to the efficacy of L2 production rather than difficulties with linguistic processing per se. The frequency of silent pauses rather than silent pause duration or the frequency and duration of filled pauses appeared to be the only marker to differentiate between false starts and corrections across the two proficiency groups

“I think that’s what he’s doing”: effects of intentional reasoning on second language (L2) speech performance

This study advances our understanding of the effects of task design on task complexity and second language (L2) performance. The research reported here focused on examining the impact of degree of intentional reasoning, operationalised at two levels of task content and task instructions, on language performance and perceptions of task difficulty. Using a mixed-methods approach, the study drew on quantitative and qualitative data collected from 20 Jordanian L2 learners performing video-based oral narratives and completing retrospective questionnaires. The results suggest that intentional reasoning has a noticeable effect in generating more syntactically complex and accurate language, and also influences perceptions of task difficulty. However, a higher intentional reasoning demand is associated with less lexical diversity and inconsistent patterns of fluency. An important finding of the study is that the link between the cognitive demands and the language used to convey intentional reasoning should be carefully considered when selecting analytic measures of complexity and accuracy

Pause behaviour within reformulations and the proficiency level of second language learners of English

This research reports on a quantitative analysis of the combination of two types of disfluency, reformulations and pauses, in the speech of lower intermediate and advanced speakers of English as a second language (L2). The present study distinguishes between corrections and false starts within the category of reformulations as well as between silent and filled pauses. It focuses on the extent to which pause behavior within reformulations varies according to the stage of L2 development and the type of reformulation used. An analysis was made of 56 L2 speakers’ 2-min monologues. The results showed that lower intermediate and advanced speakers differed on the frequency of silent pauses inserted in corrections but not on their frequency in false starts. This suggests that false starts depend less on proficiency level, and may reflect temporary problems with conceptual encoding or extralinguistic factors that contribute to the efficacy of L2 production rather than difficulties with linguistic processing per se. The frequency of silent pauses rather than silent pause duration or the frequency and duration of filled pauses appeared to be the only marker to differentiate between false starts and corrections across the two proficiency groups

Individual differences in adults\u27 second language fluency development: Motivation and language use

Utterance fluency (UF) in a second language (L2) has been found to be associated with L2 proficiency. Nevertheless, the longitudinal development of UF has been underexamined and its relationship with individual differences such as motivation and L2 use has rarely been investigated simultaneously. The current study investigated L1-Chinese L2-English speakers\u27 changes in UF (speed, pausing, and repair phenomena) before and after 5-month study-abroad and related UF changes to L2 use and motivation. The results showed that participants improved in mean syllable duration and end-clause silent pausing. Individuals\u27 changes in certain UF measures, such as mean syllable duration and mid-clause pause frequency, were positively correlated with daily use of L2. Motivation measures largely did not exhibit significant correlations with UF changes, whereas ideal L2 self and intended effort/commitment demonstrated significant positive relationships with daily L2 use