A comparative study of the variables used to measure syntactic complexity and accuracy in task-based research

The constructs of complexity, accuracy and fluency (CAF) have been used extensively to investigate learner performance on second language tasks. However, a serious concern is that the variables used to measure these constructs are sometimes used conventionally without any empirical justification. It is crucial for researchers to understand how results might be different depending on which measurements are used, and accordingly, choose the most appropriate variables for their research aims. The first strand of this article examines the variables conventionally used to measure syntactic complexity in order to identify which may be the best indicators of different proficiency levels, following suggestions by Norris and Ortega. The second strand compares the three variables used to measure accuracy in order to identify which one is most valid. The data analysed were spoken performances by 64 Japanese EFL students on two picture-based narrative tasks, which were rated at Common European Framework of Reference for Languages (CEFR) A2 to B2 according to Rasch-adjusted ratings by seven human judges. The tasks performed were very similar, but had different degrees of what Loschky and Bley-Vroman term ‘task-essentialness’ for subordinate clauses. It was found that the variables used to measure syntactic complexity yielded results that were not consistent with suggestions by Norris and Ortega. The variable found to be the most valid for measuring accuracy was errors per 100 words. Analysis of transcripts revealed that results were strongly influenced by the differing degrees of task-essentialness for subordination between the two tasks, as well as the spread of errors across different units of analysis. This implies that the characteristics of test tasks need to be carefully scrutinised, followed by careful piloting, in order to ensure greater validity and reliability in task-based research

Focus on form: A critical review

‘Focus on form’ (FonF) is a central construct in task-based language teaching. The term was first introduced by Michael Long to refer to an approach where learners’ attention is attracted to linguistic forms as they engage in the performance of tasks. It contrasts with a structure-based approach – ‘focus on forms’ (FonFs) – where specific linguistic forms are taught directly and explicitly. However, there is perhaps no construct in second language acquisition (SLA) that has proved so malleable and shifted in meaning so much. This review article begins by considering how Long’s original definition of it has stretched over time and then offers an updated definition of the construct based on the view that the term is best used to refer to specific kinds of ‘activities’ or ‘procedures’ rather than to an ‘approach’. A classification of different types of focus-on-form activities/procedures is then presented. There follows a discussion of focus on form from a psycholinguistic and discoursal perspective along with a review of research relevant to these perspectives. The article addresses a number of criticisms that have been levelled against focus on form, with special consideration paid to how focus on form can be utilized in instructional contexts where more traditional (i.e. FonFs) approaches have been the norm

The role of individual and social variables in task performance.

This paper reports on a data-based study in which we explored - as part of a larger-scale British-Hungarian research project - the effects of a number of affective and social variables on foreign language (L2) learners’ engagement in oral argumentative tasks. The assumption underlying the investigation was that students’ verbal behaviour in oral task situations is partly determined by a number of non-linguistic and non-cognitive factors whose examination may constitute a potentially fruitful extension of existing task-based research paradigms. The independent variables in the study included various aspects of L2 motivation and several factors characterizing the learner groups the participating students were members of (such as group cohesiveness and intermember relations), as well as the learners’ L2 proficiency and ‘willingness to communicate’ in their L1. The dependent variables involved objective measures of the students’ language output in two oral argumentative tasks (one in the learners’ L1, the other in their L2): the quantity of speech and the number of turns produced by the speakers. The results provide insights into the interrelationship of the multiple variables determining the learners’ task engagement, and suggest a multi-level construct whereby some independent variables only come into force when certain conditions have been met

Learner attention to form in ACCESS task-based interaction

This study explored the potential effects of communicative tasks developed using a reformulation of a task-based language teaching called Automatization in Communicative Contexts of Essential Speech Sequences (ACCESS) that includes automatization of language elements as one of its goals on learner attention to form in task-based interaction. The interaction data collected from a class for English as a second language (ESL) over a four-week period was analysed for incidence, outcome and characteristics (i.e. focus, initiation, response, and turn length) of language-related episodes (LREs) operationalized as evidence of learner attention to form. The results showed that during ACCESS task-based interactions, learners attended to form as reflected in a large number of LREs. Despite being brief, a majority of these LREs were correctly resolved, self-initiated, self- and other-responded, and focused on the target linguistic item: past-tense verbs. These results are discussed in terms of the potential effects of ACCESS task principles, different task features (i.e. task complexity, pre-task modeling, speaker role and group size), and learners’ approach to tasks on the incidence and characteristics of LREs

Increasing frailty is associated with higher prevalence and reduced recognition of delirium in older hospitalised inpatients: results of a multi-centre study

Purpose Delirium is a neuropsychiatric disorder delineated by an acute change in cognition, attention, and consciousness. It is common, particularly in older adults, but poorly recognised. Frailty is the accumulation of deficits conferring an increased risk of adverse outcomes. We set out to determine how severity of frailty, as measured using the CFS, affected delirium rates, and recognition in hospitalised older people in the United Kingdom. Methods Adults over 65 years were included in an observational multi-centre audit across UK hospitals, two prospective rounds, and one retrospective note review. Clinical Frailty Scale (CFS), delirium status, and 30-day outcomes were recorded. Results The overall prevalence of delirium was 16.3% (483). Patients with delirium were more frail than patients without delirium (median CFS 6 vs 4). The risk of delirium was greater with increasing frailty [OR 2.9 (1.8–4.6) in CFS 4 vs 1–3; OR 12.4 (6.2–24.5) in CFS 8 vs 1–3]. Higher CFS was associated with reduced recognition of delirium (OR of 0.7 (0.3–1.9) in CFS 4 compared to 0.2 (0.1–0.7) in CFS 8). These risks were both independent of age and dementia. Conclusion We have demonstrated an incremental increase in risk of delirium with increasing frailty. This has important clinical implications, suggesting that frailty may provide a more nuanced measure of vulnerability to delirium and poor outcomes. However, the most frail patients are least likely to have their delirium diagnosed and there is a significant lack of research into the underlying pathophysiology of both of these common geriatric syndromes

Increasing frailty is associated with higher prevalence and reduced recognition of delirium in older hospitalised inpatients: results of a multi-centre study

Purpose: Delirium is a neuropsychiatric disorder delineated by an acute change in cognition, attention, and consciousness. It is common, particularly in older adults, but poorly recognised. Frailty is the accumulation of deficits conferring an increased risk of adverse outcomes. We set out to determine how severity of frailty, as measured using the CFS, affected delirium rates, and recognition in hospitalised older people in the United Kingdom. Methods: Adults over 65 years were included in an observational multi-centre audit across UK hospitals, two prospective rounds, and one retrospective note review. Clinical Frailty Scale (CFS), delirium status, and 30-day outcomes were recorded. Results: The overall prevalence of delirium was 16.3% (483). Patients with delirium were more frail than patients without delirium (median CFS 6 vs 4). The risk of delirium was greater with increasing frailty [OR 2.9 (1.8–4.6) in CFS 4 vs 1–3; OR 12.4 (6.2–24.5) in CFS 8 vs 1–3]. Higher CFS was associated with reduced recognition of delirium (OR of 0.7 (0.3–1.9) in CFS 4 compared to 0.2 (0.1–0.7) in CFS 8). These risks were both independent of age and dementia. Conclusion: We have demonstrated an incremental increase in risk of delirium with increasing frailty. This has important clinical implications, suggesting that frailty may provide a more nuanced measure of vulnerability to delirium and poor outcomes. However, the most frail patients are least likely to have their delirium diagnosed and there is a significant lack of research into the underlying pathophysiology of both of these common geriatric syndromes

Assessment for Learning: An introduction to the ESCAPE project

Assessment is a significant aspect of the student learning experience and good assessment engages students with the curriculum; it creates opportunities for dialogue and ultimately stimulates learning. In spite of the accepted significance of assessment within Higher Education, the National Student Survey has in the past few years highlighted assessment and feedback as the lowest scoring aspect of the student experience. Working in partnership with the Business School and the School of Life Sciences the Effecting Sustainable Change in Assessment Practice and Experience (ESCAPE) project set out to support the development of assessment-for-learning initiatives. The ESCAPE project includes a range of curriculum development activities and change management processes. Objectives of the project relate to improving the educational effectiveness and resource efficiency of the assessment practice. An Appreciative Inquiry approach was adopted to help module teams build on existing good assessment practice. Following the design, development and implementation of pilot assessment activities, module teachers are already reporting greater engagement from students in their studies.Peer reviewe

Linguistic and strategic features of the language of learners in oral communication exercises

SIGLEAvailable from British Library Document Supply Centre-DSC:DX206186 / BLDSC - British Library Document Supply CentreGBUnited Kingdo

Pragmatic aspects of task performance: The case of argumentation.

The study reported in this paper investigated the pragmatic aspects of task-performance in a series of argumentation tasks that 24 Hungarian learners of English performed over a period of two years. The aim of our research project was to determine how task-repetition, the long-term development of language skills, and a short-term focused intervention influenced various pragmatic measures of task-performance such as the pragmalinguistic markers of argumentation, the number of claims, counterclaims, supports and counter-supports. We also analysed how these variables differed when the participants performed the same type of task in their mother tongue. The results showed that in the repeated version of the task, familiarity with the task structure helped learners pay more attention to the informational content of their message, which was reflected in the higher number of supportive moves they produced. Participants were found to have better argumentation skills in their mother tongue and used a wider variety of pragmalinguistic markers than in L2. The language development assumed to have taken place during one year and the argumentation training, however, did not result in better pragmatic and pragmalinguistic performance

Some directions for the possible survival of TBLT as a real world project

Since Brumfit's landmark definition of applied linguistics as the theoretical and empirical study of real world problems in which language plays a central role (Brumfit, 2000), there have been periodic calls for applied linguistics to engage with problems experienced by people in real world contexts (such as teaching, health, business, law, social services, business or family), rather than problems of research methodology originating in the research community, and to work to address them, both in policy and practice (Bygate, 2004; Tarone, 2013, 2015; Shuy, 2015; Widdowson, 2017). This principle may well apply to all areas of applied linguistics, but in this piece I would like to explore it in relation to task-based language teaching (TBLT). This is because while TBLT is characteristically defined in terms of the needs and interests of language teachers and learners, it is also informed by research, which is heavily shaped by the priorities of the academy, an influence which can lead it away from some of its real world objectives. Yet if proponents fail to adequately address the priorities and needs of classroom stakeholders, proposals will be doomed to failure, a point acknowledged by many (see inter alia Gatbonton and Segalowitz (1988, 2005), Edwards and Willis (2005), Thornbury and Slade (2006), van den Branden (2006), Eckerth (2008), Andon and Eckerth (2009), Ellis (2009), Gatbonton (2015), Long (2015) and Samuda, Bygate, and van den Branden (2018)). That is, research needs to engage not just with models of second language acquisition (SLA), but with the practices, demands, pressures, and perspectives of stakeholders in real world language classrooms