Evaluating Digital Libraries: A Longitudinal and Multifaceted View

published or submitted for publicatio

Explicating an English speaking examination : challenges and considerations

The assessment of speaking has become increasingly important in most language learning programmes. The Maltese postsecondary context saw the revision of the MATSEC Advanced English syllabus and the subsequent introduction of a speaking component as part of this high-stakes examination . The component's outline in the syllabus provided a degree of latitude but also had certain limitations; however, it was immediately clear that it required further refinement to guarantee a more rigorous speaking assessment. This article discusses the initiative undertaken by a group of lecturers of English at the University of Malta Junior College to explicate the speaking examination outlined in the syllabus. It illustrates how these lecturers positioned themselves as test developers in order to elaborate on the 'what' and 'how' of testing second language speaking at post-secondary level. In discussing various challenges and considerations, this article aims to illustrate some means of enhancing the high-stakes testing of speaking proficiency.peer-reviewe

Making training more cognitively effective: making videos interactive

The cost of health and safety (H&S) failures to the UK industry is currently estimated at up to £6.5 billion per annum, with the construction sector suffering unacceptably high levels of work-related incidents. Better H&S education across all skill levels in the industry is seen as an integral part of any solution. Traditional lecture-based courses often fail to recreate the dynamic realities of managing H&S on site and therefore do not sufficiently create deeper cognitive learning (which results in remembering and using what was learned). The use of videos is a move forward, but passively observing a video is not cognitively engaging and challenging, and therefore learning is not as effective as it can be. This paper describes the development of an interactive video in which learners take an active role. While observing the video, they are required to engage, participate, respond and be actively involved. The potential for this approach to be used in conjunction with more traditional approaches to H&S was explored using a group of 2nd-year undergraduate civil engineering students. The formative results suggested that the learning experience could be enhanced using interactive videos. Nevertheless, most of the learners believed that a blended approach would be most effective

Deconstructing comprehensibility: identifying the linguistic influences on listeners' L2 comprehensibility ratings

Comprehensibility, a major concept in second language (L2) pronunciation research that denotes listeners’ perceptions of how easily they understand L2 speech, is central to interlocutors’ communicative success in real-world contexts. Although comprehensibility has been modeled in several L2 oral proficiency scales—for example, the Test of English as a Foreign Language (TOEFL) or the International English Language Testing System (IELTS)—shortcomings of existing scales (e.g., vague descriptors) reflect limited empirical evidence as to which linguistic aspects influence listeners’ judgments of L2 comprehensibility at different ability levels. To address this gap, a mixed-methods approach was used in the present study to gain a deeper understanding of the linguistic aspects underlying listeners’ L2 comprehensibility ratings. First, speech samples of 40 native French learners of English were analyzed using 19 quantitative speech measures, including segmental, suprasegmental, fluency, lexical, grammatical, and discourse-level variables. These measures were then correlated with 60 native English listeners’ scalar judgments of the speakers’ comprehensibility. Next, three English as a second language (ESL) teachers provided introspective reports on the linguistic aspects of speech that they attended to when judging L2 comprehensibility. Following data triangulation, five speech measures were identified that clearly distinguished between L2 learners at different comprehensibility levels. Lexical richness and fluency measures differentiated between low-level learners; grammatical and discourse-level measures differentiated between high-level learners; and word stress errors discriminated between learners of all levels

An International Study in Competency Education: Postcards from Abroad

Acknowledging that national borders need not constrain our thinking, we have examined a selection of alternative academic cultures and, in some cases, specific schools, in search of solutions to common challenges we face when we consider reorganizing American schools. A wide range of interviews and e-mail exchanges with international researchers, government officials and school principals has informed this research, which was supplemented with a literature review scanning international reports and journal articles. Providing a comprehensive global inventory of competency-based education is not within the scope of this study, but we are confident that this is a representative sampling. The report that follows first reviews the definition of competency-based learning. A brief lesson in the international vocabulary of competency education is followed by a review of global trends that complement our own efforts to improve performance and increase equitable outcomes. Next, we share an overview of competency education against a backdrop of global education trends (as seen in the international PISA exams), before embarking on an abbreviated world tour. We pause in Finland, British Columbia (Canada), New Zealand and Scotland, with interludes in Sweden, England, Singapore and Shanghai, all of which have embraced practices that can inform the further development of competency education in the United States

E/Valuating new media in language development

This paper addresses the need for a new approach to the educational evaluation of software that falls under the rubric "new media" or "multimedia" as distinct from previous generations of Computer-Assisted Language Learning (CALL) software. The authors argue that present approaches to CALL software evaluation are not appropriate for a new genre of CALL software distinguished by its shared assumptions about language learning and teaching as well as by its technical design. The paper sketches a research-based program called "E/Valuation" that aims to assist language educators to answer questions about the educational effectiveness of recent multimedia language learning software. The authors suggest that such program needs to take into account not only the nature of the new media and its potential to promote language learning in novel ways, but also current professional knowledge about language learning and teaching

A tutorial task and tertiary courseware model for collaborative learning communities

RAED provides a computerised infrastructure to support the development and administration of Vicarious Learning in collaborative learning communities spread across multiple universities and workplaces. The system is based on the OASIS middleware for Role-based Access Control. This paper describes the origins of the model and the approach to implementation and outlines some of its benefits to collaborative teachers and learners