Digital representation for assessment of spoken EFL at university level: A case study in Vietnam

Assessing the speaking performance of students who are studying English as a Foreign Language (EFL) has mainly been conducted with face-to-face speaking tests. While such tests are undoubtedly interactive and authentic, they have been criticised for subjective scoring, as well as lacking an effective test delivery method and recordings for later review. Technology has increasingly been integrated into speaking tests over the last decade and become known as computer-assisted or computer-based assessment of speaking. Although this method is widely acknowledged to measure certain aspects of language speaking effectively, such as pronunciation and grammar, it has not yet proved to be a successful option for assessing interactive skills. An effective testing method is deemed to maintain the interactivity and authenticity of live speaking tests, able to deliver tests quickly and efficiently, and provide recordings of performances for multiple marking and review. This study investigated digital representation of EFL speaking performance as a viable form of student assessment. The feasibility of digital representation has previously been examined in relation to authenticity and reliability in assessment of different subjects in Western Australia, including Italian, Applied Information Technology, Engineering Studies, and Physical Education Studies. However, as far as the researcher is aware, no studies have yet assessed EFL speaking performance using digital representation. In an attempt to bridge this gap, this study explored the feasibility of digital representation for assessing EFL speaking performance in a university in Vietnam, the researcher’s home country. Data collection was undertaken in two phases using a mixed methods approach. In Phase 1, data related to English teachers’ and students’ perceptions of Computer- Assisted English Speaking Assessment (CAESA) were collected. Their perceptions were analysed in relation to the outcomes of a digital speaking assessment trial using the Oral Video Assessment Application (DMOVA). In Phase 2, student participants took an English speaking test while being videoed and audio recorded. English teachers invigilated and marked the trial test using the current method, followed by the digital method. Data were collected via Qualtrics surveys, interviews, observations and databases of student performance results. The feasibility of digital representation in assessing EFL speaking performance was analysed according to the Feasibility Analysis Framework developed by Kimbell, Wheeler, Miller, and Pollitt (2007). The findings from Phase 1 indicated that both teachers and students had positive attitudes towards computer-assisted assessment (CAA). They were confident with computer-assisted English assessment (CAEA) and preferred this testing method to the current paper-and-pencil process. Both cohorts believed that CAEA enhanced the precision and fairness of assessments and was efficient in terms of resources. However, some participants were sceptical about the authenticity of computer-assisted EFL speaking tests because it failed to foster conversations and interactions in the same way as face-to-face assessments. In spite of their scepticism, teachers and students indicated their willingness to trial DMOVA. Phase 2 identified the feasibility dimensions of DMOVA. This method of digital assessment was perceived to enhance fairness, reliability and validity, with some correlations between the live interview and digital tests. Teachers found it easy to manage the speaking tests with DMOVA and recognised the logistical advantages it offered. DMOVA was also credited with generating positive washback effects on learning, teaching and assessment of spoken English. In addition, the digital technology was compatible with the existing facilities at the university and required no support or advanced ICT knowledge. Overall, the benefits of the new testing method were perceived to outweigh the limitations. The study confirmed that digital representation of EFL speaking performances for assessment would be beneficial for Vietnam for the following reasons: (a) it has potential to enhance the reliability and accuracy of the current English speaking assessment method, (b) it retains evidence of students’ performance for later assessment and review, and (c) it facilitates marking and administration. These changes could boost EFL teaching, learning, and assessment, as witnessed in the trial, leading to increased motivation of teachers and students, and ultimately, enhancement of students’ English communication skills. The findings of the study also have implications for English speaking assessment policies and practices in Vietnam and other similar contexts where English is taught, spoken and assessed as a foreign language

Workshop 21. Faculty Development - Equipping clinical tutors with the skills to assist students to develop their clinical reasoning in patient consultations

Workshop ObjectivesTo consider the particular challenges for clinical tutors (experts) in helping medical students (novices) develop their clinical reasoning skills.To develop awareness of innovative approaches to faculty development to help tutors develop their skills in facilitating students development of their clinical reasoning skills in patient encounters.To encourage delegates to share best practice and reflect on faculty development in their own institutions

Oral 13. Unconscious Bias Training for our Simulated Patients: Showcasing a new and innovative workshop

Oral Presentation objectives1) To develop awareness of our innovative workshop delivered to our Simulated Patients to increase their understanding of unconscious biases, how these might impact their work as Simulated Patients in our teaching and assessments and to equip them with skills to challenge and interrogate their automatic thinking. 2) To consider Simulated patient feedback and reflections and my own critical reflections on the Workshop.3) To share best practice with delegates regarding their own experiences of developing Unconscious Bias training to Simulated Patients / other groups in their own institutions

Workshop 47. The Future of consulting: Impact of changing practice on our cognitive load as experts and educators & insights into the novice perspective

Objectives1) To consider current & future impact of remote consulting & the covid pandemic on our cognitive load as clinical reasoning ‘experts’ 2) To consider & reflect on the insights this has provided us as clinicians & educators into the student perspective (clinical reasoning ‘novices’) & their clinical reasoning development 3) To analyse delegates’ own experiences where this & similar transformative learning experiences could be deployed to drive effective learning 4) To recognise & describe the impact on traditional curricula structures

Interactive Videos As A Vocabulary Pre-Teaching Tool In Middle School Science

The purpose of this study was to compare the effectiveness of interactive video instruction to teacher-led direct instruction for pre-teaching science vocabulary to newcomer middle school ELs. The second phase of the experiment utilized interactive videos to pre-teach science vocabulary in a flipped learning environment. This study was influenced by vocabulary experts Beck, McKeown, and Kucan, as well as R. E. Mayer, multimedia learning expert. Data collection included pre-tests and post-tests of expressive and receptive vocabulary knowledge, as well as a student survey to determine ease of use, students’ perceived learning and satisfaction with the type of instruction. Results from the study showed that expressive vocabulary gains outpaced receptive vocabulary gains and that strong first language skills were more closely linked to vocabulary gains than strong second language skills. From the study, it may be concluded that interactive videos are not as effective as teacher-led vocabulary pre-teaching and that interactive videos used for flipped learning are equally as effective as interactive videos used within regular classroom instruction

Technology and Testing

From early answer sheets filled in with number 2 pencils, to tests administered by mainframe computers, to assessments wholly constructed by computers, it is clear that technology is changing the field of educational and psychological measurement. The numerous and rapid advances have immediate impact on test creators, assessment professionals, and those who implement and analyze assessments. This comprehensive new volume brings together leading experts on the issues posed by technological applications in testing, with chapters on game-based assessment, testing with simulations, video assessment, computerized test development, large-scale test delivery, model choice, validity, and error issues. Including an overview of existing literature and ground-breaking research, each chapter considers the technological, practical, and ethical considerations of this rapidly-changing area. Ideal for researchers and professionals in testing and assessment, Technology and Testing provides a critical and in-depth look at one of the most pressing topics in educational testing today

Student-Centered Learning: Functional Requirements for Integrated Systems to Optimize Learning

The realities of the 21st-century learner require that schools and educators fundamentally change their practice. "Educators must produce college- and career-ready graduates that reflect the future these students will face. And, they must facilitate learning through means that align with the defining attributes of this generation of learners."Today, we know more than ever about how students learn, acknowledging that the process isn't the same for every student and doesn't remain the same for each individual, depending upon maturation and the content being learned. We know that students want to progress at a pace that allows them to master new concepts and skills, to access a variety of resources, to receive timely feedback on their progress, to demonstrate their knowledge in multiple ways and to get direction, support and feedback from—as well as collaborate with—experts, teachers, tutors and other students.The result is a growing demand for student-centered, transformative digital learning using competency education as an underpinning.iNACOL released this paper to illustrate the technical requirements and functionalities that learning management systems need to shift toward student-centered instructional models. This comprehensive framework will help districts and schools determine what systems to use and integrate as they being their journey toward student-centered learning, as well as how systems integration aligns with their organizational vision, educational goals and strategic plans.Educators can use this report to optimize student learning and promote innovation in their own student-centered learning environments. The report will help school leaders understand the complex technologies needed to optimize personalized learning and how to use data and analytics to improve practices, and can assist technology leaders in re-engineering systems to support the key nuances of student-centered learning