Implementation of computer assisted assessment: lessons from the literature

This paper draws attention to literature surrounding the subject of computer-assisted assessment (CAA). A brief overview of traditional methods of assessment is presented, highlighting areas of concern in existing techniques. CAA is then defined, and instances of its introduction in various educational spheres are identified, with the main focus of the paper concerning the implementation of CAA. Through referenced articles, evidence is offered to inform practitioners, and direct further research into CAA from a technological and pedagogical perspective. This includes issues relating to interoperability of questions, security, test construction and testing higher cognitive skills. The paper concludes by suggesting that an institutional strategy for CAA coupled with staff development in test construction for a CAA environment can increase the chances of successful implementation

Computer assisted formative assessment: supporting students to become more reflective learners

e-Assessment is being advocated in the UK as our way of introducing a more personalised learning agenda throughout the Higher Education sector. This paper discusses the findings from two projects where formative e-assessment has contributed to students taking more control of their own learning. One study set out to provide further insights into the role of electronic formative assessment and to point the way forward to new assessment practices, capitalising on a range of open source tools. The guiding vision was to pilot a series of formative assessments which have the potential to help shape learners as independent thinkers, making their own judgements and decisions about their learning in partnership with their peers and tutors. Other work consisted of evaluating a series of formative assessments given to Philosophy students. Lessons have been learned about the type of feedback that instructors and students think will be most useful and how using theis type of application promotes self reflection. The research reported here starts to illustrate how technology can be adapted to become more 'fit for pedagogical purpose?. The feedback offered by these systems encourages learner metacognition and aims to empower students to reflect and become independent thinkers. This approach sits well within a constructivist paradigm which has often been less well served in the past through formal summative assessment which is not an integral part of the knowledge construction process

The computer as means of communication for peer-review groups

In a scientific-writing course, 15 of 54 students used a review-supporting computer program, PREP-EDITOR (PREP), to communicate with their peers about drafts. In an exploratory study, 10 students were interviewed regularly: 5 used PREP and 5 met face-to-face to exchange comments on drafts. The study showed that use of PREP did not increase time spent on various writing activities. The PREP group reported a large number of computer-related problems, whereas the non-PREP group reported more difficulties with assignments and course organization. It appeared that the technology was omnipresent in PREP users' perception of the course. The system of computer-mediated peer review has many of the drawbacks of 'distance learning,' but because networks are increasingly used by collaborating authors, we should teach our students how to use them sensibly

A Comprehensive Evaluation Model for Cumputer Based Educaton

As opportunities to use computers in learning laboratory settings increase,directors will be faced with the problem of assisting faculty to select and evaluate themost appropriate courseware for their needs. This article presents a comprehensiveevaluation model that could be applied for computer based education programs in avariety of arts and sciences areas. The model includes a pre-implementation stage.This stage determines program compatibility, content evaluation and hardwareconsiderations. A second stage considers formative evaluation, continued availabilityof equipment and the recording of time records. Finally, the last phase, summativeevaluation, includes collecting student attitudes, assessing cost effectiveness,determining external influences and finally, suggesting ways of reaching a decision ofworth. The implementation of this model should provide a system where studentscould work with computer programs of a proven quality. Also, learning laboratorydirectors and faculty could show a certain level of accountability towards spendingmoney on computer software or courseware

Improving child protection : a systematic review of training and procedural interventions

Aim: To synthesise published evidence regarding the effectiveness of training and procedural interventions aimed at improving the identification and management of child abuse and neglect by health professionals. Methods: Systematic review for the period 1994 to 2005 of studies that evaluated child protection training and procedural interventions. Main outcome measures were learning achievement, attitudinal change, and clinical behaviour. Results: Seven papers that examined the effectiveness of procedural interventions and 15 papers that evaluated training programmes met the inclusion criteria. Critical appraisal showed that evaluation of interventions was on the whole poor. It was found that certain procedural interventions (such as the use of checklists and structured forms) can result in improved recording of important clinical information and may also alert clinical staff to the possibility of abuse. While a variety of innovative training programmes were identified, there was an absence of rigorous evaluation of their impact. However a small number of onegroup pre- and post-studies suggest improvements in a range of attitudes necessary for successful engagement in the child protection process. Conclusion: Current evidence supports the use of procedural changes that improve the documentation of suspected child maltreatment and that enhance professional awareness. The lack of an evidence based approach to the implementation of child protection training may restrict the ability of all health professionals to fulfil their role in the child protection process. Formal evaluation of a variety of models for the delivery of this training is urgently needed with subsequent dissemination of results that highlight those found to be most effective

日本人大学生を対象にした英語学習ウエブアプリケーションの導入

This case study examines the introduction of web-based apps to Japanese university students for skill-based English learning. The focus is on 32 students from the International Studies and Education departments at a private Japanese university. The course was an elective English course titled,“ Current Events English.” In class, activities consisted of analog speaking activities from the textbook. However, web-based applications were introduced to support class preparation, the midterm, and the final project. The Memrise app for vocab learning was optional for class preparation. Use of Google Classroom was required for accessing the initial class documents, and Cambridge Write & Improve was required or the final project. Data was collected from the applications as well as from student surveys. The findings provide insight into the efficacy of webbased applications for language learning in Japan. It also contributes to the body of knowledge regarding the reticence of Japanese university students to adopt digital modes of language learning.本事例研究では日本人大学生を対象にした英語学習のためのウエブアプリケーション（WA） の適用可能性を明らかにする。対象は国際教育学科と教育経営学科の学生32人である。時事英語（選択教科コース）では主に教科書からのアナログ・スピーキング・アクティビティーを行ったが，授業の事前準備，中間発表，およびファイナルプロジェクトために三つのWAを導入した。学生主体の 事前準備のためにMemriseの語彙学習アプリを使用し，授業のシラバスおよびプリントを手に入れるためにグーグル・クラスルームを必要とした。ファイナルプロジェクトのためにCambridge Write & Improveも必要とした。WAと学生アンケートからデータを収集して分析した。本研究の結果は，日本人学生が言語学習にWAを使用することに控えめであるにもかかわらず，WAが語学学習には有効であるという知識体系を得られた

E/Valuating new media in language development

This paper addresses the need for a new approach to the educational evaluation of software that falls under the rubric "new media" or "multimedia" as distinct from previous generations of Computer-Assisted Language Learning (CALL) software. The authors argue that present approaches to CALL software evaluation are not appropriate for a new genre of CALL software distinguished by its shared assumptions about language learning and teaching as well as by its technical design. The paper sketches a research-based program called "E/Valuation" that aims to assist language educators to answer questions about the educational effectiveness of recent multimedia language learning software. The authors suggest that such program needs to take into account not only the nature of the new media and its potential to promote language learning in novel ways, but also current professional knowledge about language learning and teaching