Enhancing Feedback to Students in Automated Diagram Assessment

Automated assessment is an essential part of eLearning. Although comparatively easy for multiple choice questions (MCQs), automated assessment is more challenging when exercises involve languages used in computer science. In this particular case, the assessment is more than just grading and must include feedback that leads to the improvement of the students\u27 performance. This paper presents ongoing work to develop Kora, an automated diagram assessment tool with enhanced feedback, targeted to the multiple diagrammatic languages used in computer science. Kora builds on the experience gained with previous research, namely: a diagram assessment tool to compute differences between graphs; an IDE inspired web learning environment for computer science languages; and an extensible web diagram editor. Kora has several features to enhance feedback: it distinguishes syntactic and semantic errors, providing specialized feedback in each case; it provides progressive feedback disclosure, controlling the quality and quantity shown to each student after a submission; when possible, it integrates feedback within the diagram editor showing actual nodes and edges on the editor itself

Marking complex assignments using peer assessment with an electronic voting system and an automated feedback tool

The work described in this paper relates to the development and use of a range of initiatives in order to mark complex masters' level assignments related to the development of computer web applications. In the past such assignments have proven difficult to mark since they assess a range of skills including programming, human computer interaction and design. Based on the experience of several years marking such assignments, the module delivery team decided to adopt an approach whereby the students marked each other's practical work using an electronic voting system (EVS). The results of this are presented in the paper along with statistical comparison with the tutors' marking, providing evidence for the efficacy of the approach. The second part of the assignment related to theory and documentation. This was marked by the tutors using an automated feedback tool. It was found that the time to mark the work was reduced by more than 30% in all cases compared to previous years. More importantly it was possible to provide good quality individual feedback to learners rapidly. Feedback was delivered to all within three weeks of the test submission datePeer reviewe

The problem of labels in e-assessment of diagrams

In this short paper we explore a problematic aspect of automated assessment of diagrams. Diagrams have partial and sometimes inconsistent semantics. Typically much of the meaning of diagram resides in the labels, however, the choice of labeling is largely unrestricted. This means a correct solution may utilise differing yet semantically equivalent labels to the specimen solution. With human marking this problem can be easily overcome. Unfortunately with e-assessment this is challenging. We empirically explore the scale of the problem of synonyms by analysing 160 student solutions to a UML task. From this we find that cumulative growth of synonyms only shows a limited tendency to reduce at the margin. This finding has significant implications for the ease in which we may develop future e-assessment systems of diagrams, in that the need for better algorithms for assessing label semantic similarity becomes inescapable

TLAD 2010 Proceedings:8th international workshop on teaching, learning and assesment of databases (TLAD)

This is the eighth in the series of highly successful international workshops on the Teaching, Learning and Assessment of Databases (TLAD 2010), which once again is held as a workshop of BNCOD 2010 - the 27th International Information Systems Conference. TLAD 2010 is held on the 28th June at the beautiful Dudhope Castle at the Abertay University, just before BNCOD, and hopes to be just as successful as its predecessors.The teaching of databases is central to all Computing Science, Software Engineering, Information Systems and Information Technology courses, and this year, the workshop aims to continue the tradition of bringing together both database teachers and researchers, in order to share good learning, teaching and assessment practice and experience, and further the growing community amongst database academics. As well as attracting academics from the UK community, the workshop has also been successful in attracting academics from the wider international community, through serving on the programme committee, and attending and presenting papers.This year, the workshop includes an invited talk given by Richard Cooper (of the University of Glasgow) who will present a discussion and some results from the Database Disciplinary Commons which was held in the UK over the academic year. Due to the healthy number of high quality submissions this year, the workshop will also present seven peer reviewed papers, and six refereed poster papers. Of the seven presented papers, three will be presented as full papers and four as short papers. These papers and posters cover a number of themes, including: approaches to teaching databases, e.g. group centered and problem based learning; use of novel case studies, e.g. forensics and XML data; techniques and approaches for improving teaching and student learning processes; assessment techniques, e.g. peer review; methods for improving students abilities to develop database queries and develop E-R diagrams; and e-learning platforms for supporting teaching and learning

TLAD 2010 Proceedings:8th international workshop on teaching, learning and assesment of databases (TLAD)

This is the eighth in the series of highly successful international workshops on the Teaching, Learning and Assessment of Databases (TLAD 2010), which once again is held as a workshop of BNCOD 2010 - the 27th International Information Systems Conference. TLAD 2010 is held on the 28th June at the beautiful Dudhope Castle at the Abertay University, just before BNCOD, and hopes to be just as successful as its predecessors.The teaching of databases is central to all Computing Science, Software Engineering, Information Systems and Information Technology courses, and this year, the workshop aims to continue the tradition of bringing together both database teachers and researchers, in order to share good learning, teaching and assessment practice and experience, and further the growing community amongst database academics. As well as attracting academics from the UK community, the workshop has also been successful in attracting academics from the wider international community, through serving on the programme committee, and attending and presenting papers.This year, the workshop includes an invited talk given by Richard Cooper (of the University of Glasgow) who will present a discussion and some results from the Database Disciplinary Commons which was held in the UK over the academic year. Due to the healthy number of high quality submissions this year, the workshop will also present seven peer reviewed papers, and six refereed poster papers. Of the seven presented papers, three will be presented as full papers and four as short papers. These papers and posters cover a number of themes, including: approaches to teaching databases, e.g. group centered and problem based learning; use of novel case studies, e.g. forensics and XML data; techniques and approaches for improving teaching and student learning processes; assessment techniques, e.g. peer review; methods for improving students abilities to develop database queries and develop E-R diagrams; and e-learning platforms for supporting teaching and learning

Decentralised multimedia development by the content experts

This paper describes the possibility to develop interactive educational material by the content expert (teacher). It is suggested to develop small modules of flexible material that can be easily changed similar to traditional lecture presentations. The features of such material include: • Learning by problem solving and application of knowledge (constructing knowledge). • Easy internet on-line implementation of software pieces via Shockwave technology. At the same time CD-Rom versions of the same programs can be marketed. • Integrated assessment by progress tracking and uploading via the web. • Feel of ownership (avoiding the ìnot invented here syndromeî) of the program by the teacher. • Possible exchangeability of small modules between different courses. • Built in recording of student comments for improving and debugging program for the next year • Facilitated input by students (over a year by year updating). • Teachers develop expertise in using the modern and effective teaching tools. • Teachers can put into practice much more effectively than before the educational principles learned from staff development sessions such as (self paced learning, problem based learning, deep learning, constructive learning). • Student feedback (questionnaire) indicated that > 85% of students found the program modules were more effective and more ìfunî learning than traditional method

Enhancing Clinical Learning Through an Innovative Instructor Application for ECMO Patient Simulators

© 2018 The Authors. Reprinted by permission of SAGE PublicationsBackground. Simulation-based learning (SBL) employs the synergy between technology and people to immerse learners in highly-realistic situations in order to achieve quality clinical education. Due to the ever-increasing popularity of extracorporeal membrane oxygenation (ECMO) SBL, there is a pressing need for a proper technological infrastructure that enables high-fidelity simulation to better train ECMO specialists to deal with related emergencies. In this article, we tackle the control aspect of the infrastructure by presenting and evaluating an innovative cloud-based instructor, simulator controller, and simulation operations specialist application that enables real-time remote control of fullscale immersive ECMO simulation experiences for ECMO specialists as well as creating custom simulation scenarios for standardized training of individual healthcare professionals or clinical teams. Aim. This article evaluates the intuitiveness, responsiveness, and convenience of the ECMO instructor application as a viable ECMO simulator control interface. Method. A questionnaire-based usability study was conducted following institutional ethical approval. Nineteen ECMO practitioners were given a live demonstration of the instructor application in the context of an ECMO simulator demonstration during which they also had the opportunity to interact with it. Participants then filled in a questionnaire to evaluate the ECMO instructor application as per intuitiveness, responsiveness, and convenience. Results. The collected feedback data confirmed that the presented application has an intuitive, responsive, and convenient ECMO simulator control interface. Conclusion. The present study provided evidence signifying that the ECMO instructor application is a viable ECMO simulator control interface. Next steps will comprise a pilot study evaluating the educational efficacy of the instructor application in the clinical context with further technical enhancements as per participants’ feedback.Peer reviewedFinal Accepted Versio

Requirements for an Adaptive Multimedia Presentation System with Contextual Supplemental Support Media

Investigations into the requirements for a practical adaptive multimedia presentation system have led the writers to propose the use of a video segmentation process that provides contextual supplementary updates produced by users. Supplements consisting of tailored segments are dynamically inserted into previously stored material in response to questions from users. A proposal for the use of this technique is presented in the context of personalisation within a Virtual Learning Environment. During the investigation, a brief survey of advanced adaptive approaches revealed that adaptation may be enhanced by use of manually generated metadata, automated or semi-automated use of metadata by stored context dependent ontology hierarchies that describe the semantics of the learning domain. The use of neural networks or fuzzy logic filtering is a technique for future investigation. A prototype demonstrator is under construction

Student engagement with a content-based learning design

While learning is commonly conceptualised as a social, collaborative process in organisations, online courses often provide limited opportunities for communication between people. How do students engage with content-based courses? How do they find answers to their questions? How do they achieve the learning outcomes? This paper aims to answer these questions by focusing on students’ experiences in an online content-based course delivered in a large Mexican organisation. Sales supervisors (n=47) participated as students. Four main data sources were used to evaluate engagement with and learning from the course: surveys (n=40), think-aloud sessions (n=8), activity logs (n=47) and exams (n=43). Findings suggest that: (1) Students engage with a content-based course by following the guidance available and attempting to make the materials relevant to their own context. (2) Students are resourceful when trying to find support. If the materials do not provide the answers to their questions, they search for alternatives such as colleagues to talk to. (3) Content-based online learning designs may be engaging and effective. However, broadening the range of support options available to students may derive in more meaningful, contextualised and rewarding learning experiences