Formative peer assessment in a CSCL environment

In this case study our aim was to gain more insight in the possibilities of qualitative formative peer assessment in a computer supported collaborative learning (CSCL) environment. An approach was chosen in which peer assessment was operationalised in assessment assignments and assessment tools that were embedded in the course material. The course concerned a higher education case-based virtual seminar, in which students were asked to conduct research and write a report in small multidisciplinary teams. The assessment assignments contained the discussion of assessment criteria, the assessment of a group report of a fellow group, and writing an assessment report. A list of feedback rules was one of the assessment tools. A qualitative oriented study was conducted, focussing on the attitude of students towards peer assessment and practical use of peer assessment assignments and tools. Results showed that students’ attitude towards peer assessment was positive and that assessment assignments had added value. However, not all students fulfilled all assessment assignments. Recommendations for implementation of peer assessment in CSCL environments as well as suggestions for future research are discussed

Finding your way into an open online learning community

Making educational materials freely available on the web is not only a noble enterprise, but also fits the call of helping people to become lifelong learners; a call which gets louder and louder every day. The world is rapidly changing, requiring us to continuously update our knowledge and skills. A problem with this approach to lifelong learning is that the materials that are made available are often both incomplete and unsuitable for independent learning in an online setting. The OpenER (Open Educational Resources) project at the Open Universiteit Nederland makes more than 20 short courses, originally developed for independent-study, freely available from the website www.opener.ou.nl. For our research we start from an envisioned online learning environment now under development. We use backcasting to select research topics that form steps from the current to the ultimate situation. The two experiments we report on here are an extension to standard forum software and the use of student notes to annotate learning materials: two small steps towards our ultimate open learning environment

Peer reviews: What can we learn from our students?

This paper describes lessons learnt whilst using an online peer review system in an undergraduate unit for pre-service teachers. In this unit students learn to use information technologies as part of their future teaching practice. The unit aims to foster graduates who become life-long reflective educators by providing opportunities to explore and reflect on how they might use technology in authentic learning situations. Whilst peer review is an appropriate activity for supporting critical thinking and reflective practice in this kind of unit, it requires a number of decisions to be made in relation to student preparation and support, implementation strategy, and technological infrastructure to make it work in specific contexts. Much research has been conducted in recent years to inform educators in making these decisions. However, there are still gaps in the research, particularly in how to improve the quality and consistency of feedback that students give to each other in their feedback. This paper describes the experiences of implementing an online peer review system aiming to improve quality and consistency of feedback. This exploration has revealed that we can learn much about ways to improve our teaching practices by giving students an opportunity to review each other’s work and give each other feedback

The metric tide: report of the independent review of the role of metrics in research assessment and management

This report presents the findings and recommendations of the Independent Review of the Role of Metrics in Research Assessment and Management. The review was chaired by Professor James Wilsdon, supported by an independent and multidisciplinary group of experts in scientometrics, research funding, research policy, publishing, university management and administration. This review has gone beyond earlier studies to take a deeper look at potential uses and limitations of research metrics and indicators. It has explored the use of metrics across different disciplines, and assessed their potential contribution to the development of research excellence and impact. It has analysed their role in processes of research assessment, including the next cycle of the Research Excellence Framework (REF). It has considered the changing ways in which universities are using quantitative indicators in their management systems, and the growing power of league tables and rankings. And it has considered the negative or unintended effects of metrics on various aspects of research culture. The report starts by tracing the history of metrics in research management and assessment, in the UK and internationally. It looks at the applicability of metrics within different research cultures, compares the peer review system with metric-based alternatives, and considers what balance might be struck between the two. It charts the development of research management systems within institutions, and examines the effects of the growing use of quantitative indicators on different aspects of research culture, including performance management, equality, diversity, interdisciplinarity, and the ‘gaming’ of assessment systems. The review looks at how different funders are using quantitative indicators, and considers their potential role in research and innovation policy. Finally, it examines the role that metrics played in REF2014, and outlines scenarios for their contribution to future exercises

Discovering learning processes using inductive miner: A case study with learning management systems (LMSs)

Resumen tomado de la publicaciónDescubriendo procesos de aprendizaje aplicando Inductive Miner: un estudio de caso en Learning Management Systems (LMSs). Antecedentes: en la minería de procesos con datos educativos se utilizan diferentes algoritmos para descubrir modelos, sobremanera el Alpha Miner, el Heuristic Miner y el Evolutionary Tree Miner. En este trabajo proponemos la implementación de un nuevo algoritmo en datos educativos, el denominado Inductive Miner. Método: hemos utilizado datos de interacción de 101 estudiantes universitarios en una asignatura de grado desarrollada en la plataforma Moodle 2.0. Una vez prepocesados se ha realizado la minería de procesos sobre 21.629 eventos para descubrir los modelos que generan los diferentes algoritmos y comparar sus medidas de ajuste, precisión, simplicidad y generalización. Resultados: en las pruebas realizadas en nuestro conjunto de datos el algoritmo Inductive Miner es el que obtiene mejores resultados, especialmente para el valor de ajuste, criterio de mayor relevancia en lo que respecta al descubrimiento de modelos. Además, cuando ponderamos con pesos las diferentes métricas seguimos obteniendo la mejor medida general con el Inductive Miner. Conclusiones: la implementación de Inductive Miner en datos educativos es una nueva aplicación que, además de obtener mejores resultados que otros algoritmos con nuestro conjunto de datos, proporciona modelos válidos e interpretables en términos educativos.Universidad de Oviedo. Biblioteca de Psicología; Plaza Feijoo, s/n.; 33003 Oviedo; Tel. +34985104146; Fax +34985104126; [email protected]

Forging partnerships in health care: Process and measuring benefits

Universally, there is concern that much academic learning has dealt mainly in theory, removing knowledge from context with a resultant lack of practical experience. Here, the catalyst for strengthening university-community engagement, emanated from a desire to foster greater propensity within students to make connections between their academic courses and responsibility toward the community and people in need, and thus develop enhanced skills in social interaction, teamwork and effectiveness. This paper explores a variety of models of university-community engagement that aim to achieve and model good practice in policy making and planning around healthcare education and service development. Ways of integrating teaching and learning with community engagement, so there is reciprocal learning with significant benefits to the community, students, the university and industry are described. The communities of engagement for a transdisciplinary approach in healthcare are defined and the types of collaborative partnerships are outlined, including public/private partnerships, service learning approaches and regional campus engagement. The processes for initiating innovation in this field, forging sustainable partnerships, providing cooperative leadership and building shared vision are detailed. Measuring shared and sustained benefits for all participants is examined in the context of effecting changes in working relationships as well as the impact on students in terms of increased personal and social responsibility, confidence and competence. For the health professions, it is considered vital to adopt this approach in order to deliver graduates who feel aware of community needs, believe they can make a difference, and have a greater sense of community responsibility, ethic of service and more sophisticated understandings of social contexts. In the longer term, it is proposed the strategy will deliver a future healthcare workforce that is more likely to have a strengthened sense of community, social and personal responsibility and thus effect positive social change

The Power of Giving Feedback and Receiving Feedback in Peer Assessment

Despite well-documented promises of peer assessment, it is still unclear how peer as-sessment works and what contributes to students\u2019 learning gains. In order to identify cognitive processes that lead to learning enhancement, this study examined 41 stu-dents\u2019 responses to online surveys and also their online written interactions when they participated in a peer assessment activity. Data analysis revealed that students were en-gaged in various learning processes in the phases of giving and receiving feedback. While students acknowledged that both phases contributed to their learning, a greater number of students indicated that they perceived more learning benefits from giving feedback rather than receiving feedback. Interpretations and implications were dis-cussed

Student Attitude to Audio Versus Written Feedback

First year Biology at the University of Glasgow consists of two courses, 1A and 1B, with an annual intake of 750-800 students. Both courses consist of lectures, practical lab sessions, tutorials and discussion groups. With such large numbers of students, teaching methods and delivery continually change and develop to ensure best delivery of the course content. As such, assessment and feedback systems also need to remain current and accessible to all. Timely, instructive and developmental feedback on student work is arguably the most powerful single influence on a student’s ability to learn. As part of the transition from school into university, feedback is a recognised method of maximising student potential (Hattie and Timperley, 2007). Research shows that increasing student numbers and associated rise in marking workloads, means that feedback can be slow in returning to the student and lacking quality/detail (Glover and Brown, 2006). From the markers perspective there is some evidence that students fail to engage with, misinterpret or ignore written feedback. We have carried out a pilot study to apply, and attempt to build upon, principles of good feedback practice to the assessment of coursework. To do this, an essay assignment was submitted online by Biology 1A students, marked and written feedback provided to all. A randomly selected group of students (10% of the cohort) also received audio feedback (electronic audio files were imbedded into the student work and returned to them by e-mail) on their submitted work. All students then completed an anonymous ‘Feedback’ questionnaire detailing their experiences with the feedback they received, with additional questions that were answered solely by the ‘audio group’ asking more specific questions about the effectiveness of the audio feedback. To carry out this study, new technologies were utilised and these will be demonstrated at the meeting along with the study conclusions. Hattie, J. and Timperley, H. (2007) The power of feedback. Review of Educational Research, 77, 81–112 Glover, C. and Brown, E. (2006). Written Feedback for Students: too much, too detailed or too incomprehensible to be effective? Bioscience Education, 7