Formative peer assessment in a CSCL environment

In this case study our aim was to gain more insight in the possibilities of qualitative formative peer assessment in a computer supported collaborative learning (CSCL) environment. An approach was chosen in which peer assessment was operationalised in assessment assignments and assessment tools that were embedded in the course material. The course concerned a higher education case-based virtual seminar, in which students were asked to conduct research and write a report in small multidisciplinary teams. The assessment assignments contained the discussion of assessment criteria, the assessment of a group report of a fellow group, and writing an assessment report. A list of feedback rules was one of the assessment tools. A qualitative oriented study was conducted, focussing on the attitude of students towards peer assessment and practical use of peer assessment assignments and tools. Results showed that students’ attitude towards peer assessment was positive and that assessment assignments had added value. However, not all students fulfilled all assessment assignments. Recommendations for implementation of peer assessment in CSCL environments as well as suggestions for future research are discussed

Assessment innovation and student experience: a new assessment challenge and call for a multi-perspective approach to assessment research

The impact of innovative assessment on student experience in higher education is a neglected research topic. This represents an important gap in the literature given debate around the marketization of higher education, international focus on student satisfaction measurement tools and political calls to put students at the heart of higher education in the UK. This paper reports on qualitative findings from a research project examining the impact of assessment preferences and familiarity on student attainment and experience. It argues that innovation is defined by the student, shaped by diverse assessment experiences and preferences and therefore its impact is difficult to predict. It proposes that future innovations must explore assessment choice mechanisms which allow students to shape their own assessments. Cultural change and staff development will be required to achieve this. To be accepted, assessment for student experience must be viewed as a complementary layer within a complex multi perspective model of assessment which also embraces assessment of learning, assessment for learning and assessment for life long learning. Further research is required to build a meta theory of assessment to enhance the synergies between these alternative approaches and to minimise tensions between them

How to improve the peer review method: Free-selection vs assigned-pair protocol evaluated in a computer networking course

This study provides field research evidence on the efficiency of a “free-selection” peer review assignment protocol as compared to the typically implemented “assigned-pair” protocol. The study employed 54 sophomore students who were randomly assigned into three groups: Assigned-Pair (AP) (the teacher assigns student works for review to student pairs), Free-Selection (FS) (students are allowed to freely explore and select peer work for review), and No Review (NR) (control group). AP and FS student groups studied and reviewed peer work in the domain of Computer Networking, supported by a web-based environment designed to facilitate the two peer review protocols. Our results indicate that students following the Free Selection protocol demonstrate (a) better domain learning outcomes, and (b) better reviewer skills, compared to the AP condition. Overall, the study analyzes the benefits and shortcomings of the FS vs AP review assignment protocol, providing evidence that the FS condition can be multiply beneficial to students who engage in peer review activities

Using multimedia and peer assessment to promote collaborative e-learning

Collaborative e-learning is increasingly appealing as a pedagogical approach that can positively affect student learning. We propose a didactical model that integrates multimedia with collaborative tools and peer assessment to foster collaborative e-learning. In this paper, we explain it and present the results of its application to the “International Seminars on Materials Science” online course. The proposed didactical model consists of five educational activities. In the first three, students review the multimedia resources proposed by the teacher in collaboration with their classmates. Then, in the last two activities, they create their own multimedia resources and assess those created by their classmates. These activities foster communication and collaboration among students and their ability to use and create multimedia resources. Our purpose is to encourage the creativity, motivation, and dynamism of the learning process for both teachers and students

Online peer assessment in higher education: a systematic review of literature in educational practices

Neste artigo procedemos a uma revisão sistemática da literatura sobre Online Peer Assessment (OPA) no Ensino Superior, mediadas por Tecnologias Digitais de Informação e Comunicação (TIC). Identificamos suas características, centrais e opcionais e mapeamos exemplos práticos (procedimentos e TIC) de OPA que poderão ser transversais, adaptáveis e aplicáveis em diversas unidades curriculares e regimes educacionais. Os resultados apontam para a utilização da OPA como uma estratégia que potencia a “avaliação para a aprendizagem”. Os referenciais teóricos subjacentes, os métodos de avaliação e os tipos de TIC utilizadas indicam seu direcionamento para um maior envolvimento e responsabilidade do aluno na sua aprendizagem. Evidenciamos na literatura que se busca desenvolver essas competências, dando ao aluno oportunidades com alguma regularidade para autoavaliar-se e avaliar seus pares por meio de feedback construtivo. Há também evidências de que dar ou produzir feedback é mais benéfico para a aprendizagem do que apenas recebê-lo, como também é cognitivamente mais exigente e envolve os alunos de forma mais ativa e os direciona ao pensamento crítico e a processos metacognitivos. A partir dos resultados alcançados, consideramos que a OPA, enquanto ferramenta cognitiva, contribui para a construção do conhecimento e para a reflexão sobre a aprendizagem. Um desafio que se coloca diz respeito ao desenvolvimento criativo com foco na diversificação e na inovação das práticas de avaliação no sentido de potenciar aprendizagens e resultados acadêmicos, em atenção às necessidades de aprendizagem que se manifestam frente às expectativas da educação atual e futura e às exigências da sociedade.In this research a systematic review of literature about Online Peer Assessment (OPA) in higher education, mediated by Information and Communication Technology (ICT), was carried out. Optional and central characteristics and its practices (procedures and ICT) were identified and mapping. These procedures and practices may be transversal, adaptable and applied in several curriculum units and educational regimes. The results point to the use of OPA as a strategy that enhances “assessment for learning”. The theoretical framework, the methods of assessment and the kinds of ICT used indicate directions for greater involvement and responsibility from the part of the student in his/her learning. Theoretical framework identifies the need to develop students’ skills, providing them with opportunities for self-assessment and peer assessment on a regular basis through constructive feedback. There is also evidence that to give or receive feedback is more beneficial for learning than just receiving it. It is also cognitively more demanding and directs the students to critical thinking and metacognitive processes. From the results obtained, OPA is seen as a cognitive tool, contributing to the building of knowledge and to reflection about learning. Issues for further reflection are also identified such as the creative development of assessment methods with a focus on diversity and innovation in order to enhance students’ learning and academic results, taking into account their learning needs in face of the expectations of current and future education and the demands of society.CIEC - Centro de Investigação em Estudos da Criança, IE, UMinho (UI 317 da FCT), PortugalFundos Nacionais através da FCT (Fundação para a Ciência e a Tecnologia) e cofinanciado pelo Fundo Europeu de Desenvolvimento Regional (FEDER) através do COMPETE 2020 – Programa Operacional Competitividade e Internacionalização (POCI) com a referência POCI-01-0145-FEDER-007562info:eu-repo/semantics/publishedVersio

A large-scale examination of the effectiveness of anonymous marking in reducing group performance differences in higher education assessment

The present research aims to more fully explore the issues of performance differences in higher education assessment, particularly in the context of a common measure taken to address them. The rationale for the study is that, while performance differences in written examinations are relatively well researched, few studies have examined the efficacy of anonymous marking in reducing these performance differences, particularly in modern student populations. By examining a large archive (N = 30674) of assessment data spanning a twelve-year period, the relationship between assessment marks and factors such as ethnic group, gender and socio-environmental background was investigated. In particular, analysis focused on the impact that the implementation of anonymous marking for assessment of written examinations and coursework has had on the magnitude of mean score differences between demographic groups of students. While group differences were found to be pervasive in higher education assessment, these differences were observed to be relatively small in practical terms. Further, it appears that the introduction of anonymous marking has had a negligible effect in reducing them. The implications of these results are discussed, focusing on two issues, firstly a defence of examinations as a fair and legitimate form of assessment in Higher Education, and, secondly, a call for the re-examination of the efficacy of anonymous marking in reducing group performance differences

Real World Learning and Authentic Assessment

As students increasingly adopt a consumerist lifestyle academics are under pressure to assess and mark more students’ assignments in quicker turn around periods. In no other area is the marketisation shift between student and academic more apparent in the accountability that academics now need to demonstrate to students in their grading and feedback (Boud & Molloy, 2013). When evaluating their higher education experience students are most likely to complain about their grading or feedback (Boud & Molloy, 2013) and National Student Survey results consistently indicate that this category, more than any other, has the highest student dissatisfaction rates (Race, 2014)

Processfolio: uniting Academic Literacies and Critical Emancipatory Action Research for practitioner-led inquiry into EAP writing assessment

This paper reports on the design and implementation of an alternative form of writing assessment on a UK English for Academic Purposes (EAP) presessional course. The assessment, termed processfolio, was a response to research inquiry into how writing assessment in a local context negated student agency and inculcated disempowering models of teaching and learning academic writing. The project merged an Academic Literacies approach to writing (Lea and Street, 1998) with a Critical Emancipatory Action Research (Carr and Kemmis, 1986) framework and a Critical Realist(Bhaskar, 1989) perspective. Data collected from the folios and interviews with students and teachers on their experiences of the processfolio found that a small scale intervention has potential for agency to be exercised within the highly constrained context of a UK EAP pre-sessional. New directions in research are proposed which can engage students and teachers to work for change in UK EAP assessment within their internal and external constraints

Students’ Perceptions of Learning Processes as Co-Authors of Digital Tabletop Activities

We conducted a small-scale study in order to explore students’ perceptions of the learning processes when engaged as co-authors of content for collaborative higher order thinking skills learning tasks. We specifically designed the process to allow for self-critique – where authors can observe their creations being solved and therefore understand where they may improve their design. We collected data over a three-day period from a sample of twelve thirteen year olds, working in teams, authoring content for Digital Mysteries (a higher order thinking skills collaborative learning application based on the digital tabletop). The study was structured to follow Bloom’s taxonomy, a continuum of cognitive skills that develop during a learning process. We found that 1) rather than follow this continuum, skills developed in a non-linear manner due to the abstract nature of the authoring activity, and 2) the students’ demonstrated good metacognitive insights into the authoring task, technology and collaborative learning as a whole