Reflexive learning, socio-cognitive conflict and peer-assessment to improve the quality of feedbacks in online tests

International audienceOur previous works have introduced the Tsaap-notes platform dedicated to the semi automatic generation of multiple choice questionnaire providing feedbacks: it reuses interactive questions asked by teachers during lectures, as well as the notes taken by students after the presentation of the results as feedbacks integrated into the quizzes. In this paper, we introduce a new feature which aims at increasing the number of contributions of students in order to significantly improve the quality of the feedbacks used in the resulting quizzes. This feature splits the submission of an answer into several distinct phases to harvest explanations given by students, and then applies an algorithm to filter the best contributions to be integrated as feedbacks in the tests. Our approach has been validated by a first experimentation involving master students enrolled in a computer science course

Innovation in assessment: building student confidence in preparation for unfamiliar assessment methods

Innovative assessment methods in which students are active participants promote deeper learning. A group debate and a webfolio were implemented as methods of assessment in the 2015 undergraduate midwifery curriculum, with the assessment tools being evaluated by students. Thematic analysis of the evaluations showed students enjoyed undertaking innovative methods of assessment, they developed confidence and engaged meaningfully with the content to be assessed. Students also commented they developed multiple skills required for future professional practice as a midwife. Thorough preparation of students to undertake an innovative method of assessment however is vital in fostering student confidence

Examining increased flexibility in assessment formats

There have been calls in the literature for changes to assessment practices in higher education, to increase flexibility and give learners more control over the assessment process (Boud and Falchikov 2006; Nicol and MacFarlane-Dick 2006; Taras 2002). This article explores the possibilities of allowing student choice in the format used to present their work, as a starting point for changing assessment, based on recent studies and current examples of flexible assessment practice in Higher Education. The benefits of this flexible assessment format approach are highlighted, along with a discussion of classic assessment considerations such as validity, reliability and marking concerns. The role of technology in facilitating assessment method choice is considered, in terms of new opportunities for providing student choice in the way they evidence their learning and present their work. Considerations for implementing flexible assessment choices into the curriculum are presented, along with a call that further research into such practice is needed to develop a comprehensive set of practical recommendations and best practice for implementation of flexible assessment choice into the curriculum. The article should be of interest to curriculum developers and academics considering implementing changes to the assessment process to increase student ownership and control

Perceptions of Portuguese undergraduate students about assessment: a study in five public universities

This paper draws upon a broader piece of research on assessment in higher education, particularly focusing on issues regarding the fairness and effectiveness of the assessment methods and their implications for the learning process. The perceptions of undergraduate students are analysed taking into account the effectiveness and fairness of both traditional and learner-centred assessment methods, as well their influence on the learning process. In total, 624 students participated in this study in five Portuguese Public Universities in different areas of knowledge and programmes. Data were collected through questionnaires. Findings suggest that assessment is seen as more effective and fairer when it is done through the use of learner-centred assessment methods rather than by traditional assessment (e.g. written tests or exams). The students also claim that they devote more time to study when assessment is performed through learner-centred assessment methods than by traditional ones. The most used assessment methods are written tests and oral presentations in group. However, differences in the programmes were identified as well as differences according to gender. Implications of the findings for assessment and for the teaching and learning process are discussed.CIEC - Centro de Investigação em Estudos da Criança, IE, UMinho (UI 317 da FCT), Portugal. Fundos Nacionais através da FCT (Fundação para a Ciência e a Tecnologia) e cofinanciado pelo Fundo Europeu de Desenvolvimento Regional (FEDER) através do COMPETE 2020 – Programa Operacional Competitividade e Internacionalização (POCI) no âmbito do CIEC (Centro de Investigação em Estudos da Criança, da Universidade do Minho) com a referência POCI-01-0145-FEDER-007562info:eu-repo/semantics/publishedVersio

Reflexive learning, socio-cognitive conflict and peer-assessment to improve the quality of feedbacks in online tests

Our previous works have introduced the Tsaap-notes platform dedicated to the semi automatic generation of multiple choice questionnaire providing feedbacks: it reuses interactive questions asked by teachers during lectures, as well as the notes taken by students after the presentation of the results as feedbacks integrated into the quizzes. In this paper, we introduce a new feature which aims at increasing the number of contributions of students in order to significantly improve the quality of the feedbacks used in the resulting quizzes. This feature splits the submission of an answer into several distinct phases to harvest explanations given by students, and then applies an algorithm to filter the best contributions to be integrated as feedbacks in the tests. Our approach has been validated by a first experimentation involving master students enrolled in a computer science course

E-learning: you don't always get what you hope for

Despite substantial growth in the use of information and communication technologies (ICT) throughout western societies, there is much evidence of technology-led innovations within Higher Education (HE) failing to achieve the anticipated transformations in learning and teaching. This paper reviews evidence from research and evaluation studies relating not only to e-learning, but also to wider HE practices. It argues that the use of ICT does not, in itself, result in improved educational outcomes and ways of working. It considers contextual factors that are of greater significance in determining how and why e-learning is used in HE. Students' engagement with e-learning relates to their expectations and conceptions of learning and to assessment demands. Academics need to re-assess their own beliefs and practices concerning teaching and assessment and their impact on the experience of learners. Both teachers and learners need to understand why e-learning activities are to be undertaken and the rewards expected to be derived

The educational impact of assessment: a comparison of DOPS and MCQs

Aim: To evaluate the impact of two different assessment formats on the approaches to learning of final year veterinary students. The relationship between approach to learning and examination performance was also investigated. Method: An 18-item version of the Study Process Questionnaire (SPQ) was sent to 87 final year students. Each student responded to the questionnaire with regards to DOPS (Direct Observation of Procedural Skills) and a Multiple Choice Examination (MCQ). Semi-structured interviews were conducted with 16 of the respondents to gain a deeper insight into the students’ perception of assessment. Results: Students’ adopted a deeper approach to learning for DOPS and a more surface approach with MCQs. There was a positive correlation between an achieving approach to learning and examination performance. Analysis of the qualitative data revealed that deep, surface and achieving approaches were reported by the students and seven major influences on their approaches to learning were identified: motivation, purpose, consequence, acceptability, feedback, time pressure and the individual difference of the students. Conclusions: The format of DOPS has a positive influence on approaches to learning. There is a conflict for students between preparing for final examinations and preparing for clinical practice

Online peer assessment in higher education: a systematic review of literature in educational practices

Neste artigo procedemos a uma revisão sistemática da literatura sobre Online Peer Assessment (OPA) no Ensino Superior, mediadas por Tecnologias Digitais de Informação e Comunicação (TIC). Identificamos suas características, centrais e opcionais e mapeamos exemplos práticos (procedimentos e TIC) de OPA que poderão ser transversais, adaptáveis e aplicáveis em diversas unidades curriculares e regimes educacionais. Os resultados apontam para a utilização da OPA como uma estratégia que potencia a “avaliação para a aprendizagem”. Os referenciais teóricos subjacentes, os métodos de avaliação e os tipos de TIC utilizadas indicam seu direcionamento para um maior envolvimento e responsabilidade do aluno na sua aprendizagem. Evidenciamos na literatura que se busca desenvolver essas competências, dando ao aluno oportunidades com alguma regularidade para autoavaliar-se e avaliar seus pares por meio de feedback construtivo. Há também evidências de que dar ou produzir feedback é mais benéfico para a aprendizagem do que apenas recebê-lo, como também é cognitivamente mais exigente e envolve os alunos de forma mais ativa e os direciona ao pensamento crítico e a processos metacognitivos. A partir dos resultados alcançados, consideramos que a OPA, enquanto ferramenta cognitiva, contribui para a construção do conhecimento e para a reflexão sobre a aprendizagem. Um desafio que se coloca diz respeito ao desenvolvimento criativo com foco na diversificação e na inovação das práticas de avaliação no sentido de potenciar aprendizagens e resultados acadêmicos, em atenção às necessidades de aprendizagem que se manifestam frente às expectativas da educação atual e futura e às exigências da sociedade.In this research a systematic review of literature about Online Peer Assessment (OPA) in higher education, mediated by Information and Communication Technology (ICT), was carried out. Optional and central characteristics and its practices (procedures and ICT) were identified and mapping. These procedures and practices may be transversal, adaptable and applied in several curriculum units and educational regimes. The results point to the use of OPA as a strategy that enhances “assessment for learning”. The theoretical framework, the methods of assessment and the kinds of ICT used indicate directions for greater involvement and responsibility from the part of the student in his/her learning. Theoretical framework identifies the need to develop students’ skills, providing them with opportunities for self-assessment and peer assessment on a regular basis through constructive feedback. There is also evidence that to give or receive feedback is more beneficial for learning than just receiving it. It is also cognitively more demanding and directs the students to critical thinking and metacognitive processes. From the results obtained, OPA is seen as a cognitive tool, contributing to the building of knowledge and to reflection about learning. Issues for further reflection are also identified such as the creative development of assessment methods with a focus on diversity and innovation in order to enhance students’ learning and academic results, taking into account their learning needs in face of the expectations of current and future education and the demands of society.CIEC - Centro de Investigação em Estudos da Criança, IE, UMinho (UI 317 da FCT), PortugalFundos Nacionais através da FCT (Fundação para a Ciência e a Tecnologia) e cofinanciado pelo Fundo Europeu de Desenvolvimento Regional (FEDER) através do COMPETE 2020 – Programa Operacional Competitividade e Internacionalização (POCI) com a referência POCI-01-0145-FEDER-007562info:eu-repo/semantics/publishedVersio

The mechanism of impact of summative assessment on medical students’ learning

It has become axiomatic that assessment impacts powerfully on student learning, but there is a surprising dearth of research on how. This study explored the mechanism of impact of summative assessment on the process of learning of theory in higher education. Individual, in-depth interviews were conducted with medical students and analyzed qualitatively. The impact of assessment on learning was mediated through various determinants of action. Respondents’ learning behaviour was influenced by: appraising the impact of assessment; appraising their learning response; their perceptions of agency; and contextual factors. This study adds to scant extant evidence and proposes a mechanism to explain this impact. It should help enhance the use of assessment as a tool to augment learning