Does the use of summative peer assessment in collaborative group work inhibit good judgement?

The accuracy and consistency of peer marking, particularly when students have the power to reward (or penalise) during formative and summative assessment regimes, is largely unknown. The objective of this study is to evaluate students’ ability and behaviour in marking their peers’ teamwork performance in a collaborative group assessment context both when the mark is counted and not counted towards their final grade. Formative and summative assessment data were obtained from 98 participants in anonymous self and peer assessment of team members’ contributions to a group assessment in business courses. The findings indicate that students are capable of accurately and consistently judging their peers’ performance to a large extent, especially in the formative evaluation of the process component of group work. However, the findings suggest significant peer grading bias when peer marks contribute to final grades. Overall, findings suggest that students are reluctant to honestly assess their peers when they realise that their actions can penalise non-contributing students. This raises questions about the appropriateness of using peer marks for summative assessment purposes. To overcome the problems identified, this paper proposes a number of measures to guide educators in effectively embedding summative peer assessment in a group assessment contex

Navigating feedback practices across learning contexts: implications for feedback literacy

Student feedback practices have been primarily discussed within a context of the particular course or unit of study. Little attention has been paid to how students navigate their feedback practices as they progress through different learning contexts and whether they apply known feedback strategies in new settings. To open exploration of this issue, case studies of five participants were studied over different courses – undergraduate, direct-entry access program and postgraduate - in order to identify how learners’ understandings of past and immediate contexts impacted their approaches to feedback. Data were collected through student artefacts which included e-portfolios completed in the direct-entry program and two interviews, approximately one year apart. Thematic analysis of the data indicated influences of learners’ feedback histories on the application of feedback in new contexts. The findings highlight the need to consider students’ past feedback experiences, as well as identify connections between courses, in order to assist students in applying feedback practices across contexts. Further research exploring how micro transitions between courses and students’ lived experiences of interacting with feedback tools and materials influence their feedback literacy is recommended

The reflective learning continuum: reflecting on reflection

The importance of reflection to marketing educators is increasingly recognized. However, there is a lack of empirical research which considers reflection within the context of both the marketing and general business education literature. This paper describes the use of an instrument which can be used to measure four identified levels of a reflection hierarchy: habitual action, understanding, reflection and intensive reflection and two conditions for reflection: instructor to student interaction and student to student interaction. Further we demonstrate the importance of reflective learning in predicting graduates’ perception of program quality. Although the focus was on assessment of MBA level curricula, the findings have great importance to marketing education and educators

Aligning assessment with the needs of work-integrated learning: the challenges of authentic assessment in a complex context

Work-integrated learning (WIL) is a feature of university courses, both in professional areas, where it is commonplace, but also across many different disciplines. Assessment of WIL can be complex as it involves parties and settings external to the university, and it can be problematic because of difficulties in aligning learning activities during placements with what is or can be assessed by the university. This paper explores the relationship between students’ placement experiences and accompanying assessments in contexts where activities are tightly coupled with the curriculum, and in those where it is not. It draws on a qualitative analysis of student interviews and drawings by the interviewees of their WIL experiences, supplemented with analysis of unit guides. Our findings highlight that students’ perceptions of authenticity of assessment were undermined by misalignments between the student, university and industry. Assessment authenticity was perceived by students as based on alignment between their current and future selves in the assessment process, involvement of industry supervisors and relevance of placement activities to assessment activities. The paper discusses the complexity of coordination of educational activities with external partners, especially when one party drives assessment. It then suggests a reframing of WIL assessment to promote alignment and authenticity

Psychology students’ perception of and engagement with feedback as a function of year of study

Undergraduate students’ perception of feedback and level of engagement with the feedback they receive have gained increasing attention in the educational literature recently to identify areas which require educators’ attention. However, research in this area has generally been based on limited self-selecting samples, and has not considered how students’ relationship with feedback may alter depending on their year of study. To address this, a survey measuring students’ views and practices regarding feedback was completed at a higher education institution by 447 first-, second- and third-year psychology students, representing 77% of the cohort. Findings revealed that third years responded more negatively in both areas than their first- and second-year counterparts, whose ratings on these aspects themselves were far from optimal. These findings highlight the need for early interventions to improve students’ perception of and engagement with feedback in the earlier years, and to prevent the recorded deterioration later on in the degree course

Paraphrases and summaries: A means of clarification or a vehicle for articulating a preferred version of student accounts?

The use of group discussions as a means to facilitate learning from experiences is well documented in adventure education literature. Priest and Naismith (1993) assert that the use of the circular discussion method, where the leader poses questions to the participants, is the most common form of facilitation in adventure education. This paper draws on transcripts of facilitation sessions to argue that the widely advocated practice of leader summaries or paraphrases of student responses in these sessions functions as a potential mechanism to control and sponsor particular knowledge(s). Using transcripts from recorded facilitation sessions the analysis focuses on how the leader paraphrases the students’ responses and how these paraphrases or ‘formulations’ function to modify or exclude particular aspects of the students’ responses. I assert that paraphrasing is not simply a neutral activity that merely functions to clarify a student response, it is a subtle means by which the leader of the session can, often inadvertently or unknowingly, alter the student’s reply with the consequence of favouring particular knowledge(s). Revealing the subtle work that leader paraphrases perform is of importance for educators who claim to provide genuine opportunities for students to learn from their experience

Internal Knowledge Transfer: Professional Development Programmes and Embedding Real World Learning for Full-Time Undergraduates

Perrin, Hancock and Miller provide a discussion of the distinctive features of negotiated work-based learning frameworks that help capture and develop learning for part-time students who are professional practitioners. They demonstrate how approaches to teaching, learning and assessment established in these frameworks can also be leveraged for programmes aimed at full-time undergraduate students wishing to engage with ‘real world’ learning. In this way, full-time students are able to develop the type of professional practice outlooks and skills redolent of part-time students already in employment. The chapter includes two case studies of where this has occurred in UK universities and the methods that were used for this type of internal knowledge transfer

Examining increased flexibility in assessment formats

There have been calls in the literature for changes to assessment practices in higher education, to increase flexibility and give learners more control over the assessment process (Boud and Falchikov 2006; Nicol and MacFarlane-Dick 2006; Taras 2002). This article explores the possibilities of allowing student choice in the format used to present their work, as a starting point for changing assessment, based on recent studies and current examples of flexible assessment practice in Higher Education. The benefits of this flexible assessment format approach are highlighted, along with a discussion of classic assessment considerations such as validity, reliability and marking concerns. The role of technology in facilitating assessment method choice is considered, in terms of new opportunities for providing student choice in the way they evidence their learning and present their work. Considerations for implementing flexible assessment choices into the curriculum are presented, along with a call that further research into such practice is needed to develop a comprehensive set of practical recommendations and best practice for implementation of flexible assessment choice into the curriculum. The article should be of interest to curriculum developers and academics considering implementing changes to the assessment process to increase student ownership and control

An appraisal of students' awareness of "self-reflection" in a first-year pathology course of undergraduate medical/dental education

<p>Abstract</p> <p>Background</p> <p>Self-reflection and reflective practice are increasingly considered as essential attributes of competent professionals functioning in complex and ever-changing healthcare systems of the 21^stcentury. The aim of this study was to determine the extent of students' awareness and understanding of the reflective process and the meaning of 'self-reflection' within the contextual framework of their learning environment in the first-year of their medical/dental education. We endorse that the introduction of such explicit educational tasks at this early stage enhances and promotes students' awareness, understanding, and proficiency of this skill in their continuing life-long health professional learning.</p> <p>Methods</p> <p>Over two years, students registered in first-year pathology at the University of Saskatchewan were introduced to a self-reflection assignment which comprised in the submission of a one-page reflective document to a template of reflective questions provided in the given context of their learning environment. This was a mandatory but ungraded component at the midterm and final examinations. These documents were individually analyzed and thematically categorized to a "5 levels-of-reflection-awareness" scale using a specially-designed rubric based on the accepted major theories of reflection that included students' identification of: 1) personal abilities, 2) personal learning styles 3) relationships between course material and student history 4) emotional responses and 5) future applications.</p> <p>Results</p> <p>410 self-reflection documents were analyzed. The student self-awareness on personal learning style (72.7% level 3+) and course content (55.2% level 3+) were well-reflected. Reflections at a level 1 awareness included identification of a) specific teaching strategies utilized to enhance learning (58.4%), b) personal strengths/weaknesses (53%), and c) emotional responses, values, and beliefs (71.5%). Students' abilities to connect information to life experiences and to future events with understanding were more evenly distributed across all 5 levels of reflection-awareness.</p> <p>Conclusions</p> <p>Exposure to self-reflection assignments in the early years of undergraduate medical education increases student awareness and promotes the creation of personal meaning of one's reactions, values, and premises in the context of student learning environments. Early introduction with repetition to such cognitive processes as practice tools increases engagement in reflection that may facilitate proficiency in mastering this competency leading to the creation of future reflective health professionals.</p

Identifying educator behaviours for high quality verbal feedback in health professions education: literature review and expert refinement

Background Health professions education is characterised by work-based learning and relies on effective verbal feedback. However the literature reports problems in feedback practice, including lack of both learner engagement and explicit strategies for improving performance. It is not clear what constitutes high quality, learner-centred feedback or how educators can promote it. We hoped to enhance feedback in clinical practice by distinguishing the elements of an educator’s role in feedback considered to influence learner outcomes, then develop descriptions of observable educator behaviours that exemplify them. Methods An extensive literature review was conducted to identify i) information substantiating specific components of an educator’s role in feedback asserted to have an important influence on learner outcomes and ii) verbal feedback instruments in health professions education, that may describe important educator activities in effective feedback. This information was used to construct a list of elements thought to be important in effective feedback. Based on these elements, descriptions of observable educator behaviours that represent effective feedback were developed and refined during three rounds of a Delphi process and a face-to-face meeting with experts across the health professions and education. Results The review identified more than 170 relevant articles (involving health professions, education, psychology and business literature) and ten verbal feedback instruments in health professions education (plus modified versions). Eighteen distinct elements of an educator’s role in effective feedback were delineated. Twenty five descriptions of educator behaviours that align with the elements were ratified by the expert panel. Conclusions This research clarifies the distinct elements of an educator’s role in feedback considered to enhance learner outcomes. The corresponding set of observable educator behaviours aim to describe how an educator could engage, motivate and enable a learner to improve. This creates the foundation for developing a method to systematically evaluate the impact of verbal feedback on learner performance