Translating evidence-based guidelines to improve feedback practices:the interACT case study

Background: There has been a substantial body of research examining feedback practices, yet the assessment and feedback landscape in higher education is described as ‘stubbornly resistant to change’. The aim of this paper is to present a case study demonstrating how an entire programme’s assessment and feedback practices were re-engineered and evaluated in line with evidence from the literature in the interACT (Interaction and Collaboration via Technology) project.Methods: Informed by action research the project conducted two cycles of planning, action, evaluation and reflection. Four key pedagogical principles informed the re-design of the assessment and feedback practices. Evaluation activities included document analysis, interviews with staff (n = 10) and students (n = 7), and student questionnaires (n = 54). Descriptive statistics were used to analyse the questionnaire data. Framework thematic analysis was used to develop themes across the interview data.Results: InterACT was reported by students and staff to promote self-evaluation, engagement with feedback and feedback dialogue. Streamlining the process after the first cycle of action research was crucial for improving engagement of students and staff. The interACT process of promoting self-evaluation, reflection on feedback, feedback dialogue and longitudinal perspectives of feedback has clear benefits and should be transferable to other contexts.Conclusions: InterACT has involved comprehensive re-engineering of the assessment and feedback processes using educational principles to guide the design taking into account stakeholder perspectives. These principles and the strategies to enact them should be transferable to other contexts

Sharing responsibility for learning through formative evaluation: moving to evaluation as learning

When gathering student feedback on courses and programmes in higher education, the emphasis is often placed on adaptations that academic staff can make to enhance teaching approaches and thereby improve the learning experiences of students. These are commendable aims, however, it is argued in this paper that the focus on academic staff making changes to teaching and learning misses an opportunity for students to reflect upon their influences over, and potential to enhance, their learning experiences and those of their peers. Many undergraduate and postgraduate programmes aim to develop students’ skills in critical analysis and autonomous learning, with some courses specifically requiring participants to engage in critical reflection on their practice. Yet it is relatively uncommon for evaluation of courses to include any requirement for students to evaluate their own role in the learning experience. An example is presented of a simple, small-scale formative evaluation exercise where course participants were encouraged to give feedback on a course, their learning experiences and on the teaching approach used. However, this evaluation also required participants to reflect on the role they played in their own and others’ learning. It is argued that the approach described in this paper that encourages student self-reflection on learning as an integral part of evaluation processes, is a form of evaluation as learning. This is an approach that could be adapted for use in a wide range of courses for the purpose of encouraging students to reflect more deeply on their role in their own and others’ learning

Centralisation of assessment: meeting the challenges of multi-year team projects in information systems education

This paper focuses on the difficulties of assessing multi-year team projects, in which a team of students drawn from all three years of a full-time degree course works on a problem with and for a real-life organization. Although potential solutions to the problem of assessing team projects may be context-dependent, we believe that discussing these in our paper will allow readers to relate to their teaching cases and increase the general appreciation of team project related work. Findings discussed in this paper are based on the first cycle of action research in relation to an existing multi-year team project scheme. Based on the interpretivist perspective, this work draws on data from staff and student focus groups, semi structured interviews and surveys. Team project clients were also asked to comment on their experiences and the way they would like team projects to be improved in the future. Since issues affecting the success of team projects are quite closely inter-related, a systemic view is adopted rather than analysis of a single issue in isolation. Overall there is a feeling that multi-year team projects are a good idea in theory but can be challenging to implement in practice. It is argued that the main areas of concern are the assessment process, the dilemmas and tensions that it can introduce, and the related inconsistencies in stakeholder involvement, which can compromise the learning experience if not handled well. We believe that the assessment process holds the key to a successful learning experience in team project work

Towards a personal best : a case for introducing ipsative assessment in higher education

The central role that assessment plays is recognised in higher education, in particular how formative feedback guides learning. A model for effective feedback practice is used to argue that, in current schemes, formative feedback is often not usable because it is strongly linked to external criteria and standards, rather than to the processes of learning. By contrast, ipsative feedback, which is based on a comparison with the learner's previous performance and linked to longterm progress, is likely to be usable and may have additional motivational effects. After recommending a move towards ipsative formative assessment, a further step would be ipsative grading. However, such a radical shift towards a fully ipsative regime might pose new problems and these are discussed. The article explores a compromise of a combined assessment regime. The rewards for learners are potentially high, and the article concludes that ipsative assessment is well worth further investigation. © 2011 Society for Research into Higher Education

Improving a tutor’s feedback assessment tool: transforming Open Mentor following two recent deployments

Evidence shows the vital role that the quality of feedback plays on students’ performance and on the overall increase of learning opportunities that good feedback creates for students. Based on this evidence, the Open University developed Open Mentor (OM), a system to support tutors enhance their feedback practice. Open Mentor Technology transfer (OMTetra), a JISC funded project, took OM and deployed it in two Higher Education institutions with the purpose of evaluating the process of transferability and continue the development of the tools available to tutors within the system. This paper describes the original OM and the enhancements identified after use and evaluations from tutors of the institutions involved

Engaging sport students in assessment and formative feedback

Sport as a discipline in higher education is grappling with the challenge of providing authentic and relevant assessment that engages students in their learning. The centrality of assessment to the student experience is now well accepted within the research literature (Brown and Knight, 1994; Rust, 2002). In particular, formative assessment, or assessment that creates feedback to support future teaching and learning experiences, can be a powerful tool for enhancing learning (see Black and Wiliam, 1998). Given that feedback is most effective if it is considered or reflected upon, one of the key challenges is to actively engage sport students in formative assessment processes. This guide offers advice in designing and facilitating sport students’ involvement in assessment and enhancing their engagement with the feedback they receive. The aim is to support sport programme teams by taking a pragmatic approach, combining a clear academic rationale based on assessment for learning principles with case study examples of successful formative assessment exercises emphasising innovative approaches to giving feedback. The guide consists of three key sections focused on: 1) Providing staff in HLST with background knowledge of formative assessment and formative feedback and how it relates to their subject. 2) Providing case study examples of how to effectively engage sport students with assessment feedback so that it feeds-forward to aid learning. 3) Providing a resource of references and sources of support for tutors wishing to further their learning in this area

Continuing professional development in learning and teaching for Graduate Teaching Assistants (GTAs): An institutional response

Graduate teaching assistants (GTAs) are being employed in higher education in a number of roles and with a number of responsibilities regarding learning and teaching and enhancing the student experience. This is in addition to their primary role as researcher. Research training is being provided variously at national, university and departmental levels. Support for GTAs’ learning and teaching role and for their further development in this role is often provided in an ad hoc manner at departmental and university levels (though increasingly also through the support of Higher Education Academy subject centres). This paper outlines the approach that a large research-led university has taken to the continuing professional development of its GTAs. This is examined in terms of the initial support provided to GTAs as well as a more advanced level of support, encapsulated in an accredited Masters level course. The paper concludes with a proposal for research into the learning experience of the GTAs as well as for further research which will examine ways in which the university may support a larger number of GTAs in addition to other staff on hourly paid contracts