Assessment and the promotion of academic values

This paper raises issues concerning the relationship between student assessment and the values which academic institutions propagate. It argues that many current assessment practices are incompatible with the goals of independence, thoughtfulness and critical analysis to which most academics would subscribe; that forms of assessment which are commonplace are not consistent with the behaviour of academics in their own contributions to knowledge; and that there is evidence to suggest that the assessment policy of many departments undermines deep approaches to learning on the part of students. Some indications are given of possible strategies to address the problems which have been identified, drawing upon ideas from academic and professional practice in general and self-assessment and peer review in particular

Assessment could demonstrate learning gains, but what is required for it to do so?

A ready source of data to investigate learning gain is that generated normally through student assessment. That such data cannot currently be used for this purpose needs explanation and the refreshment of assessment thinking to bring it in line with thinking about standards. This opinion piece discusses what is required for this to occur

Refocusing portfolio assessment: curating for feedback and portrayal

Portfolios are embraced extensively in higher professional education as effective tools for students to represent their learning and help prepare them for future practice. They are very diverse, used for both formative and summative purposes; however, concerns are raised that the current emphasis on academic standards and/or the focus on employability may lead to the perception of portfolios simply as means to portray achievements. This paper argues that contemporary portfolios in digital environments can readily facilitate both purposes. It conceptualises a whole-of-programme approach to the use of portfolios in which consideration is given to the need to bring curation skills and feedback processes to the forefront of portfolio practices. For teachers considering these issues, a planning framework for the design of programme-wide portfolios is proposed

Exploring cultures of feedback practice: the adoption of learning-focused feedback practices in the UK and Australia

In recent years, there have been calls in the literature for the dominant model of feedback to shift away from the transmission of comments from marker to student, towards a more dialogic focus on student engagement and the impact of feedback on student learning. In the present study, we sought to gain insight into the extent to which such a shift is evident in practice, and how practice is shaped by national and disciplinary cultures. A total of 688 higher education staff from the UK and Australia completed a survey, in which we collected data pertaining to key influences on the design of feedback, and the extent to which emphasis is placed on student action following feedback. Our respondents reported that formal learning and development opportunities have less influence on feedback practice than informal learning and development, and prior experience. Australian respondents placed greater emphasis on student action following feedback than their counterparts in the UK, and were also more likely than UK respondents to judge the effectiveness of feedback by seeking evidence of its impact on student learning. We contextualise these findings within the context of disciplinary and career stage differences in our data. By demonstrating international differences in the adoption of learning-focused feedback practices, the findings indicate directions for the advancement of feedback research and practice in contemporary higher educatio

Changing representations of student achievement: the need for innovation

Transcripts and testamurs serve to confirm the award of a degree but offer limited information on what a student can actually do. This conceptual paper considers the problem of how graduate achievements are represented by universities in typically reductive and limited ways that do not enable student achievements and distinctiveness to be communicated to future employers, communities and students themselves. It argues that refinements to existing methods for the design and development of assessment are needed to encompass both university validated and contextualised credentials along with student-constructed portrayals of achievement and personas. Significant change is needed to assessment design, data capture and storage and the ways in which learning outcomes are tracked across a program and over time. Innovations in assessment representation should strengthen employer trust in the value of degrees, student trust in assessment processes and scaffold student agency in curating their employability narratives

Researching feedback dialogue: an interactional analysis approach

A variety of understandings of feedback exist in the literature, which can broadly be categorised as cognitivist information transmission and socio-constructivist. Understanding feedback as information transmission or ‘telling’ has until recently been dominant. However, a socio-constructivist perspective of feedback posits that feedback should be dialogic and help to develop students’ ability to monitor, evaluate and regulate their learning. This paper is positioned as part of the shift away from seeing feedback as input, to exploring feedback as a dialogical process focusing on effects, through presenting an innovative methodological approach to analysing feedback dialogues in situ. Interactional analysis adopts the premise that artefacts and technologies set up a social field, where understanding human–human and human–material activities and interactions is important. The paper suggests that this systematic approach to analysing dialogic feedback can enable insight into previously undocumented aspects of feedback, such as the interactional features that promote and sustain feedback dialogue. The paper discusses methodological issues in such analyses and implications for research on feedback

Examining the nature and effects of feedback dialogue

Research has conventionally viewed feedback from the point of view of the input, thus analysing only one side of the feedback relationship. More recently, there has be an increased interest in understanding feedback-as-talk. Feedback dialogue has been conceptualised as the dynamic interplay of three dimensions: the cognitive, the social-affective and the structural. We sought to explore the interactional features of each dimension and their intermediary effects on students. We analysed students’ feedback dialogue excerpts as cases using interactional analysis. Analysis involved iterative inductive and deductive coding and interpretation of feedback texts generated in an online course. The cognitive, social-affective and structural dimensions were interwoven within excerpts of feedback dialogue with effects on learners that extended beyond the immediate task (e.g. reframing of learners’ ideas, critical evaluation). The interactional features of each dimension include: cognitive (e.g. question asking, expressing oneself); social-affective (e.g. disclosure, expressing empathy); and structural (e.g. longitudinal opportunities for dialogue, invitational opportunities). The study provides evidence that strengthens the call for reconceptualising feedback as a dialogic and relational activity as well as supporting the view that dialogic feedback can be a key strategy for sustainable assessment

Sustainable assessment revisited

Sustainable assessment has been proposed as an idea that focused on the contribution of assessment to learning beyond the timescale of a given course. It was identified as an assessment that meets the needs of the present in terms of the demands of formative and summative assessment, but which also prepares students to meet their own future learning needs. This paper reviews the value of such a notion for assessment; how it has been taken up over the past 15 years in higher education and why it might still be needed. It identifies how it has been a successful intervention in assessment discourse. It explores what more is needed to locate assessment as an intervention to focus on learning for the longer term. It shows how sustainable assessment can help bridge the gap between assessment and learning, and link to ideas such as self-regulation, students’ making judgements about their own work and course-wide assessment

The effects of peer judgements on teamwork and self-assessment ability in collaborative group work

A crucial determinant of the success or failure of collaborative group work is the effect of peer feedback interventions on learning. Research exploring such effects on developing soft skills is sparse. This study seeks to address whether peer feedback leads to enhanced teamwork behaviour and self-assessment ability, two skills highly sought after by employers. Specifically, this study examines the direct effect of formative performance rating and the mediating effect of praise and criticism in peer feedback messages on achievement in teamwork and self-assessment skills. The sample consists of quantitative and qualitative data from 98 students enrolled in business programmes using a particular form of collaborative group work. The paper finds a direct positive relationship between formative performance rating and summative self-assessment ability. It also finds that praise negatively mediates the relationship between formative performance rating and summative teamwork. Further analyses suggest that a significant proportion of comments provided is past- rather than future-oriented. Potential strategies to overcome the limitations of current practices are discussed

The need to disentangle assessment and feedback in higher education

In contemporary higher education systems, the processes of assessment and feedback are often seen as coexisting activities. As a result, they have become entangled in both policy and practice, resulting in a conceptual and practical blurring of their unique purposes. In this paper, we present a critical examination of the issues created by the entanglement of assessment and feedback, arguing that it is important to ensure that the legitimate purposes of both feedback and assessment are not compromised by inappropriate conflation of the two. We situate our argument in the shifting conceptual landscape of feedback, where there is increasing emphasis on students being active players in feedback processes working with and applying information from others to future learning tasks, rather than regarding feedback as a mechanism of transmission of information by teachers. We surface and critically discuss six problems created by the entanglement of assessment and feedback: students’ focus on grades; comments justifying grades rather than support learning; feedback too late to be useful; feedback subordinated to all other processes in course design; overemphasis on documentation of feedback; and the downgrading of feedback created by requirements for anonymous marking. We then propose a series of strategies for preserving the learning function of feedback, through models that give primacy to feedback within learning cycles. We conclude by offering suggestions for research and practice that seek to engage with the challenges created by the entanglement of assessment and feedback, and that maintain the unique purposes of assessment and feedback