Improving assessment tasks through addressing our unconscious limits to change

Despite widespread recognition of the need to improve assessment in higher education, assessment tasks in individual courses are too often dominated by conventional methods. While changing assessment depends on many factors, improvements to assessment ultimately depend on the decisions and actions of individual educators. This paper considers research within the ‘heuristics and biases’ tradition in the field of decision-making and judgement which has identified unconscious factors with the potential to limit capacity for such change. The paper focuses on issues that may compromise the process of improving assessment by supporting a reluctance to change existing tasks, by limiting the time allocated to develop alternative assessment tasks, by underestimating the degree of change needed or by an unwarranted overconfidence in assessment design decisions. The paper proposes countering these unconscious limitations to change by requiring justification for changing, or not changing, assessment tasks, and by informal and formal peer review of assessment task design. Finally, an agenda for research on heuristics and biases in assessment design is suggested in order to establish their presence and help counter their influence

Threats to student evaluative judgement and their management

Students’ capacity for making evaluative judgements of their own work is widely acknowledged as central to their learning within programmes as well as being vital to their subsequent professional practice. In higher education literature, the act of evaluative judgement is usually portrayed as a process of deliberative, analytical reasoning requiring student agency and objectivity, typically scaffolded by points of reference such as explicit criteria, rubrics or exemplars. This article challenges this common portrayal of judgement by drawing attention to research from outside higher education on the role of unconscious factors in judgement and decision-making. Drawing from the field of heuristics and bias studies, the article outlines six unconscious factors that have the potential to distort students’ analytical judgement of their work. A recent challenge to the heuristics and bias approach that radically repositions the place of reasoning in judgement is also considered. Since these unconscious factors have received scant attention in higher education literature, the purpose of this article is to draw attention to them, to identify the challenges they pose to current understandings of evaluative judgement, and to outline their implications for enhancing assessment practic

What can higher education learn from feedback seeking behaviour in organisations? Implications for feedback literacy

While there is now extensive research on informal feedback seeking behaviour by employees in organisations, this literature has received limited attention in higher education. This paper addresses the gap between the two fields of feedback literacy and feedback seeking behaviour. Key organisational feedback seeking behaviour concepts including employee intentions in seeking feedback, the practice of weighing costs and benefits before seeking feedback, the qualities sought in potential feedback providers, feedback seeker characteristics that influence feedback seeking behaviour, and a range of feedback seeking methods and outcomes are outlined and their potential implications for feedback literacy are considered. The paper draws on feedback seeking behaviour literature to propose a research agenda for establishing a stronger and more nuanced understanding of feedback literacy in higher education

Reframing assessment research: through a practice perspective

Assessment as a field of investigation has been influenced by a limited number of perspectives. These have focused assessment research in particular ways that have emphasised measurement, or student learning or institutional policies. The aim of this paper is to view the phenomenon of assessment from a practice perspective drawing upon ideas from practice theory. Such a view places assessment practices as central. This perspective is illustrated using data from an empirical study of assessment decision-making and uses as an exemplar the identified practice of ‘bringing a new assessment task into being’. It is suggested that a practice perspective can position assessment as integral to curriculum practices and end separations of assessment from teaching and learning. It enables research on assessment to de-centre measurement and take account of the wider range of people, phenomena and things that constitute it

The introduction and refinement of the assessment of digitally recorded audio presentations

This case study critically evaluates benefits and challenges of a form of assessment included in a final year undergraduate Religious Studies Open University module, which combines a written essay task with a digital audio recording of a short oral presentation. Based on the analysis of student and tutor feedback and sample assignments, this study critically examines how teaching and learning practices linked to this novel form of assessment have been iteratively developed in light of the project findings over a period of two years. It concludes that while this form of assessment poses a number of challenges, it can create valuable opportunities for the development of transferable twenty-first-century graduate employability skills as well as deep, effective learning experiences, particularly – though not exclusively – in distance learning settings

How university teachers design assessments: a cross disciplinary study

There are dissonances between educators’ aspirations for assessment design and actual assessment implementation in higher education. Understanding how assessment is designed ‘on the ground’ can assist in resolving this tension. Thirty-three Australian university educators from a mix of disciplines and institutions were interviewed. A thematic analysis of the transcripts indicated that assessment design begins as a response to an impetus for change. The design process itself was shaped by environmental influences, which are the circumstances surrounding the assessment design, and professional influences, which are those factors that the educators themselves bring to the process. A range of activities or tasks were undertaken, including those which were essential to all assessment design, those more selective activities which educators chose to optimise the assessment process in particular ways and meta-design processes which educators used to dynamically respond to environmental influences. The qualitative description indicates the complex social nature of interwoven personal and environmental influences on assessment design and the value of an explicit and strategic ways of thinking within the constraints and affordances of a local environment. This suggests that focussing on relational forms of professional development that develops strategic approaches to assessment may be beneficial. The role of disciplinary approaches may be significant and remains an area for future research

Assessment might dictate the curriculum, but what dictates assessment?

Almost all tertiary educators make assessment choices, for example, when they create an assessment task, design a rubric, or write multiple-choice items. Educators potentially have access to a variety of evidence and materials regarding good assessment practice but may not choose to consult them or be successful in translating these into practice. In this article, we propose a new challenge for the Scholarship of Teaching and Learning: the need to study the disjunction between proposals for assessment “best practice” and assessment in practice by examining the assessment decision-making of teachers. We suggest that assessment decision-making involves almost all university teachers, occurs at multiple levels, and is influenced by expertise, trust, culture, and policy. Assessment may dictate the curriculum from the student’s perspective, and we argue that assessment decision-making dictates assessment