Doing what it says on the tin?:A psychometric evaluation of the Assessment Experience Questionnaire

The Assessment Experience Questionnaire has been widely used to measure conditions of learning from assessment. It is one of three methods used in the ‘Transforming the Experience of Students through Assessment’ research process, originally funded by the Higher Education Academy to explore programme assessment patterns, and now used extensively in universities in the United Kingdom. Given the growth of assessment and feedback research over the last decade, the Assessment Experience Questionnaire is ripe for revision. Critics have queried its theoretical and statistical robustness. This study investigated the psychometric properties of the Assessment Experience Questionnaire, as the first step in the process of strengthening the instrument. Specifically, we examined the validity of the questionnaire with a sample of final year undergraduate students from eight UK universities (n = 633). Results were mixed, confirming that the questionnaire has some value, but indicating that not all sub-scales possess adequate psychometric properties to underpin confident conclusions. As a result, we have embarked on a process of making conceptual modifications to the Assessment Experience Questionnaire, both to update the theoretical constructs, and to ensure stronger overall validity. This article indicates the direction of these modifications, which will be outlined in a second article

Graduate Students’ Perceptions of Written Feedback at a Private University in Pakistan

Excellence in academic performance at the graduate level requires good command of writing skills. Teachers’ written feedback can help students to develop their writing skills. However, several personal and contextual factors may influence feedback processes and its utilization by students. Therefore, understanding these factors is essential to improve the practice of written feedback. This study aimed to appraise the quality of written feedback in the graduate programmes and to ascertain students’ perceptions about it at a private university in Pakistan. A purposive sample of 15 participants comprised the study. The data were collected through in-depth students’ interviews and the teachers’ written comments on students’ assignments. Data were coded and cat egorized to assess the pattern of similarities and dissimilarities. The analysis of comments on students’ assignments indicated that the amount of feedback varied greatly. Although some feedback focused on form and style, most comments focused on the content. Moreover, the tone of comments lacked a balance of praise, criticism and suggestions. The data from students’ interviews were categorized as: variations in experiences, functions of written feedback, effectiveness of feedback and utilization of feedback. With some exceptions students’ perceptions about the quality feedback corroborated with the teachers’ comment analysis. The study highlights several factors that impact the receptivity and utilization of feedback by students. Therefore, teachers need to be aware and trained to enhance the quality of their feedback

Struggling and juggling: a comparison of assessment loads in research and teaching-intensive universities

In spite of the rising tide of metrics in UK higher education, there has been scant attention paid to assessment loads, when evidence demonstrates that heavy demands lead to surface learning. Our study seeks to redress the situation by defining assessment loads and comparing them across research-and teaching intensive universities. We clarify the concept of ‘assessment load’ in response to findings about high volumes of summative assessment on modular degrees. We define assessment load across whole undergraduate degrees, according to four measures: the volume of summative assessment; volume of formative assessment; proportion of examinations to coursework; number of different varieties of assessment. All four factors contribute to the weight of an assessment load, and influence students’ approaches to learning. Our research compares programme assessment data from 73 programmes in 14 UK universities, across two institutional categories. Research-intensives have higher summative assessment loads and a greater proportion of examinations; teaching-intensives have higher varieties of assessment. Formative assessment does not differ significantly across both university groups. These findings pose particular challenges for students in different parts of the sector. Our study questions the wisdom that ‘more’ is always better, proposing that lighter assessment loads may make room for ‘slow’ and deep learning

From fast food to a well-balanced diet: toward a programme focused approach to feedback

Feedback may be considered ‘good’ according to many of the criteria in the literature whilst still having little or no impact on students’ learning in the longer term. Here we argue for greater prominence for feedback in curriculum design. Clear principles for giving guidance on assessments and feedback at the programme level, which complement those already established and widely used for single assessments, would help curriculum designers consider communication to students about assessments in a broader context. These processes should create a dialogue that aids the students’ progression in their learning from one module to the next and encourages the development of autonomous learners. Based on a review of the literature on programme-focused approaches to teaching, assessment and feedback, the current paper delineates the benefits of a programme level approach to communication around assessments and proffers a list of broad principles that will help academics achieve a coherent and developmental approach to feedback

The Implications of programme assessment patterns for student learning

ABSTRACT Evidence from 73 programmes in 14 U.K universities sheds light on the typical student experience of assessment over a three-year undergraduate degree. A previous small-scale study in three universities characterised programme assessment environments using a similar method. The current study analyses data about assessment patterns using descriptive statistical methods, drawing on a large sample in a wider range of universities than the original study. Findings demonstrate a wide range of practice across programmes: from 12 summative assessments on one programme to 227 on another; from 87% by examination to none on others. While variations cast doubt on the comparability of U.K degrees, programme assessment patterns are complex. Further analysis distinguishes common assessment patterns across the sample. Typically, students encounter eight times as much summative as formative assessment, a dozen different types of assessment, more than three quarters by coursework. The presence of high summative and low formative assessment diets is likely to compound students’ grade orientation, reinforcing narrow and instrumental approaches to learning. High varieties of assessment are probable contributors to student confusion about goals and standards. Making systematic headway to improve student learning from assessment requires a programmatic and evidence-led approach to design, characterised by dialogue and social practice