Guide to using Evidence in Higher Education

This Guide to Using Evidence has been designed to, to support and encourage students and students’ association and union staff to actively engage with data and evidence. It offers an accessible introduction to a range of key ideas and concepts and a range of activities which allow readers to develop their own thinking and confidence in key areas. The ambition of its authors, QAA Scotland and the students who reviewed early drafts, is that students and students’ association and union staff will reach for this resource as they prepare for committees, devise new campaigns, deliver services, and do all of the other things they do to enhance students’ experiences and outcomes. Underpinning all of this is a belief that students themselves, the institutions they are working with, and the sector as a whole, are better served when students are, and are seen to be, agents in the ‘data landscape’, not just subjects of it. Engaging with this Guide will help students and students’ association and union staff to develop that sense of agency in themselves and foster it in others. This Guide is a product of a student-led project coordinated by QAA Scotland as part of the Evidence for Enhancement Theme (2017-20)

Working at the coal face: The contribution of Programme Tutors in supporting practice-based learning in nursing

This paper reports the findings of a Centre for Excellence in Teaching and Learning-funded project to explore key features of effective support for pre-registration nursing students in practice settings. Background The cultivation of positive practice learning environments for students of nursing, including high quality learning support, has been long established as a thorny issue for nurse educators and practitioners. Indeed it was a key theme for the very first nursing research series, supported by the Royal College of Nursing, in the early 1980’s. This included Fretwell’s (1982) work on ward teaching and learning, Orton’s (1981) work on the ward learning environment and Ogier’s (1982) work on the role of the ward sister. Since then there has been an explosion of research in this area. As a profession we have a responsibility to ensure high quality learning support for students in practice settings. If we do not, there will be wide-ranging implications for the quality of patient care, work-related stress, role satisfaction, retention and attrition and professional reputation. Given the significant investment in nurse education and the need to retain nurses in the workforce, it is unsurprising therefore that the practice learning environment has emerged as a key policy issue in the United Kingdom and internationally. Previous research indicates that relationships between the learner and staff are crucial in supporting learning in practice (Pearcey and Elliott, 2004) and that ‘learning is maximised when the learner is effectively partnered with a clinician and experiences are shared’ (Henderson et al., 2009, p.178). In this context, The Programme Tutor (PT) – a role unique to the pre-registration nursing programme at The Open University (OU) – is crucial in facilitating learning in the practice setting. The purpose of the PT role is to work longitudinally with both students and their mentors to support learning in practice and monitor student progress. The PT therefore plays a pivotal role in facilitating learning in the practice setting, aspects of which may have potential for transfer to the wider health education sector. Objectives The overall aim of the project was to critically examine the experiences of a sample of PTs supporting students and mentors on the pre-registration nursing programme at the OU in order to identify the key features of effective PT practice. These features would then inform the continuing development of the programme. Two PTs were recruited as co-researchers on the project, the objectives of which were to: • Explore PT’s experiences of supporting students and mentors • Explore PT’s views regarding student progression • Identify how PTs ‘grow’ into their role • Identify enabling and disabling factors contributing to role effectiveness • Examine the boundaries between the role of the PT and mentor • Explore variations in the PT role across the UK. Data collection and analysis A sample of 20 PTs working on the final practice module of the pre-registration nursing programme, and located across the nations and regions of the UK, was identified. Following ethical approval, telephone interviews were conducted using an interview guide informed by both a review of the literature and the experience of the PT co-researchers. Telephone interviews were used in preference to individual face-to-face interviews in order to accommodate the dispersed geographical spread of participants. The interviews were recorded using digital recording equipment and following transcription, conventional approaches to qualitative data analysis were used to identify common themes across the data. The ethical principles of confidentiality, anonymity and informed consent were upheld throughout the study. The sample was assured that confidentiality would be maintained at all times throughout the project. Anonymity was protected by using pseudonyms both for PTs and organisations. Informed consent was gained at the start of the project and participants were able to withdraw from the project at any stage. Findings suggest that PTs find their role both rewarding and vital in the context of creating supportive learning environments and ultimately supporting students’ transition to become registered practitioners. Being an effective communicator and establishing and maintaining relationships with students, mentors and service managers was described as crucial to the success of the role. Understanding the pressures within practice environments and being able to acknowledge the realities of ‘working at the coalface’ enabled PTs to support both students and mentors in such settings. Conclusion This paper will elaborate more fully the findings of the project, illustrated with reference to verbatim quotes from the data. Although a role unique to the OU pre-registration nursing programme, there may be aspects of the role which could be transferable to other practice-based learning settings. This will be interactively debated with conference delegates. (word count 800) References Fretwell, J. E. (1982) Ward teaching and Learning, Royal College of Nursing, London. Henderson, A., Twentyman, M., Eaton, E., Creedy, D., Stapleton, P. and Lloyd, B. (2009) Creating supportive clinical learning environments: an intervention study, Journal of Clinical Nursing, 19, pp.171-182. Ogier, M. E. (1981) An ideal sister, Royal College of Nursing, London Orton, H. D. (1981) Ward learning climate, Royal College of Nursing, London Pearcey, P. A. and Elliott, B. E. (2004) Student impressions of clinical nursing, Nurse Education Today, 18, pp.29-31

Representational task formats and problem solving strategies in kinematics and work

Previous studies have reported that students employed different problem solving approaches when presented with the same task structured with different representations. In this study, we explored and compared students’ strategies as they attempted tasks from two topical areas, kinematics and work. Our participants were 19 engineering students taking a calculus-based physics course. The tasks were presented in linguistic, graphical, and symbolic forms and requested either a qualitative solution or a value. The analysis was both qualitative and quantitative in nature focusing principally on the characteristics of the strategies employed as well as the underlying reasoning for their applications. A comparison was also made for the same student’s approach with the same kind of representation across the two topics. Additionally, the participants’ overall strategies across the different tasks, in each topic, were considered. On the whole, we found that the students prefer manipulating equations irrespective of the representational format of the task. They rarely recognized the applicability of a ‘‘qualitative’’ approach to solve the problem although they were aware of the concepts involved. Even when the students included visual representations in their solutions, they seldom used these representations in conjunction with the mathematical part of the problem. Additionally, the students were not consistent in their approach for interpreting and solving problems with the same kind of representation across the two topical areas. The representational format, level of prior knowledge, and familiarity with a topic appeared to influence their strategies, their written responses, and their ability to recognize qualitative ways to attempt a problem. The nature of the solution does not seem to impact the strategies employed to handle the problem

Practices, policies, and problems in the management of learning data: A survey of libraries’ use of digital learning objects and the data they create

This study analyzed libraries’ management of the data generated by library digital learning objects (DLO’s) such as forms, surveys, quizzes, and tutorials. A substantial proportion of respondents reported having a policy relevant to learning data, typically a campus-level policy, but most did not. Other problems included a lack of access to library learning data, concerns about student privacy, inadequate granularity or standardization, and a lack of knowledge about colleagues’ practices. We propose more dialogue on learning data within libraries, between libraries and administrators, and across the library profession

Representational task formats and problem solving strategies in kinematics and work

Previous studies have reported that students employed different problem solving approaches when presented with the same task structured with different representations. In this study, we explored and compared students’ strategies as they attempted tasks from two topical areas, kinematics and work. Our participants were 19 engineering students taking a calculus-based physics course. The tasks were presented in linguistic, graphical, and symbolic forms and requested either a qualitative solution or a value. The analysis was both qualitative and quantitative in nature focusing principally on the characteristics of the strategies employed as well as the underlying reasoning for their applications. A comparison was also made for the same student’s approach with the same kind of representation across the two topics. Additionally, the participants’ overall strategies across the different tasks, in each topic, were considered. On the whole, we found that the students prefer manipulating equations irrespective of the representational format of the task. They rarely recognized the applicability of a ‘‘qualitative’’ approach to solve the problem although they were aware of the concepts involved. Even when the students included visual representations in their solutions, they seldom used these representations in conjunction with the mathematical part of the problem. Additionally, the students were not consistent in their approach for interpreting and solving problems with the same kind of representation across the two topical areas. The representational format, level of prior knowledge, and familiarity with a topic appeared to influence their strategies, their written responses, and their ability to recognize qualitative ways to attempt a problem. The nature of the solution does not seem to impact the strategies employed to handle the problem

Crossing MGLS with the Middle Grades Research Agenda: A Guide for Researchers

For the past several years, leaders in middle grades education research have strengthened their call for more methodologically robust quantitative research to address important questions in the field. Recently, two important routes towards addressing this call have emerged: the Middle Grades Longitudinal Study from the National Center for Education Statistics, and a new research agenda from the Middle Level Education Research Special Interest Group of the American Educational Research Association. In this paper, we conduct a content analysis of the items in the forthcoming longitudinal study in light of the extant research agenda. Results indicate that research questions in eight sections of the agenda are moderately to well-addressed by the data, and that the longitudinal study will provide rich contextual data related to many others. The concurrent emergence of the research agenda and this data offers an opportunity for the research community to engage in high-level quantitative research with a middle grades lens to inform future policy. The item-by-item crosswalk available for download (scroll down for link below) provides guidance for researchers using the Middle Grades Longitudinal Study data to address questions from the research agenda

PeerWise - The Marmite of Veterinary Student Learning

PeerWise is a free online student-centred collaborative learning tool with which students anonymously author, answer, and evaluate multiple choice questions (MCQs). Features such as commenting on questions, rating questions and comments, and appearing on leaderboards, can encourage healthy competition, engage students in reflection and debate, and enhance their communication skills. PeerWise has been used in diverse subject areas but never previously in Veterinary Medicine. The Veterinary undergraduates at the University of Glasgow are a distinct cohort; academically gifted and often highly strategic in their learning due to time pressures and volume of course material. In 2010-11 we introduced PeerWise into 1st year Veterinary Biomolecular Sciences in the Glasgow Bachelor of Veterinary Medicine and Surgery programme. To scaffold PeerWise use, a short interactive session introduced students to the tool and to the basic principles of good MCQ authorship. Students were asked to author four and answer forty MCQs throughout the academic year. Participation was encouraged by an allocation of up to 5% of the final year mark and inclusion of studentauthored questions in the first summative examination. Our analysis focuses on engagement of the class with the\ud tool and their perceptions of its use. All 141 students in the class engaged with PeerWise and the majority contributed beyond that which was stipulated. Student engagement with PeerWise prior to a summative exam was positively correlated to exam score, yielding a relationship that was highly significant (p<0.001). Student perceptions of PeerWise were predominantly positive with explicit recognition of its value as a learning and revision tool, and more than two thirds of the class in agreement that question authoring and answering reinforced their learning. There was clear polarisation of views, however, and those students who did not like PeerWise were vociferous in their dislike, the biggest criticism being lack of moderation by staff

Online interactive assessment with short free-text questions and tailored feedback

A linguistically based authoring tool has been used to write e-assessment questions requiring short free-text answers of up to about 20 words in length (typically a single sentence). The answer matching is sophisticated and students are provided with instantaneous targeted feedback on incorrect and incomplete responses. They are able to use this feedback in reattempting the question. Seventy-five questions of this type have been offered to students on an entry-level interdisciplinary science module and they have been well received. Students have been observed attempting the questions and have been seen to respond in differing ways to both the questions themselves and the feedback provided. The answer matching has been demonstrated to be of similar or greater accuracy than specialist human markers. The software described is all either open source or commercially available, but the purpose of this paper is not to advertise these products but rather to encourage reflection on e-assessment's potential to support student learning