Higher Education Research in Scotland: Report of a Survey Undertaken by Universities Scotland Educational Development Sub-Committee

The aim of this study was to gain an insight into a range of higher educational research taking place across Scotland with a particular focus on the nature, expertise, support and dissemination of this research. For the purposes of this study, we used the term ‘research into higher education’ to refer to a range of higher educational research activity that included: research into higher education policies and practice, pedagogical research, research into learning and teaching taking place in higher education and research about transition from further education or school into higher education. The findings point to the underground nature of pedagogic research taking place in Scotland. Many researchers are based within disciplines and their pedagogic research is disseminated in a variety of settings that do not always make it easily accessible within generic higher education research discourse. Pedagogic research is also apparently undervalued, with many academic staff experiencing pressure to prioritise publishing within their main discipline over and above pedagogic research. In addition there appears to be a lack of capacity within Scottish institutions to maximise the profile of higher educational research in the forthcoming UK Research Excellence Framework (REF) exercise

Between analysis and transformation: technology, methodology and evaluation on the SPLICE project

This paper concerns the ways in which technological change may entail methodological development in e-learning research. The focus of our argument centres on the subject of evaluation in e-learning and how technology can contribute to consensus-building on the value of project outcomes, and the identification of mechanisms behind those outcomes. We argue that a critical approach to the methodology of evaluation which harnesses technology in this way is vital to agile and effective policy and strategy-making in institutions as the challenges of transformation in a rapidly changing educational and technological environment are grappled with. With its focus on mechanisms and multiple stakeholder perspectives, we identify Pawson and Tilley’s ‘Realistic Evaluation’ as an appropriate methodological approach for this purpose, and we report on its use within a JISC-funded project on social software, SPLICE (Social Practices, Learning and Interoperability in Connected Environments). The project created new tools to assist the identification of mechanisms responsible for change to personal and institutional technological practice. These tools included collaborative mind-mapping and focused questioning, and tools for the animated modelling of complex mechanisms. By using these tools, large numbers of project stakeholders could engage in a process where they were encouraged to articulate and share their theories and ideas as to why project outcomes occurred. Using the technology, this process led towards the identification and agreement of common mechanisms which had explanatory power for all stakeholders. In conclusion, we argue that SPLICE has shown the potential of technologically-mediated Realistic Evaluation. Given the technologies we now have, a methodology based on the mass cumulation of stakeholder theories and ideas about mechanisms is feasible. Furthermore, the summative outcomes of such a process are rich in explanatory and predictive power, and therefore useful to the immediate and strategic problems of the sector. Finally, we argue that as well as generating better explanations for phenomena, the evaluation process can itself become transformative for stakeholders

A systemic framework for managing e-learning adoption in campus universities: individual strategies in context

There are hopes that new learning technologies will help to transform university learning and teaching into a more engaging experience for twenty-first-century students. But since 2000 the changes in campus university teaching have been more limited than expected. I have drawn on ideas from organisational change management research to investigate why this is happening in one particular campus university context. My study examines the strategies of individual lecturers for adopting e-learning within their disciplinary, departmental and university work environments to develop a conceptual framework for analysing university learning and teaching as a complex adaptive system. This conceptual framework links the processes through which university teaching changes, the resulting forms of learning activity and the learning technologies used – all within the organisational context of the university. The framework suggests that systemic transformation of a university’s learning and teaching requires coordinated change across activities that have traditionally been managed separately in campus universities. Without such coordination, established ways of organising learning and teaching will reassert themselves, as support staff and lecturers seek to optimise their own work locally. The conceptual framework could inform strategies for realising the full benefits of new learning technologies in other campus universities