Innovating Pedagogy 2017: Exploring new forms of teaching, learning and assessment, to guide educators and policy makers. Open University Innovation Report 6

This series of reports explores new forms of teaching, learning and assessment for an interactive world, to guide teachers and policy makers in productive innovation. This sixth report proposes ten innovations that are already in currency but have not yet had a profound influence on education. To produce it, a group of academics at the Institute of Educational Technology in The Open University collaborated with researchers from the Learning In a NetworKed Society (LINKS) Israeli Center of Research Excellence (I-CORE). Themes: • Big-data inquiry: thinking with data • Learners making science • Navigating post-truth societies • Immersive learning • Learning with internal values • Student-led analytics • Intergroup empathy • Humanistic knowledge-building communities • Open Textbooks • Spaced Learnin

A review of ten years of implementation and research in aligning learning design with learning analytics at the Open University UK

There is an increased recognition that learning design drives both student learning experience and quality enhancements of teaching and learning. The Open University UK (OU) has been one of few institutions that have explicitly and systematically captured the designs for learning at a large scale. By applying advanced analytical techniques on large and fine-grained datasets, the OU has been unpacking the complexity of instructional practices, as well as providing conceptual and empirical evidence of how learning design influences student behaviour, satisfaction, and performance. This study discusses the implementation of learning design at the OU in the last ten years, and critically reviews empirical evidence from eight recent large-scale studies that have linked learning design with learning analytics. Four future research themes are identified to support future adoptions of learning design approaches

Stability and sensitivity of Learning Analytics based prediction models

Learning analytics seek to enhance the learning processes through systematic measurements of learning related data and to provide informative feedback to learners and educators. Track data from Learning Management Systems (LMS) constitute a main data source for learning analytics. This empirical contribution provides an application of Buckingham Shum and Deakin Crick’s theoretical framework of dispositional learning analytics: an infrastructure that combines learning dispositions data with data extracted from computer-assisted, formative assessments and LMSs. In two cohorts of a large introductory quantitative methods module, 2049 students were enrolled in a module based on principles of blended learning, combining face-to-face Problem-Based Learning sessions with e-tutorials. We investigated the predictive power of learning dispositions, outcomes of continuous formative assessments and other system generated data in modelling student performance and their potential to generate informative feedback. Using a dynamic, longitudinal perspective, computer-assisted formative assessments seem to be the best predictor for detecting underperforming students and academic performance, while basic LMS data did not substantially predict learning. If timely feedback is crucial, both use-intensity related track data from e-tutorial systems, and learning dispositions, are valuable sources for feedback generation

A literature synthesis of personalised technology-enhanced learning: what works and why

Personalised learning, having seen both surges and declines in popularity over the past few decades, is once again enjoying a resurgence. Examples include digital resources tailored to a particular learner’s needs, or individual feedback on a student’s assessed work. In addition, personalised technology-enhanced learning (TEL) now seems to be attracting interest from philanthropists and venture capitalists indicating a new level of enthusiasm for the area and a potential growth industry. However, these industries may be driven by profit rather than pedagogy, and hence it is vital these new developments are informed by relevant, evidence-based research. For many people, personalised learning is an ambiguous and even loaded term that promises much but does not always deliver. This paper provides an in-depth and critical review and synthesis of how personalisation has been represented in the literature since 2000, with a particular focus on TEL. We examine the reasons why personalised learning can be beneficial and examine how TEL can contribute to this. We also unpack how personalisation can contribute to more effective learning. Lastly, we examine the limitations of personalised learning and discuss the potential impacts on wider stakeholders

Learning design in diverse institutional and cultural contexts: suggestions from a participatory workshop with higher education professionals in Africa

Learning design approaches, such as those adopted by the Open University, provide a set of tools and resources for purposefully-designing modules with a focus on student experiences. However, many of the current learning design strategies have been situated within specific institutions in Europe and North America. This means that there are several issues worth considering around if and how established learning design approaches make sense in diverse institutional and cultural contexts. To critically assess the relevance and appropriateness of learning design strategies in new contexts, this article describes an in-depth participatory workshop with 34 education professionals from five African countries. Altogether, 10 suggestions for learning design practices were derived from the consensus of workshop participants, which provide a foundation for the development of learning design practices moving forward

EU–originated MOOCs, with focus on multi- and single-institution platforms

No abstract available

Quality in MOOCs: Surveying the Terrain

The purpose of this review is to identify quality measures and to highlight some of the tensions surrounding notions of quality, as well as the need for new ways of thinking about and approaching quality in MOOCs. It draws on the literature on both MOOCs and quality in education more generally in order to provide a framework for thinking about quality and the different variables and questions that must be considered when conceptualising quality in MOOCs. The review adopts a relativist approach, positioning quality as a measure for a specific purpose. The review draws upon Biggs’s (1993) 3P model to explore notions and dimensions of quality in relation to MOOCs — presage, process and product variables — which correspond to an input–environment–output model. The review brings together literature examining how quality should be interpreted and assessed in MOOCs at a more general and theoretical level, as well as empirical research studies that explore how these ideas about quality can be operationalised, including the measures and instruments that can be employed. What emerges from the literature are the complexities involved in interpreting and measuring quality in MOOCs and the importance of both context and perspective to discussions of quality

Assessing collaborative learning: big data, analytics and university futures

Traditionally, assessment in higher education has focused on the performance of individual students. This focus has been a practical as well as an epistemic one: methods of assessment are constrained by the technology of the day, and in the past they required the completion by individuals under controlled conditions, of set-piece academic exercises. Recent advances in learning analytics, drawing upon vast sets of digitally-stored student activity data, open new practical and epistemic possibilities for assessment and carry the potential to transform higher education. It is becoming practicable to assess the individual and collective performance of team members working on complex projects that closely simulate the professional contexts that graduates will encounter. In addition to academic knowledge this authentic assessment can include a diverse range of personal qualities and dispositions that are key to the computer-supported cooperative working of professionals in the knowledge economy. This paper explores the implications of such opportunities for the purpose and practices of assessment in higher education, as universities adapt their institutional missions to address 21st Century needs. The paper concludes with a strong recommendation for university leaders to deploy analytics to support and evaluate the collaborative learning of students working in realistic contexts