Adopting Learning Analytics to Inform Postgraduate Curriculum Design: Recommendations and Research Agenda

Understanding student sentiment plays a vital role in understanding the changes that could or should be made in curriculum design at university. Learning Analytics (LA) has shown potential for improving student learning experiences and supporting teacher inquiry. Yet, there is limited research that reports on the adoption and actual use of LA to support teacher inquiry. This four-year longitudinal study captures sentiment of postgraduate students at a university in Ireland, by integrating LA with the steps of teacher inquiry. This study makes three important contributions to teaching and learning literature. First, it reports on the use of LA to support teacher inquiry over four one-year cycles of a Master of Science in Business Analytics programme between 2016 and 2020. Second, it provides evidence-based recommendations on how to optimise LA to support teacher inquiry, with specific attention as to how these can improve the assimilation of LA into the curriculum design and delivery. Third, the paper concludes with a research agenda to help improve the adoption and integration of LA in the future

Innovating Pedagogy 2015: Open University Innovation Report 4

This series of reports explores new forms of teaching, learning and assessment for an interactive world, to guide teachers and policy makers in productive innovation. This fourth report proposes ten innovations that are already in currency but have not yet had a profound influence on education. To produce it, a group of academics at the Institute of Educational Technology in The Open University collaborated with researchers from the Center for Technology in Learning at SRI International. We proposed a long list of new educational terms, theories, and practices. We then pared these down to ten that have the potential to provoke major shifts in educational practice, particularly in post-school education. Lastly, we drew on published and unpublished writings to compile the ten sketches of new pedagogies that might transform education. These are summarised below in an approximate order of immediacy and timescale to widespread implementation

Innovating Pedagogy 2017: Exploring new forms of teaching, learning and assessment, to guide educators and policy makers. Open University Innovation Report 6

This series of reports explores new forms of teaching, learning and assessment for an interactive world, to guide teachers and policy makers in productive innovation. This sixth report proposes ten innovations that are already in currency but have not yet had a profound influence on education. To produce it, a group of academics at the Institute of Educational Technology in The Open University collaborated with researchers from the Learning In a NetworKed Society (LINKS) Israeli Center of Research Excellence (I-CORE). Themes: • Big-data inquiry: thinking with data • Learners making science • Navigating post-truth societies • Immersive learning • Learning with internal values • Student-led analytics • Intergroup empathy • Humanistic knowledge-building communities • Open Textbooks • Spaced Learnin

Unravelling the dynamics of learning design within and between disciplines in higher education using learning analytics

Designing effective learning experience in virtual learning environment (VLE) can be supported by learning analytics (LA) through explicit feedback on how learning design (LD) influences students’ engagement, satisfaction and performance. Marrying LA with LD not only puts existing pedagogical theories in instructional design to the test with actual learning data, but also provides the context of learning which helps educators translate established LA findings to direct interventions. My dissertation aims at unpacking the complexity of LD and its impact on students’ engagement, satisfaction and performance on VLE using LA. The context of this study is 400+ online and blended learning modules at the Open University (OU) UK. This research combines multiple sources of data from the OU Learning Design Initiative (OULDI), system log data, self-reported surveys, and performance data. Given the scope of this study, a wide range of visualization techniques, social network analysis, multi-level modelling, and machine learning will be used

Scientific Literacy in the digital age: tools, environments and resources for co-inquiry

This paper describes some European and International projects to promote Scientific Literacy in the digital age as well as technologies, environments and resources for co-inquiry. The aim of this research is also to describe computer applications, software tools and environments that were designed to support processes of collaborative inquiry learning to promote Scientific Literacy. These tools are analyzed by describing their interfaces and functionalities. The outcomes of this descriptive research points out some effects on student learning and competences developed known from the literature. This paper argues the importance of promoting scientific citizenship not only through schools and Universities (formal learning), but also non-credit online courses and community-based learning programmes (non-formal context), as well as daily life activities, educational open digital materials through social networks (informal scenario)

A review of ten years of implementation and research in aligning learning design with learning analytics at the Open University UK

There is an increased recognition that learning design drives both student learning experience and quality enhancements of teaching and learning. The Open University UK (OU) has been one of few institutions that have explicitly and systematically captured the designs for learning at a large scale. By applying advanced analytical techniques on large and fine-grained datasets, the OU has been unpacking the complexity of instructional practices, as well as providing conceptual and empirical evidence of how learning design influences student behaviour, satisfaction, and performance. This study discusses the implementation of learning design at the OU in the last ten years, and critically reviews empirical evidence from eight recent large-scale studies that have linked learning design with learning analytics. Four future research themes are identified to support future adoptions of learning design approaches

Mixing and Matching Learning Design and Learning Analytics

In the last five years, learning analytics has proved its potential in predicting academic performance based on trace data of learning activities. However, the role of pedagogical context in learning analytics has not been fully understood. To date, it has been difficult to quantify learning in a way that can be measured and compared. By coding the design of e-learning courses, this study demonstrates how learning design is being implemented on a large scale at the Open University UK, and how learning analytics could support as well as benefit from learning design. Building on our previous work, our analysis was conducted longitudinally on 23 undergraduate distance learning modules and their 40,083 students. The innovative aspect of this study is the availability of fine-grained learning design data at individual task level, which allows us to consider the connections between learning activities, and the media used to produce the activities. Using a combination of visualizations and social network analysis, our findings revealed a diversity in how learning activities were designed within and between disciplines as well as individual learning activities. By reflecting on the learning design in an explicit manner, educators are empowered to compare and contrast their design using their own institutional data

A literature synthesis of personalised technology-enhanced learning: what works and why

Personalised learning, having seen both surges and declines in popularity over the past few decades, is once again enjoying a resurgence. Examples include digital resources tailored to a particular learner’s needs, or individual feedback on a student’s assessed work. In addition, personalised technology-enhanced learning (TEL) now seems to be attracting interest from philanthropists and venture capitalists indicating a new level of enthusiasm for the area and a potential growth industry. However, these industries may be driven by profit rather than pedagogy, and hence it is vital these new developments are informed by relevant, evidence-based research. For many people, personalised learning is an ambiguous and even loaded term that promises much but does not always deliver. This paper provides an in-depth and critical review and synthesis of how personalisation has been represented in the literature since 2000, with a particular focus on TEL. We examine the reasons why personalised learning can be beneficial and examine how TEL can contribute to this. We also unpack how personalisation can contribute to more effective learning. Lastly, we examine the limitations of personalised learning and discuss the potential impacts on wider stakeholders

Connecting Undergraduate Students as Partners in Computer Science Teaching and Research

Connecting undergraduate students as partners can lead to the enhancement of the undergraduate experience and allow students to see the different sides of the university. Such holistic perspectives may better inform academic career choices and postgraduate study. Furthermore, student involvement in course development has many potential benefits. This paper outlines a framework for connecting research and teaching within Computer Science- though this is applicable across other disciplines. Three case studies are considered to illustrate the approach. The first case study involves students in their honours’ stage (level 6, typically 3rd year) project, the second an undergraduate intern between stages 5 and 6, and finally, a MSc (level 7) project. All three case studies have actively involved students in core parts of the University’s teaching and research activities, producing usable software systems to support these efforts. We consider this as a continuing engagement process to enhance the undergraduate learning experience within Computer Science