A review of ten years of implementation and research in aligning learning design with learning analytics at the Open University UK

There is an increased recognition that learning design drives both student learning experience and quality enhancements of teaching and learning. The Open University UK (OU) has been one of few institutions that have explicitly and systematically captured the designs for learning at a large scale. By applying advanced analytical techniques on large and fine-grained datasets, the OU has been unpacking the complexity of instructional practices, as well as providing conceptual and empirical evidence of how learning design influences student behaviour, satisfaction, and performance. This study discusses the implementation of learning design at the OU in the last ten years, and critically reviews empirical evidence from eight recent large-scale studies that have linked learning design with learning analytics. Four future research themes are identified to support future adoptions of learning design approaches

Simulating Light-Weight Personalised Recommender Systems in Learning Networks: A Case for Pedagogy-Oriented and Rating-Based Hybrid Recommendation Strategies

Recommender systems for e-learning demand specific pedagogy-oriented and hybrid recommendation strategies. Current systems are often based on time-consuming, top down information provisioning combined with intensive data-mining collaborative filtering approaches. However, such systems do not seem appropriate for Learning Networks where distributed information can often not be identified beforehand. Providing sound way-finding support for lifelong learners in Learning Networks requires dedicated personalised recommender systems (PRS), that offer the learners customised advise on which learning actions or programs to study next. Such systems should also be practically feasible and be developed with minimized effort. Currently, such so called light-weight PRS systems are scarcely available. This study shows that simulation studies can support the analysis and optimisation of PRS requirements prior to starting the costly process of their development, and practical implementation (including testing and revision) during field experiments in real-life learning situations. This simulation study confirms that providing recommendations leads towards more effective, more satisfied, and faster goal achievement. Furthermore, this study reveals that a light-weight hybrid PRS-system based on ratings is a good alternative for an ontology-based system, in particular for low-level goal achievement. Finally, it is found that rating-based light-weight hybrid PRS-systems enable more effective, more satisfied, and faster goal attainment than peer-based light-weight hybrid PRS-systems (incorporating collaborative techniques without rating).Recommendation Strategy; Simulation Study; Way-Finding; Collaborative Filtering; Rating

Measuring cognitive load and cognition: metrics for technology-enhanced learning

This critical and reflective literature review examines international research published over the last decade to summarise the different kinds of measures that have been used to explore cognitive load and critiques the strengths and limitations of those focussed on the development of direct empirical approaches. Over the last 40 years, cognitive load theory has become established as one of the most successful and influential theoretical explanations of cognitive processing during learning. Despite this success, attempts to obtain direct objective measures of the theory's central theoretical construct – cognitive load – have proved elusive. This obstacle represents the most significant outstanding challenge for successfully embedding the theoretical and experimental work on cognitive load in empirical data from authentic learning situations. Progress to date on the theoretical and practical approaches to cognitive load are discussed along with the influences of individual differences on cognitive load in order to assess the prospects for the development and application of direct empirical measures of cognitive load especially in technology-rich contexts

A Hybrid Recommender Strategy on an Expanded Content Manager in Formal Learning

The main topic of this paper is to find ways to improve learning in a formal Higher Education Area. In this environment, the teacher publishes or suggests contents that support learners in a given course, as supplement of classroom training. Generally, these materials are pre-stored and not changeable. These contents are typically published in learning management systems (the Moodle platform emerges as one of the main choices) or in sites created and maintained on the web by teachers themselves. These scenarios typically include a specific group of students (class) and a given period of time (semester or school year). Contents reutilization often needs replication and its update requires new edition and new submission by teachers. Normally, these systems do not allow learners to add new materials, or to edit existing ones. The paper presents our motivations, and some related concepts and works. We describe the concepts of sequencing and navigation in adaptive learning systems, followed by a short presentation of some of these systems. We then discuss the effects of social interaction on the learners’ choices. Finally, we refer some more related recommender systems and their applicability in supporting learning. One central idea from our proposal is that we believe that students with the same goals and with similar formal study time can benefit from contents' assessments made by learners that already have completed the same courses and have studied the same contents. We present a model for personalized recommendation of learning activities to learners in a formal learning context that considers two systems. In the extended content management system, learners can add new materials, select materials from teachers and from other learners, evaluate and define the time spent studying them. Based on learner profiles and a hybrid recommendation strategy, combining conditional and collaborative filtering, our second system will predict learning activities scores and offers adaptive and suitable sequencing learning contents to learners. We propose that similarities between learners can be based on their evaluation interests and their recent learning history. The recommender support subsystem aims to assist learners at each step suggesting one suitable ordered list of LOs, by decreasing order of relevance. The proposed model has been implemented in the Moodle Learning Management System (LMS), and we present the system’s architecture and design. We will evaluate it in a real higher education formal course and we intend to present experimental results in the near future

Combining Social- and Information-based Approaches for Personalised Recommendation on Sequencing Learning Activities

Lifelong learners who assign learning activities (from multiple sources) to attain certain learning goals throughout their lives need to know which learning activities are (most) suitable and in which sequence these should be performed. Learners need support in this way finding process (selection and sequencing), and we argue this could be provided by using personalised recommender systems. To enable personalisation, collaborative filtering could use information about learners and learning activities, since their alignment contributes to learning efficiency. A model for way finding has been developed that presents personalised recommendations in relation to information about learning goals, learning activities and learners. A personalised recommender system has been developed accordingly, and recommends learners on the best next learning activities. Both model and system combine social-based (i.e., completion data from other learners) and information-based (i.e., metadata from learner profiles and learning activities) approaches to recommend the best next learning activity to be completed

Combining Social- and Information-based Approaches for Personalised Recommendation on Sequencing Learning Activities

Hummel, H. G. K., Van den Berg, E. J., Berlanga, A. J., Drachsler, H., Janssen, J., Nadolski, R.J., & Koper, E.J.R. (2007). Combining social- and information-based approaches for personalised recommendation on sequencing learning activities. International Journal of Learning Technology, 3(2), 152-168.Lifelong learners who assign learning activities (from multiple sources) to attain certain learning goals throughout their lives need to know which learning activities are (most) suitable and in which sequence these should be performed. Learners need support in this way finding process (selection and sequencing), and we argue this could be provided by using personalised recommender systems. To enable personalisation, collaborative filtering could use information about learners and learning activities, since their alignment contributes to learning efficiency. A model for way finding has been developed that presents personalised recommendations in relation to information about learning goals, learning activities and learners. A personalised recommender system has been developed accordingly, and recommends learners on the best next learning activities. Both model and system combine social-based (i.e., completion data from other learners) and information-based (i.e., metadata from learner profiles and learning activities) approaches to recommend the best next learning activity to be completed.This work has been sponsored by the EU project TENCompetenc

Swarm-based Sequencing Recommendations in E-learning

To be presented at the International Workshop on Recommender Agents and Adaptive Web-based Systems (RAAWS 2005) held in conjunction with the Intelligent Systems Design and Applications 2005 Conference (ISDA 2005), Wroclaw, Poland, September 8-10, 2005. Proceedings 5th International Conference on Intelligent Systems Design and Applications, (Eds) Kwasnicka, H. & Paprzycki, M., IEEE Computer Society, 2005, pp.488-493Open and distance Learning (ODL) gives learners freedom of time, place and pace of study, putting learner self-direction centre-stage. However, increased responsibility should not come at the price of over-burdening or abandonment of learners as they progress along their learning journey. This paper introduces an approach to recommending the sequencing of e-learning modules for distance learners based on self-organisation theory. It describes an architecture which supports the recording, processing and presentation of collective learner behaviour designed to create a feedback loop informing learners of successful paths towards the attainment of learning goals. The article includes initial results from a large-scale experiment designed to validate the approach

Simulating light-weight Personalised Recommender Systems in Learning Networks: A case for Pedagogy-Oriented and Rating-based Hybrid Recommendation Strategies

Nadolski, R. J., Van den Berg, B., Berlanga, A. J., Drachsler, H., Hummel, H. G. K., Koper, R., & Sloep, P. B. (2009). Simulating Light-Weight Personalised Recommender Systems in Learning Networks: A Case for Pedagogy-Oriented and Rating-Based Hybrid Recommendation Strategies. Journal of Artificial Societies and Social Simulation 12(1)4 <http://jasss.soc.surrey.ac.uk/12/1/4.html>.Recommender systems for e-learning demand specific pedagogy-oriented and hybrid recommendation strategies. Current systems are often based on time-consuming, top down information provisioning combined with intensive data-mining collaborative filtering approaches. However, such systems do not seem appropriate for Learning Networks where distributed information can often not be identified beforehand. Sound way-finding for lifelong learners in Learning Networks requires dedicated personalised recommender systems (PRS) which should also be practically feasible with minimized effort. Currently, such light-weight PRS systems are scarcely available. This study shows that simulations can support defining PRS requirements prior to starting the costly process of development, implementation, testing, revision, and before conducting field experiments with real learners. This study confirms that providing recommendations leads towards more effective, more satisfied, and faster goal achievement. Furthermore, this simulation study reveals that a rating-based light-weight hybrid PRS-system is a good alternative for ontology-based recommendations, in particular for low-level goal achievement. Finally, it is found that rating-based light-weight hybrid PRS-systems enable more effective, more satisfied, and faster goal attainment than peer-based light-weight hybrid PRS-systems (incorporating collaborative techniques without rating)

Leveraging VR/AR/MR/XR Technologies to Improve Cybersecurity Education, Training, and Operations

The United States faces persistent threats conducting malicious cyber campaigns that threaten critical infrastructure, companies and their intellectual property, and the privacy of its citizens. Additionally, there are millions of unfilled cybersecurity positions, and the cybersecurity skills gap continues to widen. Most companies believe that this problem has not improved and nearly 44% believe it has gotten worse over the past 10 years. Threat actors are continuing to evolve their tactics, techniques, and procedures for conducting attacks on public and private targets. Education institutions and companies must adopt emerging technologies to develop security professionals and to increase cybersecurity awareness holistically. Leveraging Virtual/ Augmented/Mixed/Extended Reality technologies for education, training, and awareness can augment traditional learning methodologies and improve the nation’s cybersecurity posture. This paper reviews previous research to identify how distance and remote education are conducted generally, and how Virtual/Augmented/Extended/Mixed reality technologies are used to conduct cybersecurity awareness training, cybersecurity training, and conduct operations. Finally, barriers to adopting these technologies will be discussed. Understanding how these technologies can be developed and implemented provides one potential way of overcoming the cybersecurity workforce gap and increasing the competencies and capabilities of cybersecurity professionals