Effects of Automated Interventions in Programming Assignments: Evidence from a Field Experiment

A typical problem in MOOCs is the missing opportunity for course conductors to individually support students in overcoming their problems and misconceptions. This paper presents the results of automatically intervening on struggling students during programming exercises and offering peer feedback and tailored bonus exercises. To improve learning success, we do not want to abolish instructionally desired trial and error but reduce extensive struggle and demotivation. Therefore, we developed adaptive automatic just-in-time interventions to encourage students to ask for help if they require considerably more than average working time to solve an exercise. Additionally, we offered students bonus exercises tailored for their individual weaknesses. The approach was evaluated within a live course with over 5,000 active students via a survey and metrics gathered alongside. Results show that we can increase the call outs for help by up to 66% and lower the dwelling time until issuing action. Learnings from the experiments can further be used to pinpoint course material to be improved and tailor content to be audience specific.Comment: 10 page

A Personalized Knowledge Recommender System For Workspace Learning

Technology Enhanced Learning (TEL) is emerging as a popular learning approach utilized by both educational institutions and business organizations. Learning Recommender Systems (RSs) can help e-learners to cope with the data overload difficulty and suggest useful items that users may wish to use. This research aims to examine the design and implementation of personalized RS that supports individual learning in the workplace. First, a hybrid knowledge recommendation technique is proposed by combing content-based method with feedback learning method to adapt to the dynamic preference of users. Second, the design and implementation of a personalized knowledge recommender system using proposed technique in a case company is presented. Quantitative and qualitative data are collected to validate the system and evaluate its performance and impact. The preliminary results show that involving enterprise experts and target users in the system design phase can improve the system transparency and users’ trust in the system. It is also found that users’ learning attitude can be positively influenced by the system experience. This research provides important implications on employing intelligent recommender system to support workplace learning

Panorama of Recommender Systems to Support Learning

This chapter presents an analysis of recommender systems in TechnologyEnhanced Learning along their 15 years existence (2000-2014). All recommender systems considered for the review aim to support educational stakeholders by personalising the learning process. In this meta-review 82 recommender systems from 35 different countries have been investigated and categorised according to a given classification framework. The reviewed systems have been classified into 7 clusters according to their characteristics and analysed for their contribution to the evolution of the RecSysTEL research field. Current challenges have been identified to lead the work of the forthcoming years.Hendrik Drachsler has been partly supported by the FP7 EU Project LACE (619424). Katrien Verbert is a post-doctoral fellow of the Research Foundation Flanders (FWO). Olga C. Santos would like to acknowledge that her contributions to this work have been carried out within the project Multimodal approaches for Affective Modelling in Inclusive Personalized Educational scenarios in intelligent Contexts (MAMIPEC -TIN2011-29221-C03-01). Nikos Manouselis has been partially supported with funding CIP-PSP Open Discovery Space (297229

Personalized Recommender Systems for Resource-based Learning - Hybrid Graph-based Recommender Systems for Folksonomies

As the Web increasingly pervades our everyday lives, we are faced with an overload of information. We often learn on-the-job without a teacher and without didactically prepared learning resources. We not only learn on our own but also collaboratively on social platforms where we discuss issues, exchange information and share knowledge with others. We actively learn with resources we find on the Web such as videos, blogs, forums or wikis. This form of self-regulated learning is called resource-based learning. An ongoing challenge in technology enhanced learning (TEL) and in particular in resource-based learning, is supporting learners in finding learning resources relevant to their current needs and learning goals. In social tagging systems, users collaboratively attach keywords called tags to resources thereby forming a network-like structure called a folksonomy. Additional semantic information gained for example from activity hierarchies or semantic tags, form an extended folksonomy and provide valuable information about the context of the resources the learner has tagged, the related activities the resources could be relevant for, and the learning task the learner is currently working on. This additional semantic information could be exploited by recommender systems to generate personalized recommendations of learning resources. Thus, the first research goal of this thesis is to develop and evaluate personalized recommender algorithms for a resource-based learning scenario. To this end, the resource-based learning application scenario is analysed, taking an existing learning platform as a concrete example, in order to determine which additional semantic information could be exploited for the recommendation of learning resources. Several new hybrid graph-based recommender approaches are implemented and evaluated. Additional semantic information gained from activities, activity hierarchies, semantic tag types, the semantic relatedness between tags and the context-specific information found in a folksonomy are thereby exploited. The proposed recommender algorithms are evaluated in offline experiments on different datasets representing diverse evaluation scenarios. The evaluation results show that incorporating additional semantic information is advantageous for providing relevant recommendations. The second goal of this thesis is to investigate alternative evaluation approaches for recommender algorithms for resource-based learning. Offline experiments are fast to conduct and easy to repeat, however they face the so called incompleteness problem as datasets are limited to the historical interactions of the users. Thus newly recommended resources, in which the user had not shown an interest in the past, cannot be evaluated. The recommendation of novel and diverse learning resources is however a requirement for TEL and needs to be evaluated. User studies complement offline experiments as the users themselves judge the relevance or novelty of the recommendations. But user studies are expensive to conduct and it is often difficult to recruit a large number of participants. Therefore a gap exists between the fast, easy to repeat offline experiments and the more expensive user studies. Crowdsourcing is an alternative as it offers the advantages of offline experiments, whilst still retaining the advantages of a user-centric evaluation. In this thesis, a crowdsourcing evaluation approach for recommender algorithms for TEL is proposed and a repeated evaluation of one of the proposed recommender algorithms is conducted as a proof-of-concept. The results of both runs of the experiment show that crowdsourcing can be used as an alternative approach to evaluate graph-based recommender algorithms for TEL