Effects of Automated Interventions in Programming Assignments: Evidence from a Field Experiment

A typical problem in MOOCs is the missing opportunity for course conductors to individually support students in overcoming their problems and misconceptions. This paper presents the results of automatically intervening on struggling students during programming exercises and offering peer feedback and tailored bonus exercises. To improve learning success, we do not want to abolish instructionally desired trial and error but reduce extensive struggle and demotivation. Therefore, we developed adaptive automatic just-in-time interventions to encourage students to ask for help if they require considerably more than average working time to solve an exercise. Additionally, we offered students bonus exercises tailored for their individual weaknesses. The approach was evaluated within a live course with over 5,000 active students via a survey and metrics gathered alongside. Results show that we can increase the call outs for help by up to 66% and lower the dwelling time until issuing action. Learnings from the experiments can further be used to pinpoint course material to be improved and tailor content to be audience specific.Comment: 10 page

What Stays in Mind? - Retention Rates in Programming MOOCs

This work presents insights about the long-term effects and retention rates of knowledge acquired within MOOCs. In 2015 and 2017, we conducted two introductory MOOCs on object-oriented programming in Java with each over 10,000 registered participants. In this paper, we analyze course scores, quiz results and self-stated skill levels of our participants. The aim of our analysis is to uncover factors influencing the retention of acquired knowledge, such as time passed or knowledge application, in order to improve long-term success. While we know that some participants learned the programming basics within our course, we lack information on whether this knowledge was applied and fortified after the course's end. To fill this knowledge gap, we conducted a survey in 2018 among all participants of our 2015 and 2017 programming MOOCs. The first part of the survey elicits responses on whether and how MOOC knowledge was applied and gives participants opportunity to voice individual feedback. The second part of the survey contains several questions of increasing difficulty and complexity regarding course content in order to learn about the consolidation of the acquired knowledge. We distinguish three programming knowledge areas in the survey: First, understanding of concepts, such as loops and boolean algebra. Second, syntax knowledge, such as specific keywords. Third, practical skills including debugging and coding. We further analyzed the long-term effects separately per participant skill group. While answer rates were low, the collected data shows a decrease of knowledge over time, relatively unaffected by skill level. Application of the acquired knowledge improves the memory retention rates of MOOC participants across all skill levels

A case study of introductory programming with MOOCS

Computational thinking has become a crucial skill for the 21st Century learners in all disciplines. Research suggests that the best and fastest approach to understand the concepts of computational thinking is through developing programming skills. However, finding effective and affordable learning environments to introduce programming skills to a massive scale of students remains a challenge. Currently, the unprecedented utilization of MOOCs represent an opportunity to achieve this goal. But, existing introductory programming MOOCs have failed to provide instructionally-sound experience for learners. The purpose of this descriptive research is two-fold: (1) Identify the affordances of fifteen MOOC\u27s platforms that are best suited to design and implement basic programming skills courses based on the community of inquiry (CoI) framework, and (2) Describe and compare how CoI framework-based instructional strategies were implemented in six basic programming skills MOOCs

How to design for persistence and retention in MOOCs?

Design of educational interventions is typically carried out following a design cycle involving phases of investigation, conceptualization, prototyping, implementation, execution and evaluation. This cycle can be applied at different levels of granularity e.g. learning activity, module, course or programme. In this paper we consider an aspect of learner behavior that can be critical to the success of many MOOCs i.e. their persistence to study, and the related theme of learner retention. We reflect on the impact that consideration of these can have on design decisions at different stages in the design cycle with the aim of en-hancing MOOC design in relation to learner persistence and retention, with particular attention to the European context

Innovating Pedagogy 2015: Open University Innovation Report 4

This series of reports explores new forms of teaching, learning and assessment for an interactive world, to guide teachers and policy makers in productive innovation. This fourth report proposes ten innovations that are already in currency but have not yet had a profound influence on education. To produce it, a group of academics at the Institute of Educational Technology in The Open University collaborated with researchers from the Center for Technology in Learning at SRI International. We proposed a long list of new educational terms, theories, and practices. We then pared these down to ten that have the potential to provoke major shifts in educational practice, particularly in post-school education. Lastly, we drew on published and unpublished writings to compile the ten sketches of new pedagogies that might transform education. These are summarised below in an approximate order of immediacy and timescale to widespread implementation

Music Learning with Massive Open Online Courses

Steels, Luc et al.-- Editors: Luc SteelsMassive Open Online Courses, known as MOOCs, have arisen as the logical consequence of marrying long-distance education with the web and social media. MOOCs were confidently predicted by advanced thinkers decades ago. They are undoubtedly here to stay, and provide a valuable resource for learners and teachers alike. This book focuses on music as a domain of knowledge, and has three objectives: to introduce the phenomenon of MOOCs; to present ongoing research into making MOOCs more effective and better adapted to the needs of teachers and learners; and finally to present the first steps towards 'social MOOCs’, which support the creation of learning communities in which interactions between learners go beyond correcting each other's assignments. Social MOOCs try to mimic settings for humanistic learning, such as workshops, small choirs, or groups participating in a Hackathon, in which students aided by somebody acting as a tutor learn by solving problems and helping each other. The papers in this book all discuss steps towards social MOOCs; their foundational pedagogy, platforms to create learning communities, methods for assessment and social feedback and concrete experiments. These papers are organized into five sections: background; the role of feedback; platforms for learning communities; experiences with social MOOCs; and looking backwards and looking forward. Technology is not a panacea for the enormous challenges facing today's educators and learners, but this book will be of interest to all those striving to find more effective and humane learning opportunities for a larger group of students.Funded by the European Commission's OpenAIRE2020 project.Peer reviewe

Influence of employer support for professional development on MOOCs enrolment and completion: Results from a cross-course survey

Although the potential of open education and MOOCs for professional development is usually recognized, it has not yet been explored extensively. How far employers support non-formal learning is still an open question. This paper presents the findings of a survey-based study which focuses on the influence of employer support for (general) professional development on employees’ use of MOOCs. Findings show that employers are usually unaware that their employees are participating in MOOCs. In addition, employer support for general professional development is positively associated with employees completing MOOCs and obtaining certificates for them. However, the relationship between employer support and MOOC enrollment is less clear: workers who have more support from their employers tend to enroll in either a low or a high number of MOOCs. Finally, the promotion of a minimum of ICT skills by employers is shown to be an effective way of encouraging employee participation in the open education ecosystem.JRC.J.3-Information Societ

Genghis, an authoring tool for Khan Academy exercises

With the rapidly growing use of the Internet, the use of Massive Open Online Courses (MOOCs) is spreading through the academic community, in light of the bene ts these provide not only to the students but to society as well. Most of these courses generally contain some form of evaluation on which a student must prove, either to himself or for evaluation purposes, the learning he has acquired along the way, generally in the form of exercises assigned to a speci c topic or area of knowledge and have the characteristic that, most of the time, do not require human supervision or correction. The main objective of this project is to create an authoring tool for professors without any technical background to generate the aforementioned exercises in a simple, elegant way with the possibility to preview the exercise in progress and formula-editing tools for easy, simple calculations. Moreover, this tool is to be tested on a real production environment with real end users who would test not only the authoring tool, but experience the rst implementation of these courses at UC3M.Ingeniería Telemátic