Quality in MOOCs: Surveying the Terrain

The purpose of this review is to identify quality measures and to highlight some of the tensions surrounding notions of quality, as well as the need for new ways of thinking about and approaching quality in MOOCs. It draws on the literature on both MOOCs and quality in education more generally in order to provide a framework for thinking about quality and the different variables and questions that must be considered when conceptualising quality in MOOCs. The review adopts a relativist approach, positioning quality as a measure for a specific purpose. The review draws upon Biggs’s (1993) 3P model to explore notions and dimensions of quality in relation to MOOCs — presage, process and product variables — which correspond to an input–environment–output model. The review brings together literature examining how quality should be interpreted and assessed in MOOCs at a more general and theoretical level, as well as empirical research studies that explore how these ideas about quality can be operationalised, including the measures and instruments that can be employed. What emerges from the literature are the complexities involved in interpreting and measuring quality in MOOCs and the importance of both context and perspective to discussions of quality

Learning at Scale: Using an Evidence Hub To Make Sense of What We Know

The large datasets produced by learning at scale, and the need for ways of dealing with high learner/educator ratios, mean that MOOCs and related environments are frequently used for the deployment and development of learning analytics. Despite the current proliferation of analytics, there is as yet relatively little hard evidence of their effectiveness. The Evidence Hub developed by the Learning Analytics Community Exchange (LACE) provides a way of collating and filtering the available evidence in order to support the use of analytics and to target future studies to fill the gaps in our knowledge

Understanding Communication Patterns in MOOCs: Combining Data Mining and qualitative methods

Massive Open Online Courses (MOOCs) offer unprecedented opportunities to learn at scale. Within a few years, the phenomenon of crowd-based learning has gained enormous popularity with millions of learners across the globe participating in courses ranging from Popular Music to Astrophysics. They have captured the imaginations of many, attracting significant media attention - with The New York Times naming 2012 "The Year of the MOOC." For those engaged in learning analytics and educational data mining, MOOCs have provided an exciting opportunity to develop innovative methodologies that harness big data in education.Comment: Preprint of a chapter to appear in "Data Mining and Learning Analytics: Applications in Educational Research

How to design for persistence and retention in MOOCs?

Design of educational interventions is typically carried out following a design cycle involving phases of investigation, conceptualization, prototyping, implementation, execution and evaluation. This cycle can be applied at different levels of granularity e.g. learning activity, module, course or programme. In this paper we consider an aspect of learner behavior that can be critical to the success of many MOOCs i.e. their persistence to study, and the related theme of learner retention. We reflect on the impact that consideration of these can have on design decisions at different stages in the design cycle with the aim of en-hancing MOOC design in relation to learner persistence and retention, with particular attention to the European context

Framework to Enhance Teaching and Learning in System Analysis and Unified Modelling Language

Cowling, MA ORCiD: 0000-0003-1444-1563; Munoz Carpio, JC ORCiD: 0000-0003-0251-5510Systems Analysis modelling is considered foundational for Information and Communication Technology (ICT) students, with introductory and advanced units included in nearly all ICT and computer science degrees. Yet despite this, novice systems analysts (learners) find modelling and systems thinking quite difficult to learn and master. This makes the process of teaching the fundamentals frustrating and time intensive. This paper will discuss the foundational problems that learners face when learning Systems Analysis modelling. Through a systematic literature review, a framework will be proposed based on the key problems that novice learners experience. In this proposed framework, a sequence of activities has been developed to facilitate understanding of the requirements, solutions and incremental modelling. An example is provided illustrating how the framework could be used to incorporate visualization and gaming elements into a Systems Analysis classroom; therefore, improving motivation and learning. Through this work, a greater understanding of the approach to teaching modelling within the computer science classroom will be provided, as well as a framework to guide future teaching activities

iMOOC on climate change: evaluation of a massive open online learning pilot experience

MOOCs are a recent phenomenon, although given its impact, have been subject to a large debate. Several questions have been raised by researchers and educators alike as regarding its sustainability both economical and as an efficient mode of education provision. In this paper we contribute to this discussion by presenting a case study, a Portuguese MOOC about lived experiences in climate change which piloted the iMOOC pedagogical model developed at Universidade Aberta. The iMOOC is an hybrid model which incorporates elements from existing MOOCs but adds other features drawn from UAb's experience with online learning and aim at better integrate in the larger context of the institutional pedagogical culture. The iMOOC implied also an integration of platforms - Moodle and Elgg. The course had more than one thousand participants, and it was the largest MOOC course on Portuguese language delivered so far. We discuss the effort required to design and deliver the course, the technological solution developed, and the results obtained. We registered a moderate effort to create and run the course, ensured by internal staff from the University. The technological solution was a success, an integrated architecture combining well-established, well-tested open software. The completion rate was 3.3%, but the high success of this innovative learning experience is demonstrated by the active involvement of participants, almost 50% of the ones that followed the course until the end, and the satisfaction survey results, with 90% of approval. Lessons learned from this experience and future research on the field are also discussed

How learners’ interactions sustain engagement: a MOOC case study

In 2015, 35 million learners participated online in 4,200 MOOCs organised by over 500 universities. Learning designers orchestrate MOOC content to engage learners at scale and retain interest by carefully mixing videos, lectures, readings, quizzes, and discussions. Universally, far fewer people actually participate in MOOCs than originally sign up with a steady attrition as courses progress. Studies have correlated social engagement to completion rates. The FutureLearn MOOC platform specifically provides opportunities to share opinions and to reflect by posting comments, replying, or following discussion threads. This paper investigates learners’ social behaviours in MOOCs and the impact of engagement on course completion. A preliminary study suggested that dropout rates will be lower when learners engage in repeated and frequent social interactions. We subsequently reviewed the literature of prediction models and applied social network analysis techniques to characterise participants’ online interactions examining implications for participant achievements. We analysed discussions in an eight week FutureLearn MOOC, with 9855 enrolled learners. Findings indicate that if learners starts following someone, the probability of their finishing the course is increased; if learners also interact with those they follow, they are highly likely to complete, both important factors to add to the prediction of completion model