Quality in MOOCs: Surveying the Terrain

The purpose of this review is to identify quality measures and to highlight some of the tensions surrounding notions of quality, as well as the need for new ways of thinking about and approaching quality in MOOCs. It draws on the literature on both MOOCs and quality in education more generally in order to provide a framework for thinking about quality and the different variables and questions that must be considered when conceptualising quality in MOOCs. The review adopts a relativist approach, positioning quality as a measure for a specific purpose. The review draws upon Biggs’s (1993) 3P model to explore notions and dimensions of quality in relation to MOOCs — presage, process and product variables — which correspond to an input–environment–output model. The review brings together literature examining how quality should be interpreted and assessed in MOOCs at a more general and theoretical level, as well as empirical research studies that explore how these ideas about quality can be operationalised, including the measures and instruments that can be employed. What emerges from the literature are the complexities involved in interpreting and measuring quality in MOOCs and the importance of both context and perspective to discussions of quality

Massive open online course completion rates revisited: Assessment, length and attrition

This analysis is based upon enrolment and completion data collected for a total of 221 Massive Open Online Courses (MOOCs). It extends previously reported work (Jordan, 2014) with an expanded dataset; the original work is extended to include a multiple regression analysis of factors that affect completion rates and analysis of attrition rates during courses. Completion rates (defined as the percentage of enrolled students who completed the course) vary from 0.7% to 52.1%, with a median value of 12.6%. Since their inception, enrolments on MOOCs have fallen while completion rates have increased. Completion rates vary significantly according to course length (longer courses having lower completion rates), start date (more recent courses having higher percentage completion) and assessment type (courses using auto grading only having higher completion rates). For a sub-sample of courses where rates of active use and assessment submission across the course are available, the first and second weeks appear to be critical in achieving student engagement, after which the proportion of active students and those submitting assessments levels out, with less than 3% difference between them

Innovating for Learning: Designing for the Future of Education

Teaching has moved online as the world has moved online and learning is losing its sense of physical location with the availability of many different options from mobile to MOOC (Massive Open Online Course). The impact of online learning is not confined to distance learning; when a student attends a campus university they are now as likely to meet with their fellow learners virtually as face to face. The education sector has yet to fully adapt to what this means, and indeed there strong signs of a built in resilience from providers, employers and students themselves which may mean an apparent evolution is more likely than a revolution. At the same time, there are some quiet changes underway that mean we should be preparing to innovate for the revolution to come. Some of those changes are considered in work undertaken at The Open University that has been disseminated in a series of Innovating Pedagogy reports. These reports allow the academic authors to be more speculative than is usual practice and engage in considering the future, while remaining based on a view of what is happening in the sector. In particular they adopt a position focused on pedagogy that balances technology-based futurology that can dominate yet fail to resonate with those actually involved in the teaching process. The annual Innovating Pedagogy reports cover 10 topics each, with some deliberate overlap from year to year and development of themes that show innovations moving into teaching practice. This is illustrated by two cases, the impact of MOOCs and the application of learning design and analytics. The development of MOOCs demonstrates the value of reviewing pedagogy that aligns with technology. While the use of learning design and learning analytics demonstrates how improvements in the way we describe our learning processes and the way we understand learner behaviour is helping determine how choices in pedagogy impact on student satisfaction, progression and success

[Book review] Populism, Media and Education: Challenging discrimination in contemporary digital societies

Published in January 2016, this book is based on a recent cross-European research project, ‘e-Engagement Against Violence’ (e-EAV), which ran from 2012 to 2014 and included research partners from seven EU member states. The project comprised two separate research strands, which are reflected in the structure of the book. First, a discursive approach known as Critical Frame Analysis was used in order to analyse populist communicative strategies online. For clarity, Ranieri sets out the definition of populism as used by the project as “an explorative concept to systematically analyse the ‘discursive strategies’ of ‘othering’ through which right-wing organisations construct and locate the ‘others’ ‘out of the people’ by making them objects of discrimination and exclusion” (Ranieri, 2016, p. 2). In contrast, the second part of the project involved an action research-based approach to design, implement and evaluate media literacy education practices, to improve young peoples’ awareness of the issues online and enhance civic engagement

The OpenupEd quality label: benchmarks for MOOCs

In this paper we report on the development of the OpenupEd Quality Label, a self-assessment and review quality assurance process for the new European OpenupEd portal (www.openuped.eu) for MOOCs (massive open online courses). This process is focused on benchmark statements that seek to capture good practice, both at the level of the institution and at the level of individual courses. The benchmark statements for MOOCs are derived from benchmarks produced by the E xcellence e learning quality projects (E-xcellencelabel.eadtu.eu/). A process of self-assessment and review is intended to encourage quality enhancement, captured in an action plan. We suggest that a quality label for MOOCs will benefit all MOOC stakeholders

Quality Assessment for E-learning: a Benchmarking Approach (Third edition)

The primary purpose of this manual is to provide a set of benchmarks, quality criteria and notes for guidance against which e-learning programmes and their support systems may be judged. The manual should therefore be seen primarily as a reference tool for the assessment or review of e-learning programmes and the systems which support them. However, the manual should also prove to be useful to staff in institutions concerned with the design, development, teaching, assessment and support of e-learning programmes. It is hoped that course developers, teachers and other stakeholders will see the manual as a useful development and/or improvement tool for incorporation in their own institutional systems of monitoring, evaluation and enhancement

How to design for persistence and retention in MOOCs?

Design of educational interventions is typically carried out following a design cycle involving phases of investigation, conceptualization, prototyping, implementation, execution and evaluation. This cycle can be applied at different levels of granularity e.g. learning activity, module, course or programme. In this paper we consider an aspect of learner behavior that can be critical to the success of many MOOCs i.e. their persistence to study, and the related theme of learner retention. We reflect on the impact that consideration of these can have on design decisions at different stages in the design cycle with the aim of en-hancing MOOC design in relation to learner persistence and retention, with particular attention to the European context