Quality in MOOCs: Surveying the Terrain

The purpose of this review is to identify quality measures and to highlight some of the tensions surrounding notions of quality, as well as the need for new ways of thinking about and approaching quality in MOOCs. It draws on the literature on both MOOCs and quality in education more generally in order to provide a framework for thinking about quality and the different variables and questions that must be considered when conceptualising quality in MOOCs. The review adopts a relativist approach, positioning quality as a measure for a specific purpose. The review draws upon Biggs’s (1993) 3P model to explore notions and dimensions of quality in relation to MOOCs — presage, process and product variables — which correspond to an input–environment–output model. The review brings together literature examining how quality should be interpreted and assessed in MOOCs at a more general and theoretical level, as well as empirical research studies that explore how these ideas about quality can be operationalised, including the measures and instruments that can be employed. What emerges from the literature are the complexities involved in interpreting and measuring quality in MOOCs and the importance of both context and perspective to discussions of quality

Developing sustainable business models for institutions’ provision of open educational resources: Learning from OpenLearn users’ motivations and experiences

Universities across the globe have, for some time, been exploring the possibilities for achieving public benefit and generating business and visibility through releasing and sharing open educational resources (OER). Many have written about the need to develop sustainable and profitable business models around the production and release of OER. Downes (2006), for example, has questioned the financial sustainability of OER production at scale. Many of the proposed business models focus on OER’s value in generating revenue and detractors of OER have questioned whether they are in competition with formal education. This paper reports on a study intended to broaden the conversation about OER business models to consider the motivations and experiences of OER users as the basis for making a better informed decision about whether OER and formal learning are competitive or complementary with each other. The study focused on OpenLearn - the Open University’s (OU) web-based platform for OER, which hosts hundreds of online courses and videos and is accessed by over 3,000,000 users a year. A large scale survey and follow-up interviews with OpenLearn users worldwide revealed that university provided OER can offer learners a bridge to formal education, allowing them to try out a subject before registering on a formal course and to build confidence in their abilities as learners. In addition, it was found that using OER during formal paid-for study can improve learners’ performance and self-reliance, leading to increased retention and satisfaction with the learning experience

Open educational resources for all? Comparing user motivations and characteristics across The Open University’s iTunes U channel and OpenLearn platform.

With the rise in access to mobile multimedia devices, educational institutions have exploited the iTunes U platform as an additional channel to provide free educational resources with the aim of profile-raising and breaking down barriers to education. For those prepared to invest in content preparation, it is possible to produce interactive, portable material that can be made available globally. Commentators have questioned both the financial implications for platform-specific content production, and the availability of devices for learners to access it (Osborne, 2012). The Open University (OU) makes its free educational resources available on iTunes U and via its web-based open educational resources (OER) platform, OpenLearn. The OU’s OER on iTunes U reached the 60 million download mark in 2013; its OpenLearn platform boasts 27 million unique visitors since 2006. This paper reports the results of a large-scale study of users of the OU’s iTunes U channel and OpenLearn platform. A survey of several thousand users revealed key differences in demographics between those accessing OER via the web and via iTunes U. In addition, the data allowed comparison between three groups: formal learners, informal learners and educators. The study raises questions about whether university-provided OER meet the needs of users and makes recommendations for how content can be modified to suit their needs. As the publishing of OER becomes core to business, we reflect on reasons why understanding users’ motivations and demographics is vital, allowing for needs-led resource provision and content that is adapted to best achieve learner satisfaction, and to deliver institutions’ social mission

How to design for persistence and retention in MOOCs?

Design of educational interventions is typically carried out following a design cycle involving phases of investigation, conceptualization, prototyping, implementation, execution and evaluation. This cycle can be applied at different levels of granularity e.g. learning activity, module, course or programme. In this paper we consider an aspect of learner behavior that can be critical to the success of many MOOCs i.e. their persistence to study, and the related theme of learner retention. We reflect on the impact that consideration of these can have on design decisions at different stages in the design cycle with the aim of en-hancing MOOC design in relation to learner persistence and retention, with particular attention to the European context

OER Hub Researcher Pack

The OER Hub researcher pack will be of interest to anyone conducting research into the impact of open educational resources (OER) or open education. Building on the earlier release of tools developed, used and released by the OER Hub, the researcher pack provides explanation and guidance on how to use these tools. All material and tools are CC BY licensed and are available for reuse

Validation of Non-formal MOOC-based Learning: An Analysis of Assessment and Recognition Practices in Europe (OpenCred)

This report presents the outcomes of research, conducted between May 2014 and November 2015, into emerging practices in assessment, credentialisation and recognition in Massive Open Online Courses (MOOCs). Following extensive research on MOOCs in European Member States, it provides a snapshot of how European Higher Education Institutions (HEIs) recognise (or not) non-formal learning (particularly MOOC-based), and how some employers recognise open badges and MOOC certificates for continuing professional development. We analyse the relationship between forms of assessment used and credentials awarded, from badges for self-assessment to ECTS credits for on-site examinations, and consider the implications for recognition. Case studies provide deeper insights into existing practices. The report introduces a model which guides MOOC conveners in positioning and shaping their offers, and also helps institutions and employers to make recognition decisions. It concludes with a set of recommendations to European HEIs and policy makers to enable wider recognition of open learning in higher education and at the workplace.JRC.J.3-Information Societ

Who are the Open Learners? A Comparative Study Profiling non-Formal Users of Open Educational Resources

Open educational resources (OER) have been identified as having the potential to extend opportunities for learning to non-formal learners. However, little research has been conducted into the impact of OER on non-formal learners. This paper presents the results of a systematic survey of more than 3,000 users of open educational resources (OER). Data was collected between 2013 and 2014 on the demographics, attitudes and behaviours of users of three repositories. Questions included a particular focus on the behaviours of non-formal learners and the relationship between formal and non-formal study. Frequency analysis shows that there are marked differences in patterns of use, user profiles, attitudes towards OER, types of materials used and popularity of different subjects. The experience of using OER is fairly consistent across platforms in terms of satisfaction and impact on future behaviour. On the whole, non-formal learners surveyed were highly positive about their use of OER and believe they will continue to use them. With regards to this making formal study more likely some degree of polarization was observed: some believed formal study was now more likely, while others felt it made this less likely. On the whole, while non-formal learners are enthusiastic about using free and online resources, the language and concept of OER does not seem to be well understood in the groups surveyed. A range of findings relating to OER selection and use as well as differences between repositories are explored in the discussion

Re-purposing MOOCs for academic credit: a student and tutor perspective

The presentation briefly outlines practices in respect of the Accreditation of Prior Learning and their use in awarding credit for students who complete an automated assessment from a Massive Online Learning Course (MOOC). The presentation tells the story of how this was achieved for the first time from the perspective of the tutor and student. Some preliminary research findings indicate that this is probably unique in the UK

Quality Assessment for E-learning: a Benchmarking Approach (Third edition)

The primary purpose of this manual is to provide a set of benchmarks, quality criteria and notes for guidance against which e-learning programmes and their support systems may be judged. The manual should therefore be seen primarily as a reference tool for the assessment or review of e-learning programmes and the systems which support them. However, the manual should also prove to be useful to staff in institutions concerned with the design, development, teaching, assessment and support of e-learning programmes. It is hoped that course developers, teachers and other stakeholders will see the manual as a useful development and/or improvement tool for incorporation in their own institutional systems of monitoring, evaluation and enhancement

Interaction Equivalency in an OER, MOOCS and Informal Learning Era

This theoretical paper attempts to clarify design issues that the field of education has encountered in the context of OER (Open Educational Resources), Massive Open Online Courses (MOOCs) and increased emphasis on informal learning, as examined through the lens of the Interaction Equivalency Theorem. An overview of the core concepts of the Interaction Equivalency Theorem (the EQuiv) is provided and an explanation of how the EQuiv framework can be used to analyze interaction designs for online and distance education. The paper applies EQuiv ideas to categorize three variants of MOOCs (xMOOCs, sMOOCs and cMOOCs), from the perspective of interaction design so as to elucidate the major design differences. In conclusion, this paper explores the changing role of formal education in an era of learning opportunity where online educational resources and opportunities are readily accessible and in many cases completely free of cost to the learner