Understanding Communication Patterns in MOOCs: Combining Data Mining and qualitative methods

Massive Open Online Courses (MOOCs) offer unprecedented opportunities to learn at scale. Within a few years, the phenomenon of crowd-based learning has gained enormous popularity with millions of learners across the globe participating in courses ranging from Popular Music to Astrophysics. They have captured the imaginations of many, attracting significant media attention - with The New York Times naming 2012 "The Year of the MOOC." For those engaged in learning analytics and educational data mining, MOOCs have provided an exciting opportunity to develop innovative methodologies that harness big data in education.Comment: Preprint of a chapter to appear in "Data Mining and Learning Analytics: Applications in Educational Research

Discussion Analytics: Identifying Conversations and Social Learners in FutureLearn MOOCs

Discussion among learners in MOOCs has been hailed as beneficial for social constructive learning. To understand the pedagogical value of MOOC discussion forums, several researchers have utilized content analysis techniques to associate individual postings with differing levels of cognitive activity. However, this analysis typically ignores the turn taking among discussion postings, such as learners responding to others’ replies to their posts, learners receiving no reply for their posts, or learners just posting without conversing with others. This information is particularly important in understanding patterns of conversations that occur in MOOCs, and learners’ commenting behaviors. Therefore, in this paper we categorize comments in a FutureLearn MOOC based on their nature (post vs. reply to others’ post), classify learners based on their contributions for each type of post-ing, and identify conversations based on the types of comments composing them. This categorization quantifies the dynamics of conversations in the discussion activities, allowing monitoring of on-going discussion activities in FutureLearn and further analysis of identified conversations, social learners, and course steps with an unusually high number of a particular type of comment

Predicting Paid Certification in Massive Open Online Courses

Massive open online courses (MOOCs) have been proliferating because of the free or low-cost offering of content for learners, attracting the attention of many stakeholders across the entire educational landscape. Since 2012, coined as “the Year of the MOOCs”, several platforms have gathered millions of learners in just a decade. Nevertheless, the certification rate of both free and paid courses has been low, and only about 4.5–13% and 1–3%, respectively, of the total number of enrolled learners obtain a certificate at the end of their courses. Still, most research concentrates on completion, ignoring the certification problem, and especially its financial aspects. Thus, the research described in the present thesis aimed to investigate paid certification in MOOCs, for the first time, in a comprehensive way, and as early as the first week of the course, by exploring its various levels. First, the latent correlation between learner activities and their paid certification decisions was examined by (1) statistically comparing the activities of non-paying learners with course purchasers and (2) predicting paid certification using different machine learning (ML) techniques. Our temporal (weekly) analysis showed statistical significance at various levels when comparing the activities of non-paying learners with those of the certificate purchasers across the five courses analysed. Furthermore, we used the learner’s activities (number of step accesses, attempts, correct and wrong answers, and time spent on learning steps) to build our paid certification predictor, which achieved promising balanced accuracies (BAs), ranging from 0.77 to 0.95. Having employed simple predictions based on a few clickstream variables, we then analysed more in-depth what other information can be extracted from MOOC interaction (namely discussion forums) for paid certification prediction. However, to better explore the learners’ discussion forums, we built, as an original contribution, MOOCSent, a cross- platform review-based sentiment classifier, using over 1.2 million MOOC sentiment-labelled reviews. MOOCSent addresses various limitations of the current sentiment classifiers including (1) using one single source of data (previous literature on sentiment classification in MOOCs was based on single platforms only, and hence less generalisable, with relatively low number of instances compared to our obtained dataset;) (2) lower model outputs, where most of the current models are based on 2-polar iii iv classifier (positive or negative only); (3) disregarding important sentiment indicators, such as emojis and emoticons, during text embedding; and (4) reporting average performance metrics only, preventing the evaluation of model performance at the level of class (sentiment). Finally, and with the help of MOOCSent, we used the learners’ discussion forums to predict paid certification after annotating learners’ comments and replies with the sentiment using MOOCSent. This multi-input model contains raw data (learner textual inputs), sentiment classification generated by MOOCSent, computed features (number of likes received for each textual input), and several features extracted from the texts (character counts, word counts, and part of speech (POS) tags for each textual instance). This experiment adopted various deep predictive approaches – specifically that allow multi-input architecture - to early (i.e., weekly) investigate if data obtained from MOOC learners’ interaction in discussion forums can predict learners’ purchase decisions (certification). Considering the staggeringly low rate of paid certification in MOOCs, this present thesis contributes to the knowledge and field of MOOC learner analytics with predicting paid certification, for the first time, at such a comprehensive (with data from over 200 thousand learners from 5 different discipline courses), actionable (analysing learners decision from the first week of the course) and longitudinal (with 23 runs from 2013 to 2017) scale. The present thesis contributes with (1) investigating various conventional and deep ML approaches for predicting paid certification in MOOCs using learner clickstreams (Chapter 5) and course discussion forums (Chapter 7), (2) building the largest MOOC sentiment classifier (MOOCSent) based on learners’ reviews of the courses from the leading MOOC platforms, namely Coursera, FutureLearn and Udemy, and handles emojis and emoticons using dedicated lexicons that contain over three thousand corresponding explanatory words/phrases, (3) proposing and developing, for the first time, multi-input model for predicting certification based on the data from discussion forums which synchronously processes the textual (comments and replies) and numerical (number of likes posted and received, sentiments) data from the forums, adapting the suitable classifier for each type of data as explained in detail in Chapter 7

Revealing the hidden patterns : a comparative study on profiling subpopulations of MOOC students.

Massive Open Online Courses (MOOCs) exhibit a remarkable heterogeneity of students. The advent of complex “big data” from MOOC platforms is a challenging yet rewarding opportunity to deeply understand how students are engaged in MOOCs. Past research, looking mainly into overall behavior, may have missed patterns related to student diversity. Using a large dataset from a MOOC offered by FutureLearn, we delve into a new way of investigating hidden patterns through both machine learning and statistical modelling. In this paper, we report on clustering analysis of student activities and comparative analysis on both behavioral patterns and demographical patterns between student subpopulations in the MOOC. Our approach allows for a deeper understanding of how MOOC students behave and achieve. Our findings may be used to design adaptive strategies towards an enhanced MOOC experience

MOOC next week dropout prediction: weekly assessing time and learning patterns

Although Massive Open Online Course (MOOC) systems have become more prevalent in recent years, associated student attrition rates are still a major drawback. In the past decade, many researchers have sought to explore the reasons behind learner attrition or lack of interest. A growing body of literature recognises the importance of the early prediction of student attrition from MOOCs, since it can lead to timely interventions. Among them, most are concerned with identifying the best features for the entire course dropout prediction. This study focuses on innovations in predicting student dropout rates by examining their next-week-based learning activities and behaviours. The study is based on multiple MOOC platforms including 251,662 students from 7 courses with 29 runs spanning in 2013 to 2018. This study aims to build a generalised early predictive model for the weekly prediction of student completion using machine learning algorithms. In addition, this study is the first to use a ‘learner’s jumping behaviour’ as a feature, to obtain a high dropout prediction accuracy

Demographic Indicators Influencing Learning Activities in MOOCs: Learning Analytics of FutureLearn Courses

Big data and analytics for educational information systems, despite having gained researchers’ attention, are still in their infancy and will take years to mature. Massive open online courses (MOOCs), which record learner-computer interactions, bring unprecedented opportunities to analyse learner activities at a very fine granularity, using very large datasets. To date, studies have focused mainly on dropout and completion rates. This study explores learning activities in MOOCs against their demographic indicators. In particular, pre-course survey data and online learner interaction data collected from two MOOCs, delivered by the University of Warwick, in 2015, 2016, and 2017, are used, to explore how learnerdemographic indicatorsmay influence learner activities. Recommendations for educational information system development and instructional design, especially when a course attracts a diverse group of learners, are provided

[Book review] Populism, Media and Education: Challenging discrimination in contemporary digital societies

Published in January 2016, this book is based on a recent cross-European research project, ‘e-Engagement Against Violence’ (e-EAV), which ran from 2012 to 2014 and included research partners from seven EU member states. The project comprised two separate research strands, which are reflected in the structure of the book. First, a discursive approach known as Critical Frame Analysis was used in order to analyse populist communicative strategies online. For clarity, Ranieri sets out the definition of populism as used by the project as “an explorative concept to systematically analyse the ‘discursive strategies’ of ‘othering’ through which right-wing organisations construct and locate the ‘others’ ‘out of the people’ by making them objects of discrimination and exclusion” (Ranieri, 2016, p. 2). In contrast, the second part of the project involved an action research-based approach to design, implement and evaluate media literacy education practices, to improve young peoples’ awareness of the issues online and enhance civic engagement