Your click decides your fate: Inferring Information Processing and Attrition Behavior from MOOC Video Clickstream Interactions

In this work, we explore video lecture interaction in Massive Open Online Courses (MOOCs), which is central to student learning experience on these educational platforms. As a research contribution, we operationalize video lecture clickstreams of students into cognitively plausible higher level behaviors, and construct a quantitative information processing index, which can aid instructors to better understand MOOC hurdles and reason about unsatisfactory learning outcomes. Our results illustrate how such a metric inspired by cognitive psychology can help answer critical questions regarding students' engagement, their future click interactions and participation trajectories that lead to in-video & course dropouts. Implications for research and practice are discusse

Los MOOC y la evaluación del alumnado : revisión sistemática (2012-2016)

Este artículo se centra en el análisis de la evaluación en los MOOC. En primer lugar, analiza el concepto de MOOC y sus principales características. A partir de ahí, se lleva a cabo una revisión sistemática de la literatura científica más relevante producida entre 2012 y 2016 que aborda de modo específico los modelos y propuestas de evaluación del conocimiento adquirido por los alumnos que cursan MOOC. La búsqueda se ha realizado en las siguientes bases de datos: Web of Science, Scopus y EBSCOhost. Se han utilizado descriptores tanto en inglés como en español y, tras eliminar las duplicidades, se han analizado 110 artículos. El resultado es que las propuestas de evaluación más frecuentes son las pruebas objetivas automatizadas y la evaluación por pares, encontrando además que la evaluación por pares se utiliza tanto en los cMOOC como en los xMOOC

A proposal for the methodological design of collaborative language MOOC

The introduction of massive open online education has offered a new range of exciting possibilities for the development of language learning. By opening up access to language education for all who are digitally connected, it contributes to increase the speed and outreach of the dissemination of one of the key transversal competences. Additionally, it allows also for the acceleration of the language learning processes through the use of very large communities of practice. However, most of the MOOCs in offer today are not designed in such a way as to empower learners and favour collaborative learning experiences. In this chapter we explore how the massive open education movement has been evolving and discuss what the design elements favouring massive collaborative language learning experiences should be. We present a methodological proposal for collaborative language MOOCs based on the iMOOC model, developed by a team of the Open University of Portugal (Universidade Aberta – UAb.pt)iMOOC Project integrated and supported by in Laboratory of Distance Education and eLearning (https://lead.uab.pt/imooc/). Financed national funds through FCT – Fundação para a Ciência e a Tecnologia, I.P., under the projects UIDB/04372/2020info:eu-repo/semantics/publishedVersio

A CASE STUDY OF PEER ASSESSMENT IN A MOOC-BASED COMPOSITION COURSE: STUDENTS’ PERCEPTIONS, PEERS’ GRADING SCORES VERSUS INSTRUCTORS’ GRADING SCORES, AND PEERS’ COMMENTARY VERSUS INSTRUCTORS’ COMMENTARY

Although the use of peer assessment in MOOCs is common, there has been little empirical research about peer assessment in MOOCs, especially composition MOOCs. This study aimed to address issues in peer assessment in a MOOC-based composition course, in particular student perceptions, peer-grading scores versus instructor-grading scores, and peer commentary versus instructor commentary. The findings provided evidence that peer assessment was well received by the majority of student participants from their perspective as both peer evaluators of other students’ papers and as students being evaluated by their peers. However, many student participants also expressed negative feelings about certain aspects of peer assessment, for example peers’ lack of qualifications, peers’ negative and critical comments, and unfairness of peer grading. Statistical analysis of grades given by student peers and instructors revealed a consistency among grades given by peers but a low consistency between grades given by peers and those given by instructors, with the peer grades tending to be higher than those assigned by instructors. In addition, analysis of peer and instructor commentary revealed that peers’ commentary differed from instructors’ on specific categories of writing issues (idea development, organization, or sentence-level). For instance, on average peers focused a greater percentage of their comments (70%) on sentence-level issues than did instructors (64.7%), though both groups devoted more comments to sentence-level issues than to the two other issue categories. Peers’ commentary also differed from instructors’ in the approaches their comments took to communicating the writing issue (through explanation, question, or correction). For example, in commenting on sentence-level errors, on average 85% of peers’ comments included a correction as compared to 96% of instructors’ comments including that approach. In every comment category (idea development, organization, sentence-level), peers used a lower percentage of explanation—at least 10% lower—than did instructors. Overall, findings and conclusions of the study have limitations due to (1) the small size of composition MOOC studied and small sample size of graded papers used for the analysis, (2) the lack of research and scarcity of document archives on issues the study discussed, (3) the lack of examination of factors (i.e. level of education, cultural background, and English language proficiency) that might affect student participants’ perception of peer assessment, and (4) the lack of analysis of head notes, end notes, and length of comments. However, the study has made certain contributions to the existing literature, especially student perception of peer assessment in the composition MOOC in this study. Analysis of the grades given by peers and instructors in the study provides evidence-based information about whether online peer assessment should be used in MOOCs, especially composition MOOCs and what factors might affect the applicability and consistency of peer grading in MOOCs. In addition, analysis of the data provides insights into types of comments students in a composition MOOC made as compared to those instructors made. The findings of the study as a whole can inform the design of future research on peer assessment in composition MOOCs and indicate questions designers of peer assessment training and practice in such MOOCs could find helpful to consider

Adult learners\u27 perceptions of MOOC motivation, success, and completion: a virtual ethnographic study

Massive open online courses (MOOCs) have been credited with disrupting the traditional classroom and challenging distance education models in higher education. MOOCs were developed with the intention of opening up education to the masses, specifically those in developing countries who could not readily access educational resources or opportunities. However, early quantitative reports have shown that MOOC participants tend to be adult learners who already possess bachelor\u27s or master\u27s degrees. Additionally, MOOC completion rates have been reported to be significantly low with less than 15% of enrolled students actually completing them. This has led to questions about who the true target learners are and whether completion is the proper measure for gauging the effectiveness of MOOCs. Qualitative research has the potential to demystify questions about MOOC learners\u27 motivations and perceptions of success and completion. However, ethical issues of conducting qualitative research in open online environments present challenges and require a thoughtful research design regarding consent, privacy, and intellectual property. This study used virtual ethnographic, narrative inquiry, and photo-elicitation methods to qualitatively examine the experiences of adult learners (n = 12) from around the world who were enrolled in a MOOC on the social justice topic of human trafficking via the Coursera platform. The anthropological nature of the research methods led to a richer understanding of the adult learner MOOC culture as a socially dynamic democratic environment involving social presence, lurking, up-voting, down-voting, peer review, and reputations. Results from the study include co-constructed narratives of adult learners\u27 MOOC experiences, themes of commonalities and differences across learner experiences, a thick description of MOOC culture, and an initial conceptual framework for understanding adult learners\u27 perceptions of MOOC motivation, success, and completion. The findings of this research and its resulting conceptual framework could be beneficial for platform providers, instructors, and instructional designers who are developing MOOCs intended for adult learners in the areas of continuing education, professional development, volunteerism training, as well as for adults who are considering enrolling in graduate school. This study highlights a need for a more learner-centered approach to MOOC design and suggests that MOOCs have the potential to facilitate a global discussion on social justice topics as a component of attitude change instruction. Implications for MOOC design and suggestions for future research are presented

From Seminar to Lecture to MOOC: Scripting and Orchestration at Scale

This dissertation investigates the design of large online courses from the pedagogical perspective of knowledge communities. Much of the learning sciences literature has concerned itself with groups of up to 20-30 students, but in universities, courses of several hundred to more than a thousand students are common. At the same time, new models for life-long and informal learning, such as Massive Open Online Courses, are emerging. Amidst this growing enthusiasm for innovation around technology and design in teaching, there is a need for theoretically grounded innovations and rigorous research around practical models that support new approaches to learning. One recent model, known as Knowledge Community and Inquiry (KCI), engages students in the co-construction of a community knowledge base, with a commonly held understanding of the collective nature of their learning, and then provides a sequence of scaffolded inquiry activities where students make use of the knowledge base as a resource. Inspired by this approach to designing courses, the research began with a redesign of an in-service teacher education course, which increased in size from 25 to 75 students. This redesign was carefully analyzed, and design principles extracted. The second step was the design of a Massive Open Online Course for several thousand in-service teachers on technology and inquiry, in collaboration with an affiliated secondary school. A number of innovative design ideas were necessary to accommodate the large number of users, the much larger diversity in terms of background, interest, and engagement among MOOC learners, and the opportunities provided by the platform. The resulting design encompasses a 6- week long curriculum script, and a number of overlapping micro-scripts supported by a custom- written platform that integrated with the EdX platform in a seamless manner. This thesis presents the course structure, including connection to disciplinary principles, its affordances for community and collaboration and its support of individual differentiated learning and collective epistemology. It offers design principles for scripting and orchestrating collective inquiry designs for MOOCS and higher education courses