Understanding Communication Patterns in MOOCs: Combining Data Mining and qualitative methods

Massive Open Online Courses (MOOCs) offer unprecedented opportunities to learn at scale. Within a few years, the phenomenon of crowd-based learning has gained enormous popularity with millions of learners across the globe participating in courses ranging from Popular Music to Astrophysics. They have captured the imaginations of many, attracting significant media attention - with The New York Times naming 2012 "The Year of the MOOC." For those engaged in learning analytics and educational data mining, MOOCs have provided an exciting opportunity to develop innovative methodologies that harness big data in education.Comment: Preprint of a chapter to appear in "Data Mining and Learning Analytics: Applications in Educational Research

Analytics and complexity: learning and leading for the future

There is growing interest in the application of learning analytics to manage, inform and improve learning and teaching within higher education. In particular, learning analytics is seen as enabling data-driven decision making as universities are seeking to respond a range of significant challenges that are reshaping the higher education landscape. Experience over four years with a project exploring the use of learning analytics to improve learning and teaching at a particular university has, however, revealed a much more complex reality that potentially limits the value of some analytics-based strategies. This paper uses this experience with over 80,000 students across three learning management systems, combined with literature from complex adaptive systems and learning analytics to identify the source and nature of these limitations along with a suggested path forward

The Metabolism and Growth of Web Forums

We view web forums as virtual living organisms feeding on user's attention and investigate how these organisms grow at the expense of collective attention. We find that the "body mass" ($PV$) and "energy consumption" ($UV$) of the studied forums exhibits the allometric growth property, i.e., $PV_t \sim UV_t ^ \theta$. This implies that within a forum, the network transporting attention flow between threads has a structure invariant of time, despite of the continuously changing of the nodes (threads) and edges (clickstreams). The observed time-invariant topology allows us to explain the dynamics of networks by the behavior of threads. In particular, we describe the clickstream dissipation on threads using the function $D_i \sim T_i ^ \gamma$, in which $T_i$ is the clickstreams to node $i$ and $D_i$ is the clickstream dissipated from $i$. It turns out that $\gamma$, an indicator for dissipation efficiency, is negatively correlated with $\theta$ and $1/\gamma$ sets the lower boundary for $\theta$. Our findings have practical consequences. For example, $\theta$ can be used as a measure of the "stickiness" of forums, because it quantifies the stable ability of forums to convert $UV$ into $PV$, i.e., to remain users "lock-in" the forum. Meanwhile, the correlation between $\gamma$ and $\theta$ provides a convenient method to evaluate the `stickiness" of forums. Finally, we discuss an optimized "body mass" of forums at around $10^5$ that minimizes $\gamma$ and maximizes $\theta$.Comment: 6 figure

Argumentation Mining in User-Generated Web Discourse

The goal of argumentation mining, an evolving research field in computational linguistics, is to design methods capable of analyzing people's argumentation. In this article, we go beyond the state of the art in several ways. (i) We deal with actual Web data and take up the challenges given by the variety of registers, multiple domains, and unrestricted noisy user-generated Web discourse. (ii) We bridge the gap between normative argumentation theories and argumentation phenomena encountered in actual data by adapting an argumentation model tested in an extensive annotation study. (iii) We create a new gold standard corpus (90k tokens in 340 documents) and experiment with several machine learning methods to identify argument components. We offer the data, source codes, and annotation guidelines to the community under free licenses. Our findings show that argumentation mining in user-generated Web discourse is a feasible but challenging task.Comment: Cite as: Habernal, I. & Gurevych, I. (2017). Argumentation Mining in User-Generated Web Discourse. Computational Linguistics 43(1), pp. 125-17

Informatics Research Institute (IRIS) July 2004 newsletter

This summer period has been rich in presence and dissemination related activities. Several important conferences, which have enjoyed a great international participation and success, have been organized by IRIS academics in Salford. These include NLDB04, CRIS 2004 and the LTSN workshop. Also, a substantial number of research projects have been secured from national as well as European funding sources. All these activities are contributing to reinforcing the leading position that IRIS is currently enjoying in the field of Informatics. This newsletter gives an overview of all research activities that took place during this reporting period. It is hoped that this will help trigger further collaboration with existing and future colleagues from academia, research and industry to work together towards addressing the many societal and technological challenges engendered by the information age

Crowdsourcing Cognitive Presence: A Quantitative Content Analysis of a K12 Educator MOOC Discussion Forum

Massively Open Online Courses (MOOCs) offer participants opportunities to engage with content and discussion forums similar to other online courses. Pedagogical components of MOOCs and the nature of learning are worth of examining due to issues involving scale, interaction and the role of the instructor (Ross, Sinclair, Know, Bayne & McLeod, 2014). The Community of Inquiry (CoI) framework provides a basis for measuring cognitive presence in online discussion forums. As voluntary point of entry to a community of learners, it is important to consider the nature of participant contributions in terms of cognitive presence. This study focused on an educator MOOC because MOOCs have been proposed as an efficient vehicle for providing professional development due to the significant self-identification of participants as educators (Ho et al. 2014). Participant attributes have been categorized, however the discussion forum is difficult to study on a massive scale (Kizilcec, Piech, & Schulz, 2013). Automated measures of cognitive presence may not provide the full view of learning behaviors implicit in messages posted to the forums (Wong, Pursel, Divinsky & Jansen, 2015). To address this gap, the forum messages were hand-coded and analyzed using quantitative content analysis (Neuendorf, 2002). The study found that the measure of exploration increased over the duration of the course. Viewing cognitive presence over time provided a new metaphor for explaining the proportions of cognitive presence in the discussion forum of an educator MOOC. This finding suggests that increased instructor presence during the later stages of the course may increase cognitive presence over time (Akyol & Garrison, 2007; Garrison & Cleveland-Innes, 2005)

An Analysis of Presence and User Experiences Over Time

This manuscript presents the result of a series of studies intended to shed light on understanding how trends regarding user experiences in VR changes over time when engaging with VR games. In my first study, I explored how user experiences compared when playing Minecraft on the desktop against playing Minecraft within an immersive virtual reality port. Fourteen players completed six 45 minute sessions, three sessions were played on the desktop, and three in VR. The Gaming Experience Questionnaire, i-Group presence questionnaire, and Simulator Sickness Questionnaire were administered after each session, and players were interviewed at the end of the experiment. Survey data showed substantial increases in presence and positive emotions when playing Minecraft in VR while multiple themes emerged in participant interviews: participants\u27 heightened emotional experiences playing Minecraft in VR was closely linked to feelings of immersion and improved sense of scale; participants overall enjoyed using motion controls, though they felt indirect input was better for some actions; and players generally disliked traveling via teleportation, as they found it disorienting and immersion-breaking. In my second study, I identified temporal shifts in user perceptions that had taken place within the first two years that consumer VR devices had become available. To consider what could be learned about the long-term use of consumer VR devices, I analyzed online forums discussions devoted to specifically VR. I gathered posts made on the /r/Vive subreddit from the first two years after the HTC Vive\u27s release. Over time, users moved from passive to active as their attitudes and expectations towards presence and simulator sickness matured. The significant trends of interest found to influence this was game design implementation and locomotion techniques. In my third study, again, I examined the data taken from the /r/Vive subreddit forum posts to gain further insights into the scope of what ``lingering effects\u27\u27 users had reported experiencing after using VR and the progression of these effects over time. After identifying search terms designed to discover comments made about lingering effects, I found three significant categories of lingering effects (besides simulator sickness) during my qualitative analysis: perceptual effects, behavioral effects, and changes in dreams. The perceptual and behavioral categories were further divided into sub-themes; including disruption of body ownership and proprioception, loss of a sense of depth in the real world, visual after effects, the need to verify the reality of the natural world through touch, hesitation when moving in the real world, and attempts to apply VR interaction metaphors to real-life interactions. After identifying these categories of effects, I mapped out how these effects progressed concerning time. In particular, I coded data according to four temporal concepts: 1) how long must be spent in VR to trigger an effect, 2) how long before the onset of an effect upon exiting VR, 3) the duration of any specific effect, and 4) the total duration that all effects can continue to occur overall. In my fourth study, I examined how user experiences and trends regarding presence changed throughout a single gaming session. Participants were immersed in a virtual experience called \u27The Secret Shop\u27 and given instructions to explore their surroundings with no guided direction. After their experience ended, users performed an After Action Review (AAR) while watching a recording of their recent experience, followed by a semi-structured interview. I graphed each user\u27s feelings of presence over time from second to second using the results of the After Action Review. Presence was shown in these graphs to both rise and fall, gradually and rapidly, throughout the course of each user\u27s experience. The analysis of both the graphs and the interviews then showed that presence was significantly impacted by user expectations, affordance inconsistencies, and the intensity of engagement experienced throughout the session. In my final study, I loaned out VR headsets to local novice users to track their perceptions of presence across the span of four weeks. Users were given the freedom to explore any VR games and applications of interest to them off-site to simulate regular VR consumer experiences. In this study, I analyzed how over time, novice users gradually evolved in their understanding of presence and what became most important to them in order to maintain and create it in the form of visual appeal, interaction techniques, and locomotion. I also found that the levels of engagement experienced across games were shown to be linked to whether users experienced lingering effects, how their perceptions of time spent within VR had been altered, and whether or not they retained any interest in investing in future VR-related purchases

Privacy, Visibility, Transparency, and Exposure

This essay considers the relationship between privacy and visibility in the networked information age. Visibility is an important determinant of harm to privacy, but a persistent tendency to conceptualize privacy harms and expectations in terms of visibility has created two problems. First, focusing on visibility diminishes the salience and obscures the operation of nonvisual mechanisms designed to render individual identity, behavior, and preferences transparent to third parties. The metaphoric mapping to visibility suggests that surveillance is simply passive observation, rather than the active production of categories, narratives, and, norms. Second, even a broader conception of privacy harms as a function of informational transparency is incomplete. Privacy has a spatial dimension as well as an informational dimension. The spatial dimension of the privacy interest, which the author characterizes as an interest in avoiding or selectively limiting exposure, concerns the structure of experienced space. It is not negated by the fact that people in public spaces expect to be visible to others present in those spaces, and it encompasses both the arrangement of physical spaces and the design of networked communications technologies. U.S. privacy law and theory currently do not recognize this interest at all. This essay argues that they should