Analytic frameworks for assessing dialogic argumentation in online learning environments

Over the last decade, researchers have developed sophisticated online learning environments to support students engaging in argumentation. This review first considers the range of functionalities incorporated within these online environments. The review then presents five categories of analytic frameworks focusing on (1) formal argumentation structure, (2) normative quality, (3) nature and function of contributions within the dialog, (4) epistemic nature of reasoning, and (5) patterns and trajectories of participant interaction. Example analytic frameworks from each category are presented in detail rich enough to illustrate their nature and structure. This rich detail is intended to facilitate researchers’ identification of possible frameworks to draw upon in developing or adopting analytic methods for their own work. Each framework is applied to a shared segment of student dialog to facilitate this illustration and comparison process. Synthetic discussions of each category consider the frameworks in light of the underlying theoretical perspectives on argumentation, pedagogical goals, and online environmental structures. Ultimately the review underscores the diversity of perspectives represented in this research, the importance of clearly specifying theoretical and environmental commitments throughout the process of developing or adopting an analytic framework, and the role of analytic frameworks in the future development of online learning environments for argumentation

Interaction in an asynchronous online course:a synthesis of quantitative predictors

The effectiveness and potential of asynchronous online courses hinge on sustained, purposeful interaction. And while many factors affecting interaction have been uncovered by prior literature, there are few accounts of the relative importance of these factors when studied in the same online course. In this paper, we develop a literature-informed model of six predictors on the likelihood that a note receives a reply. We corroborate earlier findings (such as the impact of the date that the note was posted), but also obtain one contradictory result (that reading ease does not appear to be a significant predictor). We offer hypotheses for our findings, suggest future directions for this type of research, and offer educational implications

Collaborative trails in e-learning environments

This deliverable focuses on collaboration within groups of learners, and hence collaborative trails. We begin by reviewing the theoretical background to collaborative learning and looking at the kinds of support that computers can give to groups of learners working collaboratively, and then look more deeply at some of the issues in designing environments to support collaborative learning trails and at tools and techniques, including collaborative filtering, that can be used for analysing collaborative trails. We then review the state-of-the-art in supporting collaborative learning in three different areas – experimental academic systems, systems using mobile technology (which are also generally academic), and commercially available systems. The final part of the deliverable presents three scenarios that show where technology that supports groups working collaboratively and producing collaborative trails may be heading in the near future

Toward a script theory of guidance in computer-supported collaborative learning

This article presents an outline of a script theory of guidance for computer-supported collaborative learning (CSCL). With its four types of components of internal and external scripts (play, scene, role, and scriptlet) and seven principles, this theory addresses the question how CSCL practices are shaped by dynamically re-configured internal collaboration scripts of the participating learners. Furthermore, it explains how internal collaboration scripts develop through participation in CSCL practices. It emphasizes the importance of active application of subject matter knowledge in CSCL practices, and it prioritizes transactive over non-transactive forms of knowledge application in order to facilitate learning. Further, the theory explains how external collaboration scripts modify CSCL practices and how they influence the development of internal collaboration scripts. The principles specify an optimal scaffolding level for external collaboration scripts and allow for the formulation of hypotheses about the fading of external collaboration scripts. Finally, the article points towards conceptual challenges and future research questions

Participatory Transformations

Learning, in its many forms, from the classroom to independent study, is being transformed by new practices emerging around Internet use. Conversation, participation and community have become watchwords for the processes of learning promised by the Internet and accomplished via technologies such as bulletin boards, wikis, blogs, social software and repositories, devices such as laptops, cell phones and digital cameras, and infrastructures of internet connection, telephone, wireless and broadband. This chapter discusses the impact of emergent, participatory trends on education. In learning and teaching participatory trends harbinge a radical transformation in who learns from whom, where, under what circumstances, and for what and whose purpose. They bring changes in where we find information, who we learn from, how learning progresses, and how we contribute to our learning and the learning of others. These trends indicate a transformation to "ubiquitous learning" ??? a continuous anytime, anywhere, anyone contribution and retrieval of learning materials and advice on and through the Internet and its technologies, niches and social spaces.not peer reviewe

Examining the Effects of Discussion Strategies and Learner Interactions on Performance in Online Introductory Mathematics Courses: An Application of Learning Analytics

This dissertation study explored: 1) instructors’ use of discussion strategies that enhance meaningful learner interactions in online discussions and student performance, and 2) learners’ interaction patterns in online discussions that lead to better student performance in online introductory mathematics courses. In particular, the study applied a set of data mining techniques to a large-scale dataset automatically collected by the Canvas Learning Management System (LMS) for five consecutive years at a public university in the U.S., which included 2,869 students enrolled in 72 courses. First, the study found that the courses that posted more open-ended prompts, evaluated students’ discussion messages posted by students, used focused discussion settings (i.e., allowing a single response and replies to that response), and provided more elaborated feedback had higher students final grades than those which did not. Second, the results showed the instructors’ use of discussion strategies (discussion structures) influenced the quantity (volume of discussion), the breadth (distribution of participation throughout the discussion), and the quality of learner interactions (levels of knowledge construction) in online discussions. Lastly, the results also revealed that the students’ messages related to allocentric elaboration (i.e., taking other peers’ contributions in argumentive or evaluative ways) and application (i.e., application of new knowledge) showed the highest predictive value for their course performance. The findings from this study suggest that it is important to provide opportunities for learners to freely discuss course content, rather than creating a discussion task related to producing a correct answer, in introductory mathematics courses. Other findings reported in the study can also serve as guidance for instructors or instructional designers on how to design better online mathematics courses

Dialogue as Data in Learning Analytics for Productive Educational Dialogue

This paper provides a novel, conceptually driven stance on the state of the contemporary analytic challenges faced in the treatment of dialogue as a form of data across on- and offline sites of learning. In prior research, preliminary steps have been taken to detect occurrences of such dialogue using automated analysis techniques. Such advances have the potential to foster effective dialogue using learning analytic techniques that scaffold, give feedback on, and provide pedagogic contexts promoting such dialogue. However, the translation of much prior learning science research to online contexts is complex, requiring the operationalization of constructs theorized in different contexts (often face-to-face), and based on different datasets and structures (often spoken dialogue). In this paper, we explore what could constitute the effective analysis of productive online dialogues, arguing that it requires consideration of three key facets of the dialogue: features indicative of productive dialogue; the unit of segmentation; and the interplay of features and segmentation with the temporal underpinning of learning contexts. The paper thus foregrounds key considerations regarding the analysis of dialogue data in emerging learning analytics environments, both for learning-science and for computationally oriented researchers

Supporting peer interaction in online learning environments

This paper reports two studies into the efficacy of sentence openers to foster online peer-to-peer interaction. Sentence openers are pre-defined ways to start an utterance that are implemented in communication facilities as menu’s or buttons. In the first study, typical opening phrases were derived from naturally occurring online dialogues. The resulting set of sentence openers was implemented in a semi-structured chat tool that allowed students to compose messages in a freetext area or via sentence openers. In the second study, this tool was used to explore the students’ appreciation and unprompted use of sentence openers. Results indicate that students hardly used sentence openers and were skeptical of their usefulness. Because both measures were negatively correlated with students’ prior chat experience, optional use of sentence openers may not be the best way to support students’ online interaction. Based on these findings, alternative ways of using sentence openers are discussed and topics for further research are advanced

Epistemic and Social Scripts in Computer-Supported Collaborative Learning

Collaborative learning in computer-supported learning environments typically means that learners work on tasks together, discussing their individual perspectives via text-based media or videoconferencing, and consequently acquire knowledge. Collaborative learning, however, is often sub-optimal with respect to how learners work on the concepts that are supposed to be learned and how learners interact with each other. Therefore, instructional support needs to be implemented into computer-supported collaborative learning environments. One possibility to improve collaborative learning environments is to conceptualize scripts that structure epistemic activities and social interactions of learners. In this contribution, two studies will be reported that investigated the effects of epistemic and social scripts in a text-based computer-supported learning environment and in a videoconferencing learning environment in order to foster the individual acquisition of knowledge. In each study the factors "epistemic script" and "social script" have been independently varied in a 2×2-factorial design. 182 university students of Educational Science participated in these two studies. Results of both studies show that social scripts can be substantially beneficial with respect to the individual acquisition of knowledge, whereas epistemic scripts apparently do not lead to the expected effects.Unter kooperativem Lernen in computerunterstützten Lernumgebungen versteht man typischerweise, dass Lernende Wissen erwerben indem sie gemeinsam Aufgaben bearbeiten und dabei ihre individuellen Perspektiven mittels textbasierter Medien oder in Videokonferenzen diskutieren. Kooperatives Lernen scheint aber häufig suboptimal zu sein in Bezug auf die inhaltliche Bearbeitung der zu lernenden Konzepte sowie hinsichtlich der sozialen Interaktionen der Lernenden. Eine Möglichkeit kooperative Lernumgebungen zu verbessern besteht darin, Skripts zu konzeptualisieren, die epistemische Aktivitäten und soziale Interaktionen von Lernenden unterstützen. In diesem Beitrag werden zwei Studien berichtet, die die Wirkungen epistemischer und sozialer Skripts auf den individuellen Wissenserwerb in einer text- bzw. einer videobasierten computerunterstützten Lernumgebung untersuchen. In beiden Studien wurden die Faktoren "epistemisches Skript" und "soziales Skript" unabhängig voneinander in einem 2×2-faktoriellen Design miteinander variiert. 182 Studierende der Pädagogik der LMU München nahmen an diesen beiden Studien teil. Die Ergebnisse beider Studien deuten darauf hin, dass soziale Skripts individuellen Wissenserwerb substanziell fördern können, während epistemische Skripts scheinbar nicht zu den erwarteten Ergebnissen führen