Toward a script theory of guidance in computer-supported collaborative learning

This article presents an outline of a script theory of guidance for computer-supported collaborative learning (CSCL). With its four types of components of internal and external scripts (play, scene, role, and scriptlet) and seven principles, this theory addresses the question how CSCL practices are shaped by dynamically re-configured internal collaboration scripts of the participating learners. Furthermore, it explains how internal collaboration scripts develop through participation in CSCL practices. It emphasizes the importance of active application of subject matter knowledge in CSCL practices, and it prioritizes transactive over non-transactive forms of knowledge application in order to facilitate learning. Further, the theory explains how external collaboration scripts modify CSCL practices and how they influence the development of internal collaboration scripts. The principles specify an optimal scaffolding level for external collaboration scripts and allow for the formulation of hypotheses about the fading of external collaboration scripts. Finally, the article points towards conceptual challenges and future research questions

Specifying computer-supported collaboration scripts

Collaboration scripts are activity programs which aim to foster collaborative learning by structuring interaction between learners. Computer-supported collaboration scripts generally suffer from the problem of being restrained to a specific learning platform and learning context. A standardization of collaboration scripts first requires a specification of collaboration scripts that integrates multiple perspectives from computer science, education and psychology. So far, only few and limited attempts at such specifications have been made. This paper aims to consolidate and expand these approaches in light of recent findings and to propose a generic framework for the specification of collaboration scripts. The framework enables a description of collaboration scripts using a small number of components (participants, activities, roles, resources and groups) and mechanisms (task distribution, group formation and sequencing)

Internal and external scripts in computer-supported collaborative inquiry learning

We investigated how differently structured external scripts interact with learners’ internal scripts concerning individual knowledge acquisition in a Web-based collaborative inquiry learning environment. 90 students from two secondary schools participated. Two versions of an external collaboration script (high vs. low structured) supporting collaborative argumentation were embedded within a Web-based collaborative inquiry learning environment. Students’ internal scripts were classified as either high or low structured, establishing a 2x2-factorial design. Results suggest that the high structured external collaboration script supported the acquisition of domain-general knowledge of all learners regardless of their internal scripts. Learners’ internal scripts influenced the acquisition of domain-specific knowledge. Results are discussed concerning their theoretical relevance and practical implications for Web-based inquiry learning with collaboration scripts

Good for learning, bad for motivation? A meta-analysis on the effects of computer-supported collaboration scripts

Scripting computer-supported collaborative learning has been shown to greatly enhance learning, but is often criticized for hindering learners’ agency and thus undermining learners’ motivation. Beyond that, what makes some CSCL scripts particularly effective for learning is still a conundrum. This meta-analysis synthesizes the results of 53 primary studies that experimentally compared the effect of learning with a CSCL script to unguided collaborative learning on at least one of the variables motivation, domain learning, and collaboration skills. Overall, 5616 learners enrolled in K-12, higher education, or professional development participated in the included studies. The results of a random-effects meta-analysis show that learning with CSCL scripts leads to a non-significant positive effect on motivation (Hedges’ g = 0.13), a small positive effect (Hedges’ g = 0.24) on domain learning and a medium positive effect (Hedges’ g = 0.72) on collaboration skills. Additionally, the meta-analysis shows how scaffolding single particular collaborative activities and scaffolding a combination of collaborative activities affects the effectiveness of CSCL scripts and that synergistic or differentiated scaffolding is hard to achieve. This meta-analysis offers the first counterevidence against the widespread criticism that CSCL scripts have negative motivational effects. Furthermore, the findings can be taken as evidence for the robustness of the positive effects on domain learning and collaboration skills

Collaboration scripts - a conceptual analysis

This article presents a conceptual analysis of collaboration scripts used in face-to-face and computer-mediated collaborative learning. Collaboration scripts are scaffolds that aim to improve collaboration through structuring the interactive processes between two or more learning partners. Collaboration scripts consist of at least five components: (a) learning objectives, (b) type of activities, (c) sequencing, (d) role distribution, and (e) type of representation. These components serve as a basis for comparing prototypical collaboration script approaches for face-to-face vs. computer-mediated learning. As our analysis reveals, collaboration scripts for face-to-face learning often focus on supporting collaborators in engaging in activities that are specifically related to individual knowledge acquisition. Scripts for computer-mediated collaboration are typically concerned with facilitating communicative-coordinative processes that occur among group members. The two lines of research can be consolidated to facilitate the design of collaboration scripts, which both support participation and coordination, as well as induce learning activities closely related to individual knowledge acquisition and metacognition. In addition, research on collaboration scripts needs to consider the learners’ internal collaboration scripts as a further determinant of collaboration behavior. The article closes with the presentation of a conceptual framework incorporating both external and internal collaboration scripts

How to combine collaboration scripts and heuristic worked examples to foster mathematical argumentation – when working memory matters

Mathematical argumentation skills (MAS) are considered an important outcome of mathematics learning, particularly in secondary and tertiary education. As MAS are complex, an effective way of supporting their acquisition may require combining different scaffolds. However, how to combine different scaffolds is a delicate issue, as providing learners with more than one scaffold may be overwhelming, especially when these scaffolds are presented at the same time in the learning process and when learners’ individual learning prerequisites are suboptimal. The present study therefore investigated the effects of the presentation sequence of introducing two scaffolds (collaboration script first vs. heuristic worked examples first) and the fading of the primarily presented scaffold (fading vs. no fading) on the acquisition of dialogic and dialectic MAS of participants of a preparatory mathematics course at university. In addition, we explored how prior knowledge and working memory capacity moderated the effects. Overall, 108 university freshmen worked in dyads on mathematical proof tasks in four treatment sessions. Results showed no effects of the presentation sequence of the collaboration script and heuristic worked examples on dialogic and dialectic MAS. Yet, fading of the initially introduced scaffold had a positive main effect on dialogic MAS. Concerning dialectic MAS, fading the collaboration script when it was presented first was most effective for learners with low working memory capacity. The collaboration script might be appropriate to initially support dialectic MAS, but might be overwhelming for learners with lower working memory capacity when combined with heuristic worked examples later on

Towards adaptive argumentation learning systems : theoretical and practical considerations in the design of argumentation learning systems

This dissertation addresses four issues of pivotal importance in realizing the promises of adaptive argumentation learning systems: (1) User interface: How can argumentation user interfaces be designed to effectively structure and support problem solving, peer interaction, and learning? (2) Software architecture: How can software architectures of adaptive argumentation learning systems be designed to be employable across different argumentation domains and application scenarios in a flexible and cost-effective manner? (3) Diagnostics: How can user behavior be analyzed, automatically and accurately, to drive automated adaptations and help generation? (4) Adaptation: How can strategies for automated adaptation and support be designed to promote problem solving, peer interaction, and learning in an optimal fashion? Regarding issue (1), this dissertation investigates argument diagrams and structured discussion interfaces, two areas of focal interest in argumentation learning research during the past decades. The foundation for such structuring approaches is given by theories of learning and teaching with knowledge representations (theory of representational guidance) and collaboration scripts (script theory of guidance in computer-supported collaborative learning). This dissertation brings these two strands of research together and presents a computer-based learning environment that combines both approaches to support students in conducting high-quality discussions of controversial texts. An empirical study confirms that this combined approach has positive impact on the quality of discussions, thus, underpins the theoretical basis of the approach. Regarding issue (2), this dissertation presents a software framework for enhancing argumentation systems with adaptive support mechanisms. Adaptive support functionality of past argumentation systems has been tailored to particular domains and application scenarios. A novel software framework is presented that abstracts from the specific demands of different domains and application scenarios to provide a more general approach. The approach comprises an extensive configuration subsystem that allows the flexible definition of intelligent software agents, that is, software components able to reason and act autonomously to help students engage in fruitful learning activities. A graphical authoring tool has been conceptualized and implemented to simplify the process of defining and administering software agents beyond what has been achieved with the provided framework system. Among other things, the authoring tool allows, for the first time, specifying relevant patterns in argument diagrams using a graphical language. Empirical results indicate the high potential of the authoring approach but also challenges for future research. Regarding issue (3), the dissertation investigates two alternative approaches to automatically analyzing argumentation learning activities: the knowledge-driven and the data-driven analysis method. The knowledge-driven approach utilizes a pattern search component to identify relevant structures in argument diagrams based on declarative pattern specifications. The capabilities and appropriateness of this approach are demonstrated through three exemplary applications, for which pedagogically relevant patterns have been defined and implemented within the component. The approach proves particularly useful for patterns of limited complexity in scenarios with sufficient expert knowledge available. The data-driven approach is based on machine learning techniques, which have been employed to induce computational classifiers for important aspects of graphical online discussions, such as off-topic contributions, reasoned claims, and question-answer interactions. Validation results indicate that this approach can be realistically used even for complex classification tasks involving natural language. This research constitutes the first investigation on the use of machine learning techniques to analyze diagram-based educational discussions. The dissertation concludes with discussing the four addressed research challenges in the broader context of existing theories and empirical results. The pros and cons of different options in the design of argumentation learning systems are juxtaposed; areas for future research are identified. This final part of the dissertation gives researchers and practitioners a synopsis of the current state of the art in the design of argumentation learning systems and its theoretical and empirical underpinning. Special attention is paid to issue (4), with an in-depth discussion of existing adaptation approaches and corresponding empirical results.Diese Dissertationsschrift behandelt die folgenden vier Fragestellungen, welche bei der Realisierung adaptiver Argumentationssysteme von zentraler Bedeutung sind: (1) Benutzerschnittstelle: Wie müssen Benutzerschnittstellen beschaffen sein, um Problemlöse-, Kooperations- und Lernprozesse effektiv zu strukturieren und zu unterstützen? (2) Softwarearchitektur: Wie können die Funktionalitäten eines adaptiven Argumentationslernsystems in eine Softwarearchitektur abgebildet werden, welche flexibel und mit angemessenem Aufwand in verschiedenen Bereichen und Szenarien einsetzbar ist? (3) Diagnostik: Wie kann Benutzerverhalten automatisch und mit hoher Genauigkeit analysiert werden, um automatisierte Anpassungen und Hilfestellungen effektiv zu steuern? (4) Adaption: Wie sollten automatisierte Anpassungen und Hilfestellungen ausgestaltet werden, um Problemlöse-, Kooperations- und Lernprozesse optimal zu unterstützen? Hinsichtlich Fragestellung (1) untersucht diese Arbeit Argumentationsdiagramme und strukturierte Onlinediskussionen, zwei Schwerpunkte der Forschung zu Lernsystemen für Argumentation der vergangenen Jahre. Die Grundlage solcher Strukturierungsansätze bilden Theorien zum Lehren und Lernen mit Wissensrepräsentationen (theory of representational guidance) und Kooperationsskripten (script theory of guidance in computer-supported collaborative learning). Diese Arbeit führt beide Forschungsstränge in einer neuartigen Lernumgebung zusammen, die beide Ansätze vereint, um Lernende beim Diskutieren kontroverser Texte zu unterstützen. Eine empirische Untersuchung zeigt, dass sich dieser kombinierte Ansatz positiv auf die Diskussionsqualität auswirkt und bekräftigt damit die zu Grunde liegenden theoretischen Annahmen. Hinsichtlich Fragestellung (2) stellt diese Arbeit ein Software-Rahmensystem zur Bereitstellung adaptiver Unterstützungsmechanismen in Argumentationssystemen vor. Das Rahmensystem abstrahiert von domänen- und anwendungsspezifischen Besonderheiten und stellt damit einen generelleren Ansatz im Vergleich zu früheren Systemen dar. Der Ansatz umfasst ein umfangreiches Konfigurationssystem zur Definition intelligenter Softwareagenten, d. h. Softwarekomponenten, die eigeständig schlussfolgern und handeln, um Lernprozesse zu unterstützen. Um das Definieren und Administrieren von Softwareagenten über das bereitgestellte Rahmensystem hinaus zu vereinfachen, wurde ein grafisches Autorenwerkzeug konzipiert und entwickelt. Unter anderem erlaubt dieses erstmals, relevante Muster in Argumentationsdiagrammen ohne Programmierung mittels einer grafischen Sprache zu spezifizieren. Empirische Befunde zeigen neben dem hohen Potential des Ansatzes auch die Notwendigkeit weiterführender Forschung. Hinsichtlich Fragestellung (3) untersucht diese Arbeit zwei alternative Ansätze zur automatisierten Analyse von Lernaktivitäten im Bereich Argumentation: die wissensbasierte und die datenbasierte Analysemethodik. Der wissensbasierte Ansatz wurde mittels einer Softwarekomponente zur Mustersuche in Argumentationsdiagrammen umgesetzt, welche auf Grundlage deklarativer Musterbeschreibungen arbeitet. Die Möglichkeiten und Eignung des Ansatzes werden anhand von drei Beispielszenarien demonstriert, für die verschiedenartige, pädagogisch relevante Muster innerhalb der entwickelten Softwarekomponente definiert wurden. Der Ansatz erweist sich insbesondere als nützlich für Muster eingeschränkter Komplexität in Szenarien, für die Expertenwissen in ausreichendem Umfang verfügbar ist. Der datenbasierte Ansatz wurde mittels maschineller Lernverfahren umgesetzt. Mit deren Hilfe wurden Klassifikationsroutinen zur Analyse zentraler Aspekte von Onlinediskussionen, wie beispielsweise themenfremde Beiträge, begründete Aussagen und Frage-Antwort-Interaktionen, algorithmisch hergeleitet. Validierungsergebnisse zeigen, dass sich dieser Ansatz selbst für komplexe Klassifikationsprobleme eignet, welche die Berücksichtigung natürlicher Sprache erfordern. Dies ist die erste Arbeit zum Einsatz maschineller Lernverfahren zur Analyse von diagrammbasierten Lerndiskussionen. Die Arbeit schließt mit einer Diskussion des aktuellen Forschungsstands hinsichtlich der vier Fragestellungen im breiteren Kontext existierender Theorien und empirischer Befunde. Die Vor- und Nachteile verschiedener Optionen für die Gestaltung von Lernsystemen für Argumentation werden gegenübergestellt und zukünftige Forschungsfelder vorgeschlagen. Dieser letzte Teil der Arbeit bietet Forschern und Anwendern einen umfassenden Überblick des aktuellen Forschungsstands bezüglich des Designs computerbasierter Argumentationslernsysteme und den zugrunde liegenden lehr- und lerntheoretischen Erkenntnissen. Insbesondere wird auf Fragestellung (4) vertiefend eingegangen und bisherige Adaptionsansätze einschließlich entsprechender empirischer Befunde erörtert

Socio-cognitive scaffolding with collaboration scripts: a meta-analysis

Scripts for computer-supported collaborative learning (CSCL) offer socio-cognitive scaffolding for learners to engage in collaborative activities that are considered beneficial for learning. Yet, CSCL scripts are often criticized for hampering naturally emerging collaboration. Research on the effectiveness of CSCL scripts has shown divergent results. This article reports a meta-analysis about the effects of CSCL scripts on domain-specific knowledge and collaboration skills. Results indicate that CSCL scripts as a kind of socio-cognitive scaffolding can enhance learning outcomes substantially. Learning with CSCL scripts leads to a small positive effect on domain-specific knowledge (d = 0.20) and a large positive effect on collaboration skills (d = 0.95) compared to unstructured CSCL. Further analyses reveal that CSCL scripts are particularly effective for domain-specific learning when they prompt transactive activities (i.e., activities in which a learner’s reasoning builds on the contribution of a learning partner) and when they are combined with additional content-specific scaffolding (worked examples, concept maps, etc.). Future research on CSCL scripts should include measures of learners’ internal scripts (i.e., prior collaboration skills) and the transactivity of the actual learning process

Learning to Diagnose with Simulations

This open access book presents 8 novel approaches to measure and improve diagnostic competences with simulation. The book compares the effects of interventions on these diagnostic competences in both teacher and medical education. It includes analyses showing that important aspects of diagnostic competences and effects of instructional interventions aiming to facilitate them are comparable for teachers and doctors. Through closely analyzing projects from medical education, mathematics education, biology education, and psychology, the reader is presented with multiple options for interventions that may be used in each of the subject areas and the improvements in diagnostic skills that could be expected from each simulation. The book concludes with an outline of promising future research on the use of simulations to facilitate professional competences in higher education in general, and for the advancement of diagnostic competencies in particular. This is an open access book