Interaction Design Patterns und CSCL-Scripts für Videolernumgebungen

In den letzten Jahren haben Lernvideos im Bereich des informellen und formellen Lernens an Bedeutung gewonnen. Inwieweit Lernende bei der Nutzung von Videos unterstützt werden und Lehrende didaktische Szenarien umsetzen können, hängt jedoch von der eingesetzten Videolernumgebung ab. Es ist Anliegen der vorliegende Arbeit, Prinzipien des User Interface Designs sowie Komponenten und Mechanismen videobasierter Lehr-Lern-Szenarien in Bezug auf Videolernumgebungen zu identifizieren, zu beschreiben und technisch zu realisieren. Das Ziel besteht darin, Gestaltungsprinzipien in Form von Interaction Design Patterns zu erarbeiten und computergestützte videobasierte Lehr-Lern-Szenarien mit Hilfe von CSCL-Scripts durch eine geeignete Spezifikation und Formalisierung zu realisieren. Für die Erarbeitung der Interaction Design Patterns wurden 121 Videolernumgebungen hinsichtlich 50 Kategorien in einer Inhaltsanalyse empirisch untersucht und dokumentiert. Unter Berücksichtigung ähnlicher Patterns aus thematisch verwandten Pattern Languages und den Erfahrungen aus der Implementierung und dem Einsatz von Videolernumgebungen entstanden 45 Interaction Design Patterns für verbreitete Lösungen für wiederkehrende Probleme bei der Gestaltung und Entwicklung von Videolernumgebungen. Diese Patterns wurden auf Pattern Konferenzen diskutiert und im Anschluss evaluiert sowie bei der Konzeption, Entwicklung und Bewertung mehrerer Videolernumgebungen angewendet. Zudem wurde das Software Framework VI-TWO vorgestellt, mit dem sich fast alle Patterns auf einfache Weise in Web-Anwendungen realisieren lassen. Zur Spezifikation videobasierter CSCL-Scripts wurden existierende videobasierte und nicht videobasierte Scripts analysiert. Im Ergebnis unterschieden sich videobasierte CSCL-Scripts von allgemeinen CSCL-Scripts vor allem hinsichtlich der mit dem Video verknüpften oder darin verankerten Aufgaben und Aktivitäten. Videos werden dabei nicht als monolithische Einheiten, sondern als zeitkontinuierliche Medien betrachtet, in denen weitere Informationen zeitgenau verankert und Lernaktivitäten stattfinden können. Außerdem ließen sich drei Typen videobasierter CSCL-Scripts identifizieren: (1) Scripts zur Analyse und Diskussion von Videoinhalten, (2) Peer Annotation Scripts einschließlich dem Peer Assessment und (3) Jigsaw-Scripts, die das problembasierte Lernen mit Hilfe von Videos ermöglichen. Unabhängig davon variiert die Komplexität der Scripts auf drei Stufen: (1) sofern voneinander abgegrenzte zeitliche Phasen von Lernaktivitäten bestehen, (2) wenn darüber hinaus die Teilnehmer innerhalb von Gruppen Aufgaben bearbeiten (intra-group) und (3) falls außerdem Aufgaben auch gruppenübergreifend bearbeitet werden (inter-group). Auf Grundlage der Spezifikation konnte ein Datenmodell und ein Modell für die nutzerseitige Modellierung von Scripts verschiedener Komplexitätsstufen sowie Typen entwickelt und in dem CSCL-System VI-LAB realisiert werden. Diese Arbeit leistet in zweifacher Hinsicht einen Beitrag zur Forschung im Bereich E-Learning. Zum einen beschreiben die Interaction Design Patterns wiederkehrende User Interface Lösungen und stellen somit ein Hilfsmittel für Designer, Software Entwickler und Lehrende bei der Gestaltung und Implementierung von Videolernumgebungen dar. Zum anderen wurden durch die Spezifikation und softwareseitige Umsetzung videobasierter CSCL-Scripts Voraussetzungen geschaffen, die den praktischen Einsatz und die weitere Untersuchung des kollaborativen Lernens mit Videos ermöglichen.:1 Einführung 19 1.1 Motivation 19 1.2 Herausforderungen und Forschungsfragen 20 1.2.1 Interaction Design Patterns 20 1.2.2 Videobasierte CSCL-Scripts 22 1.3 Kapitelübersicht und Forschungsmethoden 25 1.3.1 Kapitelübersicht 25 1.3.2 Forschungsmethoden je Kapitel 27 2 Lernen mit Videos 29 2.1 Terminologie, Einsatzfelder und Potentiale von Lernvideos 30 2.1.1 Begriffsbestimmung 30 2.1.2 Einsatzfelder und Szenarien für das Lernen mit Videos 32 2.1.3 Potentiale des Medium Video 34 2.2 Videos im Kontext kognitiver Lerntheorien 36 2.2.1 Theorie der kognitiven Last 36 2.2.2 Kognitive Theorie des Lernens mit Multimedia 38 2.3 Interaktivität audiovisueller Lernmedien 44 2.4 Lernformen 48 2.4.1 Rezeptives Lernen 49 2.4.2 Selbstgesteuertes Lernen 50 2.4.3 Kollaboratives Lernen 52 2.5 Zusammenfassung 56 3 Videolernumgebungen und Hypervideos 59 3.1 Terminologie und Modelle 60 3.1.1 Videolernumgebung 60 3.1.2 Terminologie: Video, Hypervideo und interaktives Video 62 3.1.3 Spezifikationen für Hypervideo-Dokumente 65 3.1.4 Modelle des zeitlichen Layouts 66 3.2 Human Video Interface 69 3.2.1 Gestaltungsraum von Hypervideos 70 3.2.2 Usability-Herausforderungen von Human Video Interfaces 74 3.3 Technische Herausforderungen 76 3.3.1 Download und Cache-Management / Echte Nicht-Linearität 77 3.3.2 Synchronisierung von Video und Annotationen 78 3.3.3 Adressierung und Abruf von Medienfragmenten 78 3.3.4 Deklarative Ansätze der Repräsentation von Multimedia 80 3.4 Produktion und Integration in Lernumgebungen 81 3.4.1 Produktion: Vorgehensweisen und Paradigmen 82 3.4.2 Integration in Lernumgebungen und Zusammenspiel mit Diensten im WWW 85 3.5 Zusammenfassung 87 4 Interaction Design Patterns für Videolernumgebungen 91 4.1 Einführung in Design Patterns 92 4.1.1 Design Patterns 95 4.1.2 Mustersprache 101 4.1.3 Verwandte Ansätze im Interaction Design 104 4.1.4 Verwandte Pattern Languages 106 4.2 Systematische Elaboration von Design Patterns 109 4.2.1 Stand der Forschung bzgldem Pattern Mining 110 4.2.2 Inhaltsanalyse von Videolernumgebungen 112 4.2.3 Analyse und Integration ähnlicher Muster bzwMustersprachen 128 4.2.4 Verfassen sowie Revision und Evaluation der Muster 130 4.2.5 Konstruktion der Pattern Language 135 4.3 Pattern Language für Videolernumgebungen 140 4.3.1 Struktur der Pattern Language 140 4.3.2 Angrenzende Mustersprachen 144 4.3.3 Repräsentation in einer Wissensbasis 145 4.3.4 Anwendungs- und Einsatzszenarien 148 4.3.5 Exemplarische Interaction Design Patterns 151 4.4 Zusammenfassung 168 5 Videobasierte CSCL-Scripts 171 5.1 Einführung 172 5.1.1 Hintergrund zu Scripts und CSCL-Scripts 172 5.1.2 Definition videobasierter CSCL-Scripts 175 5.1.3 Mehrwert und Potentiale 177 5.1.4 Typisierung videobasierter CSCL-Scripts 178 5.2 Spezifikation videobasierter CSCL-Scripts 184 5.2.1 Script-Komponenten 185 5.2.2 Script-Mechanismen 194 5.3 Modellierung von CSCL-Scripts 197 5.3.1 Komplexitätslevel 200 5.3.2 Verwandte Systeme und Ansätze zur Modellierung von Scripts 201 5.3.3 Konzept für eine formale Repräsentation 206 5.3.4 Konzept zur Modellierung im User Interface 209 5.4 Zusammenfassung 212 6 Realisierung von Patterns und Scripts 215 6.1 VI-TWO: JavaScript Framework für interaktive Videos 216 6.1.1 Anforderungen 217 6.1.2 Verwandte Arbeiten 219 6.1.3 Architektur von VI-TWO 222 6.1.4 Videoplayer 224 6.1.5 Videoannotationen 225 6.1.6 Makrointeraktivität in Kollektionen von Videos 229 6.1.7 Autorenwerkzeuge 232 6.2 VI-LAB: CSCL-System für videobasierte CSCL-Scripts 235 6.2.1 Anforderungen 236 6.2.2 Architektur von VI-LAB 238 6.2.3 Modellierung videobasierter CSCL-Scripts 241 6.2.4 Monitoring 244 6.3 Anwendungsbeispiele für VI-TWO und VI-LAB 246 6.3.1 Vi-Wiki 246 6.3.2 IWRM education 247 6.3.3 VI-LAB (Version 1) auf Basis von Wordpress 247 6.3.4 VI-LAB (Version 2) auf Basis von node.js 248 6.3.5 Theresienstadt explained 249 6.4 Zusammenfassung 252 7 Schlussbetrachtung 255 7.1 Beitrag der Arbeit zur Forschung 255 7.2 Kritische Würdigung 256 7.3 Ausblick 25

VAST: A Human-Centered, Domain-Independent Video Analysis Support Tool

Providing computer-aided support for human analysis of videos has been a battle of extremes. Powerful solutions exist, but they tend to be domain-specific and complex. The user-friendly, simple systems provide little analysis support beyond basic media player functionality. We propose a human-centered, domain-independent solution between these two points. Our proposed model and system, VAST, is based on our experience in two diverse video analysis domains: science and athletics. Multiple-perspective location metadata is used to group related video clips together. Users interact with these clip groups through a novel interaction paradigm ? views. Each view provides a different context by which users can judge and evaluate the events that are captured by the video. Easy conversion between views allows the user to quickly switch between contexts. The model is designed to support a variety of user goals and expertise with minimal producer overhead. To evaluate our model, we developed a system prototype and conducted several rounds of user testing requiring the analysis of volleyball practice videos. The user tasks included: foreground analysis, ambiguous identification, background analysis, and planning. Both domain novices and experts participated in the study. User feedback, participant performance, and system logs were used to evaluate the system. VAST successfully supported a variety of problem solving strategies employed by participants during the course of the study. Participants had no difficulty handling multiple views (and resulting multiple video clips) simultaneously opened in the workspace. The capability to view multiple related clips at one time was highly regarded. In all tasks, except the open-ended portion of the background analysis, participants performed well. However, performance was not significantly influenced by domain expertise. Participants had a favorable opinion of the system?s intuitiveness, ease of use, enjoyability, and aesthetics. The majority of participants stated a desire to use VAST outside of the study, given the opportunity

Annotierte interaktive nichtlineare Videos - Software Suite, Download- und Cache-Management

Modern Web technology makes the dream of fully interactive and enriched video come true. Nowadays it is possible to organize videos in a non-linear way playing in a sequence unknown in advance. Furthermore, additional information can be added to the video, ranging from short descriptions to animated images and further videos. This affords an easy and efficient to use authoring tool which is capable of the management of the single media objects, as well as a clear arrangement of the links between the parts. Tools of this kind can be found rarely and do mostly not provide the full range of needed functions. While providing an interactive experience to the viewer in the Web player, parallel plot sequences and additional information lead to an increased download volume. This may cause pauses during playback while elements have to be downloaded which are displayed with the video. A good quality of experience for these videos with small waiting times and a playback without interruptions is desired. This work presents the SIVA Suite to create the previously described annotated interactive non-linear videos. We propose a video model for interactivity, non-linearity, and annotations, which is implemented in an XML format, an authoring tool, and a player. Video is the main medium, whereby different scenes are linked to a scene graph. Time controlled additional content called annotations, like text, images, audio files, or videos, is added to the scenes. The user is able to navigate in the scene graph by selecting a button at a button panel. Furthermore, other navigational elements like a table of contents or a keyword search are provided. Besides the SIVA Suite, this thesis presents algorithms and strategies for download and cache management to provide a good quality of experience while watching the annotated interactive non-linear videos. Therefor, we implemented a standard-independent player framework. Integrated into a simulation environment, the framework allows to evaluate algorithms and strategies for the calculation of start-up times, and the selection of elements to pre-fetch into and delete from the cache. Their interaction during the playback of non-linear video contents can be analyzed. The algorithms and strategies can be used to minimize interruptions in the video flow after user interactions. Our extensive evaluation showed that our techniques result in faster start-up times and lesser interruptions in the video flow than those of other players. Knowledge of the structure of an interactive non-linear video can be used to minimize the start-up time at the beginning of a video while minimizing an increase in the overall download volume.Moderne Web-Technologien lassen den Traum von voll interaktiven und bereicherten Videos wahr werden. Heutzutage ist es möglich, Videos in nicht-linearer Art und Weise zu organisieren, welche dann in einer vorher unbekannten Reihenfolge abgespielt werden können. Weiterhin können den Videos Zusatzinformationen in Form von kurzen Beschreibungen über animierte Bilder bis hin zu weiteren Videos hinzugefügt werden. Dies erfordert ein einfach und effizient zu bedienendes Autorenwerkzeug, das in der Lage ist, sowohl einzelne Medien-Objekte zu verwalten, als auch die Verbindungen zwischen den einzelnen Teilen klar darzustellen. Tools dieser Art sind selten und bieten meist nicht den vollen benötigten Funktionsumfang. Während dem Betrachter dieses interaktive Erlebnis im Web Player zur Verfügung gestellt wird, führen parallele Handlungsstränge und zusätzliche Inhalte zu einem erhöhten Download-Volumen. Dies kann zu Pausen während der Wiedergabe führen, in denen Elemente vom Server geladen werden müssen, welche mit dem Video angezeigt werden sollen. Ein gutes Benutzungserlebnis für solche Videos kann durch geringe Wartezeiten und eine unterbrechungsfreie Wiedergabe erreicht werden. Diese Arbeit stellt die SIVA Suite vor, mit der die zuvor beschriebenen annotierten interaktiven nicht-linearen Videos erstellt werden können. Wir bilden Interaktivität, Nichtlinearität und Annotationen in einem Video-Model ab. Dieses wird in unserem XML-Format, Autorentool und Player umgesetzt. Als Leitmedium werden hierbei Videos verwendet, welche aufgeteilt in Szenen zu einer Graphstruktur zusammengefügt werden können. Zeitlich gesteuerte zusätzliche Inhalte, sogenannte Annotationen, wie Texte, Bilder, Audio-Dateien und Videos, werden den Szenen hinzugefügt. Der Betrachter kann im Szenengraph navigieren, indem er in einem bereitgestellten Button-Panel eine Nachfolgeszene auswählt. Andere Navigationselemente sind ein Inhaltsverzeichnis sowie eine Suchfunktion. Neben der SIVA Suite beschreibt diese Arbeit Algorithmen und Strategien für Download und Cache Management, um eine gute Nutzungserfahrung während der Betrachtung der annotierten interaktiven nicht-linearen Videos zu bieten. Ein Webstandard-unabhängiges Playerframework erlaubt es, das Zusammenspiel von Algorithmen und Strategien zu evaluieren, welche für die Berechnung der Start-Zeitpunkte für die Wiedergabe, sowie die Auswahl von vorauszuladenden sowie zu löschenden Elemente verwendet werden. Ziel ist es, Unterbrechungen zu minimieren, wenn der Ablauf des Videos durch Benutzerinteraktion beeinflusst wird. Unsere umfassende Evaluation zeigte, dass es möglich ist, kürzere Startup-Zeiten und weniger Unterbrechungen mit unseren Strategien zu erreichen, als bei der Verwendung der Strategien anderer Player. Die Kenntnis der Struktur des interaktiven nicht-linearen Videos kann dazu verwendet werden, die Startzeit am Anfang der Szenen zu minimieren, während das Download-Volumen nicht erhöht wird

European Distance and E-Learning Network (EDEN). Conference Proceedings

Erasmus+ Programme of the European UnionThe powerful combination of the information age and the consequent disruption caused by these unstable environments provides the impetus to look afresh and identify new models and approaches for education (e.g. OERs, MOOCs, PLEs, Learning Analytics etc.). For learners this has taken a fantastic leap into aggregating, curating and co-curating and co-producing outside the boundaries of formal learning environments – the networked learner is sharing voluntarily and for free, spontaneously with billions of people.Supported by Erasmus+ Programme of the European Unioninfo:eu-repo/semantics/publishedVersio

Viznotes – Visual Summaries for videos

This project presents a method of visually summarizing TED-like videos called Viznotes. The Viznotes interface provides a structured yet organic summarization of the contents of the video. Derived from the concepts of sketchnoting, this interface provides segments of video represented as a sketch like image with summary of the segments and keywords arranged in a pre-defined template, with certain elements showing chronology and relations. Viznote also provides an interface for navigation of the videos. Further it also enables the user to customize and make a more personal visual summary. Tools like sketching, sketch components, screen image representation etc. help users to leverage additional functionality in note taking

Incorporating Andragogy and Cognitive Theory Of Multimedia Learning Into Self-Paced Training and Development Programs

In the modern higher educational system, technology permeated almost all the provisions of educational processes and transformed individual learning transactions. Empirical evidence reveals students’ skill gaps in the digitized campus and the real-world work environment driven by technology. Technical training is of high value and in high demand in helping students to develop the skills necessary to carry out schoolwork and be prepared for the real-world work environment. The purpose of this study was to investigate the effectiveness of the combined method of Andragogy and Cognitive Theory of Multimedia Learning (CTML) in enhancing learning results and optimizing students’ learning experience in an asynchronous Excel training program designed on Storyline 360. This study utilized a mixed-method design and was conducted in a private religiously affiliated university on the west coast of the U.S. Quantitative data (i.e., control group n=22; Treatment group n=22) were collected through quiz and survey to measure learning results and learning motivation, autonomy, and satisfaction respectively. Qualitative data (n=4) were collected through semi-structured individual interviews to obtain a deeper insight into the different learning experiences between conventional instruction and the Andragogy and CTML-enhanced instruction. The first finding of this study was the effectiveness of the interventional training designed with a combined method of Andragogy and CTML in improving students’ learning outcomes in the post-test (i.e., t (42) = 2.65, p-value = 0.01\u3c0.05, Cohen’s D = 0.80)) and maximizing gained scores (i.e., (t (42) = 2.23, p-value = 0.03), Cohen’s D = 0.67). iii The second finding of the research was that the interventional training designed with a combined method of Andragogy and CTML had a significant effect on improving students’ learning motivation (t (42) = 2.71, p-value = 0.0096 \u3c 0.05, Cohen’s d = 0.82,), but no effect on improving learning autonomy (t (42) = -0.17, p-value = 0.87 \u3e 0.05, Cohen’s d = -0.05,) and learning satisfaction (t (42) = 1.43 p-value = 0.16 \u3e 0.05, Cohen’s d = 0.42). The third finding of this research revealed: (1) learners found both the conventional and the Andragogy and CTML-enhanced training beneficial as it met their current or future needs; (2) learners in both groups were engaged in the micro-learning experience multimedia-based (i.e., simulations and mind maps); (3) Project-based assessment and brief course navigation instructions are preferred in the self-paced training. This study formulated an evidence-based framework to design effective online technical capability-building solutions that are centered on the needs of learners. Educational leaders should enable instructional technologies and define governance and processes to support the integration of the combined andragogy and CTML method. Additional research implementing the andragogy and CTML approach with learners in different educational settings and subject matters would further expand the findings and drive teaching innovations

Learning Activities with Semantic. Hypermedia in Higher Education

The increasing use of information and communication technologies (ICT) in diverse professional and personal contexts calls for new knowledge, and a set of abilities, competences and attitudes, for an active and participative citizenship. In this context it is acknowledged that universities have an important role innovating in the educational use of digital media to promote an inclusive digital literacy. The educational potential of digital technologies and resources has been recognized by both researchers and practitioners. Multiple pedagogical models and research approaches have already contributed to put in evidence the importance of adapting instructional and learning practices and processes to concrete contexts and educational goals. Still, academic and scientific communities believe further investments in ICT research is needed in higher education. This study focuses on educational models that may contribute to support digital technology uses, where these can have cognitive and educational relevance when compared to analogical technologies. A teaching and learning model, centered in the active role of the students in the exploration, production, presentation and discussion of interactive multimedia materials, was developed and applied using the internet and exploring emergent semantic hypermedia formats. The research approach focused on the definition of design principles for developing class activities that were applied in three different iterations in undergraduate courses from two institutions, namely the University of Texas at Austin, USA and the University of Lisbon, Portugal. The analysis of this study made possible to evaluate the potential and efficacy of the model proposed and the authoring tool chosen in the support of metacognitive skills and attitudes related to information structuring and management, storytelling and communication, using computers and the internet

ACTIVE READING ON TABLET TEXTBOOKS

To study a text, learners often engage in active reading. Through active reading, learners build an analysis by annotating, outlining, summarizing, reorganizing and synthesizing information. These strategies serve a fundamental meta-cognitive function that allows content to leave strong memory traces and helps learners reflect, understand, and recall information. Textbooks, however, are becoming more complex as new technologies change how they are designed and delivered. Interactive, touch-screen tablets offer multi-touch interaction, annotation features, and multimedia content as a browse-able book. Yet, such tablet textbooks-in spite of their increasing availability in educational settings-have received little empirical scrutiny regarding how they support and engender active reading. To address this issue, this dissertation reports on a series of studies designed to further our understanding of active reading with tablet textbooks. An exploratory study first examined strategies learners enact when reading and annotating in the tablet environment. Findings indicate learners are often distracted by touch screen mechanics, struggle to effectively annotate information delivered in audiovisuals, and labor to cognitively make connections between annotations and the content/media source from which they originated. These results inspired SMART Note, a suite of novel multimedia annotation tools for tablet textbooks designed to support active reading by: minimizing interaction mechanics during active reading, providing robust annotation for multimedia, and improving built-in study tools. The system was iteratively developed through several rounds of usability and user experience evaluation. A comparative experiment found that SMART Note outperformed tablet annotation features on the market in terms of supporting learning experience, process, and outcomes. Together these studies served to extend the active reading framework for tablet textbooks to: (a) recognize the tension between active reading and mechanical interaction; (b) provide designs that facilitate cognitive connections between annotations and media formats; and (c) offer opportunities for personalization and meaningful reorganization of learning material

Paradigms for the design of multimedia learning environments in engineering

The starting point for this research was the belief that interactive multimedia learning environments represent a significant evolution in computer based learning and therefore their design requires a re-examination of the underlying principles of learning and knowledge representation. Current multimedia learning environments (MLEs) can be seen as descendants of the earlier technologies of computer-aided learning (CAL), intelligent tutoring systems (ITS) and videodisc-based learning systems. As such they can benefit from much of the wisdom which emerged from those technologies. However, multimedia can be distinguished from earlier technologies by its much greater facility in bringing to the learner high levels of interaction with and control over still and moving image, animation, sound and graphics. Our intuition tells us that this facility has the potential to create learning environments which are not merely substitutes for "live" teaching, but which are capable of elucidating complex conceptual knowledge in ways which have not previously been possible. If the potential of interactive multimedia for learning is to be properly exploited then it needs to be better understood. MLEs should not just be regarded as a slicker version of CAL, ITS or videodisc but a new technology requiring a reinterpretation of the existing theories of learning and knowledge representation. The work described in this thesis aims to contribute to a better understanding of the ways in which MLEs can aid learning. A knowledge engineering approach was taken to the design of a MLE for civil engineers. This involved analysing in detail the knowledge content of the learning domain in terms of different paradigms of human learning and knowledge representation. From this basis, a design strategy was developed which matched the nature of the domain knowledge to the most appropriate delivery techniques. The Cognitive Apprenticeship Model (CAM) was shown to be able to support the integration and presentation of the different categories of knowledge in a coherent instructional framework. It is concluded that this approach is helpful in enabling designers of multimedia systems both to capture and to present a rich picture of the domain. The focus of the thesis is concentrated on the domain of Civil Engineering and the learning of concepts and design skills within that domain. However, much of it could be extended to other highly visual domains such as mechanical engineering. Many of the points can also be seen to be much more widely relevant to the design of any MLE.Engineering and Physical Sciences Research Counci