The Beetle and BeeDiff Tutoring Systems

We describe two tutorial dialogue systems that adapt techniques from task-oriented dialogue systems to tutorial dialogue. Both systems employ the same reusable deep natural language understanding and generation components to interpret students ' written utterances and to automatically generate adaptive tutorial responses, with separate domain reasoners to provide the necessary knowledge about the correctness of student answers and hinting strategies. We focus on integrating the domain-independent language processing components with domain-specific reasoning and tutorial components in order to improve the dialogue interaction, and present a preliminary analysis of BeeDiff's evaluation

Dance of the bulrushes: building conversations between social creatures

The interactive installation is in vogue. Interaction design and physical installations are accepted fixtures of modern life, and with these technology-driven installations beginning to exert influence on modes of mass communication and general expectations for user experiences, it seems appropriate to explore the variety of interactions that exist. This paper surveys a number of successful projects with a critical eye toward assessing the type of communication and/or conversation generated between interactive installations and human participants. Moreover, this exploration seeks to identify whether specific tactics and/or technologies are particularly suited to engendering layers of dialogue or ‘conversations’ within interactive physical computing installations. It is asserted that thoughtful designs incorporating self-organizational abilities can foster rich dialogues in which participants and the installation collaboratively generate value in the interaction. To test this hypothesis an interactive installation was designed and deployed in locations in and around London. Details of the physical objects and employed technologies are discussed, and results of the installation sessions are shown to corroborate the key tenets of this argument in addition to highlighting other concerns that are specifically relevant to the broad topic of interactive design

The Effect of Story Narrative in Multimedia Learning

abstract: ELearning, distance learning, has been a fast-developing topic in educational area. In 1999, Mayer put forward “Cognitive Theory of Multimedia learning” (Moreno, & Mayer, 1999). The theory consisted of several principles. One of the principles, Modality Principle describes that when learners are presented with spoken words, their performance are better than that with on-screen texts (Mayer, R., Dow, & Mayer, S. 2003; Moreno, & Mayer, 1999).It gave an implication that learners performance can be affected by modality of learning materials. A very common tool in education in literature and language is narrative. This way of storytelling has received success in practical use. The advantages of using narrative includes (a) inherent format advantage such as simple structure and familiar language and ideas, (b) motivating learners, (c) facilitate listening, (d) oral ability and (e)provide schema for comparison in comprehension. Although this storytelling method has been widely used in literature, language and even moral education, few studies focused it on science and technology area. The study aims to test the effect of narrative effect in multimedia setting with science topic. A script-based story was applied. The multimedia settings include a virtual human with synthetic speech, and animation on a solar cell lesson. The experiment design is a randomized alternative- treatments design, in which participants are requested to watch a video with pedagogical agent in story format or not. Participants were collected from Amazon Mechanical Turk. Result of transfer score and retention score showed that no significant difference between narrative and non-narrative condition. Discussion was put forward for future study.Dissertation/ThesisMasters Thesis Engineering 201

Ear–voice span and pauses in intra- and interlingual respeaking: An exploratory study into temporal aspects of the respeaking process

Respeaking involves producing subtitles in real time to make live television programs accessible to deaf and hard of hearing viewers. In this study we investigated how the type of material to be respoken affects temporal aspects of respeaking, such as ear–voice span and pauses. Given the similarities between respeaking and interpreting (time constraints) and between interlingual respeaking and translation (interlingual processing), we also tested whether previous interpreting and translation experience leads to a smaller delay or lesser cognitive load in respeaking, as manifested by a smaller number of pauses. We tested 22 interpreters, 23 translators, and a control group of 12 bilingual controls, who performed interlingual (English to Polish) and intralingual (Polish to Polish) respeaking of five video clips with different characteristics (speech rate, number of speakers, and scriptedness). Interlingual respeaking was found to be more challenging than the intralingual one. The temporal aspects of respeaking were affected by clip type (especially in interpreters). We found no clear interpreter or translator advantage over the bilingual controls across the respeaking tasks. However, interlingual respeaking turned out to be too difficult for many bilinguals to perform at all. To the best of our knowledge, this is the first study to examine temporal aspects of respeaking as modulated by the type of materials and previous interpreting/translation experience. The results develop our understanding of temporal aspects of respeaking and are directly applicable to respeaker training

Teaching and learning in virtual worlds: is it worth the effort?

Educators have been quick to spot the enormous potential afforded by virtual worlds for situated and authentic learning, practising tasks with potentially serious consequences in the real world and for bringing geographically dispersed faculty and students together in the same space (Gee, 2007; Johnson and Levine, 2008). Though this potential has largely been realised, it generally isn’t without cost in terms of lack of institutional buy-in, steep learning curves for all participants, and lack of a sound theoretical framework to support learning activities (Campbell, 2009; Cheal, 2007; Kluge & Riley, 2008). This symposium will explore the affordances and issues associated with teaching and learning in virtual worlds, all the time considering the question: is it worth the effort

Transforming pre-service teacher curriculum: observation through a TPACK lens

This paper will discuss an international online collaborative learning experience through the lens of the Technological Pedagogical Content Knowledge (TPACK) framework. The teacher knowledge required to effectively provide transformative learning experiences for 21st century learners in a digital world is complex, situated and changing. The discussion looks beyond the opportunity for knowledge development of content, pedagogy and technology as components of TPACK towards the interaction between those three components. Implications for practice are also discussed. In today’s technology infused classrooms it is within the realms of teacher educators, practising teaching and pre-service teachers explore and address effective practices using technology to enhance learning

Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation

This paper surveys the current state of the art in Natural Language Generation (NLG), defined as the task of generating text or speech from non-linguistic input. A survey of NLG is timely in view of the changes that the field has undergone over the past decade or so, especially in relation to new (usually data-driven) methods, as well as new applications of NLG technology. This survey therefore aims to (a) give an up-to-date synthesis of research on the core tasks in NLG and the architectures adopted in which such tasks are organised; (b) highlight a number of relatively recent research topics that have arisen partly as a result of growing synergies between NLG and other areas of artificial intelligence; (c) draw attention to the challenges in NLG evaluation, relating them to similar challenges faced in other areas of Natural Language Processing, with an emphasis on different evaluation methods and the relationships between them.Comment: Published in Journal of AI Research (JAIR), volume 61, pp 75-170. 118 pages, 8 figures, 1 tabl