Multimodal Interaction in a Haptic Environment

In this paper we investigate the introduction of haptics in a multimodal tutoring environment. In this environment a haptic device is used to control a virtual piece of sterile cotton and a virtual injection needle. Speech input and output is provided to interact with a virtual tutor, available as a talking head, and a virtual patient. We introduce the haptic tasks and how different agents in the multi-agent system are made responsible for them. Notes are provided about the way we introduce an affective model in the tutor agent

The ITALK project : A developmental robotics approach to the study of individual, social, and linguistic learning

This is the peer reviewed version of the following article: Frank Broz et al, “The ITALK Project: A Developmental Robotics Approach to the Study of Individual, Social, and Linguistic Learning”, Topics in Cognitive Science, Vol 6(3): 534-544, June 2014, which has been published in final form at doi: http://dx.doi.org/10.1111/tops.12099 This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving." Copyright © 2014 Cognitive Science Society, Inc.This article presents results from a multidisciplinary research project on the integration and transfer of language knowledge into robots as an empirical paradigm for the study of language development in both humans and humanoid robots. Within the framework of human linguistic and cognitive development, we focus on how three central types of learning interact and co-develop: individual learning about one's own embodiment and the environment, social learning (learning from others), and learning of linguistic capability. Our primary concern is how these capabilities can scaffold each other's development in a continuous feedback cycle as their interactions yield increasingly sophisticated competencies in the agent's capacity to interact with others and manipulate its world. Experimental results are summarized in relation to milestones in human linguistic and cognitive development and show that the mutual scaffolding of social learning, individual learning, and linguistic capabilities creates the context, conditions, and requisites for learning in each domain. Challenges and insights identified as a result of this research program are discussed with regard to possible and actual contributions to cognitive science and language ontogeny. In conclusion, directions for future work are suggested that continue to develop this approach toward an integrated framework for understanding these mutually scaffolding processes as a basis for language development in humans and robots.Peer reviewe

Designing and Implementing Embodied Agents: Learning from Experience

In this paper, we provide an overview of part of our experience in designing and implementing some of the embodied agents and talking faces that we have used for our research into human computer interaction. We focus on the techniques that were used and evaluate this with respect to the purpose that the agents and faces were to serve and the costs involved in producing and maintaining the software. We discuss the function of this research and development in relation to the educational programme of our graduate students

Explorations in engagement for humans and robots

This paper explores the concept of engagement, the process by which individuals in an interaction start, maintain and end their perceived connection to one another. The paper reports on one aspect of engagement among human interactors--the effect of tracking faces during an interaction. It also describes the architecture of a robot that can participate in conversational, collaborative interactions with engagement gestures. Finally, the paper reports on findings of experiments with human participants who interacted with a robot when it either performed or did not perform engagement gestures. Results of the human-robot studies indicate that people become engaged with robots: they direct their attention to the robot more often in interactions where engagement gestures are present, and they find interactions more appropriate when engagement gestures are present than when they are not.Comment: 31 pages, 5 figures, 3 table

Creating Verbal Immediacy - The Use of Immediacy and Avoidance Techniques in Online Tutorials

Like many writing center directors, I was hesitant to introduce online tutoring. However, because of limited physical space on campus, the internet provides the only room for growth available to us—a problem faced by many writing centers (Carpenter 2). The inevitability of online growth is also supported by the increase of tertiary-level online and blended courses being offered at most post-secondary schools. I was hesitant to begin online tutoring because [of] the “complexities introduced by online tutoring: the increased potential for directive tutoring instead of nondirective tutoring . . . the lack of sustained dialogue in asynchronous tutorials, and technological problems of accessibility and compatibility” (Kastman Breuch 21). In a conscious effort to avoid some of these issues, when the writing lab I direct began providing online tutorials in spring 2010. Our staff chose to use a software product called ShowDocument.com that allows students to upload their drafts and then share an interactive white board with the tutor to annotate the paper being discussed while synchronously chatting. The program does not have an audio or video function, so participants type their messages. We considered using a program such as Skype that would allow the tutor and student to see each other as they speak. However, technology is never completely trustworthy, and the ongoing issues of poor, broken, or failed transmission made Skype and similar programs an unreliable choice. Second, the close confines in which we work make the noise level in our lab high, and students themselves often login to video conferences from their dorms, or apartments, where background distractions can greatly impede the tutorial. Finally, as Lee-Ann Kastman Breuch suggests, we learned that we could not assume that all of our students who use the online service have access to equipment that enables them to use Skype or similar programs (21).University Writing Cente

Learning About Something Means Becoming Wiser: The Platonic Dialogue as a Paradigmatic Model for Writing Center Practice

As our discipline’s scholars, we must recognize that ours is a history “that is best recognized as an always incomplete narrative” and continue to delve into the past as we seek to inform our future (Lerner 25). In this article, I delve into Plato’s use of “elenchus” or cross-questioning for the purpose of achieving “aporia”—the sense of perplexity or confusion that usually accompanies the discovery that language does not have the ability to mean in any stable sense” within Theaetetus (Raign 90). In addition to extending our narrative history, studying the process of elenchus will allow us to share this methodology with our tutors, so that they can develop the ability not to merely engage in conversation with their students, or lead them to a truth not their own, but engage in the type of inquiry about language and its ability to mean that leads students toward the sort of self-discovery present in the Platonic dialogues.University Writing Cente

Affective learning: improving engagement and enhancing learning with affect-aware feedback

This paper describes the design and ecologically valid evaluation of a learner model that lies at the heart of an intelligent learning environment called iTalk2Learn. A core objective of the learner model is to adapt formative feedback based on students’ affective states. Types of adaptation include what type of formative feedback should be provided and how it should be presented. Two Bayesian networks trained with data gathered in a series of Wizard-of-Oz studies are used for the adaptation process. This paper reports results from a quasi-experimental evaluation, in authentic classroom settings, which compared a version of iTalk2Learn that adapted feedback based on students’ affective states as they were talking aloud with the system (the affect condition) with one that provided feedback based only on the students’ performance (the non-affect condition). Our results suggest that affect-aware support contributes to reducing boredom and off-task behavior, and may have an effect on learning. We discuss the internal and ecological validity of the study, in light of pedagogical considerations that informed the design of the two conditions. Overall, the results of the study have implications both for the design of educational technology and for classroom approaches to teaching, because they highlight the important role that affect-aware modelling plays in the adaptive delivery of formative feedback to support learning

Using the Internet to improve university education

Up to this point, university education has largely remained unaffected by the developments of novel approaches to web-based learning. The paper presents a principled approach to the design of problem-oriented, web-based learning at the university level. The principles include providing authentic contexts with multimedia, supporting collaborative knowledge construction, making thinking visible with dynamic visualisation, quick access to content resources via information and communication technologies, and flexible support by tele-tutoring. These principles are used in the MUNICS learning environment, which is designed to support students of computer science to apply their factual knowledge from the lectures to complex real-world problems. For example, students may model the knowledge management in an educational organisation with a graphical simulation tool. Some more general findings from a formative evaluation study with the MUNICS prototype are reported and discussed. For example, the students' ignorance of the additional content resources is discussed in the light of the well-known finding of insufficient use of help systems in software applications

Toward Explaining the Transformative Power of Talk About, Around, and for Writing

This article provides an initial approach for capturing moments of talk about, around, and for writing to explain why writing groups and writing conferences are so often considered “transformative” for the people involved. After describing the widespread and yet disparate transformations so often attributed to collaborative writing talk, I introduce applied conversation analysis (CA) as a method for getting at what is often difficult to identify, document, and explain: the intricacies of moments that underlie, if not directly account for, transformations. At the core of this article, I present a case study of a writer, Susan, and tutor, Kim, and analyze their talk and embodied interactions around writing. In particular, two sequences of their talk—the first an example of “troubles telling,” or attending to a reported trouble (Jefferson, 1981, 1984, 1988) and the second an enactment of humor that names asymmetrical power relations (Holmes, 2000)—illustrate the ways in which building affiliative relationships might allow for naming and poking fun at, if not restructuring, power relations. Further, self-reports from interview data indicate how the occasions of talk between Susan and Kim mark shifts in thinking about themselves, their writing, and their commitments—shifts that can be attributed to their relational, affiliative interactions and that provide supporting evidence for the transformative power of collaborative writing talk