Nonverbal communication interface for collaborative virtual environments

Nonverbal communication is an important aspect of real-life face-to-face interaction and one of the most efficient ways to convey emotions, therefore users should be provided the means to replicate it in the virtual world. Because articulated embodiments are well suited to provide body communication in virtual environments, this paper first reviews some of the advantages and disadvantages of complex embodiments. After a brief introduction to nonverbal communication theories, we present our solution, taking into account the practical limitations of input devices and social science aspects. We introduce our sample of actions and implementation using our VLNET (Virtual Life Network) networked virtual environment and discuss the results of an informal evaluation experimen

Nonverbal communication interface for collaborative virtual environments

Nonverbal communication is an important aspect of real-life face-to-face interaction and one of the most efficient ways to convey emotions, therefore users should be provided the means to replicate it in the virtual world. Because articulated embodiments are well suited to provide body communication in virtual environments, this paper first reviews some of the advantages and disadvantages of complex embodiments. After a brief introduction to nonverbal communication theories, we present our solution, taking into account the practical limitations of input devices and social science aspects. We introduce our sample of actions and implementation using our VLNET (Virtual Life Network) networked virtual environment and discuss the results of an informal evaluation experimen

A study of event traffic during the shared manipulation of objects within a collaborative virtual environment

Event management must balance consistency and responsiveness above the requirements of shared object interaction within a Collaborative Virtual Environment (CVE) system. An understanding of the event traffic during collaborative tasks helps in the design of all aspects of a CVE system. The application, user activity, the display interface, and the network resources, all play a part in determining the characteristics of event management. Linked cubic displays lend themselves well to supporting natural social human communication between remote users. To allow users to communicate naturally and subconsciously, continuous and detailed tracking is necessary. This, however, is hard to balance with the real-time consistency constraints of general shared object interaction. This paper aims to explain these issues through a detailed examination of event traffic produced by a typical CVE, using both immersive and desktop displays, while supporting a variety of collaborative activities. We analyze event traffic during a highly collaborative task requiring various forms of shared object manipulation, including the concurrent manipulation of a shared object. Event sources are categorized and the influence of the form of object sharing as well as the display device interface are detailed. With the presented findings the paper wishes to aid the design of future systems

Constructing Social Systems through Computer-Mediated Communication

The question whether computer-mediated communication can support the formation of genuine social systems is addressed in this paper. Our hypothesis, that technology creates new forms of social systems beyond real-life milieus, includes the idea that the technology itself may influence how social binding emerges within on-line environments. In real-life communities, a precondition for social coherence is the existence of social conventions. By observing interaction in virtual environments, we found the use of a range of social conventions. These results were analyzed to determine how the use and emergence of conventions might be influenced by the technology. One factor contributing to the coherence of on-line social systems, but not the only one, appears to be the degree of social presence mediated by the technology. We suggest that social systems can emerge by computer-mediated communication and are shaped by the media of the specific environment

Mixed reality participants in smart meeting rooms and smart home enviroments

Human–computer interaction requires modeling of the user. A user profile typically contains preferences, interests, characteristics, and interaction behavior. However, in its multimodal interaction with a smart environment the user displays characteristics that show how the user, not necessarily consciously, verbally and nonverbally provides the smart environment with useful input and feedback. Especially in ambient intelligence environments we encounter situations where the environment supports interaction between the environment, smart objects (e.g., mobile robots, smart furniture) and human participants in the environment. Therefore it is useful for the profile to contain a physical representation of the user obtained by multi-modal capturing techniques. We discuss the modeling and simulation of interacting participants in a virtual meeting room, we discuss how remote meeting participants can take part in meeting activities and they have some observations on translating research results to smart home environments

A Virtual Conversational Agent for Teens with Autism: Experimental Results and Design Lessons

We present the design of an online social skills development interface for teenagers with autism spectrum disorder (ASD). The interface is intended to enable private conversation practice anywhere, anytime using a web-browser. Users converse informally with a virtual agent, receiving feedback on nonverbal cues in real-time, and summary feedback. The prototype was developed in consultation with an expert UX designer, two psychologists, and a pediatrician. Using the data from 47 individuals, feedback and dialogue generation were automated using a hidden Markov model and a schema-driven dialogue manager capable of handling multi-topic conversations. We conducted a study with nine high-functioning ASD teenagers. Through a thematic analysis of post-experiment interviews, identified several key design considerations, notably: 1) Users should be fully briefed at the outset about the purpose and limitations of the system, to avoid unrealistic expectations. 2) An interface should incorporate positive acknowledgment of behavior change. 3) Realistic appearance of a virtual agent and responsiveness are important in engaging users. 4) Conversation personalization, for instance in prompting laconic users for more input and reciprocal questions, would help the teenagers engage for longer terms and increase the system's utility

The responses of people to virtual humans in an immersive virtual environment

This paper presents an experiment investigating the impact of behavior and responsiveness on social responses to virtual humans in an immersive virtual environment (IVE). A number of responses are investigated, including presence, copresence, and two physiological responses—heart rate and electrodermal activity (EDA). Our findings suggest that increasing agents’ responsiveness even on a simple level can have a significant impact on certain aspects of people’s social responses to humanoid agents. Despite being aware that the agents were computer-generated, participants with higher levels of social anxiety were significantly more likely to avoid “disturbing” them. This suggests that on some level people can respond to virtual humans as social actors even in the absence of complex interaction. Responses appear to be shaped both by the agents’ behaviors and by people’s expectations of the technology. Participants experienced a significantly higher sense of personal contact when the agents were visually responsive to them, as opposed to static or simply moving. However, this effect diminished with experienced computer users. Our preliminary analysis of objective heart-rate data reveals an identical pattern of responses

Meetings and Meeting Modeling in Smart Environments

In this paper we survey our research on smart meeting rooms and its relevance for augmented reality meeting support and virtual reality generation of meetings in real time or off-line. The research reported here forms part of the European 5th and 6th framework programme projects multi-modal meeting manager (M4) and augmented multi-party interaction (AMI). Both projects aim at building a smart meeting environment that is able to collect multimodal captures of the activities and discussions in a meeting room, with the aim to use this information as input to tools that allow real-time support, browsing, retrieval and summarization of meetings. Our aim is to research (semantic) representations of what takes place during meetings in order to allow generation, e.g. in virtual reality, of meeting activities (discussions, presentations, voting, etc.). Being able to do so also allows us to look at tools that provide support during a meeting and at tools that allow those not able to be physically present during a meeting to take part in a virtual way. This may lead to situations where the differences between real meeting participants, human-controlled virtual participants and (semi-) autonomous virtual participants disappear

Computer-mediated knowledge communication

New communication technologies enable an array of new working and learning scenarios in which knowledge is being communicated. This article deals with the question to what extent these technologies can impede or facilitate knowledge communication. First, the various computer-based communication technologies will be classified. Second, effects of the medium on knowledge communication will be discussed based on results of studies of the current special priority program "Net-based Knowledge Communication in Groups". Third and last, computer-based possibilities to facilitate computer-mediated knowledge communication will be reviewNeue Kommunikationstechnologien ermöglichen eine Reihe neuer Arbeits- und Lernszenarien in denen Wissen kommuniziert wird. Dieser Beitrag beschäftigt sich damit, inwiefern diese Technologien Wissenskommunikation einschränken oder fördern können. Dazu werden in einem ersten Schritt die verschiedenen computerbasierten Kommunikationstechnologien untergliedert. In einem zweiten Schritt werden Wirkungen des Mediums auf die Wissenskommunikation diskutiert. Dazu werden u. a. die Ergebnisse von Studien des aktuellen Forschungsschwerpunkts "Netzbasierte Wissenskommunikation in Gruppen" berichtet. In einem dritten und letzten Schritt werden computerbasierte Möglichkeiten zusammengefasst, computervermittelte Wissenskommunikation zu förd