Life-Sized Audiovisual Spatial Social Scenes with Multiple Characters: MARC & SMART-I²

International audienceWith the increasing use of virtual characters in virtual and mixed reality settings, the coordination of realism in audiovisual rendering and expressive virtual characters becomes a key issue. In this paper we introduce a new system combining two systems for tackling the issue of realism and high quality in audiovisual rendering and life-sized expressive characters. The goal of the resulting SMART-MARC platform is to investigate the impact of realism on multiple levels: spatial audiovisual rendering of a scene, appearance and expressive behaviors of virtual characters. Potential interactive applications include mediated communication in virtual worlds, therapy, game, arts and elearning. Future experimental studies will focus on 3D audio/visual coherence, social perception and ecologically valid interaction scenes

Virual world users evaluated according to environment design, task based adn affective attention measures

This paper presents research that engages with virtual worlds for education users to understand design of these applications for their needs. An in-depth multi-method investigation from 12 virtual worlds participants was undertaken in three stages; initially a small scale within-subjects eye-tracking comparison was made between the role playing game 'RuneScape' and the virtual social world 'Second Life', secondly an in-depth evaluation of eye-tracking data for Second Life tasks (i.e. avatar, object and world based) was conducted, finally a qualitative evaluation of Second Life tutorials in comparative 3D situations (i.e. environments that are; realistic to surreal, enclosed to open, formal to informal) was conducted. Initial findings identified increased users attention within comparable gaming and social world interactions. Further analysis identified that 3D world focused interactions increased participants' attention more than object and avatar tasks. Finally different 3D situation designs altered levels of task engagement and distraction through perceptions of comfort, fun and fear. Ultimately goal based and environment interaction tasks can increase attention and potentially immersion. However, affective perceptions of 3D situations can negatively impact on attention. An objective discussion of the limitations and benefits of virtual world immersion for student learning is presented

The Effects of Instructor-Avatar Immediacy in Second Life, an Immersive and Interactive 3D Virtual Environment

Growing interest of educational institutions in desktop 3D graphic virtual environments for hybrid and distance education prompts questions on the efficacy of such tools. Virtual worlds, such as Second Life®, enable computer-mediated immersion and interactions encompassing multimodal communication channels including audio, video, and text-. These are enriched by avatar-mediated body language and physical manipulation of the environment. In this para-physical world, instructors and students alike employ avatars to establish their social presence in a wide variety of curricular and extra-curricular contexts. As a proxy for the human body in synthetic 3D environments, an avatar represents a \u27real\u27 human computer user and incorporates default behavior patterns (e.g., autonomous gestures such as changes in body orientation or movement of hands) as well as expressive movements directly controlled by the user through keyboard \u27shortcuts.\u27 Use of headset microphones and various stereophonic effects allows users to project their speech directly from the apparent location of their avatar. In addition, personalized information displays allow users to share graphical information, including text messages and hypertext links. These \u27channels\u27 of information constituted an integrated and dynamic framework for projecting avatar \u27immediacy\u27 behaviors (including gestures, intonation, and patterns of interaction with students), that may positively or negatively affect the degree to which other observers of the virtual world perceive the user represented by the avatar as \u27socially present\u27 in the virtual world. This study contributes to the nascent research on educational implementations of Second Life in higher education. Although education researchers have investigated the impact of instructor immediacy behaviors on student perception of instructor social presence, students\u27 satisfaction, motivation, and learning, few researchers have examined the effects of immediacy behaviors in a 3D virtual environment or the effects of immediacy behaviors manifested by avatars representing instructors. The study employed a two-factor experimental design to investigate the relationship between instructor avatars\u27 immediacy behaviors (high vs. low) and students\u27 perception of instructor immediacy, instructor social presence, student avatars co-presence and learning outcomes in Second Life. The study replicates and extends aspects of an earlier study conducted by Maria Schutt, Brock S. Allen, and Mark Laumakis, including components of the experimental treatments that manipulated the frequency of various types of immediacy behaviors identified by other researchers as potentially related to perception of social presence in face-to-face and mediated instruction. Participants were 281 students enrolled in an introductory psychology course at San Diego State University who were randomly assigned to one of four groups. Each group viewed a different version of the 28-minute teaching session in Second Life on current perspective in psychology. Data were gathered from student survey responses and tests on the lesson content. Analysis of variance revealed significant differences between the treatment groups (F (3,113) = 6.5,p = .000). Students who viewed the high immediacy machinimas (Group 1 HiHi and Group 2 HiLo) rated the immediacy behaviors of the instructor-avatar more highly than those who viewed the low-immediacy machinimas (Group 3 LoHi and Group 4 LoLo). Findings also demonstrate strong correlations between students\u27 perception of instructor avatar immediacy and instructor social presence (r = .769). These outcomes in the context of a 3D virtual world are consistent with findings on instructor immediacy and social presence literature in traditional and online classes. Results relative to learning showed that all groups tested higher after viewing the treatment, with no significant differences between groups. Recommendations for current and future practice of using instructor-avatars include paralanguage behaviors such as voice quality, emotion and prosodic features and nonverbal behaviors such as proxemics and gestures, facial expression, lip synchronization and eye contact

The Impact of Experiential Augmented Reality Applications on Fashion Purchase Intention

Utilizing the stimulus-organism-response (SOR) model, the purpose of this study is to examine the effects of augmented reality (AR) (specifically augmentation) on consumers’ affective and behavioral response and to assess whether consumers’ hedonic motivation for shopping moderates this relationship. An experiment using the manipulation of AR and no AR was conducted with 162 participants aged between 18 and 35. Participants were recruited through snowball sampling and randomly assigned to the control or stimulus group. The hypothesized associations were analyzed using linear regression with bootstrapping. The paper demonstrates the benefit of using an experiential AR retail application (app) to positively impact purchase intention. The results show this effect is mediated by positive affective response. Furthermore, hedonic shopping motivation moderates the relationship between augmentation and the positive affective response. Because of the chosen research approach, the results may lack generalizability to other forms of augmentation. Therefore, researchers are encouraged to test the proposed model using different types of AR stimuli. Furthermore, replication of the study with other populations would increase the generalizability of the findings. Results of this study provide a valuable reference for retailers of the benefits of using AR when attempting to optimize experiential value in online environments. The study contributes to experiential retail and consumer purchase behavior research by deepening the conceptualization of the impact of experiential technologies, more specifically AR apps, by considering the role of hedonic shopping motivations.Peer reviewe

Virtually Sensuous (Geographies): Towards a Strategy for Archiving Multi-user Experiential and Participatory Installations

This paper explores potential strategies for the audio-visual documentation of a multi-user choreographic digital installation entitled Sensuous Geographies using VR technologies. The installation was interactive, fully immersive and participatory, with the general public initiating the details of the installation’s sonic and visual worlds. At the time of the making of Sensuous Geographies, the means of documenting participatory installations in action was limited to video documentation and photographs, which represent a third-person perspective. This article suggests that new forms of technology provide an opportunity to archive interactive choreographic installations in such a way that the choreographic forms and embodied experience they generate can be re-presented in audiovisual form to historians and audiences of the future. This article expands on a conference presentation of the same title given at the DocPerform2 Symposium, City University. London in November 2017

The use of Virtual Reality in Enhancing Interdisciplinary Research and Education

Virtual Reality (VR) is increasingly being recognized for its educational potential and as an effective way to convey new knowledge to people, it supports interactive and collaborative activities. Affordable VR powered by mobile technologies is opening a new world of opportunities that can transform the ways in which we learn and engage with others. This paper reports our study regarding the application of VR in stimulating interdisciplinary communication. It investigates the promises of VR in interdisciplinary education and research. The main contributions of this study are (i) literature review of theories of learning underlying the justification of the use of VR systems in education, (ii) taxonomy of the various types and implementations of VR systems and their application in supporting education and research (iii) evaluation of educational applications of VR from a broad range of disciplines, (iv) investigation of how the learning process and learning outcomes are affected by VR systems, and (v) comparative analysis of VR and traditional methods of teaching in terms of quality of learning. This study seeks to inspire and inform interdisciplinary researchers and learners about the ways in which VR might support them and also VR software developers to push the limits of their craft.Comment: 6 Page

How Affordances of Immersive Visualization Systems Affect Learning Outcomes through Aesthetic Experience

Virtual reality has received attention as an environment for learning, yet little is known about the effectiveness of bringing the immersive visualization systems into the university classrooms. Building upon prior literature on immersive technology and the theory of affordance, we develop a model investigating how the features afforded by an immersive visualization system escalate users’ engagement, which in turn increases their learning outcomes. We will test the model with undergraduate students who have experienced with an immersive visualization system in the classroom setting. We believe that our work will enrich the existing literature on virtual reality in education and provide insight into the design of immersive representations and the structure of immersive learning paradigm