Liberate your avatar; the revolution will be social networked

This paper brings together the practice-based creative research of artists Charlotte Gould and Paul Sermon, culminating in a collaborative interactive installation that investigates new forms of social and political narrative in multi-user virtual environments. The authors' artistic projects deal with the ironies and stereotypes that are found within Second Life in particular. Paul Sermon’s current creative practice looks specifically at the concepts of presence and performance within Second Life and 'first life', and attempts to bridge these two spaces through mixed reality techniques and interfaces. Charlotte Gould’s Ludic Second Life Narrative radically questions the way that users embody themselves in on-line virtual environments and identifies a counter-aesthetic that challenges the conventions of digital realism and consumerism. These research activities and outcomes come together within a collaborative site-specific public installation entitled Urban Intersections for ISEA09, focusing on contested virtual spaces that mirror the social and political history of Belfast. The authors' current collaborative practice critically investigates social, cultural and creative interactions in Second Life. Through these practice-based experiments the authors' argue that an enhanced social and cultural discourse within multi-user virtual environments will inevitably lead to growth, cohesion and public empowerment, and like all social networking platforms, contribute to greater social and political change in first life

Real Virtuality: A Code of Ethical Conduct. Recommendations for Good Scientific Practice and the Consumers of VR-Technology

The goal of this article is to present a first list of ethical concerns that may arise from research and personal use of virtual reality (VR) and related technology, and to offer concrete recommendations for minimizing those risks. Many of the recommendations call for focused research initiatives. In the first part of the article, we discuss the relevant evidence from psychology that motivates our concerns. In Section “Plasticity in the Human Mind,” we cover some of the main results suggesting that one’s environment can influence one’s psychological states, as well as recent work on inducing illusions of embodiment. Then, in Section “Illusions of Embodiment and Their Lasting Effect,” we go on to discuss recent evidence indicating that immersion in VR can have psychological effects that last after leaving the virtual environment. In the second part of the article, we turn to the risks and recommendations. We begin, in Section “The Research Ethics of VR,” with the research ethics of VR, covering six main topics: the limits of experimental environments, informed consent, clinical risks, dual-use, online research, and a general point about the limitations of a code of conduct for research. Then, in Section “Risks for Individuals and Society,” we turn to the risks of VR for the general public, covering four main topics: long-term immersion, neglect of the social and physical environment, risky content, and privacy. We offer concrete recommendations for each of these 10 topics, summarized in Table 1

EgoFace: Egocentric Face Performance Capture and Videorealistic Reenactment

Face performance capture and reenactment techniques use multiple cameras and sensors, positioned at a distance from the face or mounted on heavy wearable devices. This limits their applications in mobile and outdoor environments. We present EgoFace, a radically new lightweight setup for face performance capture and front-view videorealistic reenactment using a single egocentric RGB camera. Our lightweight setup allows operations in uncontrolled environments, and lends itself to telepresence applications such as video-conferencing from dynamic environments. The input image is projected into a low dimensional latent space of the facial expression parameters. Through careful adversarial training of the parameter-space synthetic rendering, a videorealistic animation is produced. Our problem is challenging as the human visual system is sensitive to the smallest face irregularities that could occur in the final results. This sensitivity is even stronger for video results. Our solution is trained in a pre-processing stage, through a supervised manner without manual annotations. EgoFace captures a wide variety of facial expressions, including mouth movements and asymmetrical expressions. It works under varying illuminations, background, movements, handles people from different ethnicities and can operate in real time

It’s not the model that doesn’t fit, it’s the controller! The role of cognitive skills in understanding the links between natural mapping, performance, and enjoyment of console video games

This study examines differences in performance, frustration, and game ratings of individuals playing first person shooter video games using two different controllers (motion controller and a traditional, pushbutton controller) in a within-subjects, randomized order design. Structural equation modeling was used to demonstrate that cognitive skills such as mental rotation ability and eye/hand coordination predicted performance for both controllers, but the motion control was significantly more frustrating. Moreover, increased performance was only related to game ratings for the traditional controller input. We interpret these data as evidence that, contrary to the assumption that motion controlled interfaces are more naturally mapped than traditional push-button controllers, the traditional controller was more naturally mapped as an interface for gameplay

Learners’ Experience of Presence in Virtual Worlds

This thesis explores participants’ experiences of presence in virtual worlds as a specific case of mediated environments, and the factors that support that experience of presence, with the aim of developing practice when using these technologies in learning and teaching. The thesis begins with a framework that was created to bring together concepts from a range of disciplines that describe presence and factors that contribute to presence. Organising categories within the framework were drawn from a blend of Activity Theory and Communities of Practice. Five case studies in Second Life (preceded by a pilot study employing webconferencing) were conducted in order to investigate learners’ experiences in these environments. Qualitative and quantitative data were gathered from these cases. The data from the separate cases were analysed using a cross-case synthesis and the role of presence, and the factors that support it, were identified. An additional strand of investigation established a typology of different forms of resistance by students to learning in virtual worlds. The findings of the study were that an experience of presence is strongly linked to students’ satisfaction with the learning activity. This experience of presence was more linked to students’ preparedness or ability to engage with the environment than with technological limitations. Some students’ resistance to learning in virtual worlds were informed by values they held about technology, but others appeared to display an inability to experience embodiment through their avatar. The experience of presence appeared to develop over time. This can be interpreted as stages in students’ development of a virtual body image, body schema and virtual identity. Different learning activities are more appropriate to different stages in this development. The thesis concludes with a suggested model for supporting students’ development of presence. The implications of these findings for educators and for further research are discussed

没入型テレプレゼンス環境における身体のマッピングと拡張に関する研究

学位の種別: 課程博士審査委員会委員 : （主査）東京大学教授 暦本 純一, 東京大学教授 坂村 健, 東京大学教授 越塚 登, 東京大学教授 中尾 彰宏, 東京大学教授 佐藤 洋一University of Tokyo(東京大学