FACING EXPERIENCE: A PAINTER’S CANVAS IN VIRTUAL REALITY

Full version unavailable due to 3rd party copyright restrictions.This research investigates how shifts in perception might be brought about through the development of visual imagery created by the use of virtual environment technology. Through a discussion of historical uses of immersion in art, this thesis will explore how immersion functions and why immersion has been a goal for artists throughout history. It begins with a discussion of ancient cave drawings and the relevance of Plato’s Allegory of the Cave. Next it examines the biological origins of “making special.” The research will discuss how this concept, combined with the ideas of “action” and “reaction,” has reinforced the view that art is fundamentally experiential rather than static. The research emphasizes how present-day virtual environment art, in providing a space that engages visitors in computer graphics, expands on previous immersive artistic practices. The thesis examines the technical context in which the research occurs by briefly describing the use of computer science technologies, the fundamentals of visual arts practices, and the importance of aesthetics in new media and provides a description of my artistic practice. The aim is to investigate how combining these approaches can enhance virtual environments as artworks. The computer science of virtual environments includes both hardware and software programming. The resultant virtual environment experiences are technologically dependent on the types of visual displays being used, including screens and monitors, and their subsequent viewing affordances. Virtual environments fill the field of view and can be experienced with a head mounted display (HMD) or a large screen display. The sense of immersion gained through the experience depends on how tracking devices and related peripheral devices are used to facilitate interaction. The thesis discusses visual arts practices with a focus on how illusions shift our cognition and perception in the visual modalities. This discussion includes how perceptual thinking is the foundation of art experiences, how analogies are the foundation of cognitive experiences and how the two intertwine in art experiences for virtual environments. An examination of the aesthetic strategies used by artists and new media critics are presented to discuss new media art. This thesis investigates the visual elements used in virtual environments and prescribes strategies for creating art for virtual environments. Methods constituting a unique virtual environment practice that focuses on visual analogies are discussed. The artistic practice that is discussed as the basis for this research also concentrates on experiential moments and shifts in perception and cognition and references Douglas Hofstadter, Rudolf Arnheim and John Dewey. iv Virtual environments provide for experiences in which the imagery generated updates in real time. Following an analysis of existing artwork and critical writing relative to the field, the process of inquiry has required the creation of artworks that involve tracking systems, projection displays, sound work, and an understanding of the importance of the visitor. In practice, the research has shown that the visitor should be seen as an interlocutor, interacting from a first-person perspective with virtual environment events, where avatars or other instrumental intermediaries, such as guns, vehicles, or menu systems, do not to occlude the view. The aesthetic outcomes of this research are the result of combining visual analogies, real time interactive animation, and operatic performance in immersive space. The environments designed in this research were informed initially by paintings created with imagery generated in a hypnopompic state or during the moments of transitioning from sleeping to waking. The drawings often emphasize emotional moments as caricatures and/or elements of the face as seen from a number of perspectives simultaneously, in the way of some cartoons, primitive artwork or Cubist imagery. In the imagery, the faces indicate situations, emotions and confrontations which can offer moments of humour and reflective exploration. At times, the faces usurp the space and stand in representation as both face and figure. The power of the placement of the caricatures in the paintings become apparent as the imagery stages the expressive moment. The placement of faces sets the scene, establishes relationships and promotes the honesty and emotions that develop over time as the paintings are scrutinized. The development process of creating virtual environment imagery starts with hand drawn sketches of characters, develops further as paintings on “digital canvas”, are built as animated, three-dimensional models and finally incorporated into a virtual environment. The imagery is generated while drawing, typically with paper and pencil, in a stream of consciousness during the hypnopompic state. This method became an aesthetic strategy for producing a snappy straightforward sketch. The sketches are explored further as they are worked up as paintings. During the painting process, the figures become fleshed out and their placement on the page, in essence brings them to life. These characters inhabit a world that I explore even further by building them into three dimensional models and placing them in computer generated virtual environments. The methodology of developing and placing the faces/figures became an operational strategy for building virtual environments. In order to open up the range of art virtual environments, and develop operational strategies for visitors’ experience, the characters and their facial features are used as navigational strategies, signposts and methods of wayfinding in order to sustain a stream of consciousness type of navigation. Faces and characters were designed to represent those intimate moments of self-reflection and confrontation that occur daily within ourselves and with others. They sought to reflect moments of wonderment, hurt, curiosity and humour that could subsequently be relinquished for more practical or purposeful endeavours. They were intended to create conditions in which visitors might reflect upon their emotional state, v enabling their understanding and trust of their personal space, in which decisions are made and the nature of world is determined. In order to extend the split-second, frozen moment of recognition that a painting affords, the caricatures and their scenes are given new dimensions as they become characters in a performative virtual reality. Emotables, distinct from avatars, are characters confronting visitors in the virtual environment to engage them in an interactive, stream of consciousness, non-linear dialogue. Visitors are also situated with a role in a virtual world, where they were required to adapt to the language of the environment in order to progress through the dynamics of a drama. The research showed that imagery created in a context of whimsy and fantasy could bring ontological meaning and aesthetic experience into the interactive environment, such that emotables or facially expressive computer graphic characters could be seen as another brushstroke in painting a world of virtual reality

Scenography and new media technologies: history, educational applications and visualization techniques

The endemic presence of digital technology is responsible for numerous changes in contemporary Western societies. This study examines the role of multimedia within the field of theatre studies, with particular focus on the theory and practice of theatre design and education. In the cross-disciplinary literature review, I investigate such primary elements of contemporary media as interactivity, immersion, integration and hyper-textuality, and explore their characteristics in the performing arts before and during the digital epoch. I also discuss various IT applications that transformed the way we experience, learn and co-create our cultural heritage. In order to illustrate how computer-generated environments could change the way we perceive and deliver cultural values, I explore a suite of rapidly-developing communication and computer-visualization techniques, which enable reciprocal exchange between viewers, theatre performances and artefacts. I analyze novel technology-mediated teaching techniques that attempt to provide a new media platform for visually-enhanced information transfer. My findings indicate that the recent changes towards the personalization of knowledge delivery and also towards student-centered study and e-learning necessitated the transformation of the learners from passive consumers of digital products to active and creative participants in the learning experience. The analysis of questionnaires and two case studies (the THEATRON and the VA projects) demonstrate the need for further development of digital-visualization techniques, especially for studying and researching scenographic artefacts. As a practical component of this thesis, I have designed and developed the Set-SPECTRUM educational project, which aims to strengthen the visual skills of the students, ultimately enabling them to use imagery as a creative tool, and as a means to analyze theatrical performances and artefacts. The 3D reconstruction of Norman Bel Geddes' set for The Divine Comedy, first of all, enables academic research of the artefact, exposing some hitherto unknown design-limitations in the original set-model, and revealing some construction inconsistencies; secondly, it contributes to educational and creative practices, offering an innovative way to learn about scenography. And, thirdly, it fills a gap in the history of the Western theatre design. This study attempts to show that when translated into digital language, scenographic artefacts become easily retrievable and highly accessible for learning and research purposes. Therefore, the development of such digital products should be encouraged, but care should also be taken to provide the necessary training for users, in order to realize the applications' full potential

To immerse or not? Experimenting with two virtual retail environments

Purpose: The aim of this paper is to examine the determinants of users’ simulated experience in a virtual store and to show the subsequent impact of that experience on engagement. The outcome of that engagement is examined in relation to enjoyment, satisfaction and purchase intentions. Design/methodology/approach: The method comprised an experiment comparing users’ perceptions of a standard 2D online clothing store with an enhanced, immersive one that aimed to provide shopping value approaching that of a traditional store by using a 3D experience where participants wore special glasses and a data glove. Findings: Results demonstrate the major role of telepresence components in simulated experience and the critical role of that experience, along with hedonic and utilitarian values, in engagement. Purchase intention is influenced by satisfaction, which is in turn influenced by enjoyment and engagement. Engagement in turn is influenced by utilitarian and hedonic value and the experience of product simulation or telepresence, which is composed of control, colour and graphics vividness, and 3D authenticity. In the immersive, 3D environment experience is more associated with engagement and enjoyment, leading to greater purchase intention. The immersive, 3D environment thus has the potential to rival traditional shopping in terms of experience, resulting in higher sales for retailers and satisfaction for consumers. Originality: This work has evaluated a robust model of purchase intention and demonstrated it to hold not only in a 3D environment on a conventional computer platform, but also in an immersive one, where participants wear special glasses and a data glove

Sonic interactions in virtual environments

This book tackles the design of 3D spatial interactions in an audio-centered and audio-first perspective, providing the fundamental notions related to the creation and evaluation of immersive sonic experiences. The key elements that enhance the sensation of place in a virtual environment (VE) are: Immersive audio: the computational aspects of the acoustical-space properties of Virutal Reality (VR) technologies Sonic interaction: the human-computer interplay through auditory feedback in VE VR systems: naturally support multimodal integration, impacting different application domains Sonic Interactions in Virtual Environments will feature state-of-the-art research on real-time auralization, sonic interaction design in VR, quality of the experience in multimodal scenarios, and applications. Contributors and editors include interdisciplinary experts from the fields of computer science, engineering, acoustics, psychology, design, humanities, and beyond. Their mission is to shape an emerging new field of study at the intersection of sonic interaction design and immersive media, embracing an archipelago of existing research spread in different audio communities and to increase among the VR communities, researchers, and practitioners, the awareness of the importance of sonic elements when designing immersive environments

Quand le jeu vid\'eo est le catalyseur d'exp\'erimentations th\'e\^atrales (2014-2019)

The meeting between the director and researcher Georges Gagner{\'e} and the digital artist and researcher C\'edric Plessiet at Paris 8 University through experiments crossing live performance and video game led to the development of tools from game techniques video and dedicated to theatrical experimentation on a mixed stage involving physical actors and avatars. The genesis of AvatarStaging setup and AKN_Regie tool is detailed through the various research-creations on which they were formalized and used. AKN_Regie is a plugin of the videogame engine Unreal Engine, programmed in blueprint, and dedicated to real time 3D previsualization and avatar direction.Comment: in French languag

Co-Creating with the Senses: Towards an Embodiment Grammar for Conceptualising Virtual Reality (VR) Narrative Design

This creative practice thesis comprises two components, a dissertation titled Co-Creating with the Senses: Towards an Embodiment Grammar for Conceptualising Virtual Reality (VR) Narrative Design and a creative work, The Recluse, a fictional VR script written in the Maria Vargas Immersive Play template, available through Final Draft. The advent of publicly available virtual reality (VR) technologies has led to the emergence of a new genre of storytelling, henceforth referred to as ‘VR narratives’. There has therefore been a need to articulate its defining grammar and to contribute insights born out of artistic experimentation in a scholarly field which until recently was dominated by scientific points of view. Employing a somaesthetics approach outlined by researcher Kristina Höök, the dissertation draws on a qualitative study into 10 VR narrative works in order to propose an embodiment grammar through which the art form may be conceptualised. The study’s findings, a group of eight embodied states organised into a framework, urge for the relenting of authorial control in order to instead frame affective potential, thus echoing a Deleuzian concept of the assemblage. In particular, the framework draws attention to the way that VR’s deeper affective dimensions may be elucidated by framing co-creation through the medium’s distinct sensory possibilities. As interest gathers in a future metaverse, the insights raised by the study are significant, with potential applications in a range of affective design contexts. The Recluse is my original contribution to this emerging art form and a case study through which to interrogate the framework’s findings. A mystery with supernatural elements, the VR script aims to communicate an experience that transports the participant to the world of Alma Cohen, a famous artist turned recluse, where they are invited to experience the strange occurrences in Alma’s life through their own embodied actions. The VR script explores the potential for intimate encounters with virtual characters and the sensory, co-creational and affective possibilities which arise through these dynamics. It highlights, following the framework, the way that more open structuring approaches are required in order to access the medium’s deeper affective possibilities and also the present technological constraints in achieving this

Sonic Interactions in Virtual Environments

This open access book tackles the design of 3D spatial interactions in an audio-centered and audio-first perspective, providing the fundamental notions related to the creation and evaluation of immersive sonic experiences. The key elements that enhance the sensation of place in a virtual environment (VE) are: Immersive audio: the computational aspects of the acoustical-space properties of Virutal Reality (VR) technologies Sonic interaction: the human-computer interplay through auditory feedback in VE VR systems: naturally support multimodal integration, impacting different application domains Sonic Interactions in Virtual Environments will feature state-of-the-art research on real-time auralization, sonic interaction design in VR, quality of the experience in multimodal scenarios, and applications. Contributors and editors include interdisciplinary experts from the fields of computer science, engineering, acoustics, psychology, design, humanities, and beyond. Their mission is to shape an emerging new field of study at the intersection of sonic interaction design and immersive media, embracing an archipelago of existing research spread in different audio communities and to increase among the VR communities, researchers, and practitioners, the awareness of the importance of sonic elements when designing immersive environments

Exploring the Player Experiences of Wearable Gaming Interfaces : A User Elicitation Study

The design and development of playful wearable devices is a challenging and complicated problem. It entails not only multidisciplinary expertise but also a comprehensive understanding of player experience. There is a scarcity of evidence-based studies in current state-of-art literature that investigate general design practices and provide pragmatic design implications and suggestions based on solid user-centered research. To bridge the gap, we developed five experience prototypes based on the speculative design concepts from previous studies, and a Wizard of Oz experiment was conducted to elicit end users' feedback regarding general gaming experience as well as specific design themes in different gaming scenarios. The user experiment results were analyzed qualitatively following a rigorous thematic analysis, generating five major design implications as output. We believe this study will offer forward-looking insights to designers, developers and the research community, facilitating future work in this field.Peer reviewe