The influence of immersion and presence in early stage engineering designing and building

This paper explores the role of a designer's sense of engagement in early stage design. In the field of virtual reality, presence and immersion are standard measures of an individual's sense of engagement and involvement in an activity. High levels of presence might indicate that the designer is highly focused on the work. The central research question is the following: do designers who are more engaged in design activity, as measured by presence and immersive tendency questionnaires, produce better designs? An experiment was conducted to assess presence and immersive tendencies within the context of a hands-on, open-ended design-and-build activity. The results indicated that the designers' sense of immersion and presence ranged widely as well as their sense of frustration and calmness while performing the design activity. It was found that higher levels of presence correlated with either high design performance or low design performance. Lower levels of presence correlated with average design performance. No correlations were found between immersive tendency and design performance. This study suggests that some level of presence can be linked with better design, and it implies that level of presence might serve as an indicator of performance and learning in similar design-and-build activities.National Science Foundation (U.S.) (Award CMMI-1130791

Desktop vs. Headset: A Comparative Study of User Experience and Engagement for Flexibility Exercise in Virtual Reality

This study aimed to investigate the effectiveness of Virtual Reality (VR) technology for flexibility exercise and compare the physical outcomes, user experience, and engagement of VR desktops and VR headsets. The VR exercise application was designed using motion capture technology and exported to different VR devices. Each of the devices was used by 30 participants to perform a flexibility exercise in VR. Physical outcomes were measured using the sit-and-reach test, and user experience and engagement were evaluated using questionnaires and group discussions. The results showed that VR desktop participants had higher sit-and-reach scores. However, VR headset participants reported a more immersive experience (reality judgment) and motivation (value and usefulness). They also had higher engagement (focused attention and reward) levels than VR desktop participants. There were no significant differences between the two approaches in terms of enjoyment, effort, pressure, choice, correspondence, absorption, perceived usability, and aesthetic appeal. The study highlights the importance of considering physical outcomes, user experience, and engagement by comparing two different VR approaches for flexibility exercise. Further research is needed to explore the limitations and potential benefits of VR technology for physical activity. Doi: 10.28991/ESJ-2023-07-04-03 Full Text: PD

From presence to consciousness through virtual reality

Immersive virtual environments can break the deep, everyday connection between where our senses tell us we are and where we are actually located and whom we are with. The concept of 'presence' refers to the phenomenon of behaving and feeling as if we are in the virtual world created by computer displays. In this article, we argue that presence is worthy of study by neuroscientists, and that it might aid the study of perception and consciousness

Design For Auditory Displays: Identifying Temporal And Spatial Information Conveyance Principles

Designing auditory interfaces is a challenge for current human-systems developers. This is largely due to a lack of theoretical guidance for directing how best to use sounds in today\u27s visually-rich graphical user interfaces. This dissertation provided a framework for guiding the design of audio interfaces to enhance human-systems performance. This doctoral research involved reviewing the literature on conveying temporal and spatial information using audio, using this knowledge to build three theoretical models to aid the design of auditory interfaces, and empirically validating select components of the models. The three models included an audio integration model that outlines an end-to-end process for adding sounds to interactive interfaces, a temporal audio model that provides a framework for guiding the timing for integration of these sounds to meet human performance objectives, and a spatial audio model that provides a framework for adding spatialization cues to interface sounds. Each model is coupled with a set of design guidelines theorized from the literature, thus combined, the developed models put forward a structured process for integrating sounds in interactive interfaces. The developed models were subjected to a three phase validation process that included review by Subject Matter Experts (SMEs) to assess the face validity of the developed models and two empirical studies. For the SME review, which assessed the utility of the developed models and identified opportunities for improvement, a panel of three audio experts was selected to respond to a Strengths, Weaknesses, Opportunities, and Threats (SWOT) validation questionnaire. Based on the SWOT analysis, the main strengths of the models included that they provide a systematic approach to auditory display design and that they integrate a wide variety of knowledge sources in a concise manner. The main weaknesses of the models included the lack of a structured process for amending the models with new principles, some branches were not considered parallel or completely distinct, and lack of guidance on selecting interface sounds. The main opportunity identified by the experts was the ability of the models to provide a seminal body of knowledge that can be used for building and validating auditory display designs. The main threats identified by the experts were that users may not know where to start and end with each model, the models may not provide comprehensive coverage of all uses of auditory displays, and the models may act as a restrictive influence on designers or they may be used inappropriately. Based on the SWOT analysis results, several changes were made to the models prior to the empirical studies. Two empirical evaluation studies were conducted to test the theorized design principles derived from the revised models. The first study focused on assessing the utility of audio cues to train a temporal pacing task and the second study combined both temporal (i.e., pace) and spatial audio information, with a focus on examining integration issues. In the pace study, there were four different auditory conditions used for training pace: 1) a metronome, 2) non-spatial auditory earcons, 3) a spatialized auditory earcon, and 4) no audio cues for pace training. Sixty-eight people participated in the study. A pre- post between subjects experimental design was used, with eight training trials. The measure used for assessing pace performance was the average deviation from a predetermined desired pace. The results demonstrated that a metronome was not effective in training participants to maintain a desired pace, while, spatial and non-spatial earcons were effective strategies for pace training. Moreover, an examination of post-training performance as compared to pre-training suggested some transfer of learning. Design guidelines were extracted for integrating auditory cues for pace training tasks in virtual environments. In the second empirical study, combined temporal (pacing) and spatial (location of entities within the environment) information were presented. There were three different spatialization conditions used: 1) high fidelity using subjective selection of a best-fit head related transfer function, 2) low fidelity using a generalized head-related transfer function, and 3) no spatialization. A pre- post between subjects experimental design was used, with eight training trials. The performance measures were average deviation from desired pace and time and accuracy to complete the task. The results of the second study demonstrated that temporal, non-spatial auditory cues were effective in influencing pace while other cues were present. On the other hand, spatialized auditory cues did not result in significantly faster task completion. Based on these results, a set of design guidelines was proposed that can be used to direct the integration of spatial and temporal auditory cues for supporting training tasks in virtual environments. Taken together, the developed models and the associated guidelines provided a theoretical foundation from which to direct user-centered design of auditory interfaces

The subjective gameplay experience: An examination of the revised game engagement model

The study of the subjective gameplay experience spans multiple disciplines, from teachers who want to harness the power of gameplay to enhance instruction to game developers hoping to create the next big hit. Despite decades of interest, little agreement has been found regarding the way constructs—such as immersion, involvement, presence, and flow—are used to describe the subjective gameplay experience. Without the consistent usage of well-defined constructs, it becomes impossible to further scientific understanding of this domain. This dissertation examined the theoretical evolution of the key subjective gameplay experience constructs. From this, definitions for immersion, involvement, presence, and flow were extracted. Based on the prior work of Brockmyer et al. (2009), a revised game engagement model was created that incorporated these definitions. To test the proposed relationships within the revised game engagement model, experienced players of the computer game Minecraft were recruited for an experimental study. The participants played the game Minecraft, which was manipulated with respect to both level of difficulty and immersive aspects. This allowed for a range of potential game engagement states to be experienced by the participants. Several individual differences hypothesized to influence the different constructs of game engagement also were measured. The results of the study supported many proposed aspects of the revised game engagement model and revealed ways in which the model could be further refined. The theoretically-derived definitions and revised game engagement model resulting from this work, along with the suggested measures for these relevant constructs, provides a framework for future work in this area. This framework will improve the consistency of construct operationalization, benefiting the continued study of the subjective gameplay experience

Understanding user experience in gaming

This research examines the effect of virtual reality gaming versus desktop based gaming on spatial presence, social presence, and intention to play. It draws on cognitive theory of presence, social presence theory, and theory of reasoned action to generate the research hypotheses and explain the observed phenomenon. A within-subject experimental design (N=53) was used to evaluate the effects of virtual reality versus desktop based gaming. The results suggest that both spatial presence and social presence were significantly enhanced in the virtual reality gaming environment while intention to play was significantly greater in the desktop based gaming environment --Abstract, page iii

Do You See What I See? Effectiveness of 360-Degree vs. 2D Video Ads Using a Neuroscience Approach

[EN] This study compares cognitive and emotional responses to 360-degree vs. static (2D) videos in terms of visual attention, brand recognition, engagement of the prefrontal cortex, and emotions. Hypotheses are proposed based on the interactivity literature, cognitive overload, advertising response model and motivation, opportunity, and ability theoretical frameworks, and tested using neurophysiological tools: electroencephalography, eye-tracking, electrodermal activity, and facial coding. The results revealed that gaze view depends on ad content, visual attention paid being lower in 360-degree FMCG ads than in 2D ads. Brand logo recognition is lower in 360-degree ads than in 2D video ads. Overall, 360-degree ads for durable products increase positive emotions, which carries the risk of non-exposure to some of the ad content. In testing four ads for durable goods and fast-moving consumer goods (FMCG) this research explains the mechanism through which 360-degree video ads outperform standard versionsThis work was supported by the Generalitat Valenciana funded project "Rebrand", grant number PROMETEU/2019/105, and by the European Regional Development Fund program of the Valencian Community 2014-2020 project "Interfaces de realidad mixta aplicada a salud y toma de decisiones", grant number IDIFEDER/2018/029.Ausin-Azofra, JM.; Bigné, E.; Ruiz, C.; Marín-Morales, J.; Guixeres Provinciale, J.; Alcañiz Raya, ML. (2021). Do You See What I See? Effectiveness of 360-Degree vs. 2D Video Ads Using a Neuroscience Approach. Frontiers in Psychology. 12:1-14. https://doi.org/10.3389/fpsyg.2021.612717S1141

Learners’ Experience of Presence in Virtual Worlds

This thesis explores participants’ experiences of presence in virtual worlds as a specific case of mediated environments, and the factors that support that experience of presence, with the aim of developing practice when using these technologies in learning and teaching. The thesis begins with a framework that was created to bring together concepts from a range of disciplines that describe presence and factors that contribute to presence. Organising categories within the framework were drawn from a blend of Activity Theory and Communities of Practice. Five case studies in Second Life (preceded by a pilot study employing webconferencing) were conducted in order to investigate learners’ experiences in these environments. Qualitative and quantitative data were gathered from these cases. The data from the separate cases were analysed using a cross-case synthesis and the role of presence, and the factors that support it, were identified. An additional strand of investigation established a typology of different forms of resistance by students to learning in virtual worlds. The findings of the study were that an experience of presence is strongly linked to students’ satisfaction with the learning activity. This experience of presence was more linked to students’ preparedness or ability to engage with the environment than with technological limitations. Some students’ resistance to learning in virtual worlds were informed by values they held about technology, but others appeared to display an inability to experience embodiment through their avatar. The experience of presence appeared to develop over time. This can be interpreted as stages in students’ development of a virtual body image, body schema and virtual identity. Different learning activities are more appropriate to different stages in this development. The thesis concludes with a suggested model for supporting students’ development of presence. The implications of these findings for educators and for further research are discussed

On the Practical Use of Immersive Virtual Reality for Rehabilitation of Intimate Partner Violence Perpetrators in Prison

Virtual reality (VR) allows the user to be immersed in environments in which they can experience situations and social interactions from different perspectives by means of virtual embodiment. In the context of rehabilitation of violent behaviors, a participant could experience a virtual violent confrontation from different perspectives, including that of the victim and bystanders. This approach and other virtual scenes can be used as a useful tool for the rehabilitation of intimate partner violence (IPV) perpetrators, through improvement of their empathic skills or for training in non-violent responses. In this perspective, we revise and discuss the use of this tool in a prison environment for the rehabilitation of IPV perpetrators with a particular focus on practical aspects based on our experience

Anxiety activating virtual environments for investigating social phobias

Social phobia has become one of the commonest manifestations of fear in any society. This fear is often accompanied by major depression or social disabilities. With the awareness that fear can be aggravated in social situations, virtual reality researchers and psychologists have investigated the feasibility of a virtual reality system as a psychotherapeutic intervention to combat social phobia. Virtual reality technology has rapidly improved over the past few years, making for better interactions. Nevertheless, the field of virtual reality exposure therapy for social phobia is still in its infancy and various issues have yet to be resolved or event uncovered. The key concept of virtual reality exposure therapy in the treatment of social phobia is based on its characteristic of perceptual illusion - the sense of presence - as an anxiety-activating system, instead of conventional imaginal or in-vivo exposure techniques. Therefore, in order to provoke a significant level of anxiety in virtual environments, it is very important to understand the impact of perceptual presence factors in virtual reality exposure therapy. Hence, this research mainly aims to investigate all the aspects of the correlation between anxiety and the components of the virtual environment in a computer-generated social simulation. By understanding this, this thesis aims to provide a framework for the construction of effective virtual reality exposure therapy for social phobia care which enables anxiety stimuli to be controlled in a gradual manner as a conventional clinical approach. This thesis presents a series of experimental studies that have been conducted with a common theme: the function of 3D inhabitants and visual apparatus in anxiety-activating virtual social simulation, a job-interview. However, each study is conducted using different research objectives. The experimental results are presented in this thesis, with psycho-physiological approach, revealing a variation of the distribution of participants' anxiety states across various VR conditions. The overall conclusion of this research is that an appropriate realism of VR stimuli is essential in sustaining the state of anxiety over the course of VR exposure. The high fidelity of virtual environment generally provoke a greater degree of anxiety, but this research also shows that aspects of VR fidelity is more related to the mental representation of individuals to the context of the stressful situation rather than any technology that is being used