Deep Learning on VR-Induced Attention

Some evidence suggests that virtual reality (VR) approaches may lead to a greater attentional focus than experiencing the same scenarios presented on computer monitors. The aim of this study is to differentiate attention levels captured during a perceptual discrimination task presented on two different viewing platforms, standard personal computer (PC) monitor and head-mounted-display (HMD)-VR, using a well-described electroencephalography (EEG)-based measure (parietal P3b latency) and deep learning-based measure (that is EEG features extracted by a compact convolutional neural network-EEGNet and visualized by a gradient-based relevance attribution method-DeepLIFT). Twenty healthy young adults participated in this perceptual discrimination task in which according to a spatial cue they were required to discriminate either a "Target" or "Distractor" stimuli on the screen of viewing platforms. Experimental results show that the EEGNet-based classification accuracies are highly correlated with the p values of statistical analysis of P3b. Also, the visualized EEG features are neurophysiologically interpretable. This study provides the first visualized deep learning-based EEG features captured during an HMD-VR-based attentional tas

Evaluating User Experience in Multisensory Meditative Virtual Reality: A Pilot Study

Virtual Reality (VR) is known for its ability to immerse users in a parallel universe. Accordingly, VR offers great potential for mindfulness therapy, especially in a post pandemic world. However, the extent to which our senses should be recruited to yield an optimal feeling of presence in the Virtual Environment (VE) remains unclear. This study investigates lived and perceived effects of adding auditory and motor components to VR experiences, through narration and head movements respectively. Twelve participants experienced four nature-based VR videos in a within-subjects research design. The study employed a mixed method approach of psychometric and neurophysiological measures. Results support a significant relationship between positive affect and presence. While statistical support was not obtained for the remaining relationships, this study provides a feasibility assessment of utilizing NeuroIS methods in evaluating immersive user experiences, along with qualitative insights that extend our understanding towards optimized VE designs

A comparison of presence and emotion between immersive virtual reality and desktop displays for musical multimedia

Visual and auditory immersion influence sense of presence, and in some cases emotional response. However, these have previously been tested separately and it is unknown whether and how immersion influences experiences combining both, as found in musical multimedia. A within-participants experiment compared participants’ sense of presence (feeling of ‘being there’), and induced and perceived emotions, when experiencing a classical concert performance presented over headphones on a desktop PC (2D video with headlocked sound reproduction) or in virtual reality (VR) (head-mounted display presenting 360° video and reactive spatial sound reproduction). Emotion was measured by self-report questionnaires based on a three-dimensional model (pleasantness, tense arousal and energetic arousal) and presence was measured using four items (Sense of physical space, Engagement, Ecological Validity and Negative Effects). Participants experienced a significant increase in pleasantness and all dimensions of presence in VR compared to the desktop condition. Ratings of felt arousal and perceived emotions did not significantly differ between conditions. The “engagement” component of presence was positively correlated with emotion felt and perceived, whereas “ecological validity” and “sense of physical space” were related to emotions experienced in the desktop condition only. The role of presence should therefore be considered when investigating emotional responses to musical multimedia

Is seeing believing? The effects of virtual reality on young children’s understanding of possibility and impossibility

This study explored the effects of virtual reality on young children’s understanding of possibility and impossibility. It involved four-year-old children (30 boys and 30 girls) who were randomly allocated to a virtual reality group, a video group, or a picture book group. Each child was individually presented with three impossible and three matched possible events using their assigned medium. After each event, children were asked whether it was possible in real life and why/why not. Children in the VR group were more likely to correctly judge the possibility of possible events than children in the video group and they were more likely to incorrectly judge the possibility of impossible events than children in the video group. Furthermore, they were more likely to correctly judge the possibility of possible events than impossible events. The results suggest that virtual reality affects four-year-old children’s understanding of possibility and impossibility. Practical implications of these findings are discussed.</p

Is seeing believing? The effects of virtual reality on young children’s understanding of possibility and impossibility

This study explored the effects of virtual reality on young children’s understanding of possibility and impossibility. It involved four-year-old children (30 boys and 30 girls) who were randomly allocated to a virtual reality group, a video group, or a picture book group. Each child was individually presented with three impossible and three matched possible events using their assigned medium. After each event, children were asked whether it was possible in real life and why/why not. Children in the VR group were more likely to correctly judge the possibility of possible events than children in the video group and they were more likely to incorrectly judge the possibility of impossible events than children in the video group. Furthermore, they were more likely to correctly judge the possibility of possible events than impossible events. The results suggest that virtual reality affects four-year-old children’s understanding of possibility and impossibility. Practical implications of these findings are discussed.</p

Use of auditory event-related potentials to measure immersion during a computer game

The degree of engagement in a computer game is determined by sensory immersion (i.e. effects of display technology) and challenge immersion (i.e. effects of task demand). Twenty participants played a computer game under two display conditions (a large TV vs. head-mounted display) with three levels of cognitive challenge (easy/hard/impossible). Immersion was defined as selective attention to external (non-game related) auditory stimuli and measured implicitly as event-related potentials (ERPs) to an auditory oddball task. The Immersive Experience Questionnaire (IEQ) was used to capture subjective indicators of immersion. The type of display had no significant influence on ERPs or responses to the IEQ. However, subjective immersion was significantly enhanced by the experience of hard and impossible demand. The amplitude of late component ERPs to oddball stimuli were significantly reduced when demand increased from easy to hard/impossible levels. We conclude that ERPs to irrelevant stimuli represent a valid method of operationalising immersion

Assessment of the influence of navigation control and screen size on the sense of presence in virtual reality using EEG

[EN] In the virtual reality field, presence refers to the sense of being there in the virtual world. Our aim in this work is to evaluate the usefulness of the Emotiv EPOC EEG device to measure brain activations due to the sense of presence in a virtual environment (VE), using for the analysis the sLORETA tool. We compare between three experimental conditions: photographs, video and free navigation through a VE. We also compare the differences in the sense of presence due to the visualization of the VE in different screens: a common desktop screen and a high-resolution power wall screen. We monitored 20 healthy subjects, obtaining significant differences between the navigation and video conditions in the activity of the right Insula for the Theta band. We also found a higher activation of the Insula for the Alpha and Theta bands while navigating, when comparing the two screen types. The Insula activation is related to stimulus attention and self-awareness processes, directly related with the sense of presence.This study was funded by Vicerrectorado de Investigacion de la Universitat Politecnica de Valencia, Spain, PAID-06-2011, R.N. 1984; by Ministerio de Educacion y Ciencia Spain, Project Game Teen (TIN2010-20187) and partially by projects Consolider-C (SEJ2006-14301/PSIC), "CIBER of Physiopathology of Obesity and Nutrition, an initiative of ISCIII", the Excellence Research Program PROMETEO (Generalitat Valenciana. Conselleria de Educacion, 2008-157) and the Consolider INGENIO program (CSD2007-00012). The work of Miriam Clemente was supported by the Generalitat Valenciana under a VALi+d Grant. The work of Alejandro Rodriguez was supported by the Spanish MEC under an FPI Grant BES-2011-043316.Clemente Bellido, M.; Rodríguez Ortega, A.; Rey, B.; Alcañiz Raya, ML. (2014). Assessment of the influence of navigation control and screen size on the sense of presence in virtual reality using EEG. Expert Systems with Applications. 41(4):1584-1592. https://doi.org/10.1016/j.eswa.2013.08.055S1584159241

Virtual Reality Assisted Non-Pharmacological Treatments in Chronic Pain Management: A Systematic Review and Quantitative Meta-Analysis

Virtual reality (VR) is a developing technology that has recently attracted the attention of healthcare practitioners. Recently, VR systems have been used to treat pain symptoms. The present study aims to evaluate the VR effectiveness on chronic pain management. A systematic literature search was performed following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Keywords were used to discover the potentially eligible studies. The primary focus of the present investigation was to evaluate the possible effect of VR-assisted treatments on chronic pain, especially in the commonly occurring low back and neck pain. Nine studies reporting randomized controlled trials were included in the present study. VR-mediated interventions demonstrated significant improvement for pain symptoms in patients experiencing chronic pain. In addition, VR-mediated therapy decreased pain intensity and disability in the case of chronic neck pain compared to control conditions. However, the VR interventions showed a statistically non-significant improvement in chronic low back pain when experimental groups were compared with controls. VR therapy positive effect on chronic pain did not differ from the one reported for other types of interventions for pain management, as physical exercise and laser therapy. Taken together, these findings showed that currently available lines of evidence on the effect of VR-mediated therapy in chronic pain management, despite pointing towards possible therapeutical benefits of the VR-based intervention, are overall inconclusive and that more research on VR-assisted therapy for chronic pain is needed.publishedVersio

The effects of age on objective and subjective recollection after visiting a virtual apartment

peer reviewedWhile aging has been associated with decreased retrieval of episodic memory details, subjective ratings about memory quality seem to remain stable. This suggests that subjective memory judgments are based on different information according to age. Here, we tested the hypothesis that older people would rather base their subjective judgments on the retrieval of personal elements (such as emotions and thoughts), whereas younger people would rather base their judgments on the retrieval of event-related elements (such as time, place, and perceptual details). Sixty participants (20 to 79 years old) performed eight actions in a virtual apartment and were then asked to verbally recall each action with a maximum of associated elements and to rate the subjective quality of their memories. The elements reported were classified into "person-related" and "event-related" categories. Executive functions, memory performance on traditional memory tasks, and subjects' perception of memory functioning were also evaluated. Results revealed that aging was associated with reduced retrieval of event-related elements, which was explained by decreasing executive resources. However, age did not affect the retrieval of person-related elements, and the subjective memory judgments of older people were not based on these elements to a greater extent than those of younger people. Finally, our results highlight the value of virtual reality (VR) in memory evaluations since subjects' perception of memory functioning was associated with their performance in the VR task but not in traditional memory tasks

Investigation of visually induced motion sickness: a comparison of mitigation techniques in real and virtual environments

Motion sickness affects almost all users of virtual reality, and can be a limiting factor in the use of virtual reality environments in applications for training, therapy and entertainment. However, some actions can be taken to reduce the severity of the motion sickness, known as mitigation techniques. One of the mitigation techniques examined in this thesis is an active hand-eye coordination task. The other is passive recovery, by way of removing one\u27s self from the sickening stimuli and allowing time to pass, referred to as natural decay. Both tasks were used in physical reality and virtual reality settings, in order to rank the efficacy of each. The hypothesis was that a virtual mitigation task can be as effective as a physical mitigation task. Forty people participated in a within-subjects experimental design over two visits. Responses on the Simulator Sickness Questionnaire served as the measure for their motion sickness symptom severity. The research found significant differences between the physical and virtual hand-eye tasks, but no significant difference between the physical and virtual natural decay tasks. Further investigation of the differences in the physical and virtual hand-eye tasks is necessary to explain the significant differences; more analysis is required to conclude that natural decay while in a virtual environment is as effective as natural decay in the physical world