Immersive Composition for Sensory Rehabilitation: 3D Visualisation, Surround Sound, and Synthesised Music to Provoke Catharsis and Healing

There is a wide range of sensory therapies using sound, music and visual stimuli. Some focus on soothing or distracting stimuli such as natural sounds or classical music as analgesic, while other approaches emphasize the active performance of producing music as therapy. This paper proposes an immersive multi-sensory Exposure Therapy for people suffering from anxiety disorders, based on a rich, detailed surround-soundscape. This soundscape is composed to include the users’ own idiosyncratic anxiety triggers as a form of habituation, and to provoke psychological catharsis, as a non-verbal, visceral and enveloping exposure. To accurately pinpoint the most effective sounds and to optimally compose the soundscape we will monitor the participants’ physiological responses such as electroencephalography, respiration, electromyography, and heart rate during exposure. We hypothesize that such physiologically optimized sensory landscapes will aid the development of future immersive therapies for various psychological conditions, Sound is a major trigger of anxiety, and auditory hypersensitivity is an extremely problematic symptom. Exposure to stress-inducing sounds can free anxiety sufferers from entrenched avoidance behaviors, teaching physiological coping strategies and encouraging resolution of the psychological issues agitated by the sound

Media Presence and Inner Presence: The Sense of Presence in Virtual Reality Technologies

Abstract. Presence is widely accepted as the key concept to be considered in any research involving human interaction with Virtual Reality (VR). Since its original description, the concept of presence has developed over the past decade to be considered by many researchers as the essence of any experience in a virtual environment. The VR generating systems comprise two main parts: a technological component and a psychological experience. The different relevance given to them produced two different but coexisting visions of presence: the rationalist and the psychological/ecological points of view. The rationalist point of view considers a VR system as a collection of specific machines with the necessity of the inclusion \ud of the concept of presence. The researchers agreeing with this approach describe the sense of presence as a function of the experience of a given medium (Media Presence). The main result of this approach is the definition of presence as the perceptual illusion of non-mediation produced by means of the disappearance of the medium from the conscious attention of the subject. At the other extreme, there \ud is the psychological or ecological perspective (Inner Presence). Specifically, this perspective considers presence as a neuropsychological phenomenon, evolved from the interplay of our biological and cultural inheritance, whose goal is the control of the human activity. \ud Given its key role and the rate at which new approaches to understanding and examining presence are appearing, this chapter draws together current research on presence to provide an up to date overview of the most widely accepted approaches to its understanding and measurement

From presence to consciousness through virtual reality

Immersive virtual environments can break the deep, everyday connection between where our senses tell us we are and where we are actually located and whom we are with. The concept of 'presence' refers to the phenomenon of behaving and feeling as if we are in the virtual world created by computer displays. In this article, we argue that presence is worthy of study by neuroscientists, and that it might aid the study of perception and consciousness

Inside the brain of an elite athlete: The neural processes that support high achievement in sports

Events like the World Championships in athletics and the Olympic Games raise the public profile of competitive sports. They may also leave us wondering what sets the competitors in these events apart from those of us who simply watch. Here we attempt to link neural and cognitive processes that have been found to be important for elite performance with computational and physiological theories inspired by much simpler laboratory tasks. In this way we hope to inspire neuroscientists to consider how their basic research might help to explain sporting skill at the highest levels of performance

First Person Perspective of Seated Participants Over a Walking Virtual Body Leads to Illusory Agency Over the Walking

Agency, the attribution of authorship to an action of our body, requires the intention to carry out the action, and subsequently a match between its predicted and actual sensory consequences. However, illusory agency can be generated through priming of the action together with perception of bodily action, even when there has been no actual corresponding action. Here we show that participants can have the illusion of agency over the walking of a virtual body even though in reality they are seated and only allowed head movements. The experiment (n = 28) had two factors: Perspective (1PP or 3PP) and Head Sway (Sway or NoSway). Participants in 1PP saw a life-sized virtual body spatially coincident with their own from a first person perspective, or the virtual body from third person perspective (3PP). In the Sway condition the viewpoint included a walking animation, but not in NoSway. The results show strong illusions of body ownership, agency and walking, in the 1PP compared to the 3PP condition, and an enhanced level of arousal while the walking was up a virtual hill. Sway reduced the level of agency. We conclude with a discussion of the results in the light of current theories of agency

Empathy and EDA Synchrony in Virtual Reality Collaboration

Objective. Empathy is essential for successful collaboration. Empathic mechanisms partly rely on receiving sensory socioemotional information during social interactions, such as facial expressions. Today, computer-mediated communication (CMC) covers a large part of daily social environments. However, socioemotional information during CMC is restricted, which directly impacts social processes and therefore, different empathic skills may become beneficial in CMC environments compared to face-to-face interactions. The impacts of CMC on social processes are insufficiently understood and studies provide mixed results. Physiological synchrony is a useful tool to study underlying aspects of social interactions. In psychophysiology, physiological states can be evaluated according to physiological responses, such as changes in electrodermal activity (EDA), which is a measure of sympathic nervous system activity. EDA synchrony is connected to empathy and collaboration in several studies. The purpose of this study is to reveal connections between empathic skills, collaborative task performance and EDA synchrony in CMC environment. Methods. EDA signals of twenty-nine pairs were recorded during collaborative task performance in VR environment. Participants were unfamiliar with each other and could not see each other during performance. Before the experiment, they conducted two empathy tests: Interpersonal Reactivity Index (IRI) and Reading the Mind in the Eyes (RME). The performance was measured and connected with empathic abilities using statistical methods. EDA synchrony indices were calculated for each pair, and were statistically connected with empathy and task performance. Results and Conclusions. The results surprisingly showed that IRI subscale ’personal distress’ predicts collaborative task performance in VR environment. Personal distress reflects emotional sensitivity and is conneceted to social avoidance and maladaptive emotion regulation strategies. This result indicates that different social skills become beneficial in CMC environment, where participants cannot see each other, as in face- to-face collaboration. In addition, RME, which reflect skills in complex emotion recognition, was connected to performance on a trend level, which is supported by previous findings. EDA synchrony occured, but was not connected with either empathic skills or collaboration

Empathic Agent Technology (EAT)

A new view on empathic agents is introduced, named: Empathic Agent Technology (EAT). It incorporates a speech analysis, which provides an indication for the amount of tension present in people. It is founded on an indirect physiological measure for the amount of experienced stress, defined as the variability of the fundamental frequency of the human voice. A thorough review of literature is provided on which the EAT is founded. In addition, the complete processing line of this measure is introduced. Hence, the first generally applicable, completely automated technique is introduced that enables the development of truly empathic agents

First person perspective of seated participants over a walking virtual body leads to illusory agency over the walking

Agency, the attribution of authorship to an action of our body, requires the intention to carry out the action, and subsequently a match between its predicted and actual sensory consequences. However, illusory agency can be generated through priming of the action together with perception of bodily action, even when there has been no actual corresponding action. Here we show that participants can have the illusion of agency over the walking of a virtual body even though in reality they are seated and only allowed head movements. The experiment (n = 28) had two factors: Perspective (1PP or 3PP) and Head Sway (Sway or NoSway). Participants in 1PP saw a life-sized virtual body spatially coincident with their own from a first person perspective, or the virtual body from third person perspective (3PP). In the Sway condition the viewpoint included a walking animation, but not in NoSway. The results show strong illusions of body ownership, agency and walking, in the 1PP compared to the 3PP condition, and an enhanced level of arousal while the walking was up a virtual hill. Sway reduced the level of agency. We conclude with a discussion of the results in the light of current theories of agency

The enactive approach to architectural experience: A neurophysiological perspective on embodiment, motivation, and affordances

From the enactivist perspective, the way people perceptually experience the world, including architectural spaces, is governed by the dynamic sensorimotor activity of the human organism as a whole and is thereby influenced by the particular conditions of man’s embodiment