An Initial Exploration of a Multi-Sensory Design Space: Tactile Support for Walking in Immersive Virtual Environments

Multi-sensory feedback can potentially improve user experience and performance in virtual environments. As it is complicated to study the effect of multi-sensory feedback as a single factor, we created a design space with these diverse cues, categorizing them into an appropriate granularity based on their origin and use cases. To examine the effects of tactile cues during non-fatiguing walking in immersive virtual environments, we selected certain tactile cues from the design space, movement wind, directional wind and footstep vibration, and another cue, footstep sounds, and investigated their influence and interaction with each other in more detail. We developed a virtual reality system with non-fatiguing walking interaction and low-latency, multi-sensory feedback, and then used it to conduct two successive experiments measuring user experience and performance through a triangle-completion task. We noticed some effects due to the addition of footstep vibration on task performance, and saw significant improvement due to the added tactile cues in reported user experience

Networked Music Performance in Virtual Reality: Current Perspectives

The ability for musicians to interact face-to-face has been highly impacted by the COVID-19 pandemic. Physical distancing and travel restrictions have forced teaching, rehearsals, and performances to be moved online. The use of videoconference platforms designed for conversation has also meant accepting their limitations when used in musical contexts. For example, in networked music performance (NMP), low-latency audio is usually transmitted alongside a separate video image. Since videoconference systems usually have a higher degree of in-built delay, the result is that performers often ignore the video image of each other in order to maintain a steady rhythm. If musicians usually avoid looking at each other during NMPs, could virtual reality provide a viable alternative to videoconferencing? In recent years, virtual reality has reemerged as an immersive medium with the ability to bring users together in an online space. However, there is a relatively small body of literature that is concerned with realistic acoustic interaction approaches in NMP when virtual reality is used as the visual medium. This paper explores research at the intersection of networked music performance, virtual reality, and virtual environments. It finds that virtual reality as a visual alternative to videoconferencing in NMP is worthy of further investigation and points to priorities for future research

I Am The Passenger: How Visual Motion Cues Can Influence Sickness For In-Car VR

This paper explores the use of VR Head Mounted Displays (HMDs) in-car and in-motion for the first time. Immersive HMDs are becoming everyday consumer items and, as they offer new possibilities for entertainment and productivity, people will want to use them during travel in, for example, autonomous cars. However, their use is confounded by motion sickness caused in-part by the restricted visual perception of motion conflicting with physically perceived vehicle motion (accelerations/rotations detected by the vestibular system). Whilst VR HMDs restrict visual perception of motion, they could also render it virtually, potentially alleviating sensory conflict. To study this problem, we conducted the first on-road and in motion study to systematically investigate the effects of various visual presentations of the real-world motion of a car on the sickness and immersion of VR HMD wearing passengers. We established new baselines for VR in-car motion sickness, and found that there is no one best presentation with respect to balancing sickness and immersion. Instead, user preferences suggest different solutions are required for differently susceptible users to provide usable VR in-car. This work provides formative insights for VR designers and an entry point for further research into enabling use of VR HMDs, and the rich experiences they offer, when travelling

A motion control method for a differential drive robot based on human walking for immersive telepresence

Abstract. This thesis introduces an interface for controlling Differential Drive Robots (DDRs) for telepresence applications. Our goal is to enhance immersive experience while reducing user discomfort, when using Head Mounted Displays (HMDs) and body trackers. The robot is equipped with a 360° camera that captures the Robot Environment (RE). Users wear an HMD and use body trackers to navigate within a Local Environment (LE). Through a live video stream from the robot-mounted camera, users perceive the RE within a virtual sphere known as the Virtual Environment (VE). A proportional controller was employed to facilitate the control of the robot, enabling to replicate the movements of the user. The proposed method uses chest tracker to control the telepresence robot and focuses on minimizing vection and rotations induced by the robot’s motion by modifying the VE, such as rotating and translating it. Experimental results demonstrate the accuracy of the robot in reaching target positions when controlled through the body-tracker interface. Additionally, it also reveals an optimal VE size that effectively reduces VR sickness and enhances the sense of presence

6G Mobile-Edge Empowered Metaverse: Requirements, Technologies, Challenges and Research Directions

The Metaverse has emerged as the successor of the conventional mobile internet to change people's lifestyles. It has strict visual and physical requirements to ensure an immersive experience (i.e., high visual quality, low motion-to-photon latency, and real-time tactile and control experience). However, the current communication systems fall short to satisfy these requirements. Mobile edge computing (MEC) has been indispensable to enable low latency and powerful computing. Moreover, the sixth generation (6G) networks promise to provide end users with high-capacity communications to MEC servers. In this paper, we bring together the primary components into a 6G mobile-edge framework to empower the Metaverse. This includes the usage of heterogeneous radios, intelligent reflecting surfaces (IRS), non-orthogonal multiple access (NOMA), and digital twins (DTs). We also discuss novel communication paradigms (i.e., semantic communication, holographic-type communication, and haptic communication) to further satisfy the demand for human-type communications and fulfil user preferences and immersive experiences in the Metaverse

Analysis of the Level of Immersion of 360º Video Features Produced by Spanish Media

This paper offers the results of a content analysis on the level of immersion in 360º video features produced by Spanish media. Unlike other conventional ways of storytelling, this new modality provides the viewer with a sensation of being really immerse in a reality that is only being represented, which favors a deeper and more meaningful understanding of it. Our study is divided in three sections. Firstly, we develop a brief theoretical framework that includes the definition and foundations on which immersive feature is based. From this theoretical foundation, we draw a scale to measure the immersion level of these pieces and we confront our proposal to the qualified assessment of 10 experts. Finally we apply this scale on a sample of 148 360º video features produced by Spanish media between January 2015 and December 2017. The aim is to analyze its use and also to infer some good practices that can be useful not only for scholars researching on this new format but also for practitioners producing it.El presente trabajo ofrece los resultados de un análisis de contenido sobre el nivel de inmersión en los vídeos en 360º producidos por medios periodísticos españoles. A diferencia de otras maneras convencionales de contar, esta nueva modalidad genera en el espectador la sensación de encontrarse realmente presente en una realidad que está siendo solo representada. Esto favorece una comprensión más profunda y significativa de ella. Nuestro estudio está dividido en tres secciones. En primer lugar, desarrollamos un breve marco teórico en el que recogemos la definición y fundamentos sobre los que se sostiene el periodismo inmersivo en general y el reportaje en vídeo en 360º en particular. A partir de esta fundamentación, proponemos una escala para medir el nivel de inmersión que hace posible este tipo de piezas y la validamos mediante la evaluación cualificada de un grupo de 10 expertos. Finalmente, aplicamos esta escala sobre una muestra de 148 reportajes en vídeo en 360º publicados por medios periodísticos españoles durante el período comprendido entre enero de 2015 y diciembre de 2017. El objetivo es analizar su uso e inferir una serie de buenas prácticas que puedan resultar de utilidad tanto a académicos que investigan este nuevo formato como a los profesionales que lo producen

How to Build an Embodiment Lab: Achieving Body Representation Illusions in Virtual Reality

Advances in computer graphics algorithms and virtual reality (VR) systems, together with the reduction in cost of associated equipment, have led scientists to consider VR as a useful tool for conducting experimental studies in fields such as neuroscience and experimental psychology. In particular virtual body ownership, where the feeling of ownership over a virtual body is elicited in the participant, has become a useful tool in the study of body representation, in cognitive neuroscience and psychology, concerned with how the brain represents the body. Although VR has been shown to be a useful tool for exploring body ownership illusions, integrating the various technologies necessary for such a system can be daunting. In this paper we discuss the technical infrastructure necessary to achieve virtual embodiment. We describe a basic VR system and how it may be used for this purpose, and then extend this system with the introduction of real-time motion capture, a simple haptics system and the integration of physiological and brain electrical activity recordings

Media Presence and Inner Presence: The Sense of Presence in Virtual Reality Technologies

Abstract. Presence is widely accepted as the key concept to be considered in any research involving human interaction with Virtual Reality (VR). Since its original description, the concept of presence has developed over the past decade to be considered by many researchers as the essence of any experience in a virtual environment. The VR generating systems comprise two main parts: a technological component and a psychological experience. The different relevance given to them produced two different but coexisting visions of presence: the rationalist and the psychological/ecological points of view. The rationalist point of view considers a VR system as a collection of specific machines with the necessity of the inclusion \ud of the concept of presence. The researchers agreeing with this approach describe the sense of presence as a function of the experience of a given medium (Media Presence). The main result of this approach is the definition of presence as the perceptual illusion of non-mediation produced by means of the disappearance of the medium from the conscious attention of the subject. At the other extreme, there \ud is the psychological or ecological perspective (Inner Presence). Specifically, this perspective considers presence as a neuropsychological phenomenon, evolved from the interplay of our biological and cultural inheritance, whose goal is the control of the human activity. \ud Given its key role and the rate at which new approaches to understanding and examining presence are appearing, this chapter draws together current research on presence to provide an up to date overview of the most widely accepted approaches to its understanding and measurement