Timing and correction of stepping movements with a virtual reality avatar

Research into the ability to coordinate one’s movements with external cues has focussed on the use of simple rhythmic, auditory and visual stimuli, or interpersonal coordination with another person. Coordinating movements with a virtual avatar has not been explored, in the context of responses to temporal cues. To determine whether cueing of movements using a virtual avatar is effective, people’s ability to accurately coordinate with the stimuli needs to be investigated. Here we focus on temporal cues, as we know from timing studies that visual cues can be difficult to follow in the timing context. Real stepping movements were mapped onto an avatar using motion capture data. Healthy participants were then motion captured whilst stepping in time with the avatar’s movements, as viewed through a virtual reality headset. The timing of one of the avatar step cycles was accelerated or decelerated by 15% to create a temporal perturbation, for which participants would need to correct to, in order to remain in time. Step onset times of participants relative to the corresponding step-onsets of the avatar were used to measure the timing errors (asynchronies) between them. Participants completed either a visual-only condition, or auditory-visual with footstep sounds included, at two stepping tempo conditions (Fast: 400ms interval, Slow: 800ms interval). Participants’ asynchronies exhibited slow drift in the Visual-Only condition, but became stable in the Auditory-Visual condition. Moreover, we observed a clear corrective response to the phase perturbation in both the fast and slow tempo auditory-visual conditions. We conclude that an avatar’s movements can be used to influence a person’s own motion, but should include relevant auditory cues congruent with the movement to ensure a suitable level of entrainment is achieved. This approach has applications in physiotherapy, where virtual avatars present an opportunity to provide the guidance to assist patients in adhering to prescribed exercises

Augmented Visibility in Architectural Space: Influencing Movement Patterns

The rapid development of computing associated with our modern era has resulted in exciting and innovative incorporation of digital technology in architectural design. However, this presents challenges for established theories of spatial analysis, such as space syntax, developed by Hillier and Hanson. The research presented in this thesis identifies and addresses a lack of knowledge concerning the impact of digitally manipulating physical architectural environments by introducing perceived visual depth into them. The research contributes to the development of space syntax theory by showing that the introduction of perceived visual depth in architectural space impacts on people’s behaviour, and that space syntax theory needs to be adjusted to account for this phenomenon. The overarching hypothesis of the experiments detailed by the thesis was that ambient displays can be introduced into physical architectural settings to augment the perceived visual depth of a space by virtually linking and extending physical space towards another real or virtual space. This augments the topological and visual relations of a space which influences how people use and move within such settings. To investigate the hypothesis a series of experiments was designed and conducted. A pilot study showed that manipulating the perceived depth of a wall through digital projection had a significant effect on people’s use of the space. The first of the main experiments showed that the position of an ambient display, acting as a virtual window through the wall upon which it was placed, had the capacity to influence people’s behaviour in space. This was established by designing a T-shaped corridor which participants entered from the bottom and were therefore required to make a left or right-hand turn decision to access a target area beyond the corridor. Whilst the environment was held constant the display was placed in one of three conditions, central, left, or right. The analysis showed that people’s turn-based decisions were affected by the position of the display. The second experiment used the same architectural setting but held the position of the ambient display constant in the central position whilst altering what it displayed in three conditions. The display either acted as a realistic virtual window, showing what would be seen if the display was a real window or it skewed the perspective of the image by manipulating the vanishing point towards the left or right. The turn-based decisions of participants entering the corridor were recorded and the results showed that they were significantly influenced by the manipulation. The experimental data showed that digital displays can act as virtual windows which alter spatial relations in a simple architectural space. This knowledge, combined with an awareness that current methods of spatial analysis cannot account for the impact of introducing digital depth into architectural space, show that theories must be adapted to ensure their ability to model behaviour in hybrid architectural environments which incorporate digital technology

Natural Walking in Virtual Reality:A Review

Recent technological developments have finally brought virtual reality (VR) out of the laboratory and into the hands of developers and consumers. However, a number of challenges remain. Virtual travel is one of the most common and universal tasks performed inside virtual environments, yet enabling users to navigate virtual environments is not a trivial challenge—especially if the user is walking. In this article, we initially provide an overview of the numerous virtual travel techniques that have been proposed prior to the commercialization of VR. Then we turn to the mode of travel that is the most difficult to facilitate, that is, walking. The challenge of providing users with natural walking experiences in VR can be divided into two separate, albeit related, challenges: (1) enabling unconstrained walking in virtual worlds that are larger than the tracked physical space and (2) providing users with appropriate multisensory stimuli in response to their interaction with the virtual environment. In regard to the first challenge, we present walking techniques falling into three general categories: repositioning systems, locomotion based on proxy gestures, and redirected walking. With respect to multimodal stimuli, we focus on how to provide three types of information: external sensory information (visual, auditory, and cutaneous), internal sensory information (vestibular and kinesthetic/proprioceptive), and efferent information. Finally, we discuss how the different categories of walking techniques compare and discuss the challenges still facing the research community.</jats:p

Performing walking Sims:from <i>Dear Esther </i>to <i>Inchcolm Project</i>

In 2012 The Chinese Room launched Dear Esther, a video game which would go on to shape video game history and define a new genre: the walking simulator. Walking simulators renounce traditional game tropes and foreground walking as an aesthetic and as a dramaturgical practice which engages the walker/player in critical acts of reading, challenging and/or performing a landscape. In October 2016, Dear Esther was adapted as a site-responsive, promenade performance set on the Scottish island of Inchcolm in the Firth of Forth. The resulting performance, Dear Rachel, was then experienced alongside the game under the umbrella name Inchcolm Project. This hybrid event - multi-media (promenade performance, gameplay, musical performance) and mixed-reality (with physical, augmented and virtual components) - required the development and implementation of complex processes of remediation and adaptation. Drawing from theoretical landscape and practitioner reflection, this paper puts forward a design framework – storywalking - which reconciled the two adaptation challenges: responding to the site, and to the game

The Impact of Sensory Marketing: Analysis of its Attributes Towards Online Perfum Users’ Behavior

Purpose: The tendency of consumers to purchase online today is enormous and requires the role of sensory marketing in providing a positive and memorable experience to all. In addition, since sensory marketing whether in online or offline settings can unconsciously govern shoppers’ judgement and purchase behavior, this paper aims to understand how multi-sensory information processing in the online environment is diverted from offline in the cosmetic perfume industry by leveraging previous research to analyze its effect on offline stores and emphasizing the present study on online retail stores.   Theoretical framework: The research study conducted by Petit et al. (2019) attempts to explore more about digital sensory marketing and multisensory technologies. However, offline and online settings would have different effects and since perfume products require the use of our senses, there would be obstacles that prevent us from using our senses when sold online. This requires us to understand sensory marketing in the online shopping environment.   Design/Methodology/Approach: This paper uses an exploratory study approach to gain in-depth understanding of the topic. The qualitative study is essentially built on primary data sources, through naturalistic observation and semi-structured interviews with 9 Generation Z individuals who are Indonesian citizens and have undertaken frequent perfume purchases online. A snowball sampling method was used in finding respondents for this study while interview results were analyzed using thematic analysis.   Findings: The paper highlights the significant impact of sensory marketing through the use of sensorial cues, sensorial attributes, and individual differences in sensory perception. Ethical considerations when utilizing sensory marketing are also being emphasized throughout this study.   Research, Practical &amp; Social implications: Results of this study can encourage future research to help bring benefits for website/internet site designers, content managers, online perfume retailers, as well as academicians in general.   Originality/Value: This paper draws attention to the growing use of online channels by cosmetic perfume industry actors and sheds light on the importance of sensory marketing practices in affecting online user behavior by answering what and how questions using exploratory studies.

Body-Borne Computers as Extensions of Self

The opportunities for wearable technologies go well beyond always-available information displays or health sensing devices. The concept of the cyborg introduced by Clynes and Kline, along with works in various fields of research and the arts, offers a vision of what technology integrated with the body can offer. This paper identifies different categories of research aimed at augmenting humans. The paper specifically focuses on three areas of augmentation of the human body and its sensorimotor capabilities: physical morphology, skin display, and somatosensory extension. We discuss how such digital extensions relate to the malleable nature of our self-image. We argue that body-borne devices are no longer simply functional apparatus, but offer a direct interplay with the mind. Finally, we also showcase some of our own projects in this area and shed light on future challenges

Cognitive Engineering

Cognitive engineering is the application of cognitive psychology and related disciplines to the design and operation of human–machine systems. Cognitive engineering combines both detailed and close study of the human worker in the actual work context and the study of the worker in more controlled environments. Cognitive engineering combines multiple methods and perspectives to achieve the goal of improved system performance. Given the origins of experimental psychology itself in issues regarding the design of human–machine systems, cognitive engineering is a core, or fundamental, discipline within academic psychology

Multimodality in {VR}: {A} Survey

Virtual reality has the potential to change the way we create and consume content in our everyday life. Entertainment, training, design and manufacturing, communication, or advertising are all applications that already benefit from this new medium reaching consumer level. VR is inherently different from traditional media: it offers a more immersive experience, and has the ability to elicit a sense of presence through the place and plausibility illusions. It also gives the user unprecedented capabilities to explore their environment, in contrast with traditional media. In VR, like in the real world, users integrate the multimodal sensory information they receive to create a unified perception of the virtual world. Therefore, the sensory cues that are available in a virtual environment can be leveraged to enhance the final experience. This may include increasing realism, or the sense of presence; predicting or guiding the attention of the user through the experience; or increasing their performance if the experience involves the completion of certain tasks. In this state-of-the-art report, we survey the body of work addressing multimodality in virtual reality, its role and benefits in the final user experience. The works here reviewed thus encompass several fields of research, including computer graphics, human computer interaction, or psychology and perception. Additionally, we give an overview of different applications that leverage multimodal input in areas such as medicine, training and education, or entertainment; we include works in which the integration of multiple sensory information yields significant improvements, demonstrating how multimodality can play a fundamental role in the way VR systems are designed, and VR experiences created and consumed