Perceiving Mass in Mixed Reality through Pseudo-Haptic Rendering of Newton's Third Law

In mixed reality, real objects can be used to interact with virtual objects. However, unlike in the real world, real objects do not encounter any opposite reaction force when pushing against virtual objects. The lack of reaction force during manipulation prevents users from perceiving the mass of virtual objects. Although this could be addressed by equipping real objects with force-feedback devices, such a solution remains complex and impractical.In this work, we present a technique to produce an illusion of mass without any active force-feedback mechanism. This is achieved by simulating the effects of this reaction force in a purely visual way. A first study demonstrates that our technique indeed allows users to differentiate light virtual objects from heavy virtual objects. In addition, it shows that the illusion is immediately effective, with no prior training. In a second study, we measure the lowest mass difference (JND) that can be perceived with this technique. The effectiveness and ease of implementation of our solution provides an opportunity to enhance mixed reality interaction at no additional cost

Sensory augmentation and the tactile sublime

This paper responds to recent developments in the field of sensory augmentation by analysing several technological devices that augment the sensory apparatus using the tactile sense. First, I will define the term sensory augmentation, as the use of technological modification to enhance the sensory apparatus, and elaborate on the preconditions for successful tactile sensory augmentation. These are the adaptability of the brain to unfamiliar sensory input and the specific qualities of the skin lending themselves to be used for the perception of additional sensory information. Two devices, Moon Ribas’ Seismic Sense and David Eagleman’s vest, will then be discussed as potential facilitators of aesthetic experiences in virtue of the tactile sensory augmentation that these devices allow. I will connect the experiences afforded by these devices to the Kantian categories of the mathematical and the dynamical sublime, and to existing accounts of tactile sublimity. Essentially, the objects these devices make sensible, earthquakes for the Seismic Sense and digital information for the vest, produce pleasurable feelings of potential danger, awe, and respect. The subsequent acclimation to this new way of sensing and the aim to comprehend its sensed object are then discussed as possible objections to the interpretation of these experiences as sublime, and as aesthetic in general. To exemplify these issues and concretise my thesis of tactile sensory augmentation as a trigger of the sublime, I will outline an experiment to use the vest as an aid for faster decision making on the stock market

An investigation of effects of the partial active assistance in a virtual environment based rehabilitation system

This thesis describes a study on a new active assistance in robotic rehabilitation in a haptic virtual environment for post-stroke patients. The novelty of this active assistance system lies in that the assistance is directly rendered on the result of a task performing. Active assistance will generally raise the confidence level of patients in performing a rehabilitation exercise. However, an overly high assistance level may induce cognitive fatigue with patients and thus decreases their motivation of performing a rehabilitation exercise. This thesis hypothesizes that a proper active assistance can improve the performance of a rehabilitation exercise, but will not reduce the motivation of patients in doing rehabilitation exercise. However, due to the difficulty in obtaining a proper number of patients for the experiment, the study turned to healthy people. Accordingly, a revised hypothesis is that active assistance on healthy people does not improve the task performance and not reduces the motivation of healthy people. In this thesis, first, a test-bed with the haptic virtual environment was designed and constructed. The test-bed included a simple task – i.e., following a predefined circle trajectory. Then, a statistical experiment was designed and an experiment was conducted on the test-bed. The experimental results test the hypothesis successfully. The main contributions of this thesis are: (1) the development of a new active assistance system for rehabilitation in a virtual environment and (2) the experimental study on the motivation of healthy people with the developed active assistance system. A care must, however, be taken that the experiment was conducted on healthy people and the conclusion drawn from the study may not be valid on patients

An aesthetics of touch: investigating the language of design relating to form

How well can designers communicate qualities of touch? This paper presents evidence that they have some capability to do so, much of which appears to have been learned, but at present make limited use of such language. Interviews with graduate designer-makers suggest that they are aware of and value the importance of touch and materiality in their work, but lack a vocabulary to fully relate to their detailed explanations of other aspects such as their intent or selection of materials. We believe that more attention should be paid to the verbal dialogue that happens in the design process, particularly as other researchers show that even making-based learning also has a strong verbal element to it. However, verbal language alone does not appear to be adequate for a comprehensive language of touch. Graduate designers-makers’ descriptive practices combined non-verbal manipulation within verbal accounts. We thus argue that haptic vocabularies do not simply describe material qualities, but rather are situated competences that physically demonstrate the presence of haptic qualities. Such competencies are more important than groups of verbal vocabularies in isolation. Design support for developing and extending haptic competences must take this wide range of considerations into account to comprehensively improve designers’ capabilities

Virtual Reality Games for Motor Rehabilitation

This paper presents a fuzzy logic based method to track user satisfaction without the need for devices to monitor users physiological conditions. User satisfaction is the key to any product’s acceptance; computer applications and video games provide a unique opportunity to provide a tailored environment for each user to better suit their needs. We have implemented a non-adaptive fuzzy logic model of emotion, based on the emotional component of the Fuzzy Logic Adaptive Model of Emotion (FLAME) proposed by El-Nasr, to estimate player emotion in UnrealTournament 2004. In this paper we describe the implementation of this system and present the results of one of several play tests. Our research contradicts the current literature that suggests physiological measurements are needed. We show that it is possible to use a software only method to estimate user emotion

How to Build an Embodiment Lab: Achieving Body Representation Illusions in Virtual Reality

Advances in computer graphics algorithms and virtual reality (VR) systems, together with the reduction in cost of associated equipment, have led scientists to consider VR as a useful tool for conducting experimental studies in fields such as neuroscience and experimental psychology. In particular virtual body ownership, where the feeling of ownership over a virtual body is elicited in the participant, has become a useful tool in the study of body representation, in cognitive neuroscience and psychology, concerned with how the brain represents the body. Although VR has been shown to be a useful tool for exploring body ownership illusions, integrating the various technologies necessary for such a system can be daunting. In this paper we discuss the technical infrastructure necessary to achieve virtual embodiment. We describe a basic VR system and how it may be used for this purpose, and then extend this system with the introduction of real-time motion capture, a simple haptics system and the integration of physiological and brain electrical activity recordings