Perceiving Mass in Mixed Reality through Pseudo-Haptic Rendering of Newton's Third Law

In mixed reality, real objects can be used to interact with virtual objects. However, unlike in the real world, real objects do not encounter any opposite reaction force when pushing against virtual objects. The lack of reaction force during manipulation prevents users from perceiving the mass of virtual objects. Although this could be addressed by equipping real objects with force-feedback devices, such a solution remains complex and impractical.In this work, we present a technique to produce an illusion of mass without any active force-feedback mechanism. This is achieved by simulating the effects of this reaction force in a purely visual way. A first study demonstrates that our technique indeed allows users to differentiate light virtual objects from heavy virtual objects. In addition, it shows that the illusion is immediately effective, with no prior training. In a second study, we measure the lowest mass difference (JND) that can be perceived with this technique. The effectiveness and ease of implementation of our solution provides an opportunity to enhance mixed reality interaction at no additional cost

Wearable Vibrotactile Haptic Device for Stiffness Discrimination during Virtual Interactions

In this paper, we discuss the development of cost effective, wireless, and wearable vibrotactile haptic device for stiffness perception during an interaction with virtual objects. Our experimental setup consists of haptic device with five vibrotactile actuators, virtual reality environment tailored in Unity 3D integrating the Oculus Rift Head Mounted Display (HMD) and the Leap Motion controller. The virtual environment is able to capture touch inputs from users. Interaction forces are then rendered at 500 Hz and fed back to the wearable setup stimulating fingertips with ERM vibrotactile actuators. Amplitude and frequency of vibrations are modulated proportionally to the interaction force to simulate the stiffness of a virtual object. A quantitative and qualitative study is done to compare the discrimination of stiffness on virtual linear spring in three sensory modalities: visual only feedback, tactile only feedback, and their combination. A common psychophysics method called the Two Alternative Forced Choice (2AFC) approach is used for quantitative analysis using Just Noticeable Difference (JND) and Weber Fractions (WF). According to the psychometric experiment result, average Weber fraction values of 0.39 for visual only feedback was improved to 0.25 by adding the tactile feedback

Advancing proxy-based haptic feedback in virtual reality

This thesis advances haptic feedback for Virtual Reality (VR). Our work is guided by Sutherland's 1965 vision of the ultimate display, which calls for VR systems to control the existence of matter. To push towards this vision, we build upon proxy-based haptic feedback, a technique characterized by the use of passive tangible props. The goal of this thesis is to tackle the central drawback of this approach, namely, its inflexibility, which yet hinders it to fulfill the vision of the ultimate display. Guided by four research questions, we first showcase the applicability of proxy-based VR haptics by employing the technique for data exploration. We then extend the VR system's control over users' haptic impressions in three steps. First, we contribute the class of Dynamic Passive Haptic Feedback (DPHF) alongside two novel concepts for conveying kinesthetic properties, like virtual weight and shape, through weight-shifting and drag-changing proxies. Conceptually orthogonal to this, we study how visual-haptic illusions can be leveraged to unnoticeably redirect the user's hand when reaching towards props. Here, we contribute a novel perception-inspired algorithm for Body Warping-based Hand Redirection (HR), an open-source framework for HR, and psychophysical insights. The thesis concludes by proving that the combination of DPHF and HR can outperform the individual techniques in terms of the achievable flexibility of the proxy-based haptic feedback.Diese Arbeit widmet sich haptischem Feedback für Virtual Reality (VR) und ist inspiriert von Sutherlands Vision des ultimativen Displays, welche VR-Systemen die Fähigkeit zuschreibt, Materie kontrollieren zu können. Um dieser Vision näher zu kommen, baut die Arbeit auf dem Konzept proxy-basierter Haptik auf, bei der haptische Eindrücke durch anfassbare Requisiten vermittelt werden. Ziel ist es, diesem Ansatz die für die Realisierung eines ultimativen Displays nötige Flexibilität zu verleihen. Dazu bearbeiten wir vier Forschungsfragen und zeigen zunächst die Anwendbarkeit proxy-basierter Haptik durch den Einsatz der Technik zur Datenexploration. Anschließend untersuchen wir in drei Schritten, wie VR-Systeme mehr Kontrolle über haptische Eindrücke von Nutzern erhalten können. Hierzu stellen wir Dynamic Passive Haptic Feedback (DPHF) vor, sowie zwei Verfahren, die kinästhetische Eindrücke wie virtuelles Gewicht und Form durch Gewichtsverlagerung und Veränderung des Luftwiderstandes von Requisiten vermitteln. Zusätzlich untersuchen wir, wie visuell-haptische Illusionen die Hand des Nutzers beim Greifen nach Requisiten unbemerkt umlenken können. Dabei stellen wir einen neuen Algorithmus zur Body Warping-based Hand Redirection (HR), ein Open-Source-Framework, sowie psychophysische Erkenntnisse vor. Abschließend zeigen wir, dass die Kombination von DPHF und HR proxy-basierte Haptik noch flexibler machen kann, als es die einzelnen Techniken alleine können

손끝 햅틱 장비를 위한 의사 햅틱의 활용

학위논문 (석사)-- 서울대학교 대학원 : 기계항공공학부, 2016. 2. 이동준.We propose a novel design of cutaneous fingertip haptic device and approach of integrating pseudo-haptics into our cutaneous haptic device. With 2-DoF cutaneous device, angle-force calibration result is presented for its operation. Then, 3-DoF cutaneous haptic device is designed for more realistic contact feedback in virtual reality (VR). Preliminary result of integrating cutaneous device and hand tracking device for complete wearable haptic interface is also demonstrated. Meanwhile, we explore possible utility of pseudo-haptics for cutaneous fingertip haptic device, whose performance is inherently limited due to the lack of kinesthetic feedback. We experimentally demonstrate that: 1) pseudo-haptics can render virtual stiffness to be more rigid or softer only by modulating visual cueand 2) pseudo-haptics can be used to expand the range of the perceived virtual stiffness to be doubled.Chapter 1 Introduction 1 1.1 Motivation and Objectives 1 1.2 Related Works 3 Chapter 2 Cutaneous Fingertip Haptic Device 6 2.1 2-DoF Cutaneous Haptic Device 6 2.1.1 Design and Specification 6 2.1.2 Angle-Force Calibration 8 2.1.3 Application of 2-DoF Cutaneous Haptic Device 10 2.2 3-DoF Cutaneous Haptic Device 11 2.2.1 Design and Specification 11 2.2.2 Control Design 14 2.2.3 IMU Distortion Offset Calibration 17 2.2.4 Device Validation 20 2.2.5 Integration with Wearable Hand Tracking Interface 21 Chapter 3 Pseudo-Haptics with Cutaneous Haptic Feedback 25 3.1 Limitation of Cutaneous Haptic Device 25 3.2 Application of Pseudo-Haptics Effect 26 Chapter 4 Experimental Study 28 4.1 Experimental Settings 28 4.2 Experiment #1 32 4.3 Experiment #2 34 4.4 Experiment #3 36 4.5 Discussion 38 Chapter 5 Conclusion and Future Work 40 5.1 Conclusion 40 5.2 Future Work 41 Bibliography 42 요약 50Maste

Effects of Haptic Feedback on the Wrist during Virtual Manipulation

As an alternative to thimble devices for the fingertips, we investigate haptic systems that apply stimulus to the user's forearm. Our aim is to provide effective interaction with virtual objects, despite the lack of co-location of virtual and real-world contacts, while taking advantage of relatively large skin area and ease of mounting on the forearm. We developed prototype wearable haptic devices that provide skin deformation in the normal and shear directions, and performed a user study to determine the effects of haptic feedback in different directions and at different locations near the wrist during virtual manipulation. Participants performed significantly better while discriminating stiffness values of virtual objects with normal forces compared to shear forces. We found no differences in performance or participant preferences with regard to stimulus on the dorsal, ventral, or both sides of the forearm.Comment: 7 pages, submitted conference paper for IEEE Haptics Symposium 202

Advances in Human-Protein Interaction - Interactive and Immersive Molecular Simulations

International audienc

物理/バーチャル空間の接続と分離を媒介する可動壁に関する研究

Tohoku University博士（情報科学）thesi

Effects of Haptic Feedback on the Wrist during Virtual Manipulation

We propose a haptic system for virtual manipulation to provide feedback on the user's forearm instead of the fingertips. In addition to visual rendering of the manipulation with virtual fingertips, we employ a device to deliver normal or shear skin-stretch at multiple points near the wrist. To understand how design parameters influence the experience, we investigated the effect of the number and location of sensory feedback on stiffness perception. Participants compared stiffness values of virtual objects, while the haptic bracelet provided interaction feedback on the dorsal, ventral, or both sides of the wrist. Stiffness discrimination judgments and duration, as well as qualitative results collected verbally, indicate no significant difference in stiffness perception with stimulation at different and multiple locations.Comment: 2 pages, work-in-progress paper on haptics symposium, 202

Haptics: Science, Technology, Applications

This open access book constitutes the proceedings of the 13th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2022, held in Hamburg, Germany, in May 2022. The 36 regular papers included in this book were carefully reviewed and selected from 129 submissions. They were organized in topical sections as follows: haptic science; haptic technology; and haptic applications

Hand-worn Haptic Interface for Drone Teleoperation

Drone teleoperation is usually accomplished using remote radio controllers, devices that can be hard to master for inexperienced users. Moreover, the limited amount of information fed back to the user about the robot's state, often limited to vision, can represent a bottleneck for operation in several conditions. In this work, we present a wearable interface for drone teleoperation and its evaluation through a user study. The two main features of the proposed system are a data glove to allow the user to control the drone trajectory by hand motion and a haptic system used to augment their awareness of the environment surrounding the robot. This interface can be employed for the operation of robotic systems in line of sight (LoS) by inexperienced operators and allows them to safely perform tasks common in inspection and search-and-rescue missions such as approaching walls and crossing narrow passages with limited visibility conditions. In addition to the design and implementation of the wearable interface, we performed a systematic study to assess the effectiveness of the system through three user studies (n = 36) to evaluate the users' learning path and their ability to perform tasks with limited visibility. We validated our ideas in both a simulated and a real-world environment. Our results demonstrate that the proposed system can improve teleoperation performance in different cases compared to standard remote controllers, making it a viable alternative to standard Human-Robot Interfaces.Comment: Accepted at the IEEE International Conference on Robotics and Automation (ICRA) 202