Synergy-based Hand Pose Sensing: Reconstruction Enhancement

Low-cost sensing gloves for reconstruction posture provide measurements which are limited under several regards. They are generated through an imperfectly known model, are subject to noise, and may be less than the number of Degrees of Freedom (DoFs) of the hand. Under these conditions, direct reconstruction of the hand posture is an ill-posed problem, and performance can be very poor. This paper examines the problem of estimating the posture of a human hand using(low-cost) sensing gloves, and how to improve their performance by exploiting the knowledge on how humans most frequently use their hands. To increase the accuracy of pose reconstruction without modifying the glove hardware - hence basically at no extra cost - we propose to collect, organize, and exploit information on the probabilistic distribution of human hand poses in common tasks. We discuss how a database of such an a priori information can be built, represented in a hierarchy of correlation patterns or postural synergies, and fused with glove data in a consistent way, so as to provide a good hand pose reconstruction in spite of insufficient and inaccurate sensing data. Simulations and experiments on a low-cost glove are reported which demonstrate the effectiveness of the proposed techniques.Comment: Submitted to International Journal of Robotics Research (2012

Towards a Twisted String Actuated Haptic Device: Experimental Testing of a 2-D Virtual Environment and Teleoperation Interface

In the article, a first stage implementation of a haptic device towards a complete 3-D workspace twisted-string actuated haptic interface is discussed. In the present work, a 2-D setup is presented, with the aim of preliminarly testing the behaviour of this novel haptic system, especially with respect to the adopted cable-based actuation solution. In particular, the component descriptions, kinematics of the planar device and the controller for teleoperation purposes are illustrated. Results regarding the behaviour of the system in rendering a virtual environment and in a robot teleoperation scenario with haptic force feedback are reported. The experimental outcomes show that the designed and implemented system is suitable for teleoperation with haptic interfaces, providing positive perspectives for the realization of the fully functional 3-D haptic interface in the future work

Prop-Based Haptic Interaction with Co-location and Immersion: an Automotive Application

Most research on 3D user interfaces aims at providing only a single sensory modality. One challenge is to integrate several sensory modalities into a seamless system while preserving each modality's immersion and performance factors. This paper concerns manipulation tasks and proposes a visuo-haptic system integrating immersive visualization, tactile force and tactile feedback with co-location. An industrial application is presented

INTERACTIVE PHYSICAL DESIGN AND HAPTIC PLAYING OF VIRTUAL MUSICAL INSTRUMENTS

International audienceIn Computer Music, a practical approach of many Digital Musical Instruments is to separate the gestural input stage from the sound synthesis stage. While these instruments offer many creative possibilities, they present a strong rupture with traditional acoustic instruments, as the physical coupling between human and sound is broken. This coupling plays a crucial role for the expressive musical playing of acoustic instruments; we believe restoring it in a digital context is of equal importance for revealing the full expressive potential of digital instruments. This paper first presents haptic and physical modelling technologies for representing the mechano-acoustical instrumental situation in the context of DMIs. From these technologies, a prototype environment has been implemented for both designing virtual musical instruments and interacting with them via a force feedback device, able to preserve the energetic coherency of the musician-sound chain

COMPARATIVE STUDY OF HAPTIC AND VISUAL FEEDBACK FOR KINESTHETIC TRAINING TASKS

Haptics is the sense of simulating and applying the sense of human touch. Application of touch sensations is done with haptic interface devices. The past few years has seen the development of several haptic interface devices with a wide variety of technologies used in their design. This thesis introduces haptic technologies and includes a survey of haptic interface devices and technologies. An improvement in simulating and applying touch sensation when using the Quanser Haptic Wand with proSense is suggested in this work using a novel five degree-of-freedom algorithm. This approach uses two additional torques to enhance the three degree-of-freedom of force feedback currently available with these products. Modern surgical trainers for performing laparoscopic surgery are incorporating haptic feedback in addition to visual feedback for training. This work presents a quantitative comparison of haptic versus visual training. One of the key results of the study is that haptic feedback is better than visual feedback for kinesthetic navigation tasks

Optical Fibre-based Force Sensing Needle Driver for Minimally Invasive Surgery

Minimally invasive surgery has been limited from its inception by insufficient haptic feedback to surgeons. The loss of haptic information threatens patients safety and results in longer operation times. To address this problem, various force sensing systems have been developed to provide information about tool–tissue interaction forces. However, the provided results for axial and grasping forces have been inaccurate in most of these studies due to considerable amount of error and uncertainty in their force acquisition method. Furthermore, sterilizability of the sensorized instruments plays a pivotal role in accurate measurement of forces inside a patient\u27s body. Therefore, the objective of this thesis was to develop a sterilizable needle-driver type grasper using fibre Bragg gratings. In order to measure more accurate and reliable tool–tissue interaction forces, optical force sensors were integrated in the grasper jaw to measure axial and grasping forces directly at their exertion point on the tool tip. Two sets of sensor prototypes were developed to prove the feasibility of proposed concept. Implementation of this concept into a needle-driver instrument resulted in the final proposed model of the sensorized laparoscopic instrument. Fibre Bragg gratings were used for measuring forces due to their many advantages for this application such as small size, sterilizability and high sensitivity. Visual force feedback was provided for users based on the acquired real-time force data. Improvement and consideration points related to the current work were identified and potential areas to continue this project in the future are discussed

A MODELLER-SIMULATOR FOR INSTRUMENTAL PLAYING OF VIRTUAL MUSICAL INSTRUMENTS

International audienceThis paper presents a musician-oriented modelling and simulation environment for designing physically modelled virtual instruments and interacting with them via a high performance haptic device. In particular, our system allows restoring the physical coupling between the user and the manipulated virtual instrument, a key factor for expressive playing of traditional acoustical instruments that is absent in the vast majority of computer-based musical systems. We first analyse the various uses of haptic devices in Computer Music, and introduce the various technologies involved in our system. We then present the modeller and simulation environments, and examples of musical virtual instruments created with this new environment