W-FYD: a Wearable Fabric-based Display for Haptic Multi-Cue Delivery and Tactile Augmented Reality

Despite the importance of softness, there is no evidence of wearable haptic systems able to deliver controllable softness cues. Here, we present the Wearable Fabric Yielding Display (W-FYD), a fabric-based display for multi-cue delivery that can be worn on user's finger and enables, for the first time, both active and passive softness exploration. It can also induce a sliding effect under the finger-pad. A given stiffness profile can be obtained by modulating the stretching state of the fabric through two motors. Furthermore, a lifting mechanism allows to put the fabric in contact with the user's finger-pad, to enable passive softness rendering. In this paper, we describe the architecture of W-FYD, and a thorough characterization of its stiffness workspace, frequency response and softness rendering capabilities. We also computed device Just Noticeable Difference in both active and passive exploratory conditions, for linear and non-linear stiffness rendering as well as for sliding direction perception. The effect of device weight was also considered. Furthermore, performance of participants and their subjective quantitative evaluation in detecting sliding direction and softness discrimination tasks are reported. Finally, applications of W-FYD in tactile augmented reality for open palpation are discussed, opening interesting perspectives in many fields of human-machine interaction

A Synergy-Based Optimally Designed Sensing Glove for Functional Grasp Recognition

Achieving accurate and reliable kinematic hand pose reconstructions represents a challenging task. The main reason for this is the complexity of hand biomechanics, where several degrees of freedom are distributed along a continuous deformable structure. Wearable sensing can represent a viable solution to tackle this issue, since it enables a more natural kinematic monitoring. However, the intrinsic accuracy (as well as the number of sensing elements) of wearable hand pose reconstruction (HPR) systems can be severely limited by ergonomics and cost considerations. In this paper, we combined the theoretical foundations of the optimal design of HPR devices based on hand synergy information, i.e., the inter-joint covariation patterns, with textile goniometers based on knitted piezoresistive fabrics (KPF) technology, to develop, for the first time, an optimally-designed under-sensed glove for measuring hand kinematics. We used only five sensors optimally placed on the hand and completed hand pose reconstruction (described according to a kinematic model with 19 degrees of freedom) leveraging upon synergistic information. The reconstructions we obtained from five different subjects were used to implement an unsupervised method for the recognition of eight functional grasps, showing a high degree of accuracy and robustness

The Rice Haptic Rocker: Skin stretch haptic feedback with the Pisa/IIT SoftHand

Touch provides an important cue to perceive the physical properties of the external objects. Recent studies showed that tactile sensation also contributes to our sense of hand position and displacement in perceptual tasks. In this study, we tested the hypothesis that, sliding our hand over a stationary surface, tactile motion may provide a feedback for guiding hand trajectory. We asked participants to touch a plate having parallel ridges at different orientations and to perform a self-paced, straight movement of the hand. In our daily-life experience, tactile slip motion is equal and opposite to hand motion. Here, we used a well-established perceptual illusion to dissociate, in a controlled manner, the two motionestimates. According to previous studies, this stimulus produces a bias in the perceived direction of tactile motion, predicted by tactile flow model. We showed a systematic deviation in the movement of the hand towards a direction opposite to the one predicted by tactile flow, supporting the hypothesis that touch contributes to motor control of the hand. We suggested a model where the perceived hand motion is equal to a weighted sum of the estimate from classical proprioceptive cues (e.g., from musculoskeletal system) and the estimate from tactile slip

From humans to robots: The role of cutaneous impairment in human environmental constraint exploitation to inform the design of robotic hands

Human hands are capable of a variety of movements, thanks to their extraordinary biomechanical structure and relying on the richness of human tactile information. Recently, soft robotic hands have opened exciting possibilities and, al the same time, new issues related to planning and control. In this work, we propose to study human strategies in environmental constraint exploitation to grasp objects from a table. We have considered both the case where participants' fingertips were free and with a rigid shell worn on them to understand the role of cutaneous touch. Main kinematic strategies were quantified and classified in an unsupervised manner. The principal strategies appear to be consistent in both experimental conditions, although cluster cardinality differs. Furthermore, as expected, tactile feedback improves both grasp precision and quality performance. Results opens interesting perspective for sensing and control of soft manipulators

A Finite element model of tactile flow for softness perception

Touch is an extremely dynamic sense. To take into account this aspect, it has been hypothesized that there are mechanisms in the brain that specialize in processing dynamic tactile stimuli, in a way not too dissimilar from what happens for optical flow in dynamic vision. The concept of tactile flow, related to the rate of expansion of isostrain volumes in the human fingerpad, was used to explain some perceptual illusions as well as mechanisms of human softness perception. In this paper we describe a computational model of tactile flow, and apply it to a finite element model of interaction between deformable bodies. The shape and material properties of the bodies are modeled from those of a human fingertip interacting with specimens with different softness properties. Results show that the rate of expansion of isostrain volumes can be used to discriminate different materials in terms of their softness characteristics

Towards a Novel Generation of Haptic and Robotic Interfaces: Integrating Active Physiology in Human-Robot Interaction

Haptic interfaces are special robots that interact with people to convey touch-related information. In addition to such a discriminative aspect, touch is also a highly emotion-related sense. However, while a lot of effort has been spent to investigate the perceptual mechanisms of discriminative touch and to suitably replicate them through haptic systems in human robot interaction (HRI), there is still a lot of work to do in order to take into account also the emotional aspects of tactual experience (i.e., the so-called affective haptics), for a more naturalistic human-robot communication. In this paper, we report evidences on how a haptic device designed to convey caress-like stimuli can influence physiological measures related to the autonomous nervous system (ANS), which is intimately connected to evoked emotions in humans. Specifically, a discriminant role of electrodermal response and heart rate variability can be associated to two different caressing velocities, which can also be linked to two different levels of pleasantness. Finally, we discuss how the results from this study could be profitably employed and generalized to pave the path towards a novel generation of robotic devices for HRI

Synergy-driven performance enhancement of vision-based 3D hand pose reconstruction

In this work we propose, for the first time, to improve the performance of a Hand Pose Reconstruction (HPR) technique from RGBD camera data, which is affected by self-occlusions, leveraging upon postural synergy information, i.e., a priori information on how human most commonly use and shape their hands in everyday life tasks. More specifically, in our approach, we ignore joint angle values estimated with low confidence through a vision-based HPR technique and fuse synergistic information with such incomplete measures. Preliminary experiments are reported showing the effectiveness of the proposed integration

Upper limb artery segmental occlusions due to chronic use of ergotamine combined with itraconazole, treated by thrombolysis

<p>Abstract</p> <p>Background</p> <p>The ergotamine tartrate associated with certain categories of drugs can lead to critical ischemia of the extremities. Discontinuation of taking ergotamine is usually sufficient for the total regression of ischemia, but in some cases it could be necessary thrombolytic and anticoagulant therapy to avoid amputation.</p> <p>Case report</p> <p>A woman of 62 years presented with a severe pain left forearm appeared 10 days ago, with a worsening trend. The same symptoms appeared after 5 days also in the right forearm. Physical examination showed the right arm slightly hypothermic, with radial reduced pulse in presence of reduced sensitivity. The left arm was frankly hypothermic, pulse less on radial and with an ulnar humeral reduced pulse, associated to a decreased sensitivity and motility.</p> <p>Clinical history shows a chronic headache for which the patient took a daily basis for years Cafergot suppository (equivalent to 3.2 mg of ergotamine).</p> <p>From about ten days had begun therapy with itraconazole for vaginal candidiasis. The Color-Doppler ultrasound shown arterial thrombosis of the upper limbs (humeral and radial bilateral), with minimal residual flow to the right and no signal on the humeral and radial left artery.</p> <p>Results</p> <p>Angiography revealed progressive reduction in size of the axillary artery and right humeral artery stenosis with right segmental occlusions and multiple hypertrophic collateral circulations at the elbow joint. At the level of the right forearm was recognizable only the radial artery, decreased in size. Does not recognize the ulnar, interosseous artery was thin. To the left showed progressive reduction in size of the distal subclavian and humeral artery, determined by multiple segmental steno-occlusion with collateral vessels serving only a thin hypotrophic interosseous artery.</p> <p>Arteriographic findings were compatible with systemic drug-induced disease. The immediate implementation of thrombolysis, continued for 26 hours, with heparin in continuous intravenous infusion and subsequent anticoagulant therapy allowed the gradual disappearance of the symptoms with the reappearance of peripheral pulses.</p> <p>Conclusion</p> <p>Angiography showed regression of vasospasm and the resumption of flow in distal vessels. The patient had regained sensitivity and motility in the upper limbs and bilaterally radial and ulnar were present.</p

Design of an under-actuated wrist based on adaptive synergies

An effective robotic wrist represents a key enabling element in robotic manipulation, especially in prosthetics. In this paper, we propose an under-actuated wrist system, which is also adaptable and allows to implement different under-actuation schemes. Our approach leverages upon the idea of soft synergies - in particular the design method of adaptive synergies - as it derives from the field of robot hand design. First we introduce the design principle and its implementation and function in a configurable test bench prototype, which can be used to demonstrate the feasibility of our idea. Furthermore, we report on results from preliminary experiments with humans, aiming to identify the most probable wrist pose during the pre-grasp phase in activities of daily living. Based on these outcomes, we calibrate our wrist prototype accordingly and demonstrate its effectiveness to accomplish grasping and manipulation tasks