A Model that Predicts the Material Recognition Performance of Thermal Tactile Sensing

Tactile sensing can enable a robot to infer properties of its surroundings, such as the material of an object. Heat transfer based sensing can be used for material recognition due to differences in the thermal properties of materials. While data-driven methods have shown promise for this recognition problem, many factors can influence performance, including sensor noise, the initial temperatures of the sensor and the object, the thermal effusivities of the materials, and the duration of contact. We present a physics-based mathematical model that predicts material recognition performance given these factors. Our model uses semi-infinite solids and a statistical method to calculate an F1 score for the binary material recognition. We evaluated our method using simulated contact with 69 materials and data collected by a real robot with 12 materials. Our model predicted the material recognition performance of support vector machine (SVM) with 96% accuracy for the simulated data, with 92% accuracy for real-world data with constant initial sensor temperatures, and with 91% accuracy for real-world data with varied initial sensor temperatures. Using our model, we also provide insight into the roles of various factors on recognition performance, such as the temperature difference between the sensor and the object. Overall, our results suggest that our model could be used to help design better thermal sensors for robots and enable robots to use them more effectively.Comment: This article is currently under review for possible publicatio

Influence of contact conditions on thermal responses of the hand

Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Mechanical Engineering, 2009.Includes bibliographical references (leaves 82-87).The objective of the research conducted for this thesis was to evaluate the influence of contact conditions on the thermal responses of the finger pad and their perceptual effects. A series of experiments investigated the thermal and perceptual effects of different contact conditions including contact force, contact duration, the object's surface temperature, and its surface roughness. The thermal response of the finger pad was measured using an infrared camera as the contact force varied from 0.1 to 6 N. It was determined that the decrease in skin temperature was highly dependent on the magnitude of contact force as well as contact duration. A second set of experiments investigated the effect of surface texture on the thermal response of the finger pad, and demonstrated, contrary to predictions, that a greater change in skin temperature occurs when the finger is in contact with rougher surfaces. The effect of varying surface texture on the perception of temperature was also investigated. The changes in temperature due to varying surface texture are perceptible, and demonstrate that the perception of surface roughness is not only influenced by changes in temperature, but in turn affects the perception of temperature. The final set of experiments examined the effect of varying the surface temperature of the thermal display on the perceived magnitude of finger force. Over the range of 20 to 38 'C, the surface temperature of the display did not have a significant effect on the perceived magnitude of force. The results of these experiments can be incorporated into thermal models that are used to create more realistic displays for virtual environments and teleoperated systems.by Jessica Anne Galie.S.M

Using pressure input and thermal feedback to broaden haptic interaction with mobile devices

Pressure input and thermal feedback are two under-researched aspects of touch in mobile human-computer interfaces. Pressure input could provide a wide, expressive range of continuous input for mobile devices. Thermal stimulation could provide an alternative means of conveying information non-visually. This thesis research investigated 1) how accurate pressure-based input on mobile devices could be when the user was walking and provided with only audio feedback and 2) what forms of thermal stimulation are both salient and comfortable and so could be used to design structured thermal feedback for conveying multi-dimensional information. The first experiment tested control of pressure on a mobile device when sitting and using audio feedback. Targeting accuracy was >= 85% when maintaining 4-6 levels of pressure across 3.5 Newtons, using only audio feedback and a Dwell selection technique. Two further experiments tested control of pressure-based input when walking and found accuracy was very high (>= 97%) even when walking and using only audio feedback, when using a rate-based input method. A fourth experiment tested how well each digit of one hand could apply pressure to a mobile phone individually and in combination with others. Each digit could apply pressure highly accurately, but not equally so, while some performed better in combination than alone. 2- or 3-digit combinations were more precise than 4- or 5-digit combinations. Experiment 5 compared one-handed, multi-digit pressure input using all 5 digits to traditional two-handed multitouch gestures for a combined zooming and rotating map task. Results showed comparable performance, with multitouch being ~1% more accurate but pressure input being ~0.5sec faster, overall. Two experiments, one when sitting indoors and one when walking indoors tested how salient and subjectively comfortable/intense various forms of thermal stimulation were. Faster or larger changes were more salient, faster to detect and less comfortable and cold changes were more salient and faster to detect than warm changes. The two final studies designed two-dimensional structured ‘thermal icons’ that could convey two pieces of information. When indoors, icons were correctly identified with 83% accuracy. When outdoors, accuracy dropped to 69% when sitting and 61% when walking. This thesis provides the first detailed study of how precisely pressure can be applied to mobile devices when walking and provided with audio feedback and the first systematic study of how to design thermal feedback for interaction with mobile devices in mobile environments

Impact de la cécité sur le système nociceptif

La vision joue un rôle très important dans la prévention du danger. La douleur a aussi pour fonction de prévenir les lésions corporelles. Nous avons donc testé l’hypothèse qu’une hypersensibilité à la douleur découlerait de la cécité en guise de compensation sensorielle. En effet, une littérature exhaustive indique qu’une plasticité intermodale s’opère chez les non-voyants, ce qui module à la hausse la sensibilité de leurs sens résiduels. De plus, plusieurs études montrent que la douleur peut être modulée par la vision et par une privation visuelle temporaire. Dans une première étude, nous avons mesuré les seuils de détection thermique et les seuils de douleur chez des aveugles de naissance et des voyants à l’aide d’une thermode qui permet de chauffer ou de refroidir la peau. Les participants ont aussi eu à quantifier la douleur perçue en réponse à des stimuli laser CO2 et à répondre à des questionnaires mesurant leur attitude face à des situations douloureuses de la vie quotidienne. Les résultats obtenus montrent que les aveugles congénitaux ont des seuils de douleur plus bas et des rapports de douleur plus élevés que leurs congénères voyants. De plus, les résultats psychométriques indiquent que les non-voyants sont plus attentifs à la douleur. Dans une deuxième étude, nous avons mesuré l’impact de l'expérience visuelle sur la perception de la douleur en répliquant la première étude dans un échantillon d’aveugles tardifs. Les résultats montrent que ces derniers sont en tous points similaires aux voyants quant à leur sensibilité à la douleur. Dans une troisième étude, nous avons testé les capacités de discrimination de température des aveugles congénitaux, car la détection de changements rapides de température est cruciale pour éviter les brûlures. Il s’est avéré que les aveugles de naissance ont une discrimination de température plus fine et qu’ils sont plus sensibles à la sommation spatiale de la chaleur. Dans une quatrième étude, nous avons examiné la contribution des fibres A∂ et C au traitement nociceptif des non-voyants, car ces récepteurs signalent la première et la deuxième douleur, respectivement. Nous avons observé que les aveugles congénitaux détectent plus facilement et répondent plus rapidement aux sensations générées par l’activation des fibres C. Dans une cinquième et dernière étude, nous avons sondé les changements potentiels qu’entrainerait la perte de vision dans la modulation descendante des intrants nociceptifs en mesurant les effets de l’appréhension d’un stimulus nocif sur la perception de la douleur. Les résultats montrent que, contrairement aux voyants, les aveugles congénitaux voient leur douleur exacerbée par l’incertitude face au danger, suggérant ainsi que la modulation centrale de la douleur est facilitée chez ces derniers. En gros, ces travaux indiquent que l’absence d’expérience visuelle, plutôt que la cécité, entraine une hausse de la sensibilité nociceptive, ce qui apporte une autre dimension au modèle d’intégration multi-sensorielle de la vision et de la douleur.Vision is important for avoiding encounters with objects in the environment that may imperil physical integrity. Since pain also plays a major role in preventing bodily injury, we tested whether, in the absence of vision, pain hypersensitivity would arise from an adaptive shift to other sensory channels. Indeed, a wealth of literature indicates that blindness leads to sensory compensation and crossmodal plasticity. Furthermore, studies have shown that pain perception can be modulated by vision and by temporary visual deprivation. In a first study, we measured innocuous and noxious thermal thresholds using a Peltier-based thermotester in congenitally blind and normal sighted participants. We also assessed their suprathreshold pain ratings using a CO2 laser device and evaluated their attitude towards daily pain encounters using questionnaires on attention and anxiety. Results show that congenitally participants have lower pain thresholds and higher suprathreshold pain ratings. The psychometric data further indicates that they are more attentive to pain compared to their sighted peers. In a second study, we investigated whether visual experience has an impact on pain perception by replicating the first study in late blind participants. Results indicate that individuals who lost sight later in life are similar to the sighted in every aspect of pain perception that we measured. In a third study, we tested whether blind individuals have supranormal skills in detecting small and quick increases in temperature, as these thermal cues of the environment might help identifying and avoiding potentially harmful objects. Results show that congenitally blind participants outperform their sighted peers and that they are more susceptible to spatial summation of heat. In a fourth study, we examined the contribution of A∂ and C-fibres to blind individuals’ nociceptive processing, as these fibres are thought to signal the first and second pain, respectively. Our findings indicate that congenital blindness leads to an enhanced detection to C-fibre mediated sensations and to faster reaction times to these nociceptive inputs. In a fifth and final study, we probed the potential changes in the descending modulation of nociceptive inputs following visual deprivation by measuring the effects of psychological factors like anticipation and anxiety on blind individuals’ pain perception. Results show that congenitally blind participants are more sensitive to pain in response to uncertainty about threat, suggesting that they are more susceptible to top-down modulation of pain. Overall, this work indicates that visual deprivation from birth, but not later in life, causes a leftward shift in the stimulus–response function to nociceptive stimuli and lends new support to a model of sensory integration of vision and pain processing

Augmenting communication technologies with non-primary sensory modalities

Humans combine their senses to enhance the world around them. While computers have evolved to reflect these sensory demands, only the primary senses of vision and audition (and to an extent, touch) are used in modern communication. This thesis investigated how additional information, such as emotion and navigational assistance, might be communicated using technology-based implementations of sensory displays that output the non-primary modalities of smell, vibrotactile touch, and thermo-touch. This thesis explored using a portable atomiser sprayer to deliver emotional information via smell to mobile phone users, a ring-shaped device worn on the finger to display emotional information using vibration and colours, and an array of thermoelectric coolers worn on the arm to create temperature sensations. Additionally, this thesis explored two methods of signalling temperature using the thermal implementation, and finally, used it in a controlled study to augment the perceived emotion of text messages using temperature. There were challenges with using some of these implementations to display information. Smells produced with the scent technology were ambiguous and highly cognitive, and poor delivery to the user produced undesirable cross-adaption effects when smells lingered and mixed in the environment. The device used to communicate vibrotactile and colour lighting cues neutralized emotions in text messages. Furthermore, temperature pattern discrimination using the thermal implementation was difficult due to non-linear interaction effects that occurred on the skin’s surface, as well as latency resulting from the thermal neurological pathway and the technology used to heat and cool the skin. However, the thermal implementation enabled more accurate user discrimination between thermal signals than what a single stimulator design provided. Furthermore, the utility of continuous thermal feedback, in the context of spatial navigation, was demonstrated, which improved user performance compared to when the user was not presented with any thermal information. Finally, temperature was demonstrated to elicit arousal reactions across subjects using the thermal implementation, and could augment the arousal of text messages, especially when the content of the message was strongly neutral. However, no similar statistical significance was observed with valence, demonstrating the complex implications of using thermal cues to convey emotional information