A Model that Predicts the Material Recognition Performance of Thermal Tactile Sensing

Tactile sensing can enable a robot to infer properties of its surroundings, such as the material of an object. Heat transfer based sensing can be used for material recognition due to differences in the thermal properties of materials. While data-driven methods have shown promise for this recognition problem, many factors can influence performance, including sensor noise, the initial temperatures of the sensor and the object, the thermal effusivities of the materials, and the duration of contact. We present a physics-based mathematical model that predicts material recognition performance given these factors. Our model uses semi-infinite solids and a statistical method to calculate an F1 score for the binary material recognition. We evaluated our method using simulated contact with 69 materials and data collected by a real robot with 12 materials. Our model predicted the material recognition performance of support vector machine (SVM) with 96% accuracy for the simulated data, with 92% accuracy for real-world data with constant initial sensor temperatures, and with 91% accuracy for real-world data with varied initial sensor temperatures. Using our model, we also provide insight into the roles of various factors on recognition performance, such as the temperature difference between the sensor and the object. Overall, our results suggest that our model could be used to help design better thermal sensors for robots and enable robots to use them more effectively.Comment: This article is currently under review for possible publicatio

A flexible sensor technology for the distributed measurement of interaction pressure

We present a sensor technology for the measure of the physical human-robot interaction pressure developed in the last years at Scuola Superiore Sant'Anna. The system is composed of flexible matrices of opto-electronic sensors covered by a soft silicone cover. This sensory system is completely modular and scalable, allowing one to cover areas of any sizes and shapes, and to measure different pressure ranges. In this work we present the main application areas for this technology. A first generation of the system was used to monitor human-robot interaction in upper- (NEUROExos; Scuola Superiore Sant'Anna) and lower-limb (LOPES; University of Twente) exoskeletons for rehabilitation. A second generation, with increased resolution and wireless connection, was used to develop a pressure-sensitive foot insole and an improved human-robot interaction measurement systems. The experimental characterization of the latter system along with its validation on three healthy subjects is presented here for the first time. A perspective on future uses and development of the technology is finally drafted

An acoustic multi-touch sensing method using amplitude disturbed ultrasonic wave diffraction patterns

This paper proposes an acoustic multi-touch tactile sensing method. The proposed method is based on an amplitude disturbed ultrasonic wave diffraction pattern. An A0 Lamb wave transmitted in a thin finite copper plate is processed to provide tactile information, for one or two fingers. A touch event is localized by identifying the diffraction signals among a database of diffracted Lamb wave references. Statistic models are used to improve the localization reliability. An artificial silicone finger is used in the calibration procedure. This touch interface is evaluated as a 2-touch interface

Whisking with robots from rat vibrissae to biomimetic technology for active touch

This article summarizes some of the key features of the rat vibrissal system, including the actively controlled sweeping movements of the vibrissae known as whisking, and reviews the past and ongoing research aimed at replicating some of this functionality in biomimetic robots

Subject-specific finite element modelling of the human hand complex : muscle-driven simulations and experimental validation

This paper aims to develop and validate a subject-specific framework for modelling the human hand. This was achieved by combining medical image-based finite element modelling, individualized muscle force and kinematic measurements. Firstly, a subject-specific human hand finite element (FE) model was developed. The geometries of the phalanges, carpal bones, wrist bones, ligaments, tendons, subcutaneous tissue and skin were all included. The material properties were derived from in-vivo and in-vitro experiment results available in the literature. The boundary and loading conditions were defined based on the kinematic data and muscle forces of a specific subject captured from the in-vivo grasping tests. The predicted contact pressure and contact area were in good agreement with the in-vivo test results of the same subject, with the relative errors for the contact pressures all being below 20%. Finally, sensitivity analysis was performed to investigate the effects of important modelling parameters on the predictions. The results showed that contact pressure and area were sensitive to the material properties and muscle forces. This FE human hand model can be used to make a detailed and quantitative evaluation into biomechanical and neurophysiological aspects of human hand contact during daily perception and manipulation. The findings can be applied to the design of the bionic hands or neuro-prosthetics in the future