Methods and Sensors for Slip Detection in Robotics: A Survey

The perception of slip is one of the distinctive abilities of human tactile sensing. The sense of touch allows recognizing a wide set of properties of a grasped object, such as shape, weight and dimension. Based on such properties, the applied force can be accordingly regulated avoiding slip of the grasped object. Despite the great importance of tactile sensing for humans, mechatronic hands (robotic manipulators, prosthetic hands etc.) are rarely endowed with tactile feedback. The necessity to grasp objects relying on robust slip prevention algorithms is not yet corresponded in existing artificial manipulators, which are relegated to structured environments then. Numerous approaches regarding the problem of slip detection and correction have been developed especially in the last decade, resorting to a number of sensor typologies. However, no impact on the industrial market has been achieved. This paper reviews the sensors and methods so far proposed for slip prevention in artificial tactile perception, starting from more classical techniques until the latest solutions tested on robotic systems. The strengths and weaknesses of each described technique are discussed, also in relation to the sensing technologies employed. The result is a summary exploring the whole state of art and providing a perspective towards the future research directions in the sector

Tactile Sensors for Friction Estimation and Incipient Slip Detection - Toward Dexterous Robotic Manipulation:A Review

Humans can handle and manipulate objects with ease; however, human dexterity has yet to be matched by artificial systems. Receptors in our fingers and hands provide essential tactile information to the motor control system during dexterous manipulation such that the grip force is scaled to the tangential forces according to the coefficient of friction. Likewise, tactile sensing will become essential for robotic and prosthetic gripping performance as applications move toward unstructured environments. However, most existing research ignores the need to sense the frictional properties of the sensor-object interface, which (along with contact forces and torques) is essential for finding the minimum grip force required to securely grasp an object. Here, we review this problem by surveying the field of tactile sensing from the perspective that sensors should: 1) detect gross slip (to adjust the grip force); 2) detect incipient slip (dependent on the frictional properties of the sensor-object interface and the geometries and mechanics of the sensor and the object) as an indication of grip security; or 3) measure friction on contact with an object and/or following a gross or incipient slip event while manipulating an object. Recommendations are made to help focus future sensor design efforts toward a generalizable and practical solution to sense, and hence control grip security. Specifically, we propose that the sensor mechanics should encourage incipient slip, by allowing parts of the sensor to slip while other parts remain stuck, and that instrumentation should measure displacement and deformation to complement conventional force, pressure, and vibration tactile sensing

Piezoelectric Transducers Based on Aluminum Nitride and Polyimide for Tactile Applications

The development of micro systems with smart sensing capabilities is paving the way to progresses in the technology for humanoid robotics. The importance of sensory feedback has been recognized the enabler of a high degree of autonomy for robotic systems. In tactile applications, it can be exploited not only to avoid objects slipping during their manipulation but also to allow safe interaction with humans and unknown objects and environments. In order to ensure the minimal deformation of an object during subtle manipulation tasks, information not only on contact forces between the object and fingers but also on contact geometry and contact friction characteristics has to be provided. Touch, unlike other senses, is a critical component that plays a fundamental role in dexterous manipulation capabilities and in the evaluation of objects properties such as type of material, shape, texture, stiffness, which is not easily possible by vision alone. Understanding of unstructured environments is made possible by touch through the determination of stress distribution in the surrounding area of physical contact. To this aim, tactile sensing and pressure detection systems should be integrated as an artificial tactile system. As illustrated in the Chapter I, the role of external stimuli detection in humans is provided by a great number of sensorial receptors: they are specialized endings whose structure and location in the skin determine their specific signal transmission characteristics. Especially, mechanoreceptors are specialized in the conversion of the mechanical deformations caused by force, vibration or slip on skin into electrical nerve impulses which are processed and encoded by the central nervous system. Highly miniaturized systems based on MEMS technology seem to imitate properly the large number of fast responsive mechanoreceptors present in human skin. Moreover, an artificial electronic skin should be lightweight, flexible, soft and wearable and it should be fabricated with compliant materials. In this respect a big challenge of bio-inspired technologies is the efficient application of flexible active materials to convert the mechanical pressure or stress into a usable electric signal (voltage or current). In the emerging field of soft active materials, able of large deformation, piezoelectrics have been recognized as a really promising and attractive material in both sensing and actuation applications. As outlined in Chapter II, there is a wide choice of materials and material forms (ceramics: PZT; polycrystalline films: ZnO, AlN; polymers and copolymers: PVDF, PVDF-TrFe) which are actively piezoelectric and exhibit features more or less attractive. Among them, aluminum nitride is a promising piezoelectric material for flexible technology. It has moderate piezoelectric coefficient, when available in c-axis oriented polycrystalline columnar structure, but, at same time, it exhibits low dielectric constant, high temperature stability, large band gap, large electrical resistivity, high breakdown voltage and low dielectric loss which make it suitable for transducers and high thermal conductivity which implies low thermal drifts. The high chemical stability allows AlN to be used in humid environments. Moreover, all the above properties and its deposition method make AlN compatible with CMOS technology. Exploiting the features of the AlN, three-dimensional AlN dome-shaped cells, embedded between two metal electrodes, are proposed in this thesis. They are fabricated on general purpose Kapton™ substrate, exploiting the flexibility of the polymer and the electrical stability of the semiconductor at the same time. As matter of fact, the crystalline layers release a compressive stress over the polymer, generating three-dimensional structures with reduced stiffness, compared to the semiconductor materials. In Chapter III, a mathematical model to calculate the residual stresses which arise because of mismatch in coefficient of thermal expansion between layers and because of mismatch in lattice constants between the substrate and the epitaxially grown films is adopted. The theoretical equation is then used to evaluate the dependence of geometrical features of the fabricated three-dimensional structures on compressive residual stress. Moreover, FEM simulations and theoretical models analysis are developed in order to qualitative explore the operation principle of curved membranes, which are labelled dome-shaped diaphragm transducers (DSDT), both as sensors and as piezo-actuators and for the related design optimization. For the reliability of the proposed device as a force/pressure sensor and piezo-actuator, an exhaustive electromechanical characterization of the devices is carried out. A complete description of the microfabrication processes is also provided. As shown in Chapter IV, standard microfabrication techniques are employed to fabricate the array of DSDTs. The overall microfabrication process involves deposition of metal and piezoelectric films, photolithography and plasma-based dry and wet etching to pattern thin films with the desired features. The DSDT devices are designed and developed according to FEM and theoretical analysis and following the typical requirements of force/pressure systems for tactile applications. Experimental analyses are also accomplished to extract the relationship between the compressive residual stress due to the aluminum nitride and the geometries of the devices. They reveal different deformations, proving the dependence of the geometrical features of the three-dimensional structures on residual stress. Moreover, electrical characterization is performed to determine capacitance and impedance of the DSDTs and to experimentally calculate the relative dielectric constant of sputtered AlN piezoelectric film. In order to investigate the mechanical behaviour of the curved circular transducers, a characterization of the flexural deflection modes of the DSDT membranes is carried out. The natural frequency of vibrations and the corresponding displacements are measured by a Laser Doppler Vibrometer when a suitable oscillating voltage, with known amplitude, is applied to drive the piezo-DSDTs. Finally, being developed for tactile sensing purpose, the proposed technology is tested in order to explore the electromechanical response of the device when impulsive dynamic and/or long static forces are applied. The study on the impulsive dynamic and long static stimuli detection is then performed by using an ad hoc setup measuring both the applied loading forces and the corresponding generated voltage and capacitance variation. These measurements allow a thorough test of the sensing abilities of the AlN-based DSDT cells. Finally, as stated in Chapter V, the proposed technology exhibits an improved electromechanical coupling with higher mechanical deformation per unit energy compared with the conventional plate structures, when the devices are used as piezo-actuator. On the other hand, it is well suited to realize large area tactile sensors for robotics applications, opening up new perspectives to the development of latest generation biomimetic sensors and allowing the design and the fabrication of miniaturized devices

Development of Sensing Systems for Improving Surgical Grasper Performance

Minimally invasive techniques play a vital and increasing role in modern surgery. In these procedures, surgical graspers are essential in replacing the surgeon’s fingertips as the main manipulator of delicate soft tissues. Current graspers lack haptic feedback, restricting the surgeon to visual feedback. Studies show that this can frequently lead to morbidity or task errors due to inappropriate application of force. Existing research has sought to address these concerns and improve the safety and performance of grasping through the provision of haptic feedback to the surgeon. However, an effective method of grasping task optimisation has not been found. This thesis explores new sensing approaches intended to reduce errors when manipulating soft tissues, and presents a novel tactile sensor designed for deployment in the grasper jaw. The requirements were first established through discussion with clinical partners and a literature review. This resulted in a conceptual approach to use multi-axis tactile sensing within the grasper jaw as a potential novel solution. As a foundation to the research, a study was conducted using instrumented graspers to investigate the characteristics of grasp force employed by surgeons of varying skill levels. The prevention of tissue slip was identified as a key method in the prevention of grasper misuse, preventing both abrasion through slip and crush damage. To detect this phenomena, a novel method was proposed based on an inductive pressure sensing system. To investigate the efficacy of this technique, experimental and computational modelling investigations were conducted. Computational models were used to better understand the transducer mechanisms, to optimise sensor geometry and to evaluate performance in slip detection. Prototype sensors were then fabricated and experimentally evaluated for their ultimate use in slip detection within a surgical grasper. The work concludes by considering future challenges to clinical translation and additional opportunities for this research in different domains

The "Federica" hand: a simple, very efficient prothesis

Hand prostheses partially restore hand appearance and functionalities. Not everyone can afford expensive prostheses and many low-cost prostheses have been proposed. In particular, 3D printers have provided great opportunities by simplifying the manufacturing process and reducing costs. Generally, active prostheses use multiple motors for fingers movement and are controlled by electromyographic (EMG) signals. The "Federica" hand is a single motor prosthesis, equipped with an adaptive grasp and controlled by a force-myographic signal. The "Federica" hand is 3D printed and has an anthropomorphic morphology with five fingers, each consisting of three phalanges. The movement generated by a single servomotor is transmitted to the fingers by inextensible tendons that form a closed chain; practically, no springs are used for passive hand opening. A differential mechanical system simultaneously distributes the motor force in predefined portions on each finger, regardless of their actual positions. Proportional control of hand closure is achieved by measuring the contraction of residual limb muscles by means of a force sensor, replacing the EMG. The electrical current of the servomotor is monitored to provide the user with a sensory feedback of the grip force, through a small vibration motor. A simple Arduino board was adopted as processing unit. The differential mechanism guarantees an efficient transfer of mechanical energy from the motor to the fingers and a secure grasp of any object, regardless of its shape and deformability. The force sensor, being extremely thin, can be easily embedded into the prosthesis socket and positioned on both muscles and tendons; it offers some advantages over the EMG as it does not require any electrical contact or signal processing to extract information about the muscle contraction intensity. The grip speed is high enough to allow the user to grab objects on the fly: from the muscle trigger until to the complete hand closure, "Federica" takes about half a second. The cost of the device is about 100 US$. Preliminary tests carried out on a patient with transcarpal amputation, showed high performances in controlling the prosthesis, after a very rapid training session. The "Federica" hand turned out to be a lightweight, low-cost and extremely efficient prosthesis. The project is intended to be open-source: all the information needed to produce the prosthesis (e.g. CAD files, circuit schematics, software) can be downloaded from a public repository. Thus, allowing everyone to use the "Federica" hand and customize or improve it

Force-Torque Sensing in Robotics

Being able to perform dynamic motions repeatably and reliably is an active research topic. The present thesis aims to contribute to this by improving the accuracy of force-torque sensing in robots. It focuses primarily on six axis force-torque sensors, although other sources of force-torque sensing are explored. Force sensing technologies, calibration procedures of these sensors and the use of force-torque sensing in robotics are described with the aim to familiarize the reader with the problem to solve. The problem is tackled in two ways: improving the accuracy of six axis force-torque sensors and exploring the use of tactile sensor arrays as force-torque sensors. The contributions of this thesis are : the development of the Model Based In situ calibration method for improving measurements of sensors already mounted on robots and the improvement in performance of the robot as a consequence; the design of a calibration device to improve the reliability and speed of calibration; and the improvement of force sensing information of a capacitive tactile array and its use on a robot as force-torque information source. The developed algorithms were tested on the humanoid robotic platform iCub