Tactile Sensing over Articulated Joints with Stretchable Sensors

©2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.Presented at the World Haptics Conference (WHC), 2013, 14-17 April 2013.DOI: 10.1109/WHC.2013.6548392Biological organisms benefit from tactile sensing across the entire surfaces of their bodies. Robots may also be able to benefit from this type of sensing, but fully covering a robot with robust and capable tactile sensors entails numerous challenges. To date, most tactile sensors for robots have been used to cover rigid surfaces. In this paper, we focus on the challenge of tactile sensing across articulated joints, which requires sensing across a surface whose geometry varies over time. We first demonstrate the importance of sensing across joints by simulating a planar arm reaching in clutter and finding the frequency of contact at the joints. We then present a simple model of how much a tactile sensor would need to stretch in order to cover a 2 degree-of-freedom (DoF) wrist joint. Next, we describe and characterize a new tactile sensor made with stretchable fabrics. Finally, we present results for a stretchable sleeve with 25 tactile sensors that covers the forearm, 2 DoF wrist, and end effector of a humanoid robot. This sleeve enabled the robot to reach a target in instrumented clutter and reduce contact forces

Soft manipulators and grippers: A review

Soft robotics is a growing area of research which utilizes the compliance and adaptability of soft structures to develop highly adaptive robotics for soft interactions. One area in which soft robotics has the ability to make significant impact is in the development of soft grippers and manipulators. With an increased requirement for automation, robotics systems are required to perform task in unstructured and not well defined environments; conditions which conventional rigid robotics are not best suited. This requires a paradigm shift in the methods and materials used to develop robots such that they can adapt to and work safely in human environments. One solution to this is soft robotics, which enables soft interactions with the surroundings while maintaining the ability to apply significant force. This review paper assesses the current materials and methods, actuation methods and sensors which are used in the development of soft manipulators. The achievements and shortcomings of recent technology in these key areas are evaluated, and this paper concludes with a discussion on the potential impacts of soft manipulators on industry and society

Stretchable metallization technologies for skin-like transducers

The skin is not only the largest human organ, capable of accomplishing distributed and multimodal sensing functions. Replicating the versatility of skin artificially is a significant challenge, not only in terms of signal processing but also in mechanics. Stretchable electronics are an approach designed to cover human and artificial limbs and provide wearable sensing capabilities: motion sensors distributed on the hand of neurologically impaired patients could help therapists quantify their abilities; prostheses equipped with multiple tactile sensors could enable amputees to naturally adjust their grasp force. Skin-like electronic systems have specific requirements: they must mechanically adapt to the deformations imposed by the body they equip with minimal impediment to its natural movements, while also providing sufficient electrical performance for sensor transduction and passing electrical signals and power. A metallization ensuring stable conductivity under large strains is a prerequisite to designing and assembling wearable circuits that are integrated with several types of sensors. In this work, two innovative metallization processes have been developed to enable scalable integration of multiple sensing modalities in stretchable circuits. First, stretchable micro-cracked gold (Au) thin films were interfaced with gallium indium eutectic (EGaIn) liquid metal wires. The Au films, thermally evaporated on silicone elastomer substrates, combined high sheet resistance (9 to 30 Ohm/sq) and high sensitivity to strain up to 50%. The EGaIn wires drawn using a micro-plotting setup had a low gauge factor (2) and a low sheet resistance (5 mOhm/sq). Second, a novel physical vapor deposition method to deposit of thin gallium-based biphasic (solid-liquid) films over large areas was achieved. The obtained conductors combined a low sheet resistance (0.5 Ohm/sq), a low gauge factor (~1 up to 80% strain), and a failure strain of more than 400%. They could be patterned down to 10 µm critical dimensions. Skin-like sensors for the hand were assembled using the two processes and their capabilities were demonstrated. Thin (0.5 mm) silicone strips integrating EGaIN wires and micro-cracked Au strain gauges were mounted on gloves to encode the position of a biomimetic robotic finger and a human finger. In combination with soft pressure sensors, they enabled precise grasp analysis over a limited range of motion. Then, biphasic films were micro-patterned on silicone to assemble 50 µm thin epidermal strain gauges. The strain gauges were attached on a user's finger and accurately encoded fine grasping tasks covering most of the human hand range of motion. The biphasic films were also used to power wireless MEMS pressure sensors integrated in a rubber scaffold. The device was mounted on a prosthetic hand to encode normal forces in the 0 N to 20 N range with excellent linearity. The epidermal strain sensors are currently being used to quantify the tremors of patients with Parkinson's disease. In the future, the unique properties of the biphasic films could enable advanced artificial skins integrating a high density of soft transducers and traditional high-performance circuits

Glove-based systems for medical applications: review of recent advancements

Human hand motion analysis is attracting researchers in the areas of neuroscience, biomedical engineering, robotics, human-machines interfaces (HMI), human-computer interaction (HCI), and artificial intelligence (AI). Among the others, the fields of medical rehabilitation and physiological assessments are suggesting high impact applications for wearable sensing systems. Glove-based systems are one of the most significant devices in assessing quantities related to hand movements. This paper provides updated survey among the main glove solutions proposed in literature for hand rehabilitation. Then, the process for designing glove-based systems is defined, by including all relevant design issues for researchers and makers. The main goal of the paper is to describe the basics of glove-based systems and to outline their potentialities and limitations. At the same time, roadmap to design and prototype the next generation of these devices is defined, according to the results of previous experiences in the scientific community

Soft Robot-Assisted Minimally Invasive Surgery and Interventions: Advances and Outlook

Since the emergence of soft robotics around two decades ago, research interest in the field has escalated at a pace. It is fuelled by the industry's appreciation of the wide range of soft materials available that can be used to create highly dexterous robots with adaptability characteristics far beyond that which can be achieved with rigid component devices. The ability, inherent in soft robots, to compliantly adapt to the environment, has significantly sparked interest from the surgical robotics community. This article provides an in-depth overview of recent progress and outlines the remaining challenges in the development of soft robotics for minimally invasive surgery

Study and development of stretchable sensors for flexible surgical instrumentation.

Recently, attention has been focused to minimize the invasiveness of existing minimally invasive surgery (MIS) approaches: one example is the development of continuum-like and soft robots that can bend, extend, contract at any point along their length. This provides them with capabilities well beyond those of their rigid-link counterparts, thus allowing to perform whole arm manipulation. One recent approach to soft and modular systems is represented by the on-going EU project STIFF-FLOP (www.stiff-flop.eu). The STIFF-FLOP arm is not fabricated by rigid structures, but soft ones showing advanced manipulation capabilities for surgical applications, with multiple degrees of freedom (DOFs), and ability of multi-bending. Ideally, the entire robotic structure should safely move with contact and bend detection and the embedded sensors should not interfere with the movements: the use of small sensors, both soft and stretchable, which remain functional when deformed, becomes necessary. For the aforementioned reasons, we introduce a small, low-cost, soft and stretchable sensor composed of a silicone rubber (EcoFlex0030, SmoothOn), integrating a conductive liquid channel filled with biocompatible Sodium Chloride (NaCl) solution. By stretching the sensor the cross-section of the channel deforms, thus leading to a change in electrical resistance. The functionality of the sensor has been proved through testing: changes in electrical resistance are measured as a function of the applied strain. The advantage of using silicone rubber is its mechanical durability and high flexibility, non-toxicity, chemical stability and low cost. Furthermore, liquid conductors eliminate the need for rigid electronics and preserve the natural elasticity of the sensor, and the NaCl solution fulfills the need for a biocompatible liquid. Differently from existing solutions that are not truly stretchable and biocompatible, the contribution of this work is an effort for improving the current soft sensors technologies through the demonstration that NaCl filled channel rubbers represent a valid solution for measuring deformations in flexible surgical instrumentation

Concept for a large master/slave-controlled robotic hand

A strategy is presented for the design and construction of a large master/slave-controlled, five-finger robotic hand. Each of the five fingers will possess four independent axes each driven by a brushless DC servomotor and, thus, four degrees-of-freedom. It is proposed that commercially available components be utilized as much as possible to fabricate a working laboratory model of the device with an anticipated overall length of two-to-four feet (0.6 to 1.2 m). The fingers are to be designed so that proximity, tactile, or force/torque sensors can be imbedded in their structure. In order to provide for the simultaneous control of the twenty independent hand joints, a multilevel master/slave control strategy is proposed in which the operator wears a specially instrumented glove which produces control signals corresponding to the finger configurations and which is capable of conveying sensor feedback signals to the operator. Two dexterous hand master devices are currently commercially available for this application with both undergoing continuing development. A third approach to be investigated for the master control mode is the use of real-time image processing of a specially patterned master glove to provide the respective control signals for positioning the multiple finger joints

Comparing Piezoresistive Substrates for Tactile Sensing in Dexterous Hands

While tactile skins have been shown to be useful for detecting collisions between a robotic arm and its environment, they have not been extensively used for improving robotic grasping and in-hand manipulation. We propose a novel sensor design for use in covering existing multi-fingered robot hands. We analyze the performance of four different piezoresistive materials using both fabric and anti-static foam substrates in benchtop experiments. We find that although the piezoresistive foam was designed as packing material and not for use as a sensing substrate, it performs comparably with fabrics specifically designed for this purpose. While these results demonstrate the potential of piezoresistive foams for tactile sensing applications, they do not fully characterize the efficacy of these sensors for use in robot manipulation. As such, we use a high density foam substrate to develop a scalable tactile skin that can be attached to the palm of a robotic hand. We demonstrate several robotic manipulation tasks using this sensor to show its ability to reliably detect and localize contact, as well as analyze contact patterns during grasping and transport tasks.Comment: 10 figures, 8 pages, submitted to ICRA 202