Exoskeleton-covered soft finger with vision-based proprioception and tactile sensing

Soft robots offer significant advantages in adaptability, safety, and dexterity compared to conventional rigid-body robots. However, it is challenging to equip soft robots with accurate proprioception and tactile sensing due to their high flexibility and elasticity. In this work, we describe the development of a vision-based proprioceptive and tactile sensor for soft robots called GelFlex, which is inspired by previous GelSight sensing techniques. More specifically, we develop a novel exoskeleton-covered soft finger with embedded cameras and deep learning methods that enable high-resolution proprioceptive sensing and rich tactile sensing. To do so, we design features along the axial direction of the finger, which enable high-resolution proprioceptive sensing, and incorporate a reflective ink coating on the surface of the finger to enable rich tactile sensing. We design a highly underactuated exoskeleton with a tendon-driven mechanism to actuate the finger. Finally, we assemble 2 of the fingers together to form a robotic gripper and successfully perform a bar stock classification task, which requires both shape and tactile information. We train neural networks for proprioception and shape (box versus cylinder) classification using data from the embedded sensors. The proprioception CNN had over 99\% accuracy on our testing set (all six joint angles were within 1 degree of error) and had an average accumulative distance error of 0.77 mm during live testing, which is better than human finger proprioception. These proposed techniques offer soft robots the high-level ability to simultaneously perceive their proprioceptive state and peripheral environment, providing potential solutions for soft robots to solve everyday manipulation tasks. We believe the methods developed in this work can be widely applied to different designs and applications.Comment: Accepted to ICRA202

Fingertip force control with embedded fiber Bragg grating sensors

Abstract—We describe the dynamic testing and control results obtained with an exoskeletal robot finger with embedded fiber optical sensors. The finger is inspired by the designs of arthropod limbs, with integral strain sensilla concentrated near the joints. The use of fiber Bragg gratings (FBGs) allows for embedded sensors with high strain sensitivity and immunity to electromagnetic interference. The embedded sensors are useful for contact detection and for control of forces during fine manipulation. The application to force control requires precise and high-bandwidth measurement of contact forces. We present a nonlinear force control approach that combines signals from an optical interrogator and conventional joint angle sensors to achieve accurate tracking of desired contact forces. I

FBG-based sensing system to improve tactile sensitivity of robotic manipulators working in unstructured environments

The emergence of Industry 4.0 has brought new concepts to the factories that optimize and improve conventional processes. These technologies have brought assignments to the industrial robots that allow them to perform tasks faster and more precisely. The improvement of the robot’s proprioception capacity and tactile sensitivity using sensors is a useful approach to achieve those goals. Optical fibers are a viable technology to be used as sensors in robotic devices because they are electrically passive and present electromagnetic immunity. This paper proposes a Fiber Bragg Grating (FBG) based sensing system to monitor robotic manipulators during their operation. It corresponds to smart textiles installed on the robot’s body to detect interactions with the environment. A mathematical model is proposed to find what should be the greatest distance between adjacent FBGs to detect contact at any point between them. From this, it is possible to obtain a minimum number of sensors to detect contact at any point and guarantee the highest spatial resolution of the system with lower costs. The tactile system is formed of a group of optical fibers with multiplexed FBGs embedded in silicone rubber. The optical fibers with the sensors are positioned between layers of polyethylene foam and cotton fabric. After the manufacturing process, temperature and force characterization were done on the sensors which make up the smart textiles. In the characterization results, almost all the FBG presented values of R² on the linear regression superior to 0.94. Individual analysis is performed for the sensors which present a low coefficient of determination. Finally, the system was tested in an experimental validation in which the robot was hit while executing a task. From the results, it can be observed that the system can provide the position on the robot’s body, the amplitude in terms of force and the instant of time in which an external impact occurred.publishe

Soft manipulators and grippers: A review

Soft robotics is a growing area of research which utilizes the compliance and adaptability of soft structures to develop highly adaptive robotics for soft interactions. One area in which soft robotics has the ability to make significant impact is in the development of soft grippers and manipulators. With an increased requirement for automation, robotics systems are required to perform task in unstructured and not well defined environments; conditions which conventional rigid robotics are not best suited. This requires a paradigm shift in the methods and materials used to develop robots such that they can adapt to and work safely in human environments. One solution to this is soft robotics, which enables soft interactions with the surroundings while maintaining the ability to apply significant force. This review paper assesses the current materials and methods, actuation methods and sensors which are used in the development of soft manipulators. The achievements and shortcomings of recent technology in these key areas are evaluated, and this paper concludes with a discussion on the potential impacts of soft manipulators on industry and society

Force sensing robot fingers using embedded fiber Bragg grating sensors and shape deposition manufacturing

Abstract — Force sensing is an essential requirement for dexterous robot manipulation. Although strain gages have been widely used, a new sensing approach is desirable for applications that require greater robustness, design flexibility and immunity to electromagnetic noise. An exoskeletal force sensing robot finger was developed by embedding Fiber Bragg Grating (FBG) sensors into a polymer-based structure. Multiple FBG sensors were embedded into the structure to allow the manipulator to sense and measure both contact forces and grasping forces. In order to fabricate a three-dimensional structure, a new shape deposition manufacturing (SDM) process was explored. The sensorized SDM-fabricated finger was then characterized using an FBG interrogator. A force localization scheme is also described. I

Development of highly sensitive multimodal tactile sensor

The sense of touch is crucial for interpreting exteroceptive stimuli, and for moderating physical interactions with one’s environment during object grasping and manipulation tasks. For years, tactile researchers have sought a method that will allow robots to achieve the same tactile sensing capabilities as humans, but the solution has remained elusive. This is a problem for people in the medical and robotics communities, as prosthetic and robotic limbs provide little or no force feedback during contact with objects. During object manipulation tasks, the inability to control the force (applied by the prosthetic or robotic hand to the object) frequently results in damage to the object. Moreover, amputees must compensate for the lack of tactility by paying continuous visual attention to the task at hand, making even the simplest task a frustrating and time-consuming endeavor. We believe that these challenges of object manipulation might best be addressed by a closed feedback loop with a tactile sensory system that is capable of detecting multiple stimuli. To this end, the goal of our research is the development of a tactile sensor that mimics the human sensory apparatus as closely as possible. Thus far, tactile sensors have been unable to match the human sensory apparatus in terms of simultaneous multimodality, high resolution, and broad sensitivity. In particular, previous sensors have typically been able to sense either a wide range of forces, or very low forces, but never both at the same time; and they are designed for either static or dynamic sensing, rather than multimodality. These restrictions have left them unsuited to the needs of robotic applications. Capacitance-based sensors represent the most promising approach, but they too must overcome many limitations. Although recent innovations in the touch screen industry have resolved the issue of processing complexity, through the replacement of clunky processing circuits with new integrated circuits (ICs), most capacitive sensors still remain limited by hysteresis and narrow ranges of sensitivity, due to the properties of their dielectrics. In this thesis, we present the design of a new capacitive tactile sensor that is capable of making highly accurate measurements at low force levels, while also being sensitive to a wide range of forces. Our sensor is not limited to the detection of either low forces or broad sensitivity, because the improved soft dielectric that we have constructed allows it to do both at the same time. To construct the base of the dielectric, we used a geometrically modified silicone material. To create this material, we used a soft-lithography process to construct microfeatures that enhance the silicone’s compressibility under pressure. Moreover, the silicone was doped with high-permittivity ceramic nanoparticles, thereby enhancing the capacitive response of the sensor. Our dielectric features a two-stage microstructure, which makes it very sensitive to low forces, while still able to measure a wide range of forces. Despite these steps, and the complexity of the dielectric’s structure, we were still able to fabricate the dielectric using a relatively simple process. In addition, our sensor is not limited to either static or dynamic sensing; unlike previous sensors, it is capable of doing both simultaneously. This multimodality allows our sensor to detect fluctuating forces, even at very low force levels. Whereas past researchers have used separate technologies for static and dynamic sensing, our dynamic sensing unit is formed with same capacitive technology as the static one. This was possible because of the high sensitivity of our dielectric. We used the entire surface area effectively, by integrating the single dynamic sensing taxel on the same layer as the static sensing taxels. Essentially, the dynamic taxel takes the shape of the lines of a grid, filling in the spaces between the individual static taxels. For further optimization, the geometry of the dynamic taxel has been redesigned by fringing miniature traces of the dynamic taxel within the static taxels. In this way, the entire surface of the sensor is sensitive to both dynamic and static events. While this design slightly reduces the area that is covered by the static taxels, the trade-off is justified, as the capacitive behavior is boosted by the edge effect of the capacitor. The fusion of an innovative dielectric with a capacitive sensing IC has produced a highly sensitive tactile sensor that meets our goals regarding resolution, noise immunity, and overall performance. It is sensitive to forces ranging from 1 mN to 15 N. We verified the functionality of our sensor by mounting it on several of the most popular mechanical hands. Our grasp assessment experiments delivered promising results, and showed how our sensor might be further refined so that it can be used to accurately estimate the outcome of an attempted grasp. In future, we believe that combining an advanced robotic hand with the sensor we have developed will allow us to meet the demand for human-like tactile sensing abilities

Object grasping and safe manipulation using friction-based sensing.

This project provides a solution for slippage prevention in industrial robotic grippers for the purpose of safe object manipulation. Slippage sensing is performed using novel friction-based sensors, with customisable slippage sensitivity and complemented by an effective slippage prediction strategy. The outcome is a reliable and affordable slippage prevention technology

Sensitive Skin for Robotics

This thesis explores two novel ways of reducing the data complexity of tactile sensing. The thesis begins by examining the state-of-the art in tactile sensing, not only examining the sensor construction and interpretation of data but also the motivation for these designs. The thesis then proposes two methods for reducing the complexity of data in tactile sensing. The first is a low-power tactile sensing array exploiting a novel application of a pressure-sensitive material called quantum tunnelling composite. The properties of this material in this array form are shown to be beneficial in robotics. The electrical characteristics of the material are also explored. A bit-based structure for representing tactile data called Bitworld is then defined and its computational performance is characterised. It is shown that this bit-based structure outperforms floating-point arrays by orders of magnitude. This structure is then shown to allow high-resolution images to be produced by combining low resolution sensor arrays with equivalent functional performance to a floating-point array, but with the advantages of computational efficiency. Finally, an investigation into making Bitworld robust in the presence of positional noise is described with simulations to verify that such robustness can be achieved. Overall, the sensor and data structure described in this thesis allow simple, but effective tactile systems to be deployed in robotics without requiring a significant commitment of computational or power resources on the part of a robot designer.EThOS - Electronic Theses Online ServiceGBUnited Kingdo