Tactile Sensing and Control of Robotic Manipulator Integrating Fiber Bragg Grating Strain-Sensor

Tactile sensing is an instrumental modality of robotic manipulation, as it provides information that is not accessible via remote sensors such as cameras or lidars. Touch is particularly crucial in unstructured environments, where the robot's internal representation of manipulated objects is uncertain. In this study we present the sensorization of an existing artificial hand, with the aim to achieve fine control of robotic limbs and perception of object's physical properties. Tactile feedback is conveyed by means of a soft sensor integrated at the fingertip of a robotic hand. The sensor consists of an optical fiber, housing Fiber Bragg Gratings (FBGs) transducers, embedded into a soft polymeric material integrated on a rigid hand. Through several tasks involving grasps of different objects in various conditions, the ability of the system to acquire information is assessed. Results show that a classifier based on the sensor outputs of the robotic hand is capable of accurately detecting both size and rigidity of the operated objects (99.36 and 100% accuracy, respectively). Furthermore, the outputs provide evidence of the ability to grab fragile objects without breakage or slippage e and to perform dynamic manipulative tasks, that involve the adaptation of fingers position based on the grasped objects' condition

Tactile Sensing and Control of Robotic Manipulator Integrating Fiber Bragg Grating Strain-Sensor

Tactile sensing is an instrumental modality of robotic manipulation, as it provides information that is not accessible via remote sensors such as cameras or lidars. Touch is particularly crucial in unstructured environments, where the robot's internal representation of manipulated objects is uncertain. In this study we present the sensorization of an existing artificial hand, with the aim to achieve fine control of robotic limbs and perception of object's physical properties. Tactile feedback is conveyed by means of a soft sensor integrated at the fingertip of a robotic hand. The sensor consists of an optical fiber, housing Fiber Bragg Gratings (FBGs) transducers, embedded into a soft polymeric material integrated on a rigid hand. Through several tasks involving grasps of different objects in various conditions, the ability of the system to acquire information is assessed. Results show that a classifier based on the sensor outputs of the robotic hand is capable of accurately detecting both size and rigidity of the operated objects (99.36 and 100% accuracy, respectively). Furthermore, the outputs provide evidence of the ability to grab fragile objects without breakage or slippage e and to perform dynamic manipulative tasks, that involve the adaptation of fingers position based on the grasped objects' condition

Tactile Sensors for Friction Estimation and Incipient Slip Detection - Toward Dexterous Robotic Manipulation:A Review

Humans can handle and manipulate objects with ease; however, human dexterity has yet to be matched by artificial systems. Receptors in our fingers and hands provide essential tactile information to the motor control system during dexterous manipulation such that the grip force is scaled to the tangential forces according to the coefficient of friction. Likewise, tactile sensing will become essential for robotic and prosthetic gripping performance as applications move toward unstructured environments. However, most existing research ignores the need to sense the frictional properties of the sensor-object interface, which (along with contact forces and torques) is essential for finding the minimum grip force required to securely grasp an object. Here, we review this problem by surveying the field of tactile sensing from the perspective that sensors should: 1) detect gross slip (to adjust the grip force); 2) detect incipient slip (dependent on the frictional properties of the sensor-object interface and the geometries and mechanics of the sensor and the object) as an indication of grip security; or 3) measure friction on contact with an object and/or following a gross or incipient slip event while manipulating an object. Recommendations are made to help focus future sensor design efforts toward a generalizable and practical solution to sense, and hence control grip security. Specifically, we propose that the sensor mechanics should encourage incipient slip, by allowing parts of the sensor to slip while other parts remain stuck, and that instrumentation should measure displacement and deformation to complement conventional force, pressure, and vibration tactile sensing

Reflex: A Closed-Loop Tactile Feedback System for Use in Upper Limb Prosthesis Grip Control

Tactile sensing provides valuable insight to the environment in which we interact with. Upper limb amputees lack the sensations that generates the necessary information to stably grasp the wide variety of objects we interact with on a daily basis. Utilizing tactile sensing to provide feedback to a prosthetic hand provides a mechanism for replacing the grip control functionality of the mechanoreceptors found in human skin. Novel customizable, low cost tactile sensors for monitoring the dynamics of an object grasped by a prosthetic hand are developed and presented as part of this thesis. The response of sensors placed on a prosthetic hand provides information regarding the state of a grasped object, particularly contact and slip. The sensors are made up of various textile materials, including stretchable interfacing layers and conductive traces. Essentially a force sensitive resistor, each sensor is shaped into stretchable cu ff that can be placed around the finger of a prosthetic hand. An outer rubber layer on the sensor provides compliance, which is found to enhance grasping performance with a prosthesis. Two control algorithms were developed as part of the closed-loop tactile feedback system, called Reflex, to enhance grasping functionality with a prosthesis. A Contact Detection strategy uses force information to effectively reduce the user's electromyography (EMG) signals, which are used to control the prosthesis. Essentially, the goal of this strategy is to help a user grab fragile objects without breaking them. A second strategy, Slip Prevention, uses the derivative of a force signal to detect slip of a grasped object. Instances of slip trigger electrical pulses sent from the prosthesis control unit to close the hand in an effort to prevent additional slip. The Reflex system, comprised of two control strategies along with flexible textile based force sensors on the fingers of a prosthesis, was shown to improve the grasping functionality of a prosthesis under normal use conditions. Able body participants were used to test the system. Results show the sensors' ability to greatly enhance grasping fragile objects while also helping prevent object slip. The compliant nature of the sensors enables users to more confidently pick up and move small,fragile objects, such as foam peanuts and crackers. Without sensors and tactile feedback, users had a higher likelihood of breaking objects while grabbing them. The addition of sensors reduced this failure rate, and the failure rate was reduced even further with the implementation of control algorithms running in real-time. The slip prevention strategy was also shown to help reduce the amount of object movement after a grasp is initiated, although the most benefit comes from the compliant nature of the sensors. Reflex is the first closed-loop tactile feedback system with multiple control strategies that can be used on a prosthetic hand to enhance grasping functionality. The system allows one to switch between Contact Detection or Slip Prevention control strategies, giving the user the ability to use each control as needed. Feedback from the textile sensors directly to the prosthesis control unit provides valuable information regarding grasping forces. This research aims to help improve prosthetic technology so that one day amputees will feel as if their device is a natural extension of their body