Dexterous manipulation of unknown objects using virtual contact points

The manipulation of unknown objects is a problem of special interest in robotics since it is not always possible to have exact models of the objects with which the robot interacts. This paper presents a simple strategy to manipulate unknown objects using a robotic hand equipped with tactile sensors. The hand configurations that allow the rotation of an unknown object are computed using only tactile and kinematic information, obtained during the manipulation process and reasoning about the desired and real positions of the fingertips during the manipulation. This is done taking into account that the desired positions of the fingertips are not physically reachable since they are located in the interior of the manipulated object and therefore they are virtual positions with associated virtual contact points. The proposed approach was satisfactorily validated using three fingers of an anthropomorphic robotic hand (Allegro Hand), with the original fingertips replaced by tactile sensors (WTS-FT). In the experimental validation, several everyday objects with different shapes were successfully manipulated, rotating them without the need of knowing their shape or any other physical property.Peer ReviewedPostprint (author's final draft

Tactile-based Manipulation of Deformable Objects with Dynamic Center of Mass

International audienceTactile sensing feedback provides feasible solutions to robotic dexterous manipulation tasks. In this paper, we present a novel tactile-based framework for detecting/correcting slips and regulating grasping forces while manipulating de-formable objects with the dynamic center of mass. This framework consists of a tangential force based slip detection method and a deformation prevention approach relying on weight estimation. Moreover, we propose a new strategy for manipulating deformable heavy objects. Objects with different stiffnesses, surface textures, and centers of mass are tested in experiments. Results show that proposed approaches are capable of handling objects with uncertainties in their characteristics, and also robust to external disturbances

Sensors for Robotic Hands: A Survey of State of the Art

Recent decades have seen significant progress in the field of artificial hands. Most of the surveys, which try to capture the latest developments in this field, focused on actuation and control systems of these devices. In this paper, our goal is to provide a comprehensive survey of the sensors for artificial hands. In order to present the evolution of the field, we cover five year periods starting at the turn of the millennium. At each period, we present the robot hands with a focus on their sensor systems dividing them into categories, such as prosthetics, research devices, and industrial end-effectors.We also cover the sensors developed for robot hand usage in each era. Finally, the period between 2010 and 2015 introduces the reader to the state of the art and also hints to the future directions in the sensor development for artificial hands

Slippage detection for grasping force control of robotic hand using force sensing resistors

This paper presents the formulation of a nonlinear adaptive backstepping force control in grasping weight-varying objects using robotic hand driven by Pneumatic Artificial Muscle (PAM). The modelling and control problems arise from the high nonlinear PAM dynamics and the inherent hysteresis leading to a lack of robustness in the hand’s performance. The robotic finger and the PAM actuator been mathematically modelled as a nonlinear second order system based on an empirical approach. An adaptive backstepping controller has been designed for force control of the pneumatic hand. The estimator of the system uncertainty is incorporated into the proposed control law and a slip detection strategy is introduced to grasp objects with changing weights. The simulation and experimental results show that the robotic hand can maintain grasping an object and stop further slippage when its weight is increased up to 500 g by detecting the slip signal from the force sensor. The results also have proven that the adaptive backstepping controller is capable to compensate the uncertain coulomb friction force of PAM actuator with maximum hysteresis error 0.18◦

Improved GelSight Tactile Sensor for Measuring Geometry and Slip

A GelSight sensor uses an elastomeric slab covered with a reflective membrane to measure tactile signals. It measures the 3D geometry and contact force information with high spacial resolution, and successfully helped many challenging robot tasks. A previous sensor, based on a semi-specular membrane, produces high resolution but with limited geometry accuracy. In this paper, we describe a new design of GelSight for robot gripper, using a Lambertian membrane and new illumination system, which gives greatly improved geometric accuracy while retaining the compact size. We demonstrate its use in measuring surface normals and reconstructing height maps using photometric stereo. We also use it for the task of slip detection, using a combination of information about relative motions on the membrane surface and the shear distortions. Using a robotic arm and a set of 37 everyday objects with varied properties, we find that the sensor can detect translational and rotational slip in general cases, and can be used to improve the stability of the grasp.Comment: IEEE/RSJ International Conference on Intelligent Robots and System

A dynamic tactile sensor on photoelastic effect

Certain photoelastic materials exhibit birefringent characteristics at a very low level of strain. This property of material may be suitable for dynamic or wave propagation studies, which can be exploited for designing tactile sensors. This paper presents the design, construction and testing of a novel dynamic sensor based on photoelastic effect, which is capable of detecting object slip as well as providing normal force information. The paper investigates the mechanics of object slip, and develops an approximate model of the sensor. This allows visualization of various parameters involved in the sensor design. The model also explains design improvements necessary to obtain continuous signal during object slip. The developed sensor has been compared with other existing sensors and experimental results from the sensor have been discussed. The sensor is calibrated for normal force which is in addition to the dynamic signal that it provides from the same contact location. The sensor has a simple design and is of a small size allowing it to be incorporated into robotic fingers, and it provides output signals which are largely unaffected by external disturbances