A novel event-based incipient slip detection using Dynamic Active-Pixel Vision Sensor (DAVIS)

In this paper, a novel approach to detect incipient slip based on the contact area between a transparent silicone medium and different objects using a neuromorphic event-based vision sensor (DAVIS) is proposed. Event-based algorithms are developed to detect incipient slip, slip, stress distribution and object vibration. Thirty-seven experiments were performed on five objects with different sizes, shapes, materials and weights to compare precision and response time of the proposed approach. The proposed approach is validated by using a high speed constitutional camera (1000 FPS). The results indicate that the sensor can detect incipient slippage with an average of 44.1 ms latency in unstructured environment for various objects. It is worth mentioning that the experiments were conducted in an uncontrolled experimental environment, therefore adding high noise levels that affected results significantly. However, eleven of the experiments had a detection latency below 10 ms which shows the capability of this method. The results are very promising and show a high potential of the sensor being used for manipulation applications especially in dynamic environments

Tactile Sensors for Friction Estimation and Incipient Slip Detection - Toward Dexterous Robotic Manipulation:A Review

Humans can handle and manipulate objects with ease; however, human dexterity has yet to be matched by artificial systems. Receptors in our fingers and hands provide essential tactile information to the motor control system during dexterous manipulation such that the grip force is scaled to the tangential forces according to the coefficient of friction. Likewise, tactile sensing will become essential for robotic and prosthetic gripping performance as applications move toward unstructured environments. However, most existing research ignores the need to sense the frictional properties of the sensor-object interface, which (along with contact forces and torques) is essential for finding the minimum grip force required to securely grasp an object. Here, we review this problem by surveying the field of tactile sensing from the perspective that sensors should: 1) detect gross slip (to adjust the grip force); 2) detect incipient slip (dependent on the frictional properties of the sensor-object interface and the geometries and mechanics of the sensor and the object) as an indication of grip security; or 3) measure friction on contact with an object and/or following a gross or incipient slip event while manipulating an object. Recommendations are made to help focus future sensor design efforts toward a generalizable and practical solution to sense, and hence control grip security. Specifically, we propose that the sensor mechanics should encourage incipient slip, by allowing parts of the sensor to slip while other parts remain stuck, and that instrumentation should measure displacement and deformation to complement conventional force, pressure, and vibration tactile sensing

ANN Control Based on Patterns Recognition for A Robotic Hand Under Different Load Conditions

في هذا البحث, الشبكة العصبية الاصطناعية (ANN) قد تم تدريبها على انماط نسب المركبات العمودية الى الافقية لقوى التماس عند وقت حدوث الانزلاق, لتكون قادرة على تمييز الانزلاق تحت انواع مختلفة من الأحمال (الحمل الستاتيكي والحمل الديناميكي), ومن ثم توليد اشارة راجعة تستخدم كمشغل لمحرك اليد الصناعية. هذه العملية اجريت بدون الحاجة لأي معلومات حول خواص الجسم الممسوك, مثل الوزن, تركيب السطح, الشكل, معامل الاحتكاك و نوع الحمل المؤثر على الجسم الممسوك. لتحقيق ذلك , تم اقتراح تصميم جديد لرأس الاصبع من اجل كشف الانزلاق في اتجاهات متعددة بين الجسم الممسوك ورؤس الاصابع الاصطناعية. هذا التصميم يتألف من اصبعين مع نظام تشغيل يتضمن اجزاء مرنة (نوابض انضغاطية). هذه النوابض تعمل كمعوض لقوة المسك عند وقت حدوث الانزلاق حتى في وضعية التوقف لمحرك اليد. نسب مركبات قوى التماس يمكن حسابها بواسطة حساسات قوى تقليدية (FlexiForce sensor) بعد معالجة بيانات القوى باستخدام برنامج Matlab/Simulink ومن خلال علاقات رياضية معينة التي تم اشتقاقها لوصف الآلية الميكانيكية للإصبع الاصطناعي.In this paper, the Artificial Neural Network (ANN) is trained on the patterns of the normal component to tangential component ratios at the time of slippage occurrence, so that it can be able to distinguish the slippage occurrence under different type of load (quasi-static and dynamic loads), and then generates a feedback signal used as an input signal to run the actuator. This process is executed without the need for any information about the characteristics of the grasped object, such as weight, surface texture, shape, coefficient of the friction and the type of the load exerted on the grasped object. For fulfillment this approach, a new fingertip design has been proposed in order to detect the slippage in multi-direction between the grasped object and the artificial fingertips. This design is composed of two under-actuated fingers with an actuation system which includes flexible parts (compressive springs). These springs operate as a compensator for the grasping force at the time of slippage occurrence in spite of the actuator is in stopped situation. The contact force component ratios can be calculated via a conventional sensor (Flexiforce sensor) after processed the force data using Matlab/Simulink program through a specific mathematical model which is derived according to the mechanism of the artificial finger

Methods and Sensors for Slip Detection in Robotics: A Survey

The perception of slip is one of the distinctive abilities of human tactile sensing. The sense of touch allows recognizing a wide set of properties of a grasped object, such as shape, weight and dimension. Based on such properties, the applied force can be accordingly regulated avoiding slip of the grasped object. Despite the great importance of tactile sensing for humans, mechatronic hands (robotic manipulators, prosthetic hands etc.) are rarely endowed with tactile feedback. The necessity to grasp objects relying on robust slip prevention algorithms is not yet corresponded in existing artificial manipulators, which are relegated to structured environments then. Numerous approaches regarding the problem of slip detection and correction have been developed especially in the last decade, resorting to a number of sensor typologies. However, no impact on the industrial market has been achieved. This paper reviews the sensors and methods so far proposed for slip prevention in artificial tactile perception, starting from more classical techniques until the latest solutions tested on robotic systems. The strengths and weaknesses of each described technique are discussed, also in relation to the sensing technologies employed. The result is a summary exploring the whole state of art and providing a perspective towards the future research directions in the sector

Incipient slip detection and grasping automation for robotic surgery

Robotic minimally invasive surgery provides multiple improvements over traditional laparoscopic procedures, but one significant issue still encountered is their limited force control during the grasping and retraction of tissue, as the surgeon is separated from the instrument, and therefore denuded of their sense of touch and the applied forces. Prior solutions have largely looked towards haptic feedback to resolve this issue, but an alternative approach is to detect and monitor the occurrence of tissue slip events. This would allow the force to be automatically adjusted to prevent slip, minimising the clamp force used to maintain control, thus reducing the probability of tissue trauma. The aim of this work is to develop a method for the early detection and mitigation of tissue slip during robotic surgical manipulation tasks, helping to reduce tissue trauma and minimise tissue slip events. Initial investigations into literature, and evaluation of the slip mechanics when grasping soft, lubricated, deformable materials, indicated that small localised slips occur before the onset of macro slip. Two phenomena were identified in the slip mechanics investigation that could be employed to induce these slip in a measurable and repeatable manner. Firstly through using the tissue's deformable properties to create slip differentials between the front and rear of the grasper face, and secondly through using a curved surface to create a variation in the normal force, and thus frictional force, across the surface. Two instrumented grasper faces were developed, based on each of these phenomena, that were capable of monitoring the occurrence of localised tissue slip through monitoring the displacement of a series of independent movable islands that made up the grasper face. These were then demonstrated to be capable of automatically detecting slip events for a range of test conditions with tissue simulants, before being utilised to automatically control the grasping forces during a tissue retraction task. Both sensor systems provided similar levels of tissue control to one which utilised the maximum clamp force throughout the task, whilst applying lower forces during the early stages of retraction, reducing the probability of tissue damage. In addition the normal force based method, with the curved grasper face, was demonstrated to be effective for the early detection of slip when grasping porcine liver tissue, successfully detecting incipient slip in 77% of cases. This work provides a strong basis for further development of incipient slip sensing for surgical applications. It provides novel contributions in the understanding of slip mechanics of soft tissues, as well as presenting two separate novel sensing approaches for the automatic detection and mitigation of slip events, offering an opportunity for reducing the occurrence of tissue slip events whilst minimising tissue trauma, as well as surgeon fatigue

Under Pressure: Learning to Detect Slip with Barometric Tactile Sensors

Despite the utility of tactile information, tactile sensors have yet to be widely deployed in industrial robotics settings -- part of the challenge lies in identifying slip and other key events from the tactile data stream. In this paper, we present a learning-based method to detect slip using barometric tactile sensors. Although these sensors have a low resolution, they have many other desirable properties including high reliability and durability, a very slim profile, and a low cost. We are able to achieve slip detection accuracies of greater than 91% while being robust to the speed and direction of the slip motion. Further, we test our detector on two robot manipulation tasks involving common household objects and demonstrate successful generalization to real-world scenarios not seen during training. We show that barometric tactile sensing technology, combined with data-driven learning, is potentially suitable for complex manipulation tasks such as slip compensation.Comment: Submitted to th RoboTac Workshop in the IEEE/RSJ International Conference on Intelligent Robotics and Systems (IROS'21), Prague, Czech Republic, Sept 27- Oct 1, 202