972 research outputs found

    Neuromorphic event-based slip detection and suppression in robotic grasping and manipulation

    Get PDF
    Slip detection is essential for robots to make robust grasping and fine manipulation. In this paper, a novel dynamic vision-based finger system for slip detection and suppression is proposed. We also present a baseline and feature based approach to detect object slips under illumination and vibration uncertainty. A threshold method is devised to autonomously sample noise in real-time to improve slip detection. Moreover, a fuzzy based suppression strategy using incipient slip feedback is proposed for regulating the grip force. A comprehensive experimental study of our proposed approaches under uncertainty and system for high-performance precision manipulation are presented. We also propose a slip metric to evaluate such performance quantitatively. Results indicate that the system can effectively detect incipient slip events at a sampling rate of 2kHz (Δt=500μs\Delta t = 500\mu s) and suppress them before a gross slip occurs. The event-based approach holds promises to high precision manipulation task requirement in industrial manufacturing and household services.Comment: 18 pages, 14 figure

    A novel event-based incipient slip detection using Dynamic Active-Pixel Vision Sensor (DAVIS)

    Get PDF
    In this paper, a novel approach to detect incipient slip based on the contact area between a transparent silicone medium and different objects using a neuromorphic event-based vision sensor (DAVIS) is proposed. Event-based algorithms are developed to detect incipient slip, slip, stress distribution and object vibration. Thirty-seven experiments were performed on five objects with different sizes, shapes, materials and weights to compare precision and response time of the proposed approach. The proposed approach is validated by using a high speed constitutional camera (1000 FPS). The results indicate that the sensor can detect incipient slippage with an average of 44.1 ms latency in unstructured environment for various objects. It is worth mentioning that the experiments were conducted in an uncontrolled experimental environment, therefore adding high noise levels that affected results significantly. However, eleven of the experiments had a detection latency below 10 ms which shows the capability of this method. The results are very promising and show a high potential of the sensor being used for manipulation applications especially in dynamic environments

    ANN Control Based on Patterns Recognition for A Robotic Hand Under Different Load Conditions

    Get PDF
    في هذا البحث, الشبكة العصبية الاصطناعية (ANN) قد تم تدريبها على انماط نسب المركبات العمودية الى الافقية لقوى التماس عند وقت حدوث الانزلاق, لتكون قادرة على تمييز الانزلاق تحت انواع مختلفة من الأحمال (الحمل الستاتيكي والحمل الديناميكي), ومن ثم توليد اشارة راجعة تستخدم كمشغل لمحرك اليد الصناعية. هذه العملية اجريت بدون الحاجة لأي معلومات حول خواص الجسم الممسوك, مثل الوزن, تركيب السطح, الشكل, معامل الاحتكاك و نوع الحمل المؤثر على الجسم الممسوك. لتحقيق ذلك , تم اقتراح تصميم جديد لرأس الاصبع من اجل كشف الانزلاق في اتجاهات متعددة بين الجسم الممسوك ورؤس الاصابع الاصطناعية. هذا التصميم يتألف من اصبعين مع نظام تشغيل يتضمن اجزاء مرنة (نوابض انضغاطية). هذه النوابض تعمل كمعوض لقوة المسك عند وقت حدوث الانزلاق حتى في وضعية التوقف لمحرك اليد. نسب مركبات قوى التماس يمكن حسابها بواسطة حساسات قوى تقليدية (FlexiForce sensor) بعد معالجة بيانات القوى باستخدام برنامج Matlab/Simulink ومن خلال علاقات رياضية معينة التي تم اشتقاقها لوصف الآلية الميكانيكية للإصبع الاصطناعي.In this paper, the Artificial Neural Network (ANN) is trained on the patterns of the normal component to tangential component ratios at the time of slippage occurrence, so that it can be able to distinguish the slippage occurrence under different type of load (quasi-static and dynamic loads), and then generates a feedback signal used as an input signal to run the actuator. This process is executed without the need for any information about the characteristics of the grasped object, such as weight, surface texture, shape, coefficient of the friction and the type of the load exerted on the grasped object. For fulfillment this approach, a new fingertip design has been proposed in order to detect the slippage in multi-direction between the grasped object and the artificial fingertips. This design is composed of two under-actuated fingers with an actuation system which includes flexible parts (compressive springs). These springs operate as a compensator for the grasping force at the time of slippage occurrence in spite of the actuator is in stopped situation. The contact force component ratios can be calculated via a conventional sensor (Flexiforce sensor) after processed the force data using Matlab/Simulink program through a specific mathematical model which is derived according to the mechanism of the artificial finger

    Haptic Exploration of Unknown Objects for Robust in-hand Manipulation.

    Get PDF
    Human-like robot hands provide the flexibility to manipulate a variety of objects that are found in unstructured environments. Knowledge of object properties and motion trajectory is required, but often not available in real-world manipulation tasks. Although it is possible to grasp and manipulate unknown objects, an uninformed grasp leads to inferior stability, accuracy, and repeatability of the manipulation. Therefore, a central challenge of in-hand manipulation in unstructured environments is to acquire this information safely and efficiently. We propose an in-hand manipulation framework that does not assume any prior information about the object and the motion, but instead extracts the object properties through a novel haptic exploration procedure and learns the motion from demonstration using dynamical movement primitives. We evaluate our approach by unknown object manipulation experiments using a human-like robot hand. The results show that haptic exploration improves the manipulation robustness and accuracy significantly, compared to the virtual spring framework baseline method that is widely used for grasping unknown objects

    Dynamic-vision-based force measurements using convolutional recurrent neural networks

    Get PDF
    In this paper, a novel dynamic Vision-Based Measurement method is proposed to measure contact force independent of the object sizes. A neuromorphic camera (Dynamic Vision Sensor) is utilizused to observe intensity changes within the silicone membrane where the object is in contact. Three deep Long Short-Term Memory neural networks combined with convolutional layers are developed and implemented to estimate the contact force from intensity changes over time. Thirty-five experiments are conducted using three objects with different sizes to validate the proposed approach. We demonstrate that the networks with memory gates are robust against variable contact sizes as the networks learn object sizes in the early stage of a grasp. Moreover, spatial and temporal features enable the sensor to estimate the contact force every 10 ms accurately. The results are promising with Mean Squared Error of less than 0.1 N for grasping and holding contact force using leave-one-out cross-validation method

    Model-Based Fault Detection and Identification for Prognostics of Electromechanical Actuators Using Genetic Algorithms

    Get PDF
    Traditional hydraulic servomechanisms for aircraft control surfaces are being gradually replaced by newer technologies, such as Electro-Mechanical Actuators (EMAs). Since field data about reliability of EMAs are not available due to their recent adoption, their failure modes are not fully understood yet; therefore, an effective prognostic tool could help detect incipient failures of the flight control system, in order to properly schedule maintenance interventions and replacement of the actuators. A twofold benefit would be achieved: Safety would be improved by avoiding the aircraft to fly with damaged components, and replacement of still functional components would be prevented, reducing maintenance costs. However, EMA prognostic presents a challenge due to the complexity and to the multi-disciplinary nature of the monitored systems. We propose a model-based fault detection and isolation (FDI) method, employing a Genetic Algorithm (GA) to identify failure precursors before the performance of the system starts being compromised. Four different failure modes are considered: dry friction, backlash, partial coil short circuit, and controller gain drift. The method presented in this work is able to deal with the challenge leveraging the system design knowledge in a more effective way than data-driven strategies, and requires less experimental data. To test the proposed tool, a simulated test rig was developed. Two numerical models of the EMA were implemented with different level of detail: A high fidelity model provided the data of the faulty actuator to be analyzed, while a simpler one, computationally lighter but accurate enough to simulate the considered fault modes, was executed iteratively by the GA. The results showed good robustness and precision, allowing the early identification of a system malfunctioning with few false positives or missed failures.https://susy.mdpi

    Methods and Sensors for Slip Detection in Robotics: A Survey

    Get PDF
    The perception of slip is one of the distinctive abilities of human tactile sensing. The sense of touch allows recognizing a wide set of properties of a grasped object, such as shape, weight and dimension. Based on such properties, the applied force can be accordingly regulated avoiding slip of the grasped object. Despite the great importance of tactile sensing for humans, mechatronic hands (robotic manipulators, prosthetic hands etc.) are rarely endowed with tactile feedback. The necessity to grasp objects relying on robust slip prevention algorithms is not yet corresponded in existing artificial manipulators, which are relegated to structured environments then. Numerous approaches regarding the problem of slip detection and correction have been developed especially in the last decade, resorting to a number of sensor typologies. However, no impact on the industrial market has been achieved. This paper reviews the sensors and methods so far proposed for slip prevention in artificial tactile perception, starting from more classical techniques until the latest solutions tested on robotic systems. The strengths and weaknesses of each described technique are discussed, also in relation to the sensing technologies employed. The result is a summary exploring the whole state of art and providing a perspective towards the future research directions in the sector

    Tactile Sensors for Friction Estimation and Incipient Slip Detection - Toward Dexterous Robotic Manipulation:A Review

    Get PDF
    Humans can handle and manipulate objects with ease; however, human dexterity has yet to be matched by artificial systems. Receptors in our fingers and hands provide essential tactile information to the motor control system during dexterous manipulation such that the grip force is scaled to the tangential forces according to the coefficient of friction. Likewise, tactile sensing will become essential for robotic and prosthetic gripping performance as applications move toward unstructured environments. However, most existing research ignores the need to sense the frictional properties of the sensor-object interface, which (along with contact forces and torques) is essential for finding the minimum grip force required to securely grasp an object. Here, we review this problem by surveying the field of tactile sensing from the perspective that sensors should: 1) detect gross slip (to adjust the grip force); 2) detect incipient slip (dependent on the frictional properties of the sensor-object interface and the geometries and mechanics of the sensor and the object) as an indication of grip security; or 3) measure friction on contact with an object and/or following a gross or incipient slip event while manipulating an object. Recommendations are made to help focus future sensor design efforts toward a generalizable and practical solution to sense, and hence control grip security. Specifically, we propose that the sensor mechanics should encourage incipient slip, by allowing parts of the sensor to slip while other parts remain stuck, and that instrumentation should measure displacement and deformation to complement conventional force, pressure, and vibration tactile sensing

    Sensors for Robotic Hands: A Survey of State of the Art

    Get PDF
    Recent decades have seen significant progress in the field of artificial hands. Most of the surveys, which try to capture the latest developments in this field, focused on actuation and control systems of these devices. In this paper, our goal is to provide a comprehensive survey of the sensors for artificial hands. In order to present the evolution of the field, we cover five year periods starting at the turn of the millennium. At each period, we present the robot hands with a focus on their sensor systems dividing them into categories, such as prosthetics, research devices, and industrial end-effectors.We also cover the sensors developed for robot hand usage in each era. Finally, the period between 2010 and 2015 introduces the reader to the state of the art and also hints to the future directions in the sensor development for artificial hands
    corecore