Adaptive robust interaction control for low-cost robotic grasping

Robotic grasping is a challenging area in the field of robotics. When a gripper starts interacting with an object to perform a grasp, the mechanical properties of the object (stiffness and damping) will play an important role. A gripper which is stable in isolated conditions, can become unstable when coupled to an object. This can lead to the extreme condition where the gripper becomes unstable and generates excessive or insufficient grip force resulting in the grasped object either being crushed, or falling and breaking. In addition to the stability issue, grasp maintenance is one of the most important requirements of any grasp where it guarantees a secure grasp in the presence of any unknown disturbance. The term grasp maintenance refers to the reaction of the controller in the presence of external disturbances, trying to prevent any undesired slippage. To do so, the controller continuously adjusts the grip force. This is a challenging task as it requires an accurate model of the friction and object’s weight to estimate a sufficient grip force to stop the object from slipping while incurring minimum deformation. Unfortunately, in reality, there is no solution which is able to obtain the mechanical properties, frictional coefficient and weight of an object before establishing a mechanical interaction with it. External disturbance forces are also stochastic meaning they are impossible to predict. This thesis addresses both of the problems mentioned above by:Creating a novel variable stiffness gripper, capable of grasping unknown objects, mainly those found in agricultural or food manufacturing companies. In addition to the stabilisation effect of the introduced variable stiffness mechanism, a novel force control algorithm has been designed that passively controls the grip force in variable stiffness grippers. Due to the passive nature of the suggested controller, it completely eliminates the necessity for any force sensor. The combination of both the proposed variable stiffness gripper and the passivity based control provides a unique solution for the stable grasp and force control problem in tendon driven, angular grippers.Introducing a novel active multi input-multi output slip prevention algorithm. The algorithm developed provides a robust control solution to endow direct drive parallel jaw grippers with the capability to stop held objects from slipping while incurring minimum deformation; this can be done without any prior knowledge of the object’s friction and weight. The large number of experiments provided in this thesis demonstrate the robustness of the proposed controller when controlling parallel jaw grippers in order to quickly grip, lift and place a broad range of objects firmly without dropping or crushing them. This is particularly useful for teleoperation and nuclear decommissioning tasks where there is often no accurate information available about the objects to be handled. This can mean that pre-programming of the gripper is required for each different object and for high numbers of objects this is impractical and overly time-consuming. A robust controller, which is able to compensate for any uncertainties regarding the object model and any unknown external disturbances during grasping, is implemented. This work has advanced the state of the art in the following two main areas: Direct impedance modulation for stable grasping in tendon driven, angular grippers. Active MIMO slip prevention grasp control for direct drive parallel jaw grippers

Run-time reconfiguration for efficient tracking of implanted magnets with a myokinetic control interface applied to robotic hands

Tese (doutorado)—Universidade de Brasília, Faculdade de Tecnologia, Departamento de Engenharia Mecânica, 2021.Este trabalho introduz a aplicação de soluções de aprendizagem de máquinas visado ao problema do rastreamento de posição do antebraço baseado em sensores magnéticos. Especi ficamente, emprega-se uma estratégia baseada em dados para criar modelos matemáticos que possam traduzir as informações magnéticas medidas em entradas utilizáveis para dispositivos protéticos. Estes modelos são implementados em FPGAs usando operadores customizados de ponto flutuante para otimizar o consumo de hardware e energia, que são importantes em dispositivos embarcados. A arquitetura de hardware é proposta para ser implementada como um sistema com reconfiguração dinâmica parcial, reduzindo potencialmente a utilização de recursos e o consumo de energia da FPGA. A estratégia de dados proposta e sua implemen tação de hardware pode alcançar uma latência na ordem de microssegundos e baixo consumo de energia, o que encoraja mais pesquisas para melhorar os métodos aqui desenvolvidos para outras aplicações.Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES).This work introduces the application of embedded machine learning solutions for the problem of magnetic sensors-based limb tracking. Namely, we employ a data-driven strat egy to create mathematical models that can translate the magnetic information measured to usable inputs for prosthetic devices. These models are implemented in FPGAs using cus tomized floating-point operations to optimize hardware and energy consumption, which are important in wearable devices. The hardware architecture is proposed to be implemented as a dynamically partial reconfigured system, potentially reducing resource utilization and power consumption of the FPGA. The proposed data-driven strategy and its hardware implementa tion can achieve a latency in the order of microseconds and low energy consumption, which encourages further research on improving the methods herein devised for other application

Adaptive and reconfigurable robotic gripper hands with a meso-scale gripping range

Grippers and robotic hands are essential and important end-effectors of robotic manipulators. Developing a gripper hand that can grasp a large variety of objects precisely and stably is still an aspiration even though research in this area has been carried out for several decades. This thesis provides a development approach and a series of gripper hands which can bridge the gap between micro-gripper and macro-gripper by extending the gripping range to the mesoscopic scale (meso-scale). Reconfigurable topology and variable mobility of the design offer versatility and adaptability for the changing environment and demands. By investigating human grasping behaviours and the unique structures of human hand, a CFB-based finger joint for anthropomorphic finger is developed to mimic a human finger with a large grasping range. The centrodes of CFB mechanism are explored and a contact-aided CFB mechanism is developed to increase stiffness of finger joints. An integrated gripper structure comprising cross four-bar (CFB) and remote-centre-of-motion (RCM) mechanisms is developed to mimic key functionalities of human hand. Kinematics and kinetostatic analyses of the CFB mechanism for multimode gripping are conducted to achieve passive-adjusting motion. A novel RCM-based finger with angular, parallel and underactuated motion is invented. Kinematics and stable gripping analyses of the RCM-based multi-motion finger are also investigated. The integrated design with CFB and RCM mechanisms provides a novel concept of a multi-mode gripper that aims to tackle the challenge of changing over for various sizes of objects gripping in mesoscopic scale range. Based on the novel designed mechanisms and design philosophy, a class of gripper hands in terms of adaptive meso-grippers, power-precision grippers and reconfigurable hands are developed. The novel features of the gripper hands are one degree of freedom (DoF), self-adaptive, reconfigurable and multi-mode. Prototypes are manufactured by 3D printing and the grasping abilities are tested to verify the design approach.EPSR

Automation and Robotics: Latest Achievements, Challenges and Prospects

This SI presents the latest achievements, challenges and prospects for drives, actuators, sensors, controls and robot navigation with reverse validation and applications in the field of industrial automation and robotics. Automation, supported by robotics, can effectively speed up and improve production. The industrialization of complex mechatronic components, especially robots, requires a large number of special processes already in the pre-production stage provided by modelling and simulation. This area of research from the very beginning includes drives, process technology, actuators, sensors, control systems and all connections in mechatronic systems. Automation and robotics form broad-spectrum areas of research, which are tightly interconnected. To reduce costs in the pre-production stage and to reduce production preparation time, it is necessary to solve complex tasks in the form of simulation with the use of standard software products and new technologies that allow, for example, machine vision and other imaging tools to examine new physical contexts, dependencies and connections

Modelado de sensores piezoresistivos y uso de una interfaz basada en guantes de datos para el control de impedancia de manipuladores robóticos

Tesis inédita de la Universidad Complutense de Madrid, Facultad de Ciencias Físicas, Departamento de Arquitectura de Computadores y Automática, leída el 21-02-2014Sección Deptal. de Arquitectura de Computadores y Automática (Físicas)Fac. de Ciencias FísicasTRUEunpu

Parametric mechanical design and optimisation of the Canterbury Hand.

As part of worldwide research humanoid robots have been developed for household, industrial and exploratory applications. If such robots are to interact with people and human created environments they will require human-like hands. The objective of this thesis was the parametric design and optimisation of a dexterous, and anthropomorphic robotic end effector. Known as the ‘Canterbury Hand’ it has 11 degree of freedoms with four fingers and a thumb. The hand has applications for dexterous teleoperation and object manipulation in industrial, hazardous or uncertain environments such as orbital robotics. The human hand was analysed so that the Canterbury Hand could copy its motions, appearance and grasp types. An analysis of the current literature on experimental prosthetic and robotic hands was also carried out. A disadvantage of many of these hand designs was that they were remotely powered using large, heavy actuator packs. The advantage of the Canterbury Hand is that it has been designed to hold the motors, wires, and circuit boards entirely within itself; although a belt carried battery pack is required. The hand was modelled using a parametric 3D computer aided design (CAD) program. Two different configurations of the hand were created in the model. One configuration, as a dexterous robot hand, used Ø13mm 3 Watt DC motors, while the other used Ø10mm, 0.5 Watt DC motors (although this hand is still slightly too large for a general prosthesis). The parts within the hand were modelled to permit changes to the geometry. This was necessary for the optimisation process. The bearing geometry of the finger and thumb linkages, as well as the thumb rotation axis was optimised for anthropomorphic motion, appearance and increased force output. A design table within a spreadsheet was created to interact with the CAD models of the hand to quickly implement the optimised geometry. The work reported in this thesis has shown the possibilities for parametric design and optimisation of an anthropomorphic, dexterous robotic hand

Signal and Information Processing Methods for Embedded Robotic Tactile Sensing Systems

The human skin has several sensors with different properties and responses that are able to detect stimuli resulting from mechanical stimulations. Pressure sensors are the most important type of receptors for the exploration and manipulation of objects. In the last decades, smart tactile sensing based on different sensing techniques have been developed as their application in robotics and prosthetics is considered of huge interest, mainly driven by the prospect of autonomous and intelligent robots that can interact with the environment. However, regarding object properties estimation on robots, hardness detection is still a major limitation due to the lack of techniques to estimate it. Furthermore, finding processing methods that can interpret the measured information from multiple sensors and extract relevant information is a Challenging task. Moreover, embedding processing methods and machine learning algorithms in robotic applications to extract meaningful information such as object properties from tactile data is an ongoing challenge, which is controlled by the device constraints (power constraint, memory constraints, etc.), the computational complexity of the processing and machine learning algorithms, the application requirements (real-time operations, high prediction performance). In this dissertation, we focus on the design and implementation of pre-processing methods and machine learning algorithms to handle the aforementioned challenges for a tactile sensing system in robotic application. First, we propose a tactile sensing system for robotic application. Then we present efficient preprocessing and feature extraction methods for our tactile sensors. Then we propose a learning strategy to reduce the computational cost of our processing unit in object classification using sensorized Baxter robot. Finally, we present a real-time robotic tactile sensing system for hardness classification on a resource-constrained devices. The first study represents a further assessment of the sensing system that is based on the PVDF sensors and the interface electronics developed in our lab. In particular, first, it presents the development of a skin patch (multilayer structure) that allows us to use the sensors in several applications such as robotic hand/grippers. Second, it shows the characterization of the developed skin patch. Third, it validates the sensing system. Moreover, we designed a filter to remove noise and detect touch. The experimental assessment demonstrated that the developed skin patch and the interface electronics indeed can detect different touch patterns and stimulus waveforms. Moreover, the results of the experiments defined the frequency range of interest and the response of the system to realistic interactions with the sensing system to grasp and release events. In the next study, we presented an easy integration of our tactile sensing system into Baxter gripper. Computationally efficient pre-processing techniques were designed to filter the signal and extract relevant information from multiple sensor signals, in addition to feature extraction methods. These processing methods aim in turn to reduce also the computational complexity of machine learning algorithms utilized for object classification. The proposed system and processing strategy were evaluated on object classification application by integrating our system into the gripper and we collected data by grasping multiple objects. We further proposed a learning strategy to accomplish a trade-off between the generalization accuracy and the computational cost of the whole processing unit. The proposed pre-processing and feature extraction techniques together with the learning strategy have led to models with extremely low complexity and very high generalization accuracy. Moreover, the support vector machine achieved the best trade-off between accuracy and computational cost on tactile data from our sensors. Finally, we presented the development and implementation on the edge of a real–time tactile sensing system for hardness classification on Baxter robot based on machine and deep learning algorithms. We developed and implemented in plain C a set of functions that provide the fundamental layer functionalities of the Machine learning and Deep Learning models (ML and DL), along with the pre–processing methods to extract the features and normalize the data. The models can be deployed to any device that supports C code since it does not rely on any of the existing libraries. Shallow ML/DL algorithms for the deployment on resource–constrained devices are designed. To evaluate our work, we collected data by grasping objects of different hardness and shape. Two classification problems were addressed: 5 levels of hardness classified on the same objects’ shape, and 5 levels of hardness classified on two different objects’ shape. Furthermore, optimization techniques were employed. The models and pre–processing were implemented on a resource constrained device, where we assessed the performance of the system in terms of accuracy, memory footprint, time latency, and energy consumption. We achieved for both classification problems a real-time inference (< 0.08 ms), low power consumption (i.e., 3.35 μJ), extremely small models (i.e., 1576 Byte), and high accuracy (above 98%)

Technology 2003: The Fourth National Technology Transfer Conference and Exposition, volume 2

Proceedings from symposia of the Technology 2003 Conference and Exposition, Dec. 7-9, 1993, Anaheim, CA, are presented. Volume 2 features papers on artificial intelligence, CAD&E, computer hardware, computer software, information management, photonics, robotics, test and measurement, video and imaging, and virtual reality/simulation

A NEUROMORPHIC APPROACH TO TACTILE PERCEPTION

Ph.DDOCTOR OF PHILOSOPH