Grasping With Mechanical Intelligence

Many robotic hands have been designed and a number have been built. Because of the difficulty of controlling and using complex hands, which usually have nine or more degrees of freedom, the simple one- or two-degree-of-freedom gripper is still the most common robotic end effector. This thesis presents a new category of device: a medium-complexity end effector. With three to five degrees of freedom, such a tool is much easier to control and use, as well as more economical, compact and lightweight than complex hands. In order to increase the versatility, it was necessary to identify grasping primitives and to implement them in the mechanism. In addition, power and enveloping grasps are stressed over fingertip and precision grasps. The design is based upon analysis of object apprehension types, requisite characteristics for active sensing, and a determination of necessary environmental interactions. Contained in this thesis are the general concepts necessary to the design of a medium-complexity end effector, an analysis of typica.1 performance, and a computer simulation of a grasp planning algorithm specific to this type of mechanism. Finally, some details concerning the UPenn Hand - a tool designed for the research laboratory - are presented

A Distributed System for Robot Manipulator Control

This is the final report representing three years of work under the current grant. This work was directed to the development of a distributed computer architecture to function as a force and motion server to a robot system. In the course of this work we developed a compliant contact sensor to provide for transitions between position and force control; we have developed an end-effector capable of securing a stable grasp on an object and a theory of grasping; we have built a controller which minimizes control delays, and are currently achieving delays of the order of five milliseconds, with sample rates of 200 hertz; we have developed parallel kinematics algorithms for the controller; we have developed a consistent approach to the definition of motion both in joint coordinates and in Cartesian coordinates; we have developed a symbolic simplification software package to generate the dynamics equations of a manipulator such that the calculations may be split between background and foreground

Data-Driven Grasp Synthesis - A Survey

We review the work on data-driven grasp synthesis and the methodologies for sampling and ranking candidate grasps. We divide the approaches into three groups based on whether they synthesize grasps for known, familiar or unknown objects. This structure allows us to identify common object representations and perceptual processes that facilitate the employed data-driven grasp synthesis technique. In the case of known objects, we concentrate on the approaches that are based on object recognition and pose estimation. In the case of familiar objects, the techniques use some form of a similarity matching to a set of previously encountered objects. Finally for the approaches dealing with unknown objects, the core part is the extraction of specific features that are indicative of good grasps. Our survey provides an overview of the different methodologies and discusses open problems in the area of robot grasping. We also draw a parallel to the classical approaches that rely on analytic formulations.Comment: 20 pages, 30 Figures, submitted to IEEE Transactions on Robotic

Quasi-dynamic analysis, design optimization, and evaluation of a two-finger underactuated hand

Underactuated hands are able to achieve shape adaptation to conformally grasp a wide variety of objects, while keeping low undesirable hand attributes such as weight, size, complexity and cost. The available analytical and simulation studies of planar underactuated hands normally assume quasi-static conditions and a fixed object. In the present paper, a new quasi-dynamic analysis of the grasping process in the horizontal plane by a planar, two-finger, four-joint underactuated hand is presented. The study considers object movement during the grasping process, and also contact friction with a surface that supports the object. An extensive and versatile simulation program, based on the analysis, is developed to investigate the effects of various parameters of hand and object on the grasping process. A prototype hand has been developed and the simulation results are validated experimentally. An extensive and detailed study and optimization exercise is carried out using the developed simulation tool. Specifically, the study concerns a manipulative grasping process that moves the object to the hand centerline during the process. Important new findings on the influence of link dimensions, link angular speeds, friction with the supporting surface, object mass and object size on the grasping performance of the hand in this scenario are presented. The results are used to establish new design guidelines for the hand. In particular, the results indicate that in the case where there is limited information on the size and precise initial location of the object to be grasped, the optimal hand design would involve inner to outer phalange size ratios of approximately 3:1, and inner phalange joints that are very close to each other.peer-reviewe

On the Interplay between Mechanical and Computational Intelligence in Robot Hands

Researchers have made tremendous advances in robotic grasping in the past decades. On the hardware side, a lot of robot hand designs were proposed, covering a large spectrum of dexterity (from simple parallel grippers to anthropomorphic hands), actuation (from underactuated to fully actuated), and sensing capabilities (from only open/close states to tactile sensing). On the software side, grasping techniques also evolved significantly, from open-loop control, classical feedback control, to learning-based policies. However, most of the studies and applications follow the one-way paradigm that mechanical engineers/researchers design the hardware first and control/learning experts write the code to use the hand. In contrast, we aim to study the interplay between the mechanical and computational aspects in robotic grasping. We believe both sides are important but cannot solve grasping problems on their own, and both sides are highly connected by the laws of physics and should not be developed separately. We use the term "Mechanical Intelligence" to refer to the ability realized by mechanisms to appropriately respond to the external inputs, and we show that incorporating Mechanical Intelligence with Computational Intelligence is beneficial for grasping. The first part of this thesis is to derive hand underactuation mechanisms from grasp data. The mechanical coordination in robot hands, which is one type of Mechanical Intelligence, corresponds to the concept of dimensionality reduction in Machine Learning. However, the resulted low-dimensional manifolds need to be realizable using underactuated mechanisms. In this project, we first collect simulated grasp data without accounting for underactuation, apply a dimensionality reduction technique (we term it "Mechanically Realizable Manifolds") considering both pre-contact postural synergies and post-contact joint torque coordination, and finally build robot hands based on the resulted low-dimensional models. We also demonstrate a real-world application on a free-flying robot for the International Space Station. The second part is about proprioceptive grasping for unknown objects by taking advantage of hand compliance. Mechanical compliance is intrinsically connected to force/torque sensing and control. In this work, we proposed a series-elastic hand providing embodied compliance and proprioception, and an associated grasping policy using a network of proportional-integral controllers. We show that, without any prior model of the object and with only proprioceptive sensing, a robot hand can make stable grasps in a reactive fashion. The last part is about developing the Mechanical and Computational Intelligence jointly --- to co-optimize the mechanisms and control policies using deep Reinforcement Learning (RL). Traditional RL treats robot hardware as immutable and models it as part of the environment. In contrast, we move the robot hardware out of the environment, express its mechanics as auto-differentiable physics and connect it with the computational policy to create a unified policy (we term this method "Hardware as Policy"), which allows RL algorithms to back-propagate gradients w.r.t both hardware and computational parameters and optimize them in the same fashion. We present a mass-spring toy problem to illustrate this idea, and also a real-world design case of an underactuated hand. The three projects we present in this thesis are meaningful examples to demonstrate the interplay between the mechanical and computational aspects of robotic grasping. In the Conclusion part, we summarize some high-level philosophies and suggestions to integrate Mechanical and Computational Intelligence, as well as the high-level challenges that still exist when pushing this area forward