Grasp Analysis Tools for Synergistic Underactuated Robotic Hands

Despite being a classical topic in robotics, the research on dexterous robotic hands still stirs a lively research activity. The current interest is especially attracted by underactuated robotic hands where a high number of degrees of freedom (DoFs), and a relatively low number of degrees of actuation co-exist. The correlation between the DoFs obtained through a wise distribution of actuators is aimed at simplifying the control with a minimal loss of dexterity. In this sense, the application of bio-inspired principles is bringing research toward a more conscious design. This work proposes new, general approaches for the analysis of grasps with synergistic underactuated robotic hands.After a review of the quasi-static equations describing the system, where contact preload is also considered, two different approaches to the analysis are presented. The first one is based on a systematic combination of the equations. The independent and the dependent variables are defined, and cause-effect relationships between them are found. In addition, remarkable properties of the grasp, as the subspace of controllable internal force and the grasp compliance, are worked out in symbolic form. Then, some relevant kinds of tasks, such as pure squeeze, spurious squeeze and kinematic grasp displacements, are defined, in terms of nullity or non-nullity of proper variables. The second method of analysis shows how to discover the feasibility of the pre-defined tasks, operating a systematic decomposition of the solution space of the system. As a result, the inputs to be given to the hand, in order to achieve the desired system displacements, are found. The study of the feasible variations is carried out arriving at the discovery of all the combinations of nullity and/or non-nullity variables which are allowed by the equations describing the system. Numerical results are presented both for precision and power grasps, finding forces and displacements that the hand can impose on the object, and showing which properties are preserved after the introduction of a synergistic underactuation mechanism

Adaptive Synergies for the Design and Control of the Pisa/IIT SoftHand

In this paper we introduce the Pisa/IIT SoftHand, a novel robot hand prototype designed with the purpose of being robust and easy to control as an industrial gripper, while exhibiting high grasping versatility and an aspect similar to that of the human hand. In the paper we briefly review the main theoretical tools used to enable such simplification, i.e. the neuroscience-based notion of soft synergies. A discussion of several possible actuation schemes shows that a straightforward implementation of the soft synergy idea in an effective design is not trivial. The approach proposed in this paper, called adaptive synergy, rests on ideas coming from underactuated hand design. A synthesis method to realize a desired set of soft synergies through the principled design of adaptive synergy is discussed. This approach leads to the design of hands accommodating in principle an arbitrary number of soft synergies, as demonstrated in grasping and manipulation simulations and experiments with a prototype. As a particular instance of application of the synthesis method of adaptive synergies, the Pisa/IIT SoftHand is described in detail. The hand has 19 joints, but only uses 1 actuator to activate its adaptive synergy. Of particular relevance in its design is the very soft and safe, yet powerful and extremely robust structure, obtained through the use of innovative articulations and ligaments replacing conventional joint design. The design and implementation of the prototype hand are shown and its effectiveness demonstrated through grasping experiments, reported also in multimedia extensio

The role of morphology of the thumb in anthropomorphic grasping : a review

The unique musculoskeletal structure of the human hand brings in wider dexterous capabilities to grasp and manipulate a repertoire of objects than the non-human primates. It has been widely accepted that the orientation and the position of the thumb plays an important role in this characteristic behavior. There have been numerous attempts to develop anthropomorphic robotic hands with varying levels of success. Nevertheless, manipulation ability in those hands is to be ameliorated even though they can grasp objects successfully. An appropriate model of the thumb is important to manipulate the objects against the fingers and to maintain the stability. Modeling these complex interactions about the mechanical axes of the joints and how to incorporate these joints in robotic thumbs is a challenging task. This article presents a review of the biomechanics of the human thumb and the robotic thumb designs to identify opportunities for future anthropomorphic robotic hands

Modeling and Simulation of Robotic Grasping in Simulink Through Simscape Multibody

Grasping and dexterous manipulation remain fundamental challenges in robotics, above all when performed with multifingered robotic hands. Having simulation tools to design and test grasp and manipulation control strategies is paramount to get functional robotic manipulation systems. In this paper, we present a framework for modeling and simulating grasps in the Simulink environment, by connecting SynGrasp, a well established MATLAB toolbox for grasp simulation and analysis, and Simscape Multibody, a Simulink Library allowing the simulation of physical systems. The proposed approach can be used to simulate the grasp dynamics in Simscape, and then analyse the obtained grasps in SynGrasp. The devised functions and blocks can be easily customized to simulate different hands and objects

A soft, synergy-based robotic glove for grasping assistance

This paper presents a soft, tendon-driven, robotic glove designed to augment grasp capability and provide rehabilitation assistance for postspinal cord injury patients. The basis of the design is an underactuation approach utilizing postural synergies of the hand to support a large variety of grasps with a single actuator. The glove is lightweight, easy to don, and generates sufficient hand closing force to assist with activities of daily living. Device efficiency was examined through a characterization of the power transmission elements, and output force production was observed to be linear in both cylindrical and pinch grasp configurations. We further show that, as a result of the synergy-inspired actuation strategy, the glove only slightly alters the distribution of forces across the fingers, compared to a natural, unassisted grasping pattern. Finally, a preliminary case study was conducted using a participant suffering from an incomplete spinal cord injury (C7). It was found that through the use of the glove, the participant was able to achieve a 50% performance improvement (from four to six blocks) in a standard Box and Block test

The design of a hybrid DC motor/SMA actuated robotic hand based on physiological and anatomical synergies

Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Mechanical Engineering, 2008.Includes bibliographical references (p. 73-74).A new approach to the design and control of multi-fingered hands using hybrid DC motor-Shape Memory Alloy (SMA) array actuators is presented in this thesis. The fundamental design concept is based on the principle of motor control synergy, a biomechanics terminology for coordinated motion generation. Principal component analysis is used for determining the most significant direction as well as the residual directions. A single DC motor is used for driving multiple fingers at a particular velocity distribution over a vast number of finger joints corresponding to the direction of the most significant synergy. SMA array actuators are used for driving the fingers in the residual directions. Although many actuator axes are needed for spanning the residual space, the required strokes are much shorter than the most significant direction; compact and high energy-density SMA actuators meet these requirements. The thesis presents synergistic integration of these two types of actuators having diverse characteristics. This allows us to embed all the actuators and transmission mechanisms in the palm, eliminating a bundle of tendons crossing over the wrist joints. An initial prototype hand is designed and built.by Josiah Benjamin Rosmarin.S.M

On the Interplay between Mechanical and Computational Intelligence in Robot Hands

Researchers have made tremendous advances in robotic grasping in the past decades. On the hardware side, a lot of robot hand designs were proposed, covering a large spectrum of dexterity (from simple parallel grippers to anthropomorphic hands), actuation (from underactuated to fully actuated), and sensing capabilities (from only open/close states to tactile sensing). On the software side, grasping techniques also evolved significantly, from open-loop control, classical feedback control, to learning-based policies. However, most of the studies and applications follow the one-way paradigm that mechanical engineers/researchers design the hardware first and control/learning experts write the code to use the hand. In contrast, we aim to study the interplay between the mechanical and computational aspects in robotic grasping. We believe both sides are important but cannot solve grasping problems on their own, and both sides are highly connected by the laws of physics and should not be developed separately. We use the term "Mechanical Intelligence" to refer to the ability realized by mechanisms to appropriately respond to the external inputs, and we show that incorporating Mechanical Intelligence with Computational Intelligence is beneficial for grasping. The first part of this thesis is to derive hand underactuation mechanisms from grasp data. The mechanical coordination in robot hands, which is one type of Mechanical Intelligence, corresponds to the concept of dimensionality reduction in Machine Learning. However, the resulted low-dimensional manifolds need to be realizable using underactuated mechanisms. In this project, we first collect simulated grasp data without accounting for underactuation, apply a dimensionality reduction technique (we term it "Mechanically Realizable Manifolds") considering both pre-contact postural synergies and post-contact joint torque coordination, and finally build robot hands based on the resulted low-dimensional models. We also demonstrate a real-world application on a free-flying robot for the International Space Station. The second part is about proprioceptive grasping for unknown objects by taking advantage of hand compliance. Mechanical compliance is intrinsically connected to force/torque sensing and control. In this work, we proposed a series-elastic hand providing embodied compliance and proprioception, and an associated grasping policy using a network of proportional-integral controllers. We show that, without any prior model of the object and with only proprioceptive sensing, a robot hand can make stable grasps in a reactive fashion. The last part is about developing the Mechanical and Computational Intelligence jointly --- to co-optimize the mechanisms and control policies using deep Reinforcement Learning (RL). Traditional RL treats robot hardware as immutable and models it as part of the environment. In contrast, we move the robot hardware out of the environment, express its mechanics as auto-differentiable physics and connect it with the computational policy to create a unified policy (we term this method "Hardware as Policy"), which allows RL algorithms to back-propagate gradients w.r.t both hardware and computational parameters and optimize them in the same fashion. We present a mass-spring toy problem to illustrate this idea, and also a real-world design case of an underactuated hand. The three projects we present in this thesis are meaningful examples to demonstrate the interplay between the mechanical and computational aspects of robotic grasping. In the Conclusion part, we summarize some high-level philosophies and suggestions to integrate Mechanical and Computational Intelligence, as well as the high-level challenges that still exist when pushing this area forward

Grasp Stability Analysis with Passive Reactions

Despite decades of research robotic manipulation systems outside of highly-structured industrial applications are still far from ubiquitous. Perhaps particularly curious is the fact that there appears to be a large divide between the theoretical grasp modeling literature and the practical manipulation community. Specifically, it appears that the most successful approaches to tasks such as pick-and-place or grasping in clutter are those that have opted for simple grippers or even suction systems instead of dexterous multi-fingered platforms. We argue that the reason for the success of these simple manipulation systemsis what we call passive stability: passive phenomena due to nonbackdrivable joints or underactuation allow for robust grasping without complex sensor feedback or controller design. While these effects are being leveraged to great effect, it appears the practical manipulation community lacks the tools to analyze them. In fact, we argue that the traditional grasp modeling theory assumes a complexity that most robotic hands do not possess and is therefore of limited applicability to the robotic hands commonly used today. We discuss these limitations of the existing grasp modeling literature and setout to develop our own tools for the analysis of passive effects in robotic grasping. We show that problems of this kind are difficult to solve due to the non-convexity of the Maximum Dissipation Principle (MDP), which is part of the Coulomb friction law. We show that for planar grasps the MDP can be decomposed into a number of piecewise convex problems, which can be solved for efficiently. Despite decades of research robotic manipulation systems outside of highlystructured industrial applications are still far from ubiquitous. Perhaps particularly curious is the fact that there appears to be a large divide between the theoretical grasp modeling literature and the practical manipulation community. Specifically, it appears that the most successful approaches to tasks such as pick-and-place or grasping in clutter are those that have opted for simple grippers or even suction systems instead of dexterous multi-fingered platforms. We argue that the reason for the success of these simple manipulation systemsis what we call passive stability: passive phenomena due to nonbackdrivable joints or underactuation allow for robust grasping without complex sensor feedback or controller design. While these effects are being leveraged to great effect, it appears the practical manipulation community lacks the tools to analyze them. In fact, we argue that the traditional grasp modeling theory assumes a complexity that most robotic hands do not possess and is therefore of limited applicability to the robotic hands commonly used today. We discuss these limitations of the existing grasp modeling literature and setout to develop our own tools for the analysis of passive effects in robotic grasping. We show that problems of this kind are difficult to solve due to the non-convexity of the Maximum Dissipation Principle (MDP), which is part of the Coulomb friction law. We show that for planar grasps the MDP can be decomposed into a number of piecewise convex problems, which can be solved for efficiently. We show that the number of these piecewise convex problems is quadratic in the number of contacts and develop a polynomial time algorithm for their enumeration. Thus, we present the first polynomial runtime algorithm for the determination of passive stability of planar grasps. For the spacial case we present the first grasp model that captures passive effects due to nonbackdrivable actuators and underactuation. Formulating the grasp model as a Mixed Integer Program we illustrate that a consequence of omitting the maximum dissipation principle from this formulation is the introduction of solutions that violate energy conservation laws and are thus unphysical. We propose a physically motivated iterative scheme to mitigate this effect and thus provide the first algorithm that allows for the determination of passive stability for spacial grasps with both fully actuated and underactuated robotic hands. We verify the accuracy of our predictions with experimental data and illustrate practical applications of our algorithm. We build upon this work and describe a convex relaxation of the Coulombfriction law and a successive hierarchical tightening approach that allows us to find solutions to the exact problem including the maximum dissipation principle. It is the first grasp stability method that allows for the efficient solution of the passive stability problem to arbitrary accuracy. The generality of our grasp model allows us to solve a wide variety of problems such as the computation of optimal actuator commands. This makes our framework a valuable tool for practical manipulation applications. Our work is relevant beyond robotic manipulation as it applies to the stability of any assembly of rigid bodies with frictional contacts, unilateral constraints and externally applied wrenches. Finally, we argue that with the advent of data-driven methods as well as theemergence of a new generation of highly sensorized hands there are opportunities for the application of the traditional grasp modeling theory to fields such as robotic in-hand manipulation through model-free reinforcement learning. We present a method that applies traditional grasp models to maintain quasi-static stability throughout a nominally model-free reinforcement learning task. We suggest that such methods can potentially reduce the sample complexity of reinforcement learning for in-hand manipulation.We show that the number of these piecewise convex problems is quadratic in the number of contacts and develop a polynomial time algorithm for their enumeration. Thus, we present the first polynomial runtime algorithm for the determination of passive stability of planar grasps

Artificial Intelligence and Ambient Intelligence

This book includes a series of scientific papers published in the Special Issue on Artificial Intelligence and Ambient Intelligence at the journal Electronics MDPI. The book starts with an opinion paper on “Relations between Electronics, Artificial Intelligence and Information Society through Information Society Rules”, presenting relations between information society, electronics and artificial intelligence mainly through twenty-four IS laws. After that, the book continues with a series of technical papers that present applications of Artificial Intelligence and Ambient Intelligence in a variety of fields including affective computing, privacy and security in smart environments, and robotics. More specifically, the first part presents usage of Artificial Intelligence (AI) methods in combination with wearable devices (e.g., smartphones and wristbands) for recognizing human psychological states (e.g., emotions and cognitive load). The second part presents usage of AI methods in combination with laser sensors or Wi-Fi signals for improving security in smart buildings by identifying and counting the number of visitors. The last part presents usage of AI methods in robotics for improving robots’ ability for object gripping manipulation and perception. The language of the book is rather technical, thus the intended audience are scientists and researchers who have at least some basic knowledge in computer science