Dexterous Manipulation Graphs

We propose the Dexterous Manipulation Graph as a tool to address in-hand manipulation and reposition an object inside a robot's end-effector. This graph is used to plan a sequence of manipulation primitives so to bring the object to the desired end pose. This sequence of primitives is translated into motions of the robot to move the object held by the end-effector. We use a dual arm robot with parallel grippers to test our method on a real system and show successful planning and execution of in-hand manipulation

Innovative robot hand designs of reduced complexity for dexterous manipulation

This thesis investigates the mechanical design of robot hands to sensibly reduce the system complexity in terms of the number of actuators and sensors, and control needs for performing grasping and in-hand manipulations of unknown objects. Human hands are known to be the most complex, versatile, dexterous manipulators in nature, from being able to operate sophisticated surgery to carry out a wide variety of daily activity tasks (e.g. preparing food, changing cloths, playing instruments, to name some). However, the understanding of why human hands can perform such fascinating tasks still eludes complete comprehension. Since at least the end of the sixteenth century, scientists and engineers have tried to match the sensory and motor functions of the human hand. As a result, many contemporary humanoid and anthropomorphic robot hands have been developed to closely replicate the appearance and dexterity of human hands, in many cases using sophisticated designs that integrate multiple sensors and actuators---which make them prone to error and difficult to operate and control, particularly under uncertainty. In recent years, several simplification approaches and solutions have been proposed to develop more effective and reliable dexterous robot hands. These techniques, which have been based on using underactuated mechanical designs, kinematic synergies, or compliant materials, to name some, have opened up new ways to integrate hardware enhancements to facilitate grasping and dexterous manipulation control and improve reliability and robustness. Following this line of thought, this thesis studies four robot hand hardware aspects for enhancing grasping and manipulation, with a particular focus on dexterous in-hand manipulation. Namely: i) the use of passive soft fingertips; ii) the use of rigid and soft active surfaces in robot fingers; iii) the use of robot hand topologies to create particular in-hand manipulation trajectories; and iv) the decoupling of grasping and in-hand manipulation by introducing a reconfigurable palm. In summary, the findings from this thesis provide important notions for understanding the significance of mechanical and hardware elements in the performance and control of human manipulation. These findings show great potential in developing robust, easily programmable, and economically viable robot hands capable of performing dexterous manipulations under uncertainty, while exhibiting a valuable subset of functions of the human hand.Open Acces

Effect of game activities on manual dexterity in older adults

The purpose of this study was to examine the effects of game activities on manual dexterity performance iri older adults. Seventeen participants (mean age 84.3 years) from local assisted- and independent-living retirement communities were randomly assigned to an experimental or control group. Experimental group participants played selected game activities three days per week for an average of 34.6 minutes per game for a six-week period. Both control and experimental group participants completed the Purdue Pegboard as a pre- and post-test assessment of manual dexterity performance. A 2 X 2 repeated measures mixed ANOVA conducted for each subtest of the Purdue Pegboard revealed no significant differences (p \u3e .05) between experimental and control groups when considering right hand function, both hands function, combined hand function, and assembly function tasks. However, the control group demonstrated significantly greater left hand function at pre- and post-test. It was concluded that a six-week intervention of game activities did not significantly improve manual dexterity performance in assisted- and independent-living older adults

Improved GelSight Tactile Sensor for Measuring Geometry and Slip

A GelSight sensor uses an elastomeric slab covered with a reflective membrane to measure tactile signals. It measures the 3D geometry and contact force information with high spacial resolution, and successfully helped many challenging robot tasks. A previous sensor, based on a semi-specular membrane, produces high resolution but with limited geometry accuracy. In this paper, we describe a new design of GelSight for robot gripper, using a Lambertian membrane and new illumination system, which gives greatly improved geometric accuracy while retaining the compact size. We demonstrate its use in measuring surface normals and reconstructing height maps using photometric stereo. We also use it for the task of slip detection, using a combination of information about relative motions on the membrane surface and the shear distortions. Using a robotic arm and a set of 37 everyday objects with varied properties, we find that the sensor can detect translational and rotational slip in general cases, and can be used to improve the stability of the grasp.Comment: IEEE/RSJ International Conference on Intelligent Robots and System

Learning Haptic-based Object Pose Estimation for In-hand Manipulation Control with Underactuated Robotic Hands

Unlike traditional robotic hands, underactuated compliant hands are challenging to model due to inherent uncertainties. Consequently, pose estimation of a grasped object is usually performed based on visual perception. However, visual perception of the hand and object can be limited in occluded or partly-occluded environments. In this paper, we aim to explore the use of haptics, i.e., kinesthetic and tactile sensing, for pose estimation and in-hand manipulation with underactuated hands. Such haptic approach would mitigate occluded environments where line-of-sight is not always available. We put an emphasis on identifying the feature state representation of the system that does not include vision and can be obtained with simple and low-cost hardware. For tactile sensing, therefore, we propose a low-cost and flexible sensor that is mostly 3D printed along with the finger-tip and can provide implicit contact information. Taking a two-finger underactuated hand as a test-case, we analyze the contribution of kinesthetic and tactile features along with various regression models to the accuracy of the predictions. Furthermore, we propose a Model Predictive Control (MPC) approach which utilizes the pose estimation to manipulate objects to desired states solely based on haptics. We have conducted a series of experiments that validate the ability to estimate poses of various objects with different geometry, stiffness and texture, and show manipulation to goals in the workspace with relatively high accuracy

The GR2 gripper: an underactuated hand for open-loop in-hand planar manipulation

Performing dexterous manipulation of unknown objects with robot grippers without using high-fidelity contact sensors, active/sliding surfaces, or a priori workspace exploration is still an open problem in robot manipulation and a necessity for many robotics applications. In this paper, we present a two-fingered gripper topology that enables an enhanced predefined in-hand manipulation primitive controlled without knowing the size, shape, or other particularities of the grasped object. The in-hand manipulation behavior, namely, the planar manipulation of the grasped body, is predefined thanks to a simple hybrid low-level control scheme and has an increased range of motion due to the introduction of an elastic pivot joint between the two fingers. Experimental results with a prototype clearly show the advantages and benefits of the proposed concept. Given the generality of the topology and in-hand manipulation principle, researchers and designers working on multiple areas of robotics can benefit from the findings

Optical Proximity Sensing for Pose Estimation During In-Hand Manipulation

During in-hand manipulation, robots must be able to continuously estimate the pose of the object in order to generate appropriate control actions. The performance of algorithms for pose estimation hinges on the robot's sensors being able to detect discriminative geometric object features, but previous sensing modalities are unable to make such measurements robustly. The robot's fingers can occlude the view of environment- or robot-mounted image sensors, and tactile sensors can only measure at the local areas of contact. Motivated by fingertip-embedded proximity sensors' robustness to occlusion and ability to measure beyond the local areas of contact, we present the first evaluation of proximity sensor based pose estimation for in-hand manipulation. We develop a novel two-fingered hand with fingertip-embedded optical time-of-flight proximity sensors as a testbed for pose estimation during planar in-hand manipulation. Here, the in-hand manipulation task consists of the robot moving a cylindrical object from one end of its workspace to the other. We demonstrate, with statistical significance, that proximity-sensor based pose estimation via particle filtering during in-hand manipulation: a) exhibits 50% lower average pose error than a tactile-sensor based baseline; b) empowers a model predictive controller to achieve 30% lower final positioning error compared to when using tactile-sensor based pose estimates.Comment: 8 pages, 6 figure

Automated Configuration of Gripper Fingers from a Construction Kit for Robotic Applications

Gripper finger design is a complex process that requires a lot of experience, time, and effort. For this reason, automating this design process is an important area of research that has the potential to improve the efficiency and effectiveness of robotic systems. The current approaches are aimed at the automated design of monolithic gripper fingers, which have to be manufactured additively or by machining. This paper describes a novel approach for the automated design of gripper fingers. The motivation for this work stems from the increasing demand for flexible, adaptable handling systems in various industries in response to the increasing individualization of products as well as the increasing volatility in the markets. Based on the CAD data of the handling objects, the most suitable configuration of gripper fingers can be determined from the existing modules of a construction kit for the respective handling object, which can significantly reduce the provisioning time for new gripper fingers. It can be shown that gripper fingers can be effectively configured for a variety of objects and two different grippers, increasing flexibility in industrial handling processes