220 research outputs found
Deep Learning Approaches to Grasp Synthesis: A Review
Grasping is the process of picking up an object by applying forces and torques at a set of contacts. Recent advances in deep learning methods have allowed rapid progress in robotic object grasping. In this systematic review, we surveyed the publications over the last decade, with a particular interest in grasping an object using all six degrees of freedom of the end-effector pose. Our review found four common methodologies for robotic grasping: sampling-based approaches, direct regression, reinforcement learning, and exemplar approaches In addition, we found two “supporting methods” around grasping that use deep learning to support the grasping process, shape approximation, and affordances. We have distilled the publications found in this systematic review (85 papers) into ten key takeaways we consider crucial for future robotic grasping and manipulation research
Performance of modified jatropha oil in combination with hexagonal boron nitride particles as a bio-based lubricant for green machining
This study evaluates the machining performance of newly developed modified jatropha oils (MJO1, MJO3 and MJO5), both with and without hexagonal boron nitride (hBN) particles (ranging between 0.05 and 0.5 wt%) during turning of AISI 1045 using minimum quantity lubrication (MQL). The experimental results indicated that, viscosity improved with the increase in MJOs molar ratio and hBN concentration. Excellent tribological behaviours is found to correlated with a better machining performance were achieved by MJO5a with 0.05 wt%. The MJO5a sample showed the lowest values of cutting force, cutting temperature and surface roughness, with a prolonged tool life and less tool wear, qualifying itself to be a potential alternative to the synthetic ester, with regard to the environmental concern
Grasp Stability Prediction for a Dexterous Robotic Hand Combining Depth Vision and Haptic Bayesian Exploration.
Grasp stability prediction of unknown objects is crucial to enable autonomous robotic manipulation in an unstructured environment. Even if prior information about the object is available, real-time local exploration might be necessary to mitigate object modelling inaccuracies. This paper presents an approach to predict safe grasps of unknown objects using depth vision and a dexterous robot hand equipped with tactile feedback. Our approach does not assume any prior knowledge about the objects. First, an object pose estimation is obtained from RGB-D sensing; then, the object is explored haptically to maximise a given grasp metric. We compare two probabilistic methods (i.e. standard and unscented Bayesian Optimisation) against random exploration (i.e. uniform grid search). Our experimental results demonstrate that these probabilistic methods can provide confident predictions after a limited number of exploratory observations, and that unscented Bayesian Optimisation can find safer grasps, taking into account the uncertainty in robot sensing and grasp execution
DMFC-GraspNet: Differentiable Multi-Fingered Robotic Grasp Generation in Cluttered Scenes
Robotic grasping is a fundamental skill required for object manipulation in
robotics. Multi-fingered robotic hands, which mimic the structure of the human
hand, can potentially perform complex object manipulation. Nevertheless,
current techniques for multi-fingered robotic grasping frequently predict only
a single grasp for each inference time, limiting computational efficiency and
their versatility, i.e. unimodal grasp distribution. This paper proposes a
differentiable multi-fingered grasp generation network (DMFC-GraspNet) with
three main contributions to address this challenge. Firstly, a novel neural
grasp planner is proposed, which predicts a new grasp representation to enable
versatile and dense grasp predictions. Secondly, a scene creation and label
mapping method is developed for dense labeling of multi-fingered robotic hands,
which allows a dense association of ground truth grasps. Thirdly, we propose to
train DMFC-GraspNet end-to-end using using a forward-backward automatic
differentiation approach with both a supervised loss and a differentiable
collision loss and a generalized Q 1 grasp metric loss. The proposed approach
is evaluated using the Shadow Dexterous Hand on Mujoco simulation and ablated
by different choices of loss functions. The results demonstrate the
effectiveness of the proposed approach in predicting versatile and dense
grasps, and in advancing the field of multi-fingered robotic grasping.Comment: Submitted IROS 2023 workshop "Policy Learning in Geometric Spaces
Data-Driven Grasp Synthesis - A Survey
We review the work on data-driven grasp synthesis and the methodologies for
sampling and ranking candidate grasps. We divide the approaches into three
groups based on whether they synthesize grasps for known, familiar or unknown
objects. This structure allows us to identify common object representations and
perceptual processes that facilitate the employed data-driven grasp synthesis
technique. In the case of known objects, we concentrate on the approaches that
are based on object recognition and pose estimation. In the case of familiar
objects, the techniques use some form of a similarity matching to a set of
previously encountered objects. Finally for the approaches dealing with unknown
objects, the core part is the extraction of specific features that are
indicative of good grasps. Our survey provides an overview of the different
methodologies and discusses open problems in the area of robot grasping. We
also draw a parallel to the classical approaches that rely on analytic
formulations.Comment: 20 pages, 30 Figures, submitted to IEEE Transactions on Robotic
Towards Developing Gripper to obtain Dexterous Manipulation
Artificial hands or grippers are essential elements in many robotic systems, such as, humanoid,
industry, social robot, space robot, mobile robot, surgery and so on. As humans, we use
our hands in different ways and can perform various maneuvers such as writing, altering
posture of an object in-hand without having difficulties. Most of our daily activities are
dependent on the prehensile and non-prehensile capabilities of our hand. Therefore, the
human hand is the central motivation of grasping and manipulation, and has been explicitly
studied from many perspectives such as, from the design of complex actuation, synergy, use
of soft material, sensors, etc; however to obtain the adaptability to a plurality of objects along
with the capabilities of in-hand manipulation of our hand in a grasping device is not easy,
and not fully evaluated by any developed gripper.
Industrial researchers primarily use rigid materials and heavy actuators in the design for
repeatability, reliability to meet dexterity, precision, time requirements where the required
flexibility to manipulate object in-hand is typically absent. On the other hand, anthropomorphic
hands are generally developed by soft materials. However they are not deployed
for manipulation mainly due to the presence of numerous sensors and consequent control
complexity of under-actuated mechanisms that significantly reduce speed and time requirements
of industrial demand. Hence, developing artificial hands or grippers with prehensile
capabilities and dexterity similar to human like hands is challenging, and it urges combined
contributions from multiple disciplines such as, kinematics, dynamics, control, machine
learning and so on. Therefore, capabilities of artificial hands in general have been constrained
to some specific tasks according to their target applications, such as grasping (in biomimetic
hands) or speed/precision in a pick and place (in industrial grippers).
Robotic grippers developed during last decades are mostly aimed to solve grasping
complexities of several objects as their primary objective. However, due to the increasing
demands of industries, many issues are rising and remain unsolved such as in-hand manipulation
and placing object with appropriate posture. Operations like twisting, altering
orientation of object within-hand, require significant dexterity of the gripper that must be
achieved from a compact mechanical design at the first place. Along with manipulation,
speed is also required in many robotic applications. Therefore, for the available speed and
design simplicity, nonprehensile or dynamic manipulation is widely exploited. The nonprehensile
approach however, does not focus on stable grasping in general. Also, nonprehensile
or dynamic manipulation often exceeds robot\u2019s kinematic workspace, which additionally
urges installation of high speed feedback and robust control. Hence, these approaches are
inapplicable especially when, the requirements are grasp oriented such as, precise posture
change of a payload in-hand, placing payload afterward according to a strict final configuration.
Also, addressing critical payload such as egg, contacts (between gripper and egg)
cannot be broken completely during manipulation. Moreover, theoretical analysis, such as
contact kinematics, grasp stability cannot predict the nonholonomic behaviors, and therefore,
uncertainties are always present to restrict a maneuver, even though the gripper is capable of
doing the task.
From a technical point of view, in-hand manipulation or within-hand dexterity of a gripper
significantly isolates grasping and manipulation skills from the dependencies on contact type,
a priory knowledge of object model, configurations such as initial or final postures and also
additional environmental constraints like disturbance, that may causes breaking of contacts
between object and finger. Hence, the property (in-hand manipulation) is important for a
gripper in order to obtain human hand skill.
In this research, these problems (to obtain speed, flexibility to a plurality of grasps,
within-hand dexterity in a single gripper) have been tackled in a novel way. A gripper
platform named Dexclar (DEXterous reConfigurable moduLAR) has been developed in order
to study in-hand manipulation, and a generic spherical payload has been considered at the
first place. Dexclar is mechanism-centric and it exploits modularity and reconfigurability to
the aim of achieving within-hand dexterity rather than utilizing soft materials. And hence,
precision, speed are also achievable from the platform. The platform can perform several
grasps (pinching, form closure, force closure) and address a very important issue of releasing
payload with final posture/ configuration after manipulation. By exploiting 16 degrees of
freedom (DoF), Dexclar is capable to provide 6 DoF motions to a generic spherical or
ellipsoidal payload. And since a mechanism is reliable, repeatable once it has been properly
synthesized, precision and speed are also obtainable from them. Hence Dexclar is an ideal
starting point to study within-hand dexterity from kinematic point of view.
As the final aim is to develop specific grippers (having the above capabilities) by exploiting
Dexclar, a highly dexterous but simply constructed reconfigurable platform named
VARO-fi (VARiable Orientable fingers with translation) is proposed, which can be used as
an industrial end-effector, as well as an alternative of bio-inspired gripper in many robotic
applications. The robust four fingered VARO-fi addresses grasp, in-hand manipulation and
release (payload with desired configuration) of plurality of payloads, as demonstrated in this
thesis.
Last but not the least, several tools and end-effectors have been constructed to study
prehensile and non-prehensile manipulation, thanks to Bayer Robotic challenge 2017, where
the feasibility and their potentiality to use them in an industrial environment have been
validated.
The above mentioned research will enhance a new dimension for designing grippers
with the properties of dexterity and flexibility at the same time, without explicit theoretical
analysis, algorithms, as those are difficult to implement and sometime not feasible for real
system
- …