Global Search with Bernoulli Alternation Kernel for Task-oriented Grasping Informed by Simulation

We develop an approach that benefits from large simulated datasets and takes full advantage of the limited online data that is most relevant. We propose a variant of Bayesian optimization that alternates between using informed and uninformed kernels. With this Bernoulli Alternation Kernel we ensure that discrepancies between simulation and reality do not hinder adapting robot control policies online. The proposed approach is applied to a challenging real-world problem of task-oriented grasping with novel objects. Our further contribution is a neural network architecture and training pipeline that use experience from grasping objects in simulation to learn grasp stability scores. We learn task scores from a labeled dataset with a convolutional network, which is used to construct an informed kernel for our variant of Bayesian optimization. Experiments on an ABB Yumi robot with real sensor data demonstrate success of our approach, despite the challenge of fulfilling task requirements and high uncertainty over physical properties of objects.Comment: To appear in 2nd Conference on Robot Learning (CoRL) 201

A stiffness-based quality measure for compliant grasps and fixtures

This paper presents a systematic approach to quantifying the effectiveness of compliant grasps and fixtures of an object. The approach is physically motivated and applies to the grasping of two- and three-dimensional objects by any number of fingers. The approach is based on a characterization of the frame-invariant features of a grasp or fixture stiffness matrix. In particular, we define a set of frame-invariant characteristic stiffness parameters, and provide physical and geometric interpretation for these parameters. Using a physically meaningful scheme to make the rotational and translational stiffness parameters comparable, we define a frame-invariant quality measure, which we call the stiffness quality measure. An example of a frictional grasp illustrates the effectiveness of the quality measure. We then consider the optimal grasping of frictionless polygonal objects by three and four fingers. Such frictionless grasps are useful in high-load fixturing applications, and their relative simplicity allows an efficient computation of the globally optimal finger arrangement. We compute the optimal finger arrangement in several examples, and use these examples to discuss properties that characterize the stiffness quality measure

REBA: A Refinement-Based Architecture for Knowledge Representation and Reasoning in Robotics

This paper describes an architecture for robots that combines the complementary strengths of probabilistic graphical models and declarative programming to represent and reason with logic-based and probabilistic descriptions of uncertainty and domain knowledge. An action language is extended to support non-boolean fluents and non-deterministic causal laws. This action language is used to describe tightly-coupled transition diagrams at two levels of granularity, with a fine-resolution transition diagram defined as a refinement of a coarse-resolution transition diagram of the domain. The coarse-resolution system description, and a history that includes (prioritized) defaults, are translated into an Answer Set Prolog (ASP) program. For any given goal, inference in the ASP program provides a plan of abstract actions. To implement each such abstract action, the robot automatically zooms to the part of the fine-resolution transition diagram relevant to this action. A probabilistic representation of the uncertainty in sensing and actuation is then included in this zoomed fine-resolution system description, and used to construct a partially observable Markov decision process (POMDP). The policy obtained by solving the POMDP is invoked repeatedly to implement the abstract action as a sequence of concrete actions, with the corresponding observations being recorded in the coarse-resolution history and used for subsequent reasoning. The architecture is evaluated in simulation and on a mobile robot moving objects in an indoor domain, to show that it supports reasoning with violation of defaults, noisy observations and unreliable actions, in complex domains.Comment: 72 pages, 14 figure

Mobility of bodies in contact. II. How forces are generated bycurvature effects

For part I, see ibid., p.696-708. The paper considers how forces are produced by compliance and surface curvature effects in systems where an object a is kinematically immobilized to second-order by finger bodies Al,...,Ak. A class of configuration-space based elastic deformation models is introduced. Using these elastic deformation models, it is shown that any object which is kinematically immobilized to first or second-order is also dynamically locally asymptotically stable with respect to perturbations. Moreover, it is shown that for preloaded grasps kinematic immobility implies that the stiffness matrix of the grasp is positive definite. The stability result provides physical justification for using second-order effects for purposes of immobilization in practical applications. Simulations illustrate the concepts

Unscented Bayesian Optimization for Safe Robot Grasping

We address the robot grasp optimization problem of unknown objects considering uncertainty in the input space. Grasping unknown objects can be achieved by using a trial and error exploration strategy. Bayesian optimization is a sample efficient optimization algorithm that is especially suitable for this setups as it actively reduces the number of trials for learning about the function to optimize. In fact, this active object exploration is the same strategy that infants do to learn optimal grasps. One problem that arises while learning grasping policies is that some configurations of grasp parameters may be very sensitive to error in the relative pose between the object and robot end-effector. We call these configurations unsafe because small errors during grasp execution may turn good grasps into bad grasps. Therefore, to reduce the risk of grasp failure, grasps should be planned in safe areas. We propose a new algorithm, Unscented Bayesian optimization that is able to perform sample efficient optimization while taking into consideration input noise to find safe optima. The contribution of Unscented Bayesian optimization is twofold as if provides a new decision process that drives exploration to safe regions and a new selection procedure that chooses the optimal in terms of its safety without extra analysis or computational cost. Both contributions are rooted on the strong theory behind the unscented transformation, a popular nonlinear approximation method. We show its advantages with respect to the classical Bayesian optimization both in synthetic problems and in realistic robot grasp simulations. The results highlights that our method achieves optimal and robust grasping policies after few trials while the selected grasps remain in safe regions.Comment: conference pape