Nonprehensile Manipulation of Deformable Objects: Achievements and Perspectives from the RoDyMan Project

The goal of this work is to disseminate the results achieved so far within the RODYMAN project related to planning and control strategies for robotic nonprehensile manipulation. The project aims at advancing the state of the art of nonprehensile dynamic manipulation of rigid and deformable objects to future enhance the possibility of employing robots in anthropic environments. The final demonstrator of the RODYMAN project will be an autonomous pizza maker. This article is a milestone to highlight the lessons learned so far and pave the way towards future research directions and critical discussions

Nonprehensile Manipulation of Deformable Objects: Achievements and Perspectives from the RobDyMan Project

International audienceThe goal of this work is to disseminate the results achieved so far within the RODYMAN project related to planning and control strategies for robotic nonprehensile manipulation. The project aims at advancing the state of the art of nonprehensile dynamic manipulation of rigid and deformable objects to future enhance the possibility of employing robots in anthropic environments. The final demonstrator of the RODYMAN project will be an autonomous pizza maker. This article is a milestone to highlight the lessons learned so far and pave the way towards future research directions and critical discussions

Push to know! -- Visuo-Tactile based Active Object Parameter Inference with Dual Differentiable Filtering

For robotic systems to interact with objects in dynamic environments, it is essential to perceive the physical properties of the objects such as shape, friction coefficient, mass, center of mass, and inertia. This not only eases selecting manipulation action but also ensures the task is performed as desired. However, estimating the physical properties of especially novel objects is a challenging problem, using either vision or tactile sensing. In this work, we propose a novel framework to estimate key object parameters using non-prehensile manipulation using vision and tactile sensing. Our proposed active dual differentiable filtering (ADDF) approach as part of our framework learns the object-robot interaction during non-prehensile object push to infer the object's parameters. Our proposed method enables the robotic system to employ vision and tactile information to interactively explore a novel object via non-prehensile object push. The novel proposed N-step active formulation within the differentiable filtering facilitates efficient learning of the object-robot interaction model and during inference by selecting the next best exploratory push actions (where to push? and how to push?). We extensively evaluated our framework in simulation and real-robotic scenarios, yielding superior performance to the state-of-the-art baseline.Comment: 8 pages. Accepted at IROS 202

Dynamic Control of Multifingered Hands for Pivoting Operation

In this paper, we propose a dynamic control method of multi ngered hands for pivoting an object in contact with the environment. This pivoting operation is often observed when a human moves a large or heavy object such as furniture on the oor. Di erent from the conventional manipulation of the object by only ngers, the characteristics of the pivoting operation is that we can use the reaction force from the environment. By using this reaction force, we can expect the magnitude of the forces applied to the object by the ngers is smaller than the conventional manipulation of the object by only ngers. In this paper, taking this characteristics of the reaction force into consideration, we propose a dynamic control method for pivoting. To verify our approach, simulation results are also presented