49 research outputs found
Adaptive Shape Servoing of Elastic Rods using Parameterized Regression Features and Auto-Tuning Motion Controls
In this paper, we present a new vision-based method to control the shape of
elastic rods with robot manipulators. Our new method computes parameterized
regression features from online sensor measurements that enable to
automatically quantify the object's configuration and establish an explicit
shape servo-loop. To automatically deform the rod into a desired shape, our
adaptive controller iteratively estimates the differential transformation
between the robot's motion and the relative shape changes; This valuable
capability allows to effectively manipulate objects with unknown mechanical
models. An auto-tuning algorithm is introduced to adjust the robot's shaping
motion in real-time based on optimal performance criteria. To validate the
proposed theory, we present a detailed numerical and experimental study with
vision-guided robotic manipulators.Comment: 13 pages, 22 figures, 2 table
Vision-based Manipulation of Deformable and Rigid Objects Using Subspace Projections of 2D Contours
This paper proposes a unified vision-based manipulation framework using image
contours of deformable/rigid objects. Instead of using human-defined cues, the
robot automatically learns the features from processed vision data. Our method
simultaneously generates---from the same data---both, visual features and the
interaction matrix that relates them to the robot control inputs. Extraction of
the feature vector and control commands is done online and adaptively, with
little data for initialization. The method allows the robot to manipulate an
object without knowing whether it is rigid or deformable. To validate our
approach, we conduct numerical simulations and experiments with both deformable
and rigid objects
FEM-based Deformation Control for Dexterous Manipulation of 3D Soft Objects
International audienceIn this paper, a method for dexterous manipulation of 3D soft objects for real-time deformation control is presented, relying on Finite Element modelling. The goal is to generate proper forces on the fingertips of an anthropomor-phic device during in-hand manipulation to produce desired displacements of selected control points on the object. The desired motions of the fingers are computed in real-time as an inverse solution of a Finite Element Method (FEM), the forces applied by the fingertips at the contact points being modelled by Lagrange multipliers. The elasticity parameters of the model are preliminarly estimated using a vision system and a force sensor. Experimental results are shown with an underactuated anthropomorphic hand that performs a manipulation task on a soft cylindrical object
A Depth-Based Algorithm for Manipulating Deformable Objects Using Smooth Parametric Surfaces and Energy Minimisation
International audienceIn this brief work, we present a new method for controlling deformations of soft objects by using parametric surfaces as a new type of deformation feedback features. This new approach allows us to actively deform objects into complex 3D shapes. A kinematic-based motion controller is derived using an energy minimisation strategy
Defo-Net: Learning Body Deformation using Generative Adversarial Networks
Modelling the physical properties of everyday objects is a fundamental
prerequisite for autonomous robots. We present a novel generative adversarial
network (Defo-Net), able to predict body deformations under external forces
from a single RGB-D image. The network is based on an invertible conditional
Generative Adversarial Network (IcGAN) and is trained on a collection of
different objects of interest generated by a physical finite element model
simulator. Defo-Net inherits the generalisation properties of GANs. This means
that the network is able to reconstruct the whole 3-D appearance of the object
given a single depth view of the object and to generalise to unseen object
configurations. Contrary to traditional finite element methods, our approach is
fast enough to be used in real-time applications. We apply the network to the
problem of safe and fast navigation of mobile robots carrying payloads over
different obstacles and floor materials. Experimental results in real scenarios
show how a robot equipped with an RGB-D camera can use the network to predict
terrain deformations under different payload configurations and use this to
avoid unsafe areas.Comment: In ICRA 201
Survey of Visual and Force/Tactile Control of Robots for Physical Interaction in Spain
Sensors provide robotic systems with the information required to perceive the changes that happen in unstructured environments and modify their actions accordingly. The robotic controllers which process and analyze this sensory information are usually based on three types of sensors (visual, force/torque and tactile) which identify the most widespread robotic control strategies: visual servoing control, force control and tactile control. This paper presents a detailed review on the sensor architectures, algorithmic techniques and applications which have been developed by Spanish researchers in order to implement these mono-sensor and multi-sensor controllers which combine several sensors
Model-Free 3D Shape Control of Deformable Objects Using Novel Features Based on Modal Analysis
Shape control of deformable objects is a challenging and important robotic
problem. This paper proposes a model-free controller using novel 3D global
deformation features based on modal analysis. Unlike most existing controllers
using geometric features, our controller employs a physically-based deformation
feature by decoupling 3D global deformation into low-frequency mode shapes.
Although modal analysis is widely adopted in computer vision and simulation, it
has not been used in robotic deformation control. We develop a new model-free
framework for modal-based deformation control under robot manipulation.
Physical interpretation of mode shapes enables us to formulate an analytical
deformation Jacobian matrix mapping the robot manipulation onto changes of the
modal features. In the Jacobian matrix, unknown geometry and physical
properties of the object are treated as low-dimensional modal parameters which
can be used to linearly parameterize the closed-loop system. Thus, an adaptive
controller with proven stability can be designed to deform the object while
online estimating the modal parameters. Simulations and experiments are
conducted using linear, planar, and solid objects under different settings. The
results not only confirm the superior performance of our controller but also
demonstrate its advantages over the baseline method.Comment: Accepted by the IEEE Transactions on Robotics. The paper will appear
in the IEEE Transactions on Robotics. IEEE copyrigh