Analysis of Shapes to Measure Surfaces: An Approach for Detection of Deformations

This paper presents a method to analyse 3D planar surfaces and to measure variations on it. The method is oriented to the detection of deformations on the elastic object surfaces formed by flat faces. These deformations are usually caused when two bodies, a solid and another elastic object, come in contact and there are contact pressures among their faces. Our method describes a strategy to model the shape of deformation using a mathematical approach based on two concepts: Histogram and Map of curvature. In particular, we describe the algorithm for deformations in order to use it in visual control and inspection tasks for manipulation processes with robot hands. Several experiments and their results are shown to evaluate the validity and robustness of the method to detect and measure deformations in grasping tasks. To do it, some virtual scenarios were created to simulate contacts with fingers of a hand robot.The research leading to these results has received funding from the Spanish Government and European FEDER funds (DPI2012-32390) and the Valencia Regional Government (PROMETEO/2013/085)

Model-free vision-based shaping of deformable plastic materials

We address the problem of shaping deformable plastic materials using non-prehensile actions. Shaping plastic objects is challenging, since they are difficult to model and to track visually. We study this problem, by using kinetic sand, a plastic toy material which mimics the physical properties of wet sand. Inspired by a pilot study where humans shape kinetic sand, we define two types of actions: \textit{pushing} the material from the sides and \textit{tapping} from above. The chosen actions are executed with a robotic arm using image-based visual servoing. From the current and desired view of the material, we define states based on visual features such as the outer contour shape and the pixel luminosity values. These are mapped to actions, which are repeated iteratively to reduce the image error until convergence is reached. For pushing, we propose three methods for mapping the visual state to an action. These include heuristic methods and a neural network, trained from human actions. We show that it is possible to obtain simple shapes with the kinetic sand, without explicitly modeling the material. Our approach is limited in the types of shapes it can achieve. A richer set of action types and multi-step reasoning is needed to achieve more sophisticated shapes.Comment: Accepted to The International Journal of Robotics Research (IJRR