What Metric Stereo Can Do for Visual Servoing

This paper describes a number of geometric tools that can be easily implemented in order to obtain a very robust visual servoing platform. Most often, visual servoing algorithms are either based on calibrated systems or dispose of enough information to selfcalibrate (the most noteworthy exception being [15]). We show that this abundance of information can be exploited in the case of stereo servoing as to offer a solution for some problems related to signal loss such as temporary occlusions, specularities or cad tracking difficulties. The presented servoing algorithm can cope with large image perturbations and is able to control a robot through a non modeled set of reference points. 1 Introduction Visual servoing is the technique of using 2d visual data, coming from one or more cameras observing, to control a robot and guide it to a goal position. Most visual servoing approaches [3, 10, 7, 12], exception made of [15], are based on the computation of a kinematic screw that is then app..