Person Detection and Tracking Using Binocular Lucas-Kanade Feature Tracking and K-means Clustering

In this thesis, we present the design and implementation of a method for real-time person detection and tracking. Many current methods for detecting and tracking people rely on color contrast or movement to segment the image. Using color, however, requires the target and the background to be significantly different, and motion segmentation requires the target to be in constant motion relative to the background, often requiring stationary cameras. Pattern detection methods have also been applied to the problem of detecting pedestrians, but these approaches are slower and require stationary cameras to function. The method we present in this work does not require a color difference or constant motion to operate. We use Lucas-Kanade features to track feature points between left and right images, producing a sparse disparity map which is then segmented through the application of k-means clustering. We apply a Viola-Jones face detector to determine which, if any, of the resulting feature clusters represent a trackable person. This algorithm is tested using two identical standard cameras mounted on a mobile robot platform. Results are presented demonstrating detection and tracking of a person in several different situations, including partial occlusion and self-occlusion

Binocular Tracking Based on Virtual Horopters

This paper presents a stereo active vision system which performs tracking tasks on smoothly moving objects in complex backgrounds. Dynamic control of the vergence angle adapts the horopter geometry to the target position and allows to pick it up easily on the basis of stereoscopic disparity features. We introduce a novel vergence control strategy based on the computation of "virtual horopters" to track a target movement generating rapid changes of disparity. The control strategy is implemented on a binocular head, whose right and left pan angles are controlled independently. Experimental results of gaze holding on a smoothly moving target translating and rotating in a complex surrounding demonstrate the efficiency of the tracking system. 1 Introduction The importance of eye movement to biological visual systems is obvious. In contrast, controlled camera movement have played a small role in computer vision research, but are becoming increasingly recognized as important capabilities in ..