Extending Light Fields using Object Tracking Techniques

We present two new approaches to extending existing light fields with additional image data. In this case a light field is initially constructed from an image sequence taken by a hand-held camera, and pose parameters of this camera obtained through structure-from-motion approaches. To extend such a light field, point correspondences are necessary from one image in the original sequence to the new images to estimate their relative poses. The two introduced approaches assist in finding the original image closest to the new image, and provide initial motion estimates. A SIFT feature based method is used to determine the closest image and an imagespace motion homography. The second approach uses images rendered from the light field to estimate the camera pose of the image to be added using adaptive random search or a particle filter.