Mosaics from arbitrary stereo video sequences

lthough mosaics are well established as a compact and non-redundant representation of image sequences, their application still suffers from restrictions of the camera motion or has to deal with parallax errors. We present an approach that allows construction of mosaics from arbitrary motion of a head-mounted camera pair. As there are no parallax errors when creating mosaics from planar objects, our approach first decomposes the scene into planar sub-scenes from stereo vision and creates a mosaic for each plane individually. The power of the presented mosaicing technique is evaluated in an office scenario, including the analysis of the parallax error

1D-mosaics grouping using lattice vector quantization for a video browsing application

International audience1D-mosaics have been introduced as a tool for structuring and navigation in video content. These objects can be con- sidered as the spatio-temporal signatures of the video shots. Our work aims at grouping automatically the video shots into scenes using these signatures. The original method is based on the tree-structured lattice vector quantization of the 1D-mosaics. Because of the hierarchical structure of the code-books, they can be compared progressively, and lattice use is time efficient. Indexing retrieval results are given for two video sequences, and different mosaics are successively compared to each other in order to assess the presented scheme's effectiveness

Enhancement of Underwater Video Mosaics for Post-Processing

Mosaics of seafloor created from still images or video acquired underwater have proved to be useful for construction of maps of forensic and archeological sites, species\u27 abundance estimates, habitat characterization, etc. Images taken by a camera mounted on a stable platform are registered (at first pair-wise and then globally) and assembled in a high resolution visual map of the surveyed area. While this map is usually sufficient for a human orientation and even quantitative measurements, it often contains artifacts that complicate an automatic post-processing (for example, extraction of shapes for organism counting, or segmentation for habitat characterization). The most prominent artifacts are inter-frame seams caused by inhomogeneous artificial illumination, and local feature misalignments due to parallax effects - result of an attempt to represent a 3D world on a 2D map. In this paper we propose two image processing techniques for mosaic quality enhancement - median mosaic-based illumination correction suppressing appearance of inter-frame seams, and micro warping decreasing influence of parallax effects

Status of availability of Mariner 9 (1971-051A) TV picture data

The Mariner 9 TV data that are now available from the National Space Science Data Center are described. Included are the mission test video system pictures, image processing laboratory/reduced data records, mosaics, and journal articles

Sensor-Assisted Video Mosaicing for Seafloor Mapping

This paper discusses a proposed processing technique for combining video imagery with auxiliary sensor information. The latter greatly simplifies image processing by reducing complexity of the transformation model. The mosaics produced by this technique are adequate for many applications, in particular habitat mapping. The algorithm is demonstrated through simulations and hardware configuration is described

Dynamic 3D Urban Scene Modeling Using Multiple Pushbroom Mosaics

In this paper, a unified, segmentation-based approach is proposed to deal with both stereo reconstruction and moving objects detection problems using multiple stereo mosaics. Each set of parallel-perspective (pushbroom) stereo mosaics is generated from a video sequence captured by a single video camera. First a colorsegmentation approach is used to extract the so-called natural matching primitives from a reference view of a pair of stereo mosaics to facilitate both 3D reconstruction of textureless urban scenes and man-made moving targets (e.g. vehicles). Multiple pairs of stereo mosaics are used to improve the accuracy and robustness in 3D recovery and occlusion handling. Moving targets are detected by inspecting their 3D anomalies, either violating the epipolar geometry of the pushbroom stereo or exhibiting abnormal 3D structure. Experimental results on both simulated and real video sequences are provided to show the effectiveness of our approach. 1

Sensor-assisted Video Mapping of the Seafloor

In recent years video surveys have become an increasingly important ground-truthing of acousticseafloor characterization and benthic habitat mapping studies. However, the ground-truthing and detailed characterization provided by video are still typically done using sparse sample imagery supplemented by physical samples. Combining single video frames in a seamless mosaic can provide a tool by which imagery has significant areal coverage, while at the same time showing small fauna and biological features at mm resolution. The generation of such a mosaic is a challenging task due to height variations of the imaged terrain and decimeter scale knowledge of camera position. This paper discusses the current role of underwater video survey, and the potential for generating consistent, quantitative image maps using video data, accompanied by data that can be measured by auxiliary sensors with sufficient accuracy, such as camera tilt and heading, and their use in automated mosaicking techniques. The camera attitude data also provide the necessary information to support the development of a video collage. The collage provides a quick look at the large spatial scale features in a scene and can be used to pinpoint regions that are likely to yield useful information when rendered into high-resolution mosaics. It is proposed that high quality mosaics can be produced using consumer-grade cameras and low-cost sensors, thereby allowing for the economical scientific video surveys. A case study is presented with the results from benthic habitat mapping and the ground-truthing ofseafloor acoustic data using both real underwater imagery and simulations. A computer modeling of the process of video data acquisition (in particular on a non-flat terrain) allows for a better understanding of the main sources of error in mosaic generation and for the choice of near-optimal processing strategies. Various spatial patterns of video survey coverage are compared and it is shown that some patterns have certain advantages in the sense of accumulated error and overall mosaic accuracy

Improvement of Image Alignment Using Camera Attitude Information

We discuss a proposed technique for incorporation of information from a variety of sensors in a video imagery processing pipeline. The auxiliary information allows one to simplify computations, effectively reducing the number of independent parameters in the transformation model. The mosaics produced by this technique are adequate for many applications, in particular habitat mapping. The algorithm, demonstrated through simulations and hardware configuration, is described in detai

Estimating the best reference homography for planar mosaics from videos

This paper proposes a novel strategy to find the best reference homography in mosaics from video sequences. The reference homography globally minimizes the distortions induced on each image frame by the mosaic homography itself. This method is designed for planar mosaics on which a bad choice of the first reference image frame can lead to severe distortions after concatenating several successive homographies. This often happens in the case of underwater mosaics with non-flat seabed and no georeferential information available. Given a video sequence of an almost planar surface, sub-mosaics with low distortions of temporally close image frames are computed and successively merged according to a hierarchical clustering procedure. A robust and effective feature tracker using an approximated global position map between image frames allows us to build the mosaic also between locally close but not temporally consecutive frames. Sub-mosaics are successively merged by concatenating their relative homographies with another reference homography which minimizes the distortion on each frame of the fused image. Experimental results on challenging real underwater videos show the validity of the proposed method