Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications

Three-dimensional television (3D-TV) has gained increasing popularity in the broadcasting domain, as it enables enhanced viewing experiences in comparison to conventional two-dimensional (2D) TV. However, its application has been constrained due to the lack of essential contents, i.e., stereoscopic videos. To alleviate such content shortage, an economical and practical solution is to reuse the huge media resources that are available in monoscopic 2D and convert them to stereoscopic 3D. Although stereoscopic video can be generated from monoscopic sequences using depth measurements extracted from cues like focus blur, motion and size, the quality of the resulting video may be poor as such measurements are usually arbitrarily defined and appear inconsistent with the real scenes. To help solve this problem, a novel method for object-based stereoscopic video generation is proposed which features i) optical-flow based occlusion reasoning in determining depth ordinal, ii) object segmentation using improved region-growing from masks of determined depth layers, and iii) a hybrid depth estimation scheme using content-based matching (inside a small library of true stereo image pairs) and depth-ordinal based regularization. Comprehensive experiments have validated the effectiveness of our proposed 2D-to-3D conversion method in generating stereoscopic videos of consistent depth measurements for 3D-TV applications

Absolute height measurement of specular surfaces with modified active fringe reflection photogrammetry

Deflectometric methods have existed for more than a decade for slope measurement of specular freeform surfaces through utilization of the deformation of a sample pattern after reflection from a test surface. Usually, these approaches require two-directional fringe patterns to be projected on a LCD screen or ground glass and require slope integration, which leads to some complexity for the whole measuring process. This paper proposes a new mathematical measurement model for measuring topography information of freeform specular surfaces, which integrates a virtual reference specular surface into the method of active fringe reflection delfectometry and presents a straight-forward relation between height and phase. This method only requires one direction of horizontal or vertical sinusoidal fringe patterns to be projected on a LCD screen, resulting in a significant reduction in capture time over established method. Assuming the whole system has been pre-calibrated, during the measurement process, the fringe patterns are captured separately via the virtual reference and detected freeform surfaces by a CCD camera. The reference phase can be solved according to spatial geometrical relation between LCD screen and CCD camera. The captured phases can be unwrapped with a heterodyne technique and optimum frequency selection method. Based on this calculated unwrapped-phase and that proposed mathematical model, absolute height of the inspected surface can be computed. Simulated and experimental results show that this methodology can conveniently calculate topography information for freeform and structured specular surfaces without integration and reconstruction processes