Stereo Computation for a Single Mixture Image

This paper proposes an original problem of \emph{stereo computation from a single mixture image}-- a challenging problem that had not been researched before. The goal is to separate (\ie, unmix) a single mixture image into two constitute image layers, such that the two layers form a left-right stereo image pair, from which a valid disparity map can be recovered. This is a severely illposed problem, from one input image one effectively aims to recover three (\ie, left image, right image and a disparity map). In this work we give a novel deep-learning based solution, by jointly solving the two subtasks of image layer separation as well as stereo matching. Training our deep net is a simple task, as it does not need to have disparity maps. Extensive experiments demonstrate the efficacy of our method.Comment: Accepted by European Conference on Computer Vision (ECCV) 201

Depth Map Estimation and Colorization of Anaglyph Images Using Local Color Prior and Reverse Intensity Distribution

In this paper, we present a joint iterative anaglyph stereo matching and colorization framework for obtaining a set of disparity maps and colorized images. Conventional stereo matching algorithms fail when addressing anaglyph images that do not have similar intensities on their two respective view images. To resolve this problem, we propose two novel data costs using local color prior and reverse intensity distribution factor for obtaining accurate depth maps. To colorize an anaglyph image, each pixel in one view is warped to another view using the obtained disparity values of non-occluded regions. A colorization algorithm using optimization is then employed with additional constraint to colorize the remaining occluded regions. Experimental results confirm that the proposed unified framework is robust and produces accurate depth maps and colorized stereo images.National Research Foundation of Korea (Basic Science Research Program (Ministry of Education, NRF-2012R1A1A2009495))National Research Foundation of Korea (Korea government (MSIP), grant No. NRF-2013R1A2A2A01069181

Подготовка стереоизображений для детских изданий

В статті розкриваються питання щодо використання стереозображень у дитячих виданнях. Особливістю роботи є висвітлення анагліфного способу створення 3D зображень. Запропоновано спосіб підготовки зображень стереопари у Adobe Photoshop та подальшого їх використання для створення псевдо стереозображень.The article describes the issues related to the use of stereo images in children’s magazines. Feature of the work is to highlight ways to create 3D anaglyph images. We propose an approach for generating synthetic anaglyphs – images with volume effect, created from a planar original image. A method of preparing a stereo pair of images based on the separation of the image into layers. Image elements are divided into groups according to the distance from the viewer. Each element group is located in a separate layer and each layer is applied to an offset from the central axis. The sign and value of the offset is variable and dependent on the position of the element relative to the viewer. Practical implementation of the method demonstrated its high efficiency for the drawing originals, which often illustrate children’s books. On these originals complex textures and objects with small details that can complicate the application of the proposed method are rare. The result is a natural volume effect, and color distortions are minimized.В статье раскрываются вопросы, касающиеся использования стереоизображений в детских изданиях. Особенностью работы является освещение анаглифного способа создания 3D изображений. Предлагается способ подготовки изображений стереопары в Adobe Photoshop и дальнейшего их использования для создания псевдостереоизображений

Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications

Three-dimensional television (3D-TV) has gained increasing popularity in the broadcasting domain, as it enables enhanced viewing experiences in comparison to conventional two-dimensional (2D) TV. However, its application has been constrained due to the lack of essential contents, i.e., stereoscopic videos. To alleviate such content shortage, an economical and practical solution is to reuse the huge media resources that are available in monoscopic 2D and convert them to stereoscopic 3D. Although stereoscopic video can be generated from monoscopic sequences using depth measurements extracted from cues like focus blur, motion and size, the quality of the resulting video may be poor as such measurements are usually arbitrarily defined and appear inconsistent with the real scenes. To help solve this problem, a novel method for object-based stereoscopic video generation is proposed which features i) optical-flow based occlusion reasoning in determining depth ordinal, ii) object segmentation using improved region-growing from masks of determined depth layers, and iii) a hybrid depth estimation scheme using content-based matching (inside a small library of true stereo image pairs) and depth-ordinal based regularization. Comprehensive experiments have validated the effectiveness of our proposed 2D-to-3D conversion method in generating stereoscopic videos of consistent depth measurements for 3D-TV applications

Anahita: A System for 3D Video Streaming with Depth Customization

Producing high-quality stereoscopic 3D content requires significantly more effort than preparing regular video footage. In order to assure good depth perception and visual comfort, 3D videos need to be carefully adjusted to specific viewing conditions before they are shown to viewers. While most stereoscopic 3D content is designed for viewing in movie theaters, where viewing conditions do not vary significantly, adapting the same content for viewing on home TV-sets, desktop displays, laptops, and mobile devices requires additional adjustments. To address this challenge, we propose a new system for 3D video streaming that provides automatic depth adjustments as one of its key features. Our system takes into account both the content and the display type in order to customize 3D videos and maximize their perceived quality. We propose a novel method for depth adjustment that is well-suited for videos of field sports such as soccer, football, and tennis. Our method is computationally efficient and it does not introduce any visual artifacts. We have implemented our 3D streaming system and conducted two user studies, which show: (i) adapting stereoscopic 3D videos for different displays is beneficial, and (ii) our proposed system can achieve up to 35% improvement in the perceived quality of the stereoscopic 3D content

Master of Science

thesisAs the visualization field matures, an increasing number of general toolkits are developed to cover a broad range of applications. However, no general tool can incorporate the latest capabilities for all possible applications, nor can the user interfaces and workflows be easily adjusted to accommodate all user communities. As a result, users will often choose either substandard solutions presented in familiar, customized tools or assemble a patchwork of individual applications glued through ad-hoc scripts and extensive, manual intervention. Instead, we need the ability to easily and rapidly assemble the best-in-task tools into custom interfaces and workflows to optimally serve any given application community. Unfortunately, creating such meta-applications at the API or SDK level is difficult, time consuming, and often infeasible due to the sheer variety of data models, design philosophies, limits in functionality, and the use of closed commercial systems. In this thesis, we present the ManyVis framework which enables custom solutions to be built both rapidly and simply by allowing coordination and communication across existing unrelated applications. ManyVis allows users to combine software tools with complementary characteristics into one virtual application driven by a single, custom-designed interface

High-efficiency Blue Phase Liquid Crystal Displays

Blue phase liquid crystals (BPLCs) have a delicate lattice structure existing between chiral nematic and isotropic phases, with a stable temperature range of about 2 K. But due to short coherent length, these self-assembled nano-structured BPLCs have a fast response time. In the past three decades, the application of BPLC has been rather limited because of its narrow temperature range. In 2002, Kikuchi et al. developed a polymer stabilization method to extend the blue-phase temperature range to more than 60 K. This opens a new gateway for display and photonic applications. In this dissertation, I investigate the material properties of polymer-stabilized BPLCs. According the Gerber’s model, the Kerr constant of a BPLC is linearly proportional to the dielectric anisotropy of the LC host. Therefore, in the frequency domain, the relaxation of the Kerr constant follows the same trend as the dielectric relaxation of the host LC. I have carried out experiments to validate the theoretical predictions, and proposed a model called extended Cole-Cole model to describe the relaxation of the Kerr constant. On the other hand, because of the linear relationship, the Kerr constant should have the same sign as the dielectric anisotropy of the LC host; that is, a positive or negative Kerr constant results from positive (∆ε \u3e 0) or negative host LCs (∆ε \u3c 0), respectively. BPLCs with a positive Kerr constant have been studied extensively, but there has been no study on negative ∆ε polymer-stabilized BPLCs. Therefore, I have prepared a BPLC mixture using a negative ∆ε LC host and investigated its electro-optic properties. I have demonstrated that indeed the induced birefringence and Kerr constant are of negative sign. Due to the fast response time of BPLCs, color sequential display is made possible without color breakup. By removing the spatial color filters, the optical efficiency and resolution density are both tripled. With other advantages such as alignment free and wide viewing angle, polymer-stabilized BPLC is emerging as a promising candidate for next-generation displays. However, the optical efficiency of the BPLC cell is relatively low and the operating voltage is quite high using conventional in-plane-switching electrodes. I have proposed several device structures for improving the optical efficiency of transmissive BPLC cells. Significant improvement in transmittance is achieved by using enhanced protrusion electrodes, and a 100% transmittance is achievable using complementary enhanced protrusion electrode structure. For a conventional transmissive blue phase LCD, although it has superb performances indoor, when exposed to strong sunlight the displayed images could be washed out, leading to a degraded contrast ratio and readability. To overcome the sunlight readability problem, a common approach is to adaptively boost the backlight intensity, but the tradeoff is in the increased power consumption. Here, I have proposed a transflective blue phase LCD where the backlight is turned on in dark surroundings while ambient light is used to illuminate the displayed images in bright surroundings. Therefore, a good contrast ratio is preserved even for a strong ambient. I have proposed two transflective blue phase LCD structures, both of which have single cell gap, single gamma driving, reasonably wide view angle, low power consumption, and high optical efficiency. Among all the 3D technologies, integral imaging is an attractive approach due to its high efficiency and real image depth. However, the optimum observation distance should be adjusted as the displayed image depth changes. This requires a fast focal length change of an adaptive lens array. BPLC adaptive lenses are a good candidate because of their intrinsic fast response time. I have proposed several BPLC lens structures which are polarization independent and exhibit a parabolic phase profile in addition to fast response time. To meet the low power consumption requirement set by Energy Star, high optical efficiency is among the top lists of next-generation LCDs. In this dissertation, I have demonstrated some new device structures for improving the optical efficiency of a polymerstabilized BPLC transmissive display and proposed sunlight readable transflective blue-phase LCDs by utilizing ambient light to reduce the power consumption. Moreover, we have proposed several blue-phase LC adaptive lenses for high efficiency 3D displays