무안경식 3 차원 디스플레이와 투사형 디스플레이를 이용한 깊이 융합 디스플레이의 관찰 특성 향상

학위논문 (박사)-- 서울대학교 대학원 : 전기·컴퓨터공학부, 2015. 8. 이병호.In this dissertation, various methods for enhancing the viewing characteristics of the depth-fused display are proposed with combination of projection-type displays or integral imaging display technologies. Depth-fused display (DFD) is one kind of the volumetric three-dimensional (3D) displays composed of multiple slices of depth images. With a proper weighting to the luminance of the images on the visual axis of the observer, it provides continuous change of the accommodation within the volume confined by the display layers. Because of its volumetric property depth-fused 3D images can provide very natural volumetric images, but the base images should be located on the exact positions on the viewing axis, which gives complete superimpose of the images. If this condition is not satisfied, the images are observed as two separated images instead of continuous volume. This viewing characteristic extremely restricts the viewing condition of the DFD resulting in the limited applications of DFDs. While increasing the number of layers can result in widening of the viewing angle and depth range by voxelizing the reconstructed 3D images, the required system complexity also increases along with the number of image layers. For solving this problem with a relatively simple configuration of the system, hybrid techniques are proposed for DFDs. The hybrid technique is the combination of DFD with other display technologies such as projection-type displays or autostereoscopic displays. The projection-type display can be combined with polarization-encoded depth method for projection of 3D information. Because the depth information is conveyed by polarization states, there is no degradation in spatial resolution or video frame in the reconstructed 3D images. The polarized depth images are partially selected at the stacked polarization selective screens according to the given depth states. As the screen does not require any active component for the reconstruction of images, projection part and reconstruction part can be totally separated. Also, the projection property enables the scalability of the reconstructed images like a conventional projection display, which can give immersive 3D experience by providing large 3D images. The separation of base images due to the off-axis observation can be compensated by shifting the base images along the viewers visual axis. It can be achieved by adopting multi-view techniques. While conventional multi-view displays provide different view images for different viewers positions, it can be used for showing shifted base images for DFD. As a result, multiple users can observe the depth-fused 3D images at the same time. Another hybrid method is the combination of floating method with DFD. Convex lens can optically translate the depth position of the object. Based on this principle, the optical gap between two base images can be extended beyond the physical dimension of the images. Employing the lens with a short focal length, the gap between the base images can be greatly reduced. For a practical implementation of the system, integral imaging method can be used because it is composed of array of lenses. The floated image can be located in front of the lens as well as behind the lens. Both cases result in the expansion of depth range beyond the physical gap of base images, but real-mode floating enables interactive application of the DFD. In addition to the expansion of depth range, the viewing angle of the hybrid system can be increased by employing tracking method. Viewer tracking method also enables dynamic parallax for the DFD with real-time update of base images along with the viewing direction of the tracked viewers. Each chapter of this dissertation explains the theoretical background of the proposed hybrid method and demonstrates the feasibility of the idea with experimental systems.Abstract i Contents iv List of Figures vi List of Tables xii Chapter 1 Introduction 1 1.1 Overview of three-dimensional displays 1 1.2 Motivation 7 1.3 Scope and organization 9 Chapter 2 Multi-layered depth-fused display with projection-type display 10 2.1 Introduction 10 2.2 Polarization-encoded depth information for depth-fused display 12 2.3 Visualization with passive scattering film 16 2.4 Summary 30 Chapter 3 Compact depth-fused display with enhanced depth and viewing angle 31 3.1 Introduction 31 3.2 Enhancement of viewing characteristics 34 3.2.1 Viewing angle enhancement using multi-view method 34 3.2.2 Depth enhancement using integral imaging 37 3.2.3 Depth and viewing angle enhancement 39 3.3 Implementation of experimental system with enhanced viewing parameters 44 3.4 Summary 51 Chapter 4 Real-mode depth-fused display with viewer tracking 52 4.1 Introduction 52 4.2 Viewer tracking method 55 4.2.1 Viewer-tracked depth-fused display 55 4.2.2 Viewer-tracked integral imaging for a depth-fused display 58 4.3 Implementation of viewer-tracked integral imaging 63 4.4 Summary 71 Chapter 5 Conclusion 72 Bibliography 74 초록 83Docto

A stereo display prototype with multiple focal distances

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or direct commercial advantage and that copies show this notice on the first page or initial screen of a display along with the full citation. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, to redistribute to lists, or to use any component of this work in other works requires prior specific permission and/or a fee

투명한 매질에서의 광 경로 분석을 이용한 집약적 3차원 디스플레이

학위논문 (박사)-- 서울대학교 대학원 : 전기·컴퓨터공학부, 2017. 2. 이병호.본 박사학위 논문에서는 광학적으로 투명한 매질에서의 광 경로 분석을 바탕으로 집약적인 3차원 디스플레이 시스템을 구현하는 접근 방법에 대하여 논의한다. 3차원 영상 장치를 구성하는 요소와 시청자 사이의 물리적인 거리를 줄이는 것은 집약적인 3차원 디스플레이 시스템을 구현하는 직관적인 방법이다. 또한, 기존 시스템의 크기를 유지하면서 더 많은 양의 3차원 영상 정보를 표현하는 것 또한 집약적 3차원 디스플레이 시스템을 의미한다. 높은 대역폭과 작은 구조를 가진 집약적 3차원 디스플레이 시스템을 구현하기 위하여 다음의 두 가지 광학 현상을 이용한다. 등방성 물질에서의 전반사 특성과 이방성 물질에서의 복굴절 특성이다. 가시광 영역에서 빛을 투과시키는 두 매질의 고유 광학 특성을 기존의 3차원 디스플레이 시스템에 적용하기 위하여 광 경로 추적을 통하여 분석한다. 광 도파로의 전반사 특성은 집약적 다중 투사 3차원 디스플레이 시스템을 구현하기 위하여 사용한다. 투사 광학계의 영상 정보는 광 도파로로 입사, 내부에서 전반사를 통하여 진행하고, 이에 수평 투사 거리는 광 도파로의 두께로 제한된다. 다수의 전반사 이후 영상 정보는 광 도파로의 출사 면을 통해 빠져나가고, 렌즈에 의하여 최적 시청 지점에서 시점을 형성한다. 광 도파로 내부에서의 광 경로를 등가 모델을 통하여 조사하고, 이를 통해 다수의 투사 광학계로부터 생성된 다수의 시점 영상이 왜곡되는 것을 분석하고 보정한다. 10개의 시점을 제공하는 집약적 다중 투사 3차원 디스플레이 시스템을 통해 제안된 방법을 검증한다. 향상된 대역폭 특성을 가진 다중 투사 3차원 디스플레이와 다중 초점 헤드 마운트 디스플레이 구현을 위한 이방성 판을 이용한 편광 다중화 방법을 제안한다. 빛의 편광 상태, 이방성 판의 광축 방향에 따라 광 경로가 달라진다. 측면 방향으로의 광 경로 전환은 다중 투사 3차원 디스플레이 기술과 결합하여 시점을 측면 방향으로 두 배로 증가시킨다. 깊이 방향으로의 광 경로 전환은 헤드 마운트 디스플레이에서 다중 초점 기능을 구현한다. 광 경로 추적 시뮬레이션을 통해 이방성 판의 모양, 광축, 파장 등의 다양한 파라미터 변화에 따른 광 경로 전환을 분석한다. 각각의 기능에 맞도록 설계된 이방성 판과 편광 회전자를 실시간으로 결합하여, 다중 투사 3차원 디스플레이와 다중 초점 헤드 마운트 디스플레이의 대역폭이 2배 증가한다. 각 시스템에 대한 시작품을 제작하고, 제안된 방법을 실험적으로 검증한다. 본 논문에서는 광 도파로와 복굴절 물질을 이용하여 그 광 경로를 분석, 대형의 다중 투사 3차원 디스플레이 시스템과 개인 사용자의 헤드 마운트 디스플레이 시스템의 크기를 감소시키고, 표현 가능한 정보량을 증가시키는 방법을 제안한다. 광 도파로와 이방성 판은 기존의 3차원 디스플레이 시스템과 쉽게 결합이 가능하며, 제안된 방법은 향후 소형뿐만 아니라 중대형 3차원 디스플레이 시스템의 집약화에 기여할 수 있을 것으로 기대된다.This dissertation investigates approaches for realizing compact three-dimensional (3D) display systems based on optical path analysis in optically transparent medium. Reducing the physical distance between 3D display apparatuses and an observer is an intuitive method to realize compact 3D display systems. In addition, it is considered compact 3D display systems when they present more 3D data than conventional systems while preserving the size of the systems. For implementing compact 3D display systems with high bandwidth and minimized structure, two optical phenomena are investigated: one is the total internal reflection (TIR) in isotropic materials and the other is the double refraction in birefringent crystals. Both materials are optically transparent in visible range and ray tracing simulations for analyzing the optical path in the materials are performed to apply the unique optical phenomenon into conventional 3D display systems. An optical light-guide with the TIR is adopted to realize a compact multi-projection 3D display system. A projection image originated from the projection engine is incident on the optical light-guide and experiences multiple folds by the TIR. The horizontal projection distance of the system is effectively reduced as the thickness of the optical light-guide. After multiple folds, the projection image is emerged from the exit surface of the optical light-guide and collimated to form a viewing zone at the optimum viewing position. The optical path governed by the TIR is analyzed by adopting an equivalent model of the optical light-guide. Through the equivalent model, image distortion for multiple view images in the optical light-guide is evaluated and compensated. For verifying the feasibility of the proposed system, a ten-view multi-projection 3D display system with minimized projection distance is implemented. To improve the bandwidth of multi-projection 3D display systems and head-mounted display (HMD) systems, a polarization multiplexing technique with the birefringent plate is proposed. With the polarization state of the image and the direction of optic axis of the birefringent plate, the optical path of rays varies in the birefringent material. The optical path switching in the lateral direction is applied in the multi-projection system to duplicate the viewing zone in the lateral direction. Likewise, a multi-focal function in the HMD is realized by adopting the optical path switching in the longitudinal direction. For illuminating the detailed optical path switching and the image characteristic such as an astigmatism and a color dispersion in the birefringent material, ray tracing simulations with the change of optical structure, the optic axis, and wavelengths are performed. By combining the birefringent material and a polarization rotation device, the bandwidth of both the multi-projection 3D display and the HMD is doubled in real-time. Prototypes of both systems are implemented and the feasibility of the proposed systems is verified through experiments. In this dissertation, the optical phenomena of the TIR and the double refraction realize the compact 3D display systems: the multi-projection 3D display for public and the multi-focal HMD display for individual. The optical components of the optical light-guide and the birefringent plate can be easily combined with the conventional 3D display system and it is expected that the proposed method can contribute to the realization of future 3D display systems with compact size and high bandwidth.Chapter 1 Introduction 10 1.1 Overview of modern 3D display providing high quality 3D images 10 1.2 Motivation of this dissertation 15 1.3 Scope and organization 18 Chapter 2 Compact multi-projection 3D displays with optical path analysis of total internal reflection 20 2.1 Introduction 20 2.2 Principle of compact multi-projection 3D display system using optical light-guide 23 2.2.1 Multi-projection 3D display system 23 2.2.2 Optical light-guide for multi-projection 3D display system 26 2.2.3 Analysis on image characteristics of projection images in optical light-guide 34 2.2.4 Pre-distortion method for view image compensation 44 2.3 Implementation of prototype of multi-projection 3D display system with reduced projection distance 47 2.4 Summary and discussion 52 Chapter 3 Compact multi-projection 3D displays with optical path analysis of double refraction 53 3.1 Introduction 53 3.2 Principle of viewing zone duplication in multi-projection 3D display system 57 3.2.1 Polarization-dependent optical path switching in birefringent crystal 57 3.2.2 Analysis on image formation through birefringent plane-parallel plate 60 3.2.3 Full-color generation of dual projection 64 3.3 Implementation of prototype of viewing zone duplication of multi-projection 3D display system 68 3.3.1 Experimental setup for viewing zone duplication of multi-projection 3D display system 68 3.3.2 Luminance distribution measurement of viewing zone duplication of multi-projection 3D display system 74 3.4 Summary and discussion 79 Chapter 4 Compact multi-focal 3D HMDs with optical path analysis of double refraction 81 4.1 Introduction 81 4.2 Principle of multi-focal 3D HMD system 86 4.2.1 Multi-focal 3D HMD system using Savart plate 86 4.2.2 Astigmatism compensation by modified Savart plate 89 4.2.3 Analysis on lateral chromatic aberration of extraordinary plane 96 4.2.4 Additive type compressive light field display 101 4.3 Implementation of prototype of multi-focal 3D HMD system 104 4.4 Summary and discussion 112 Chapter 5 Conclusion 114 Bibliography 117 Appendix 129 초 록 130Docto

Roadmap on 3D integral imaging: Sensing, processing, and display

This Roadmap article on three-dimensional integral imaging provides an overview of some of the research activities in the field of integral imaging. The article discusses various aspects of the field including sensing of 3D scenes, processing of captured information, and 3D display and visualization of information. The paper consists of a series of 15 sections from the experts presenting various aspects of the field on sensing, processing, displays, augmented reality, microscopy, object recognition, and other applications. Each section represents the vision of its author to describe the progress, potential, vision, and challenging issues in this field

Colour depth-from-defocus incorporating experimental point spread function measurements

Depth-From-Defocus (DFD) is a monocular computer vision technique for creating depth maps from two images taken on the same optical axis with different intrinsic camera parameters. A pre-processing stage for optimally converting colour images to monochrome using a linear combination of the colour planes has been shown to improve the accuracy of the depth map. It was found that the first component formed using Principal Component Analysis (PCA) and a technique to maximise the signal-to-noise ratio (SNR) performed better than using an equal weighting of the colour planes with an additive noise model. When the noise is non-isotropic the Mean Square Error (MSE) of the depth map by maximising the SNR was improved by 7.8 times compared to an equal weighting and 1.9 compared to PCA. The fractal dimension (FD) of a monochrome image gives a measure of its roughness and an algorithm was devised to maximise its FD through colour mixing. The formulation using a fractional Brownian motion (mm) model reduced the SNR and thus produced depth maps that were less accurate than using PCA or an equal weighting. An active DFD algorithm to reduce the image overlap problem has been developed, called Localisation through Colour Mixing (LCM), that uses a projected colour pattern. Simulation results showed that LCM produces a MSE 9.4 times lower than equal weighting and 2.2 times lower than PCA. The Point Spread Function (PSF) of a camera system models how a point source of light is imaged. For depth maps to be accurately created using DFD a high-precision PSF must be known. Improvements to a sub-sampled, knife-edge based technique are presented that account for non-uniform illumination of the light box and this reduced the MSE by 25%. The Generalised Gaussian is presented as a model of the PSF and shown to be up to 16 times better than the conventional models of the Gaussian and pillbox

Instabilities of volatile films and drops

We report on instabilities during spreading of volatile liquids, with emphasis on the novel instability observed when isopropyl alcohol (IPA) is deposited on a monocrystalline silicon (Si) wafer. This instability is characterized by emission of drops ahead of the expanding front, with each drop followed by smaller, satellite droplets, forming the structures which we nickname “octopi” due to their appearance. A less volatile liquid, or a substrate of larger heat conductivity, suppress this instability. In addition, we examine the spreading of drops of water (DJW)-JPA mixtures on both Si wafers and plain glass slides, and describe the variety of contact line instabilities which appear. We find that the decrease of IPA concentration in mixtures leads to transition from “octopi” to mushroom-like instabilities. Through manipulation of our experimental set up, we also find that the mechanism responsible for these instabilities appears to be mostly insensitive to both the external application of convection to the gas phase, and the doping of the gas phase with vapor in order to create the saturated environment. In order to better understand the “octopi” instability, we develop a theoretical model for evaporation of a pure liquid drop on a thermally conductive solid substrate. This model includes all relevant physical effects, including evaporation, thermal conductivity in both liquid and solid, (thermocapillary) Marangoni effect, vapor recoil, disjoining pressure, and gravity. The crucial ingredient in this problem is the evaporation model, since it influences both the motion of the drop contact line, and the temperature profiles along the liquid-solid and liquid-gas interfaces. We consider two evaporation models: the equilibrium “lens” model and the non-equilibrium one-sided (NEOS) model. Along with the assumption of equilibrium at the liquid-gas interface, the “lens” model also assumes that evaporation proceeds in a (vapor) diffusion-limited regime, therefore bringing the focus to the gas phase, where the problem of vapor mass diffusion is to be solved, which invokes analogy with the problem of lens-shaped conductor from electrostatics. On the other hand, NEOS model assumes non-equilibrium at the liquid-gas interface and a reaction-limited regime of evaporation; the liquid and gas phases are decoupled using the one-sided assumption, and hence, the problem is to be solved in the liquid phase only. We use lubrication approximation and derive a single governing equation for the evolution of drop thickness, which includes both models. An experimental procedure is described next, which we use in order to estimate the volatility parameter corresponding to each model. We also describe the numerical code, which we use to solve the governing equation for drop thickness, and show how this equation can be used to predict which evaporation model is more appropriate for a particular physical problem. Next, we perform linear stability analysis (LSA) of perturbed thin film configuration. We find excellent agreement between our numerical results and LSA predictions. Furthermore, these results indicate that the IPA/Si configuration is the most unstable one, in direct agreement with experimental results. We perform numerical simulations in the simplified 2d geometry (cross section of the drop) for both planar and radial symmetry and show that our theoretical model reproduces the main features of the experiment, namely, the formation of “octopus” -like features ahead of the contact line of an evaporating drop. Finally, we perform quasi-3d numerical simulations of evaporating drops, where stability to azimuthal perturbations of the contact line is examined. We recover the “octopi” instability for IPA/Si configuration, similarly as seen in the experiments

Change blindness: eradication of gestalt strategies

Arrays of eight, texture-defined rectangles were used as stimuli in a one-shot change blindness (CB) task where there was a 50% chance that one rectangle would change orientation between two successive presentations separated by an interval. CB was eliminated by cueing the target rectangle in the first stimulus, reduced by cueing in the interval and unaffected by cueing in the second presentation. This supports the idea that a representation was formed that persisted through the interval before being 'overwritten' by the second presentation (Landman et al, 2003 Vision Research 43149–164]. Another possibility is that participants used some kind of grouping or Gestalt strategy. To test this we changed the spatial position of the rectangles in the second presentation by shifting them along imaginary spokes (by ±1 degree) emanating from the central fixation point. There was no significant difference seen in performance between this and the standard task [F(1,4)=2.565, p=0.185]. This may suggest two things: (i) Gestalt grouping is not used as a strategy in these tasks, and (ii) it gives further weight to the argument that objects may be stored and retrieved from a pre-attentional store during this task

Real-time analysis of video signals

Many practical and experimental systems employing image processing techniques have been built by other workers for various applications. Most of these systems are computer-based and very few operate in a real time environment. The objective of this work is to build a microprocessor-based system for video image processing. The system is used in conjunction with an on-line TV camera and processing is carried out in real time. The enormous storage requirement of digitized TV signals and the real time constraint suggest that some simplification of the data must take place prior to any viable processing. Data reduction is attained through the representation of objects by their edges, an approach often adopted for feature extraction in pattern recognition systems. A new technique for edge detection by applying comparison criteria to differentials at adjacent pixels of the video image is developed and implemented as a preprocessing hardware unit. A circuit for the generation of the co-ordinates of edge points is constructed to free the processing computer of this task, allowing it more time for on-line analysis of video signals. Besides the edge detector and co-ordinate generator the hardware built consists of a microprocessor system based on a Texas Instruments T.US 9900 device, a first-in-first-out buffer store and interface circuitry to a TV camera and display devices. All hardware modules and their power supplies are assembled in one unit to provide a standalone instrument. The problem chosen for investigation is analysis of motion in a visual scene. Aspects of motion studied concern the tracking of moving objects with simple geometric shapes and description of their motion. More emphasis is paid to the analysis of human eye movements and measurement of its point-of-regard which has many practical applications in the fields of physiology and psychology. This study provides a basis for the design of a processing unit attached to an oculometer to replace bulky minicomputer-based eye motion analysis systems. Programs are written for storage, analysis and display of results in real time

Spatial and human factors affecting image quality and viewer experience of stereoscopic 3D in television and cinema

PhD ThesisThe horizontal offset in the two eyes’ locations in the skull means that they receive slightly different images of the world. The visual cortex uses these disparities to calculate where in depth different objects are, absolutely (physical distance from the viewer, perceived very imprecisely) and relatively (whether one object is in front of another, perceived with great precision). For well over a century, stereoscopic 3D (S3D) technology has existed which can generate an artificial sense of depth by displaying images with slight disparities to the different retinas. S3D technology is now considerably cheaper to access in the home, but remains a niche market, partly reflecting problems with viewer experience and enjoyment of S3D. This thesis considers some of the factors that could affect viewer experience of S3D content. While S3D technology can give a vivid depth percept, it can also lead to distortions in perceived size and shape, particularly if content is viewed at the wrong distance or angle. Almost all S3D content is designed for a viewing angle perpendicular to the screen, and with a recommended viewing distance, but little is known about the viewing distance typically used for S3D, or the effect of viewing angle. Accordingly, Chapter 2 of this thesis reports a survey of members of the British public. Chapters 3 and 4 report two experiments, one designed to assess the effect of oblique viewing, and another to consider the interaction between S3D and perceived size. S3D content is expensive to generate, hence producers sometimes “fake” 3D by shifting 2D content behind the screen plane. Chapter 5 investigates viewer experience with this fake 3D, and finds it is not a viable substitute for genuine S3D while also examining whether viewers fixate on different image features when video content is viewed in S3D, as compared to 2D.part-funded by BSkyB and EPSRC as a CASE PhD studentship supporting PH

A real-time low-cost vision sensor for robotic bin picking

This thesis presents an integrated approach of a vision sensor for bin picking. The vision system that has been devised consists of three major components. The first addresses the implementation of a bifocal range sensor which estimates the depth by measuring the relative blurring between two images captured with different focal settings. A key element in the success of this approach is that it overcomes some of the limitations that were associated with other related implementations and the experimental results indicate that the precision offered by the sensor discussed in this thesis is precise enough for a large variety of industrial applications. The second component deals with the implementation of an edge-based segmentation technique which is applied in order to detect the boundaries of the objects that define the scene. An important issue related to this segmentation technique consists of minimising the errors in the edge detected output, an operation that is carried out by analysing the information associated with the singular edge points. The last component addresses the object recognition and pose estimation using the information resulting from the application of the segmentation algorithm. The recognition stage consists of matching the primitives derived from the scene regions, while the pose estimation is addressed using an appearance-based approach augmented with a range data analysis. The developed system is suitable for real-time operation and in order to demonstrate the validity of the proposed approach it has been examined under varying real-world scenes