Removing lateral chromatic aberration in bright field optical microscopy

"We present an efficient alternative to remove lateral chromatic aberration (LCA) in bright field light microscopy images. Our procedure is based on error calibration using time-sequential acquisition at different wavelengths, and error correction through digital image warping. Measurement of the displacements of fiducial marks in the red and green images relative to blue provide calibration factors that are subsequently used in test images to realign color channels digitally. We demonstrate quantitative improvement in the position and boundaries of objects in target slides and in the color content and morphology of specimens in stained biological samples. Our results show a reduction of LCA content below the 0.1% level.

Perceptual models for high-refresh-rate rendering

Rendering realistic images requires substantial computational power. With new high-refresh-rate displays as well as the renaissance of virtual reality (VR) and augmented reality (AR), one cannot expect that GPU performance will scale fast enough to meet the requirements of immersive photo-realistic rendering with current rendering techniques. In this dissertation, I follow the dual of the well-known computer vision approach: vision is inverse graphics: to improve graphical algorithms, I consider the operation of the human visual system. I propose to model and exploit the limitations of the visual system in the context of novel high-refresh-rate displays; specifically, I focus on spatio-temporal perception, a topic that has received remarkably less attention than spatial-only perception so far. I present three main contributions. First, I demonstrate the validity of the perceptual approach by presenting a conceptually simple rendering technique motivated by our eyes' limited sensitivity to high spatio-temporal change which reduces the rendering load and transmission requirement of current-generation VR headsets without introducing perceivable visual artefacts. Second, I present two visual models related to motion perception: (a) a metric for detecting flicker; and (b) a comprehensive visual model to predict perceived motion quality on monitors with arbitrary refresh rates and monitor resolutions. Third, I propose an adaptive rendering algorithm that utilises the proposed models. All algorithms operate on physical colorimetric units (instead of display-referenced pixel values), for which I provide the appropriate display measurements and models. All proposed algorithms and visual models are calibrated and validated with psychophysical experiments

Doctor of Philosophy

dissertationDiffractive optics, an important part of modern optics, involves the control of optical fields by thin microstructured elements via diffraction and interference. Although the basic theoretical understanding of diffractive optics has been known for a long time, many of its applications have not yet been explored. As a result, the field of diffractive optics is old and young at the same time. The interest in diffractive optics originates from the fact that diffractive optical elements are flat and lightweight. This makes their applications into compact optical systems more feasible compared to bulky refractive optics. Although these elements demonstrate excellent diffraction efficiency for monochromatic light, they fail to generate complex intensity profiles under broadband illumination. This is due to the fact that the degrees-of-freedom in these elements are insufficient to overcome their strong chromatic aberration. As a result, despite their so many advantages over refractive optics, their applications are somewhat limited in broadband systems. In this dissertation, a recently developed diffractive optical element, called a polychromat, is demonstrated for several broadband applications. The polychromat is comprised of linear "grooves" or square "pixels" with feature size in the micrometer scale. The grooves or pixels can have multiple height levels. Such grooved or pixelated structures with multilevel topography provide enormous degrees-of-freedom which in turn facilitates generation of complex intensity distributions with high diffraction efficiency under broadband illumination. Furthermore, the super-wavelength feature size and low aspect ratio of this micro-optic make its fabrication process simpler. Also, this diffractive element is not polarization sensitive. As a result, the polychromat holds the potential to be used in numerous technological applications. Throughout this dissertation, the broadband operation of the polychromat is demonstrated in four different areas, namely, photovoltaics, displays, lenses and holograms. Specifically, we have developed a polychromat-photovoltaic system which facilitates better photon-to-electron conversion via spectrum splitting and concentration, a modified liquid crystal display (LCD) that offers higher luminance compared to a standard LCD, a cylindrical lens that demonstrates super-achromatic focusing over the entire visible band, a planar diffractive lens that images over the visible and near-IR spectrum and broadband transmission holograms that project complex full-color images with high efficiency. In each of these applications, a unique figure of merit was defined and the height topography of the polychromat was optimized to maximize the figure of merit. The optimization was achieved with the aid of scalar diffraction theory and a modified version of direct binary search algorithm. Single step grayscale lithography was developed and optimized to fabricate these devices with the smallest possible fabrication errors. Rigorous characterization of these systems demonstrated broadband performance of the polychromat in all of the applications

편광 다중화를 이용하여 향상된 기능을 제공하는 도파관 기반의 근안 디스플레이

학위논문 (박사) -- 서울대학교 대학원 : 공과대학 전기·정보공학부, 2021. 2. 이병호.This dissertation presents the studies on the optical design method that enhances the display performance of see-through waveguide-based near-eye displays (WNEDs) using the polarization multiplexing technique. The studies focus on the strategies to improve the crucial display performances without compromising a small form factor, the most attractive merit of the WNEDs. To achieve this goal, thin and lightweight polarization-dependent optical elements are devised and employed in the WNED structure. The polarization-dependent devices can allow multiple optical functions or optical paths depending on the polarization state of the input beam, which can break through the limitation of the waveguide system with the polarization multiplexing. To realize the function-selective eyepiece for AR applications, the proposed devices should operate as an optically transparent window for the real scene while performing specific optical functions for the virtual image. The proposed devices are manufactured in a combination structure in which polarization-dependent optical elements are stacked. The total thickness of the stacked structure is about 1 mm, and it can be attached to the waveguide surface without conspicuously increasing the form factor of the optical system. Using the proposed polarization-dependent devices, the author proposes three types of novel WNED systems with enhanced performance. First, the author suggests a compact WNED with dual focal planes. Conventional WNEDs have an inherent limitation that the focal plane of the virtual image is at an infinite distance because they extract a stream of collimated light at the out-coupler. By using the polarization-dependent eyepiece lens, an additional focal plane can be generated with the polarization multiplexing in addition to infinity depth. The proposed configuration can provide comfortable AR environments by alleviating visual fatigue caused by vergence-accommodation conflict. Second, the novel WNED configuration with extended field-of-view (FOV) is presented. In the WNEDs, the maximum allowable FOV is determined by the material properties of the diffraction optics and the substrate. By using the polarization-dependent steering combiner, the FOV can be extended up to two times, which can provide more immersive AR experiences. In addition, this dissertation demonstrates that the distortion for the real scene caused by the stacked structure cannot severely disturb the image quality, considering the acuity of human vision. Lastly, the author presents a retinal projection-based WNED with switchable viewpoints by simultaneously adopting the polarization-dependent lens and grating. The proposed system can convert the viewpoint according to the position of the eye pupil without mechanical movement. The polarization-dependent viewpoint switching can resolve the inherent problem of a narrow eyebox in retinal projection displays without employing the bulky optics for mechanical movement. In conclusion, the dissertation presents the practical optical design and detailed analysis for enhanced WNED based on the polarization multiplexing technique through various simulations and experiments. The proposed approaches are expected to be utilized as an innovative solution for compact wearable displays.본 박사학위 논문에서는 편광 다중화 기법을 이용하여 도파관 기반의 증강현실 근안 디스플레이의 성능을 향상시키는 광학 설계 및 이에 대한 분석에 대해 논의한다. 본 연구는 도파관 기반 근안 디스플레이의 가장 큰 장점인 소형 폼 팩터를 유지하면서 디스플레이 성능을 개선하는 것에 중점을 둔다. 이를 위해 기존 광학 소자에 비해 매우 가볍고 얇은 편광 의존형 결합기 광학 소자가 새롭게 제안되며, 이는 입사광의 편광 상태에 따라 독립적인 광 경로 제어를 가능케 하여 편광 다중화를 통해 향상된 성능을 제공 할 수 있다. 또한 실제 영상의 빛은 그대로 투과 시킴으로써 증강현실을 위한 소자로 활용 가능하다. 본 연구에서 제안하는 편광 의존형 결합기 광학 소자는 기하학적 위상(geometric phase, GP)에 기반하여 동작한다. GP 기반의 광학소자가 서로 직교하는 원형 편광 입사광에 대해 상보적인 기능을 수행하는 것을 이용하여, 두 개 이상의 GP 소자와 편광 제어를 위한 광학 필름들을 중첩 시킴으로써 증강현실 결합기 광학 소자를 구현할 수 있다. 이들 광학소자는 매우 얇기 때문에, 본 연구에서 제작된 편광 의존형 결합기 광학 소자의 총 두께는 1 mm 수준으로 폼 팩터 제약으로부터 자유롭다. 또한 평평한 필름 형태이므로, 평판형 도파관에 부착하기 쉽다는 이점을 지닌다. 고안된 편광 의존형 결합기 광학 소자를 사용하여 세 가지 유형의 새로운 도파관 기반의 근안 디스플레이 구조를 제안한다. 첫 번째는 입사광의 편광 상태에 따라 투명 광학 창 또는 오목 렌즈로 작동하는 편광 의존형 결합기 렌즈를 적용하여 가상 영상에 대해 이중 초점면을 제공하는 시스템이다. 제안된 구조는 기존의 도파관 기반 근안 디스플레이가 무한대 위치에 단일 초점면을 제공함으로써 발생하는 시각적 피로 및 흐릿한 증강현실 영상의 문제를 완화할 수 있다. 두 번째로는 입사광의 편광 상태에 따라 광 경로를 좌측 또는 우측으로 제어할 수 있는 편광 격자를 활용하여 가상 영상의 시야각을 기존보다 최대 2배까지 확장할 수 있는 시스템을 제안한다. 이는 단일 도파관 기반 근안 디스플레이에서 영상 결합기 (imaging combiner)로 활용되는 회절 소자의 설계 변수에 의해 제한되는 시야각 한계점을 돌파할 수 있는 구조로 컴팩트한 폼 팩터로 더욱 몰입감 있는 대화면 증강현실 영상을 제공할 수 있다. 마지막으로 위에서 제안된 두 가지 편광 의존형 광학 소자를 모두 사용하여 시점 전환이 가능한 도파관 기반의 망막 투사형 디스플레이 구조를 제안한다. 편광 다중화를 통해 다중 초점들을 선택적으로 활성화함으로써, 확장된 시청영역을 제공하는 동시에 동공 크기 변화 또는 움직임에 의한 이중 영상 문제를 완화할 수 있다. 또한 기계적 움직임 없이 시점 간의 고속 전환이 가능하다는 장점을 지니고 있다. 본 박사학위 논문에서 제시한 편광 다중화를 활용한 새로운 결합기 광학 소자 및 광학 구조들은 도파관 기반 근안 디스플레이의 향상된 성능을 제공하는 해결책 및 새로운 가능성으로 제시할 수 있을 것이라 기대된다.Abstract i Contents iii List of Tables vi List of Figures vii Chapter. 1 Introduction 1 1.1 Augmented reality near-eye display 1 1.2 Key performance parameters of near-eye displays 4 1.3 Basic scheme of waveguide-based near-eye displays 22 1.4 Motivation and purpose of this dissertation 33 1.5 Scope and organization 37 Chapter 2 Dual-focal waveguide-based near-eye display using polarization-dependent combiner lens 39 2.1 Introduction 39 2.2 Optical design for polarization-dependent combiner lens 42 2.2.1 Design and principle of polarization-dependent combiner lens 42 2.2.2 Prototype implementation 48 2.3 Waveguide-based augmented reality near-eye display with dual-focal plane using polarization-dependent combiner lens 51 2.3.1 Implementation of the prototype and experimental results 51 2.3.2 Performance analysis and discussion 57 2.4 Conclusion 69 Chapter 3 Extended-field-of-view waveguide-based near-eye display via polarization-dependent steering combiner 70 3.1 Introduction 70 3.2 Optical design for polarization-dependent steering combiner 73 3.2.1 Principle of polarization grating 73 3.2.2 Principle of polarization-dependent steering combiner 76 3.2.3 Analysis and verification experiment for real-scene distortion 77 3.3 Waveguide-based augmented reality near-eye display with extended-field-of-view 81 3.3.1 Field-of-view for volume grating based waveguide technique 81 3.3.2 Implementation of the prototype and experimental results 84 3.3.3 Performances analysis and discussion 87 3.4 Conclusion 92 Chapter 4 Viewpoint switchable retinal-projection-based near-eye display with waveguide configuration 93 4.1 Introduction 93 4.2 Polarization-dependent switchable eyebox 97 4.2.1 Optical devices for polarization-dependent switching of viewpoints 97 4.2.2 System configuration for proposed method 100 4.2.3 Design of waveguide and imaging combiner 105 4.3 Compact retinal projection-based near-eye display with switchable viewpoints via waveguide configuration 114 4.3.1 Implementation of the prototype and experimental results 114 4.3.2 Performance analysis and discussion 118 4.4 Conclusion 122 Chapter 5. Conclusion 123 Bibliography 127 Appendix 135Docto

System Design Considerations for a Low-Intensity Hyperspectral Imager of Sensitive Cultural Heritage Manuscripts

Cultural heritage imaging is becoming more common with the increased availability of more complex imaging systems, including multi- and hyperspectral imaging (MSI and HSI) systems. A particular concern with HSI systems is the broadband source required, regularly including infrared and ultraviolet spectra, which may cause fading or damage to a target. Guidelines for illumination of such objects, even while on display at a museum, vary widely from one another. Standards must be followed to assure the curator to allow imaging and ensure protection of the document. Building trust in the cultural heritage community is key to gaining access to objects of significant import, thus allowing scientists, historians, and the public to view digitally preserved representations of the object, and to allow further discovery of the object through spectral processing and analysis. Imaging was conducted with a light level of 270 lux at variable ground sample distances (GSD’s). The light level was chosen to maintain a total dose similar to an hour’s display time at a museum, based on the United Kingdom standard for cultural heritage display, PAS 198:2012. The varying GSD was used as a variable to increase signal-to-noise ratios (SNR) or decrease total illumination time on a target. This adjustment was performed both digitally and physically, and typically results in a decrease in image quality, as the spatial resolution of the image decreases. However, a technique called “panchromatic sharpening” was used to recover some of the spatial resolution. This method fuses a panchromatic image with good spatial resolution with a spectral image (either MSI or HSI) with poorer spatial resolution to construct a derivative spectral image with improved spatial resolution. Detector systems and additional methods of data capture to assist in processing of cultural heritage documents are investigated, with specific focus on preserving the physical condition of the potentially sensitive documents

Evaluation of the color image and video processing chain and visual quality management for consumer systems

With the advent of novel digital display technologies, color processing is increasingly becoming a key aspect in consumer video applications. Today’s state-of-the-art displays require sophisticated color and image reproduction techniques in order to achieve larger screen size, higher luminance and higher resolution than ever before. However, from color science perspective, there are clearly opportunities for improvement in the color reproduction capabilities of various emerging and conventional display technologies. This research seeks to identify potential areas for improvement in color processing in a video processing chain. As part of this research, various processes involved in a typical video processing chain in consumer video applications were reviewed. Several published color and contrast enhancement algorithms were evaluated, and a novel algorithm was developed to enhance color and contrast in images and videos in an effective and coordinated manner. Further, a psychophysical technique was developed and implemented for performing visual evaluation of color image and consumer video quality. Based on the performance analysis and visual experiments involving various algorithms, guidelines were proposed for the development of an effective color and contrast enhancement method for images and video applications. It is hoped that the knowledge gained from this research will help build a better understanding of color processing and color quality management methods in consumer video

Engineering data compendium. Human perception and performance. User's guide

The concept underlying the Engineering Data Compendium was the product of a research and development program (Integrated Perceptual Information for Designers project) aimed at facilitating the application of basic research findings in human performance to the design and military crew systems. The principal objective was to develop a workable strategy for: (1) identifying and distilling information of potential value to system design from the existing research literature, and (2) presenting this technical information in a way that would aid its accessibility, interpretability, and applicability by systems designers. The present four volumes of the Engineering Data Compendium represent the first implementation of this strategy. This is the first volume, the User's Guide, containing a description of the program and instructions for its use

Development and implementation of quadratically distorted (QD) grating and grisms system for 4D multi-colour microscopy imaging (MCMI)

The recent emergence of super-resolution microscopy imaging techniques has surpassed the diffraction limit to improve image resolution. Contrary to the breakthroughs of spatial resolution, high temporal resolution remains a challenge. This dissertation demonstrates a simple, on axis, 4D (3D + time) multi-colour microscopy imaging (MCMI) technology that delivers simultaneous 3D broadband imaging over cellular volumes, which is especially applicable to the real-time imaging of fast moving biospecimens. Quadratically distorted (QD) grating, in the form of an off axis-Fresnel zone plate, images multiple object planes simultaneously on a single image plane. A delicate mathematical model of 2D QD grating has been established and implemented in the design and optimization of QD grating. Grism, a blazed grating and prism combination, achieves chromatic control in the 4D multi-plane imaging. A pair of grisms, whose separation can be varied, provide a collimated beam with a tuneable chromatic shear from a collimated polychromatic input. The optical system based on QD grating and grisms has been simply appended to the camera port of a commercial microscope, and a few bioimaging tests have been performed, i.e. the 4D chromatically corrected imaging of fluorescence microspheres, MCF-7 and HeLa cells. Further investigation of bioimaging problems is still in progress

Response normalization and blur adaptation:data and multi-scale model

Adapting to blurred or sharpened images alters perceived blur of a focused image (M. A. Webster, M. A. Georgeson, & S. M. Webster, 2002). We asked whether blur adaptation results in (a) renormalization of perceived focus or (b) a repulsion aftereffect. Images were checkerboards or 2-D Gaussian noise, whose amplitude spectra had (log-log) slopes from -2 (strongly blurred) to 0 (strongly sharpened). Observers adjusted the spectral slope of a comparison image to match different test slopes after adaptation to blurred or sharpened images. Results did not show repulsion effects but were consistent with some renormalization. Test blur levels at and near a blurred or sharpened adaptation level were matched by more focused slopes (closer to 1/f) but with little or no change in appearance after adaptation to focused (1/f) images. A model of contrast adaptation and blur coding by multiple-scale spatial filters predicts these blur aftereffects and those of Webster et al. (2002). A key proposal is that observers are pre-adapted to natural spectra, and blurred or sharpened spectra induce changes in the state of adaptation. The model illustrates how norms might be encoded and recalibrated in the visual system even when they are represented only implicitly by the distribution of responses across multiple channels