Correcting for optical aberrations using multilayer displays

Optical aberrations of the human eye are currently corrected using eyeglasses, contact lenses, or surgery. We describe a fourth option: modifying the composition of displayed content such that the perceived image appears in focus, after passing through an eye with known optical defects. Prior approaches synthesize pre-filtered images by deconvolving the content by the point spread function of the aberrated eye. Such methods have not led to practical applications, due to severely reduced contrast and ringing artifacts. We address these limitations by introducing multilayer pre-filtering, implemented using stacks of semi-transparent, light-emitting layers. By optimizing the layer positions and the partition of spatial frequencies between layers, contrast is improved and ringing artifacts are eliminated. We assess design constraints for multilayer displays; autostereoscopic light field displays are identified as a preferred, thin form factor architecture, allowing synthetic layers to be displaced in response to viewer movement and refractive errors. We assess the benefits of multilayer pre-filtering versus prior light field pre-distortion methods, showing pre-filtering works within the constraints of current display resolutions. We conclude by analyzing benefits and limitations using a prototype multilayer LCD.National Science Foundation (U.S.) (Grant IIS-1116452)Alfred P. Sloan Foundation (Research Fellowship)United States. Defense Advanced Research Projects Agency (Young Faculty Award)Vodafone (Firm) (Wireless Innovation Award

On-screen pre-deblurring of digital images using the wavefront aberration function of the human eye to improve computer access for the visually impaired

Traditional Optics has provided ways to compensate some common visual limitations (up to second order visual impairments) through spectacles or contact lenses. Recent developments in wavefront science make it possible to obtain an accurate model of the Point Spread Function (PSF) of the human eye. Through what is known as the Wavefront Aberration Function of the human eye, exact knowledge of the optical aberration of the human eye is possible, allowing a mathematical model of the PSF to be obtained. This model could be used to pre-compensate (inverse-filter) the images displayed on computer screens in order to counter the distortion in the user\u27s eye. This project takes advantage of the fact that the wavefront aberration function, commonly expressed as a Zernike polynomial, can be generated from the ophthalmic prescription used to fit spectacles to a person. This allows the pre-compensation, or onscreen deblurring, to be done for various visual impairments, up to second order (commonly known as myopia, hyperopia, or astigmatism). The technique proposed towards that goal and results obtained using a lens, for which the PSF is known, that is introduced into the visual path of subjects without visual impairment will be presented. In addition to substituting the effect of spectacles or contact lenses in correcting the loworder visual limitations of the viewer, the significance of this approach is that it has the potential to address higher-order abnormalities in the eye, currently not correctable by simple means

Head tracking two-image 3D television displays

The research covered in this thesis encompasses the design of novel 3D displays, a consideration of 3D television requirements and a survey of autostereoscopic methods is also presented. The principle of operation of simple 3D display prototypes is described, and design of the components of optical systems is considered. A description of an appropriate non-contact infrared head tracking method suitable for use with 3D television displays is also included. The thesis describes how the operating principle of the displays is based upon a twoimage system comprising a pair of images presented to the appropriate viewers' eyes. This is achieved by means of novel steering optics positioned behind a direct view liquid crystal display (LCD) that is controlled by a head position tracker. Within the work, two separate prototypes are described, both of which provide 3D to a single viewer who has limited movement. The thesis goes on to describe how these prototypes can be developed into a multiple-viewer display that is suitable for television use. A consideration of 3D television requirements is documented showing that glassesfree viewing (autostereoscopic), freedom of viewer movement and practical designs are important factors for 3D television displays. The displays are novel in design in several important aspects that comply with the requirements for 3D television. Firstly they do not require viewers to wear special glasses, secondly the displays allow viewers to move freely when viewing and finally the design of the displays is practical with a housing size similar to modem television sets and a cost that is not excessive. Surveys of other autostereoscopic methods included within the work suggest that no contemporary 3D display offers all of these important factors

Material Recognition Meets 3D Reconstruction : Novel Tools for Efficient, Automatic Acquisition Systems

For decades, the accurate acquisition of geometry and reflectance properties has represented one of the major objectives in computer vision and computer graphics with many applications in industry, entertainment and cultural heritage. Reproducing even the finest details of surface geometry and surface reflectance has become a ubiquitous prerequisite in visual prototyping, advertisement or digital preservation of objects. However, today's acquisition methods are typically designed for only a rather small range of material types. Furthermore, there is still a lack of accurate reconstruction methods for objects with a more complex surface reflectance behavior beyond diffuse reflectance. In addition to accurate acquisition techniques, the demand for creating large quantities of digital contents also pushes the focus towards fully automatic and highly efficient solutions that allow for masses of objects to be acquired as fast as possible. This thesis is dedicated to the investigation of basic components that allow an efficient, automatic acquisition process. We argue that such an efficient, automatic acquisition can be realized when material recognition "meets" 3D reconstruction and we will demonstrate that reliably recognizing the materials of the considered object allows a more efficient geometry acquisition. Therefore, the main objectives of this thesis are given by the development of novel, robust geometry acquisition techniques for surface materials beyond diffuse surface reflectance, and the development of novel, robust techniques for material recognition. In the context of 3D geometry acquisition, we introduce an improvement of structured light systems, which are capable of robustly acquiring objects ranging from diffuse surface reflectance to even specular surface reflectance with a sufficient diffuse component. We demonstrate that the resolution of the reconstruction can be increased significantly for multi-camera, multi-projector structured light systems by using overlappings of patterns that have been projected under different projector poses. As the reconstructions obtained by applying such triangulation-based techniques still contain high-frequency noise due to inaccurately localized correspondences established for images acquired under different viewpoints, we furthermore introduce a novel geometry acquisition technique that complements the structured light system with additional photometric normals and results in significantly more accurate reconstructions. In addition, we also present a novel method to acquire the 3D shape of mirroring objects with complex surface geometry. The aforementioned investigations on 3D reconstruction are accompanied by the development of novel tools for reliable material recognition which can be used in an initial step to recognize the present surface materials and, hence, to efficiently select the subsequently applied appropriate acquisition techniques based on these classified materials. In the scope of this thesis, we therefore focus on material recognition for scenarios with controlled illumination as given in lab environments as well as scenarios with natural illumination that are given in photographs of typical daily life scenes. Finally, based on the techniques developed in this thesis, we provide novel concepts towards efficient, automatic acquisition systems

Bioimage informatics in STED super-resolution microscopy

Optical microscopy is living its renaissance. The diffraction limit, although still physically true, plays a minor role in the achievable resolution in far-field fluorescence microscopy. Super-resolution techniques enable fluorescence microscopy at nearly molecular resolution. Modern (super-resolution) microscopy methods rely strongly on software. Software tools are needed all the way from data acquisition, data storage, image reconstruction, restoration and alignment, to quantitative image analysis and image visualization. These tools play a key role in all aspects of microscopy today – and their importance in the coming years is certainly going to increase, when microscopy little-by-little transitions from single cells into more complex and even living model systems. In this thesis, a series of bioimage informatics software tools are introduced for STED super-resolution microscopy. Tomographic reconstruction software, coupled with a novel image acquisition method STED< is shown to enable axial (3D) super-resolution imaging in a standard 2D-STED microscope. Software tools are introduced for STED super-resolution correlative imaging with transmission electron microscopes or atomic force microscopes. A novel method for automatically ranking image quality within microscope image datasets is introduced, and it is utilized to for example select the best images in a STED microscope image dataset.Siirretty Doriast

Performance-Metric Driven Atmospheric Compensation for Robust Free-Space Laser Communication

The effect of turbulence on laser propagation is a significant challenge to current electro-optical systems. While atmospheric compensation techniques in space object imaging and high-energy laser weapons have been thoroughly investigated, optimizing these techniques for Laser Communication (LaserCom) has not been examined to the same degree. Average Strehl ratio is the typical design metric for current atmospheric compensation systems. However, fade probability is the relevant metric for LaserCom. This difference motivated the investigation into metric-driven atmospheric compensation. Metric-based tracking techniques for fade mitigation is the first major focus of this research. In a moderate range air-to-air scenario, focal plane spot breakup is the dominant failure mechanism. Although the impact of spot breakup on average Strehl is small, spot breakup considerably increases fade probability. This result demonstrates that optimization of an atmospheric compensation system requires consideration of the metric of interest. Metric-driven design led to exploration of peak intensity tracking, which reduces fade probability by greater than 50% over conventional centroid trackers and Adaptive Optics (AO) systems for scenarios studied. An investigation of atmospheric compensation requirements based on deep fade phenomenology is the second major focus of this research. Fades are classified based on complexity of the required compensation technique. For compensation techniques studied, regions of superior performance, in terms of fade probability, are identified. Peak tracking is shown to outperform AO for thresholds below approximately 4% of the unabberated intensity. Furthermore, the boundary between superior performance regions is nearly invariant to turbulence strength. This boundary invariance simplifies operation of a composite system which is able to adaptively select compensation methodology in near real-time

Deep tissue light-sheet microscopy

Light-sheet fluorescence microscopy, also recognised as selective plane illumination microscopy, or SPIM, has paved a new road towards imaging of entire specimens for long periods of time, in vivo. Nevertheless, as in any other microscopy technique, light-sheet fluorescence microscopy also heavily depends on the scattering and absorption properties of the imaged sample in order to generate 3D datasets with high signal to noise even at larger tissue depths. This thesis focuses on the development and implementation of new strategies and methods which target the minimization of scattering and absorption effects stemming from living specimens. Combined, the three methods provide the ability to perform gentle, high contrast deep tissue imaging and photomanipulation. Additionally, it allows easier handling and fusion of 3D multiview light-sheet images