Computational Imaging for Shape Understanding

Geometry is the essential property of real-world scenes. Understanding the shape of the object is critical to many computer vision applications. In this dissertation, we explore using computational imaging approaches to recover the geometry of real-world scenes. Computational imaging is an emerging technique that uses the co-designs of image hardware and computational software to expand the capacity of traditional cameras. To tackle face recognition in the uncontrolled environment, we study 2D color image and 3D shape to deal with body movement and self-occlusion. Especially, we use multiple RGB-D cameras to fuse the varying pose and register the front face in a unified coordinate system. The deep color feature and geodesic distance feature have been used to complete face recognition. To handle the underwater image application, we study the angular-spatial encoding and polarization state encoding of light rays using computational imaging devices. Specifically, we use the light field camera to tackle the challenging problem of underwater 3D reconstruction. We leverage the angular sampling of the light field for robust depth estimation. We also develop a fast ray marching algorithm to improve the efficiency of the algorithm. To deal with arbitrary reflectance, we investigate polarimetric imaging and develop polarimetric Helmholtz stereopsis that uses reciprocal polarimetric image pairs for high-fidelity 3D surface reconstruction. We formulate new reciprocity and diffuse/specular polarimetric constraints to recover surface depths and normals using an optimization framework. To recover the 3D shape in the unknown and uncontrolled natural illumination, we use two circularly polarized spotlights to boost the polarization cues corrupted by the environment lighting, as well as to provide photometric cues. To mitigate the effect of uncontrolled environment light in photometric constraints, we estimate a lighting proxy map and iteratively refine the normal and lighting estimation. Through expensive experiments on the simulated and real images, we demonstrate that our proposed computational imaging methods outperform traditional imaging approaches

Simultaneous 2D and 3D Video Rendering

The representation of stereoscopic video on a display is typically enabled either by using active shutter or polarizing viewing glasses in the television sets and displays available for end users. It is likely that in some usage situations some viewers do not wear viewing glasses at all times and hence it would be desirable if the stereoscopic video content could be tuned in the rendering device in such a manner that it could be simultaneously watched with and without viewing glasses with an acceptable quality. In this thesis, a novel video rendering technique is proposed and implemented in the post-processing stage which enables good quality both stereoscopic and traditional 2D video perception of the same content. This has been accomplished by manipulating of one view in the stereoscopic video by making it more similar to the other view in order to reduce the ghosting artifact perceived when the content is watched without viewing glasses while stereoscopic perception is maintained. The proposed technique includes three steps: disparity selection, contrast adjustment, and low-pass-filtering. Through an extensive series of subjective tests, the proposed approach has been evaluated to show that stereoscopic content can be viewed without glasses with an acceptable quality. The proposed methods resulted in a lower bitrate stereoscopic video stream requiring a smaller bandwidth for broadcasting

Compression and Subjective Quality Assessment of 3D Video

In recent years, three-dimensional television (3D TV) has been broadly considered as the successor to the existing traditional two-dimensional television (2D TV) sets. With its capability of offering a dynamic and immersive experience, 3D video (3DV) is expected to expand conventional video in several applications in the near future. However, 3D content requires more than a single view to deliver the depth sensation to the viewers and this, inevitably, increases the bitrate compared to the corresponding 2D content. This need drives the research trend in video compression field towards more advanced and more efficient algorithms. Currently, the Advanced Video Coding (H.264/AVC) is the state-of-the-art video coding standard which has been developed by the Joint Video Team of ISO/IEC MPEG and ITU-T VCEG. This codec has been widely adopted in various applications and products such as TV broadcasting, video conferencing, mobile TV, and blue-ray disc. One important extension of H.264/AVC, namely Multiview Video Coding (MVC) was an attempt to multiple view compression by taking into consideration the inter-view dependency between different views of the same scene. This codec H.264/AVC with its MVC extension (H.264/MVC) can be used for encoding either conventional stereoscopic video, including only two views, or multiview video, including more than two views. In spite of the high performance of H.264/MVC, a typical multiview video sequence requires a huge amount of storage space, which is proportional to the number of offered views. The available views are still limited and the research has been devoted to synthesizing an arbitrary number of views using the multiview video and depth map (MVD). This process is mandatory for auto-stereoscopic displays (ASDs) where many views are required at the viewer side and there is no way to transmit such a relatively huge number of views with currently available broadcasting technology. Therefore, to satisfy the growing hunger for 3D related applications, it is mandatory to further decrease the bitstream by introducing new and more efficient algorithms for compressing multiview video and depth maps. This thesis tackles the 3D content compression targeting different formats i.e. stereoscopic video and depth-enhanced multiview video. Stereoscopic video compression algorithms introduced in this thesis mostly focus on proposing different types of asymmetry between the left and right views. This means reducing the quality of one view compared to the other view aiming to achieve a better subjective quality against the symmetric case (the reference) and under the same bitrate constraint. The proposed algorithms to optimize depth-enhanced multiview video compression include both texture compression schemes as well as depth map coding tools. Some of the introduced coding schemes proposed for this format include asymmetric quality between the views. Knowing that objective metrics are not able to accurately estimate the subjective quality of stereoscopic content, it is suggested to perform subjective quality assessment to evaluate different codecs. Moreover, when the concept of asymmetry is introduced, the Human Visual System (HVS) performs a fusion process which is not completely understood. Therefore, another important aspect of this thesis is conducting several subjective tests and reporting the subjective ratings to evaluate the perceived quality of the proposed coded content against the references. Statistical analysis is carried out in the thesis to assess the validity of the subjective ratings and determine the best performing test cases

Aerospace Medicine and Biology: A continuing bibliography with indexes, supplement 237

A bibliography is given on the biological, physiological, psychological, and environmental effects to which man is subjected during and following simulated or actual flight in the Earth's atmosphere or in interplanetary space. References describing similar effects of biological organisms of lower order are also included. Such related topics as sanitary problems, pharmacology, toxicology, safety and survival, life support systems, exobiology, and personnel factors receive appropriate attention. In general, emphasis is placed on applied research, but references to fundamental studies and theoretical principles related to experimental development also qualify for inclusion

Visual Impairment and Blindness

Blindness and vision impairment affect at least 2.2 billion people worldwide with most individuals having a preventable vision impairment. The majority of people with vision impairment are older than 50 years, however, vision loss can affect people of all ages. Reduced eyesight can have major and long-lasting effects on all aspects of life, including daily personal activities, interacting with the community, school and work opportunities, and the ability to access public services. This book provides an overview of the effects of blindness and visual impairment in the context of the most common causes of blindness in older adults as well as children, including retinal disorders, cataracts, glaucoma, and macular or corneal degeneration

Glaucoma

This book addresses the basic and clinical science of glaucomas, a group of diseases that affect the optic nerve and visual fields and is usually accompanied by increased intraocular pressure. The book incorporates the latest development as well as future perspectives in glaucoma, since it has expedited publication. It is aimed for specialists in glaucoma, researchers, general ophthalmologists and trainees to increase knowledge and encourage further progress in understanding and managing these complicated diseases

A developmental assessment of visual perception for pre-school children

An assessment of Visual Perceptual skills for children of pre-school age (three to four- and-a-half years) was designed. Twenty-one subtests utilise three-dimensional play material where possible to maintain the interest and involvement of young children. Requirements for comprehension of verbal instructions are minimised, as is the necessity for accurate movement responses, making the assessment suitable for use with children who have delayed development and who may have Special Educational Needs such as physical disabilities, language disorder, or learning difficulties, and with non-English speaking children. Normative data was collected from a preliminary standardisation sample of one hundred children aged from two-and-a-half to four-and-a-half years. The Assessment was also administered to twenty children for whom English was not their mother tongue and forty-five children designated as having Special Educational Needs who suffered from a variety of handicaps. Those children whom their teachers suspected of being perceptually impaired were accurately identified by the Assessment. A small group of Down's Syndrome children were also tested, and most were found not to have a specific impairment in visual perception when this was compared to their general level of cognitive development. Good evidence of test-re-test and inter-rater reliability was demonstrated. Validation as established by correlation with existing measures of visual perception