Roadmap on 3D integral imaging: Sensing, processing, and display

This Roadmap article on three-dimensional integral imaging provides an overview of some of the research activities in the field of integral imaging. The article discusses various aspects of the field including sensing of 3D scenes, processing of captured information, and 3D display and visualization of information. The paper consists of a series of 15 sections from the experts presenting various aspects of the field on sensing, processing, displays, augmented reality, microscopy, object recognition, and other applications. Each section represents the vision of its author to describe the progress, potential, vision, and challenging issues in this field

Sparse aperture 3D passive image sensing and recognition

The way we perceive, capture, store, communicate and visualize the world has greatly changed in the past century Novel three dimensional (3D) imaging and display systems are being pursued both in academic and industrial settings. In many cases, these systems have revolutionized traditional approaches and/or enabled new technologies in other disciplines including medical imaging and diagnostics, industrial metrology, entertainment, robotics as well as defense and security. ^ In this dissertation, we focus on novel aspects of sparse aperture multi-view imaging systems and their application in quantum-limited object recognition in two separate parts. In the first part, two concepts are proposed. First a solution is presented that involves a generalized framework for 3D imaging using randomly distributed sparse apertures. Second, a method is suggested to extract the profile of objects in the scene through statistical properties of the reconstructed light field. In both cases, experimental results are presented that demonstrate the feasibility of the techniques. ^ In the second part, the application of 3D imaging systems in sensing and recognition of objects is addressed. In particular, we focus on the scenario in which only 10s of photons reach the sensor from the object of interest, as opposed to hundreds of billions of photons in normal imaging conditions. At this level, the quantum limited behavior of light will dominate and traditional object recognition practices may fail. We suggest a likelihood based object recognition framework that incorporates the physics of sensing at quantum-limited conditions. Sensor dark noise has been modeled and taken into account. This framework is applied to 3D sensing of thermal objects using visible spectrum detectors. Thermal objects as cold as 250K are shown to provide enough signature photons to be sensed and recognized within background and dark noise with mature, visible band, image forming optics and detector arrays. The results suggest that one might not need to venture into exotic and expensive detector arrays and associated optics for sensing room-temperature thermal objects in complete darkness.

Fostering social interactions within communal spaces within high-rise residential buildings on UBC Campus

High-­rise residential buildings are becoming more and more common nowadays, be it in the UBC campus or in many of the cities around the World. Past research suggests that living in high-­rise buildings adversely affects people’s satisfaction level and social relations. High-­‐rise residences also tend to generate many negative outcomes such as fear, dissatisfaction, behavioural problems, reduced helpfulness, poor social relations and hindered child development. The common spaces in these buildings have the potential to address these issues by creating a feeling of community and bringing people together. These are the spaces which are open to all building residents and can be used by people to sit, study, have a conversation, hold events, and for many other social uses. In this project we examined how the design features and Indoor Environment Quality (IEQ) factors of these spaces affect the social interactions occurring in these spaces. In this project the social common space in 5 different high rise buildings were analyzed, 3 of which are UBC student residences buildings: Marine Drive, Ponderosa Commons and Walter Gage and the other two are strata owned Academy and Sitka towers. We adopted three approaches to study these buildings: Observations of design features and physical measurements of IEQ features, On‐site Observations and Interviews and Survey Questionnaires. The research team spent approximately 8 hours in each of these spaces and observed and measured its design and Indoor Environmental Quality features such as lighting, thermal comfort, indoor air quality and acoustics. We also observed the use of the space and interviewed people. The survey conducted in received a response rate of around 10% from each building and providing us with some useful insights of occupant’s needs and satisfaction levels. We conducted a descriptive analysis on our collected data and have been able to find some interesting conclusions and useful recommendation for the developers of these buildings. In general, we found that there is not a clear direct correlation between the design features, IEQ factors and the social interactions that occur in these spaces. However, some recommendations can be logically deduced from our findings which are applicable to buildings similar to the buildings studied in this project. These conclusions and recommendations have been described in detail in the report. There exists a huge scope for further expanding on this study by studying more number of buildings and different common spaces in these buildings such as garbage sorting area and washing rooms. In the last section of the report we have explained the limitations of this study and some suggestions for future work. Disclaimer: “UBC SEEDS provides students with the opportunity to share the findings of their studies, as well as their opinions, conclusions and recommendations with the UBC community. The reader should bear in mind that this is a student project/report and is not an official document of UBC. Furthermore readers should bear in mind that these reports may not reflect the current status of activities at UBC. We urge you to contact the research persons mentioned in a report or the SEEDS Coordinator about the current status of the subject matter of a project/report.”Applied Science, Faculty ofUnreviewedGraduat

Simultaneous Computational Super-resolution and 3D Integral Imaging in the Long-wave Infrared Using an Array of Compact Cameras

We present an integral-imaging super-resolution imaging system in the long-wave infrared based on a synchronous array of low-cost uncooled cameras that yields enhanced angular resolution and 3D integral-imaging capabilities, operating at video rate. Integral imaging facilitates the sub-pixel image registration required for SR at specific planes, and can be used for a 3D scene reconstruction with simultaneous SR