Studies in ambient intelligent lighting

The revolution in lighting we are arguably experiencing is led by technical developments in the area of solid state lighting technology. The improved lifetime, efficiency and environmentally friendly raw materials make LEDs the main contender for the light source of the future. The core of the change is, however, not in the basic technology, but in the way users interact with it and the way the quality of the produced effect on the environment is judged. With the new found freedom the users can switch their focus from the confines of the technology to the expression of their needs, regardless of the details of the lighting system. Identifying the user needs, creating an effective language to communicate them to the system, and translating them to control signals that fulfill them, as well as defining the means to measure the quality of the produced result are the topic of study of a new multidisciplinary area of study, Ambient Intelligent Lighting. This thesis describes a series of studies in the field of Ambient Intelligent Lighting, divided in two parts. The first part of the thesis demonstrates how, by adopting a user centric design philosophy, the traditional control paradigms can be superseded by novel, so-called effect driven controls. Chapter 3 describes an algorithm that, using statistical methods and image processing, generates a set of colors based on a term or set of terms. The algorithm uses Internet image search engines (Google Images, Flickr) to acquire a set of images that represent a term and subsequently extracts representative colors from the set. Additionally, an estimate of the quality of the extracted set of colors is computed. Based on the algorithm, a system that automatically enriches music with lyrics based images and lighting was built and is described. Chapter 4 proposes a novel effect driven control algorithm, enabling users easy, natural and system agnostic means to create a spatial light distribution. By using an emerging technology, visible light communication, and an intuitive effect definition, a real time interactive light design system was developed. Usability studies on a virtual prototype of the system demonstrated the perceived ease of use and increased efficiency of an effect driven approach. In chapter 5, using stochastic models, natural temporal light transitions are modeled and reproduced. Based on an example video of a natural light effect, a Markov model of the transitions between colors of a single light source representing the effect is learned. The model is a compact, easy to reproduce, and as the user studies show, recognizable representation of the original light effect. The second part of the thesis studies the perceived quality of one of the unique capabilities of LEDs, chromatic temporal transitions. Using psychophysical methods, existing spatial models of human color vision were found to be unsuitable for predicting the visibility of temporal artifacts caused by the digital controls. The chapters in this part demonstrate new perceptual effects and make the first steps towards building a temporal model of human color vision. In chapter 6 the perception of smoothness of digital light transitions is studied. The studies presented demonstrate the dependence of the visibility of digital steps in a temporal transition on the frequency of change, chromaticity, intensity and direction of change of the transition. Furthermore, a clear link between the visibility of digital steps and flicker visibility is demonstrated. Finally, a new, exponential law for the dependence of the threshold speed of smooth transitions on the changing frequency is hypothesized and proven in subsequent experiments. Chapter 7 studies the discrimination and preference of different color transitions between two colors. Due to memory effects, the discrimination threshold for complete transitions was shown to be larger than the discrimination threshold for two single colors. Two linear transitions in different color spaces were shown to be significantly preferred over a set of other, curved, transitions. Chapter 8 studies chromatic and achromatic flicker visibility in the periphery. A complex change of both the absolute visibility thresholds for different frequencies, as well as the critical flicker frequency is observed. Finally, an increase in the absolute visibility thresholds caused by an addition of a mental task in central vision is demonstrated

Hyperspectral benthic mapping from underwater robotic platforms

We live on a planet of vast oceans; 70% of the Earth's surface is covered in water. They are integral to supporting life, providing 99% of the inhabitable space on Earth. Our oceans and the habitats within them are under threat due to a variety of factors. To understand the impacts and possible solutions, the monitoring of marine habitats is critically important. Optical imaging as a method for monitoring can provide a vast array of information however imaging through water is complex. To compensate for the selective attenuation of light in water, this thesis presents a novel light propagation model and illustrates how it can improve optical imaging performance. An in-situ hyperspectral system is designed which comprised of two upward looking spectrometers at different positions in the water column. The downwelling light in the water column is continuously sampled by the system which allows for the generation of a dynamic water model. In addition to the two upward looking spectrometers the in-situ system contains an imaging module which can be used for imaging of the seafloor. It consists of a hyperspectral sensor and a trichromatic stereo camera. New calibration methods are presented for the spatial and spectral co-registration of the two optical sensors. The water model is used to create image data which is invariant to the changing optical properties of the water and changing environmental conditions. In this thesis the in-situ optical system is mounted onboard an Autonomous Underwater Vehicle. Data from the imaging module is also used to classify seafloor materials. The classified seafloor patches are integrated into a high resolution 3D benthic map of the surveyed site. Given the limited imaging resolution of the hyperspectral sensor used in this work, a new method is also presented that uses information from the co-registered colour images to inform a new spectral unmixing method to resolve subpixel materials

2D and 3D high-speed multispectral optical imaging systems for in-vivo biomedical research

Functional optical imaging encompasses the use of optical imaging techniques to study living biological systems in their native environments. Optical imaging techniques are well-suited for functional imaging because they are minimally-invasive, use non ionizing radiation, and derive contrast from a wide range of biological molecules. Modern transgenic labeling techniques, active and inactive exogenous agents, and intrinsic sources of contrast provide specific and dynamic markers of in-vivo processes at subcellular resolution. A central challenge in building functional optical imaging systems is to acquire data at high enough spatial and temporal resolutions to be able to resolve the in-vivo process(es) under study. This challenge is particularly highlighted within neuroscience where considerable effort in the field has focused on studying the structural and functional relationships within complete neurovascular units in the living brain. Many existing functional optical techniques are limited in meeting this challenge by their imaging geometries, light source(s), and/or hardware implementations. In this thesis we describe the design, construction, and application of novel 2D and 3D optical imaging systems to address this central challenge with a specific focus on functional neuroimaging applications. The 2D system is an ultra-fast, multispectral, wide-field imaging system capable of imaging 7.5 times faster than existing technologies. Its camera-first design allows for the fastest possible image acquisition rates because it is not limited by synchronization challenges that have hindered previous multispectral systems. We present the development of this system from a bench top instrument to a portable, low-cost, modular, open source, laptop based instrument. The constructed systems can acquire multispectral images at >75 frames per second with image resolutions up to 512 x 512 pixels. This increased speed means that spectral analysis more accurately reflects the instantaneous state of tissues and allows for significantly improved tracking of moving objects. We describe 3 quantitative applications of these systems to in-vivo research and clinical studies of cortical imaging and calcium signaling in stem cells. The design and source code of the portable system was released to the greater scientific community to help make high-speed, multispectral imaging more accessible to a larger number of dynamic imaging applications, and to foster further development of the software package. The second system we developed is an entirely new, high-speed, 3D fluorescence microscopy platform called Laser-Scanning Intersecting Plane Tomography (L-SIPT). L-SIPT uses a novel combination of light-sheet illumination and off-axis detection to provide en-face 3D imaging of samples. L-SIPT allows samples to move freely in their native environments, enabling a range of experiments not possible with previous 3D optical imaging techniques. The constructed system is capable of acquiring 3D images at rates >20 volumes per second (VPS) with volume resolutions of 1400 x 50 x 150 pixels, over a 200 fold increase over conventional laser scanning microscopes. Spatial resolution is set by choice of telescope design. We developed custom opto-mechanical components, computer raytracing models to guide system design and to characterize the technique's fundamental resolution limits, and phantoms and biological samples to refine the system's performance capabilities. We describe initial applications development of the system to image freely moving, transgenic Drosophila Melanogaster larvae, 3D calcium signaling and hemodynamics in transgenic and exogenously labeled rodent cortex in-vivo, and 3D calcium signaling in acute transgenic rodent cortical brain slices in-vitro