Reducing Worst-Case Illumination Estimates for Better Automatic White Balance

Automatic white balancing works quite well on average, but seriously fails some of the time. These failures lead to completely unacceptable images. Can the number, or severity, of these failures be reduced, perhaps at the expense of slightly poorer white balancing on average, with the overall goal being to increase the overall acceptability of a collection of images? Since the main source of error in automatic white balancing arises from misidentifying the overall scene illuminant, a new illuminationestimation algorithm is presented that minimizes the high percentile error of its estimates. The algorithm combines illumination estimates from standard existing algorithms and chromaticity gamut characteristics of the image as features in a feature space. Illuminant chromaticities are quantized into chromaticity bins. Given a test image of a real scene, its feature vector is computed, and for each chromaticity bin, the probability of the illuminant chromaticity falling into a chromaticity bin given the feature vector is estimated. The probability estimation is based on Loftsgaarden-Quesenberry multivariate density function estimation over the feature vectors derived from a set of synthetic training images. Once the probability distribution estimate for a given chromaticity channel is known, the smallest interval that is likely to contain the right answer with a desired probability (i.e., the smallest chromaticity interval whose sum of probabilities is greater or equal to the desired probability) is chosen. The point in the middle of that interval is then reported as the chromaticity of the illuminant. Testing on a dataset of real images shows that the error at the 90th and 98th percentile ranges can be reduced by roughly half, with minimal impact on the mean error

High dynamic range imaging for archaeological recording

This paper notes the adoption of digital photography as a primary recording means within archaeology, and reviews some issues and problems that this presents. Particular attention is given to the problems of recording high-contrast scenes in archaeology and High Dynamic Range imaging using multiple exposures is suggested as a means of providing an archive of high-contrast scenes that can later be tone-mapped to provide a variety of visualisations. Exposure fusion is also considered, although it is noted that this has some disadvantages. Three case studies are then presented (1) a very high contrast photograph taken from within a rock-cut tomb at Cala Morell, Menorca (2) an archaeological test pitting exercise requiring rapid acquisition of photographic records in challenging circumstances and (3) legacy material consisting of three differently exposed colour positive (slide) photographs of the same scene. In each case, HDR methods are shown to significantly aid the generation of a high quality illustrative record photograph, and it is concluded that HDR imaging could serve an effective role in archaeological photographic recording, although there remain problems of archiving and distributing HDR radiance map data

Screening for Neonatal Jaundice by Smartphone Sclera Imaging

Jaundice is observed in over 60% of neonates and must be carefully monitored. Ifsevere cases go unnoticed, death or permanent disability can result. Neonatal jaun-dice causes 100,000 deaths yearly, with low-income countries in Africa and SouthAsia particularly affected. There is an unmet need for an accessible and objectivescreening method. This thesis proposes a smartphone camera-based method forscreening based on quantification of yellow discolouration in the sclera.The primary aim is to develop and test an app to screen for neonatal jaundicethat requires only the smartphone itself. To this end, a novel ambient subtractionmethod is proposed and validated, with less dependence on external hardware orcolour cards than previous app-based methods. Another aim is to investigate thebenefits of screening via the sclera. An existing dataset of newborn sclera images(n=87) is used to show that sclera chromaticity can predict jaundice severity.The neoSCB app is developed to predict total serum bilirubin (TSB) fromambient-subtracted sclera chromaticity via a flash/ no-flash image pair. A studyis conducted in Accra, Ghana to evaluate the app. With 847 capture sessions, thisis the largest study on image-based jaundice detection to date. A model trained onsclera chromaticity is found to be more accurate than one based on skin. The modelis validated on an independent dataset collected at UCLH (n=38).The neoSCB app has a sensitivity of 100% and a specificity of 76% in iden-tifying neonates with TSB≥250μmol/L (n=179). This is equivalent to the TcB(JM-105) data collected concurrently, and as good as the best-performing app in theliterature (BiliCam). Following a one-time calibration, neoSCB works without spe-cialist equipment, which could help widen access to effective jaundice screening

Investigation related to multispectral imaging systems

A summary of technical progress made during a five year research program directed toward the development of operational information systems based on multispectral sensing and the use of these systems in earth-resource survey applications is presented. Efforts were undertaken during this program to: (1) improve the basic understanding of the many facets of multispectral remote sensing, (2) develop methods for improving the accuracy of information generated by remote sensing systems, (3) improve the efficiency of data processing and information extraction techniques to enhance the cost-effectiveness of remote sensing systems, (4) investigate additional problems having potential remote sensing solutions, and (5) apply the existing and developing technology for specific users and document and transfer that technology to the remote sensing community

In situ performance measurements of the mitre photovoltaic array

A data acquisition system was developed to provide more accurate and consistent measurement of the degradation of solar arrays. A technique was developed for in-situ measurement of photovoltaic panels of sufficient quality to permit evaluation of electrical performance over extended periods of several years

Smartphone screening for neonatal jaundice via ambient-subtracted sclera chromaticity

Jaundice is a major cause of mortality and morbidity in the newborn. Globally, early identification and home monitoring are significant challenges in reducing the incidence of jaundice-related neurological damage. Smartphone cameras are promising as colour-based screening tools as they are low-cost, objective and ubiquitous. We propose a novel smartphone method to screen for neonatal jaundice by imaging the sclera. It does not rely on colour calibration cards or accessories, which may facilitate its adoption at scale and in less economically developed regions. Our approach is to explicitly address three confounding factors in relating colour to jaundice: (1) skin pigmentation, (2) ambient light, and (3) camera spectral response. (1) The variation in skin pigmentation is avoided by imaging the sclera. (2) With the smartphone screen acting as an illuminating flash, a flash/ no-flash image pair is captured using the front-facing camera. The contribution of ambient light is subtracted. (3) In principle, this permits a device- and ambient-independent measure of sclera chromaticity following a one-time calibration. We introduce the concept of Scleral-Conjunctival Bilirubin (SCB), in analogy with Transcutaneous Bilirubin (TcB). The scleral chromaticity is mapped to an SCB value. A pilot study was conducted in the UCL Hospital Neonatal Care Unit (n = 37). Neonates were imaged using a specially developed app concurrently with having a blood test for total serum bilirubin (TSB). The better of two models for SCB based on ambient-subtracted sclera chromaticity achieved r = 0.75 (p250μmol/L (area under receiver operating characteristic curve, AUROC, 0.86), and 92% (specificity 67%) in identifying newborns with TSB>205μmol/L (AUROC 0.85). These results are comparable to modern transcutaneous bilirubinometers

Software-Defined Lighting.

For much of the past century, indoor lighting has been based on incandescent or gas-discharge technology. But, with LED lighting experiencing a 20x/decade increase in flux density, 10x/decade decrease in cost, and linear improvements in luminous efficiency, solid-state lighting is finally cost-competitive with the status quo. As a result, LED lighting is projected to reach over 70% market penetration by 2030. This dissertation claims that solid-state lighting’s real potential has been barely explored, that now is the time to explore it, and that new lighting platforms and applications can drive lighting far beyond its roots as an illumination technology. Scaling laws make solid-state lighting competitive with conventional lighting, but two key features make solid-state lighting an enabler for many new applications: the high switching speeds possible using LEDs and the color palettes realizable with Red-Green-Blue-White (RGBW) multi-chip assemblies. For this dissertation, we have explored the post-illumination potential of LED lighting in applications as diverse as visible light communications, indoor positioning, smart dust time synchronization, and embedded device configuration, with an eventual eye toward supporting all of them using a shared lighting infrastructure under a unified system architecture that provides software-control over lighting. To explore the space of software-defined lighting (SDL), we design a compact, flexible, and networked SDL platform to allow researchers to rapidly test new ideas. Using this platform, we demonstrate the viability of several applications, including multi-luminaire synchronized communication to a photodiode receiver, communication to mobile phone cameras, and indoor positioning using unmodified mobile phones. We show that all these applications and many other potential applications can be simultaneously supported by a single lighting infrastructure under software control.PhDElectrical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/111482/1/samkuo_1.pd

Illuminant Estimation By Deep Learning

Computational color constancy refers to the problem of estimating the color of the scene illumination in a color image, followed by color correction of the image through a white balancing process so that the colors of the image will be viewed as if the image was captured under a neutral white light source, and hence producing a plausible natural looking image. The illuminant estimation part is still a challenging task due to the ill-posed nature of the problem, and many methods have been proposed in the literature while each follows a certain approach in an attempt to improve the performance of the Auto-white balancing system for accurately estimating the illumination color for better image correction. These methods can typically be categorized into static-based and learning-based methods. Most of the proposed methods follow the learning-based approach because of its higher estimation accuracy compared to the former which relies on simple assumptions. While many of those learning-based methods show a satisfactory performance in general, they are built upon extracting handcrafted features which require a deep knowledge of the color image processing. More recent learning-based methods have shown higher improvements in illuminant estimation through using Deep Learning (DL) systems presented by the Convolutional Neural Networks (CNNs) that automatically learned to extract useful features from the given image dataset. In this thesis, we present a highly effective Deep Learning approach which treats the illuminant estimation problem as an illuminant classification task by learning a Convolutional Neural Network to classify input images belonging to certain pre-defined illuminant classes. Then, the output of the CNN which is in the form of class probabilities is used for computing the illuminant color estimate. Since training a deep CNN requires large number of training examples to avoid the “overfitting” problem, most of the recent CNN-based illuminant estimation methods attempted to overcome the limited number of images in the benchmark illuminant estimation dataset by sampling input images to multiple smaller patches as a way of data augmentation, but this can adversely affect the CNN training performance because some of these patches may not contain any semantic information and therefore, can be considered as noisy examples for the CNN that can lead to estimation ambiguity. However, in this thesis, we propose a novel approach for dataset augmentation through synthesizing images with different illuminations using the ground-truth illuminant color of other training images, which enhanced the performance of the CNN training compared to similar previous methods. Experimental results on the standard illuminant estimation benchmark dataset show that the proposed solution outperforms most of the previous illuminant estimation methods and show a competitive performance to the state-of-the-art methods