High-fidelity colour reproduction for high-dynamic-range imaging

The aim of this thesis is to develop a colour reproduction system for high-dynamic-range (HDR) imaging. Classical colour reproduction systems fail to reproduce HDR images because current characterisation methods and colour appearance models fail to cover the dynamic range of luminance present in HDR images. HDR tone-mapping algorithms have been developed to reproduce HDR images on low-dynamic-range media such as LCD displays. However, most of these models have only considered luminance compression from a photographic point of view and have not explicitly taken into account colour appearance. Motivated by the idea to bridge the gap between crossmedia colour reproduction and HDR imaging, this thesis investigates the fundamentals and the infrastructure of cross-media colour reproduction. It restructures cross-media colour reproduction with respect to HDR imaging, and develops a novel cross-media colour reproduction system for HDR imaging. First, our HDR characterisation method enables us to measure HDR radiance values to a high accuracy that rivals spectroradiometers. Second, our colour appearance model enables us to predict human colour perception under high luminance levels. We first built a high-luminance display in order to establish a controllable high-luminance viewing environment. We conducted a psychophysical experiment on this display device to measure perceptual colour attributes. A novel numerical model for colour appearance was derived from our experimental data, which covers the full working range of the human visual system. Our appearance model predicts colour and luminance attributes under high luminance levels. In particular, our model predicts perceived lightness and colourfulness to a significantly higher accuracy than other appearance models. Finally, a complete colour reproduction pipeline is proposed using our novel HDR characterisation and colour appearance models. Results indicate that our reproduction system outperforms other reproduction methods with statistical significance. Our colour reproduction system provides high-fidelity colour reproduction for HDR imaging, and successfully bridges the gap between cross-media colour reproduction and HDR imaging

Perception-Aware Optimisation Methodologies for Quantum Dot Based Displays and Lighting

Human colour vision acuity is limited. This presents opportunities to leverage these perceptual limits to achieve engineering optimisations for devices and systems that interact with the human vision system. This dissertation presents the results of few investigations we carried out into quantifying these limits and several optimisation methodologies that we devised. The first step in this process is to quantify the acuity of human colour vision. We obtained a large corpus of colour matching data from a mobile video game called Specimen. We examine what questions about human vision this dataset allows us to answer and explore global statistics about colour vision based on this data on 41,000 players from 175 countries. We show that we can use the information in this dataset to infer potential candidate functions for the spectral sensitivities of each person in the dataset. The human eye acts like a many to one function; quantifiably different spectra can look like the same colour. This is referred to as metamerism. From a device perspective, different spectra consume different amounts of energy to generate. We show that we can use these two properties to elicit the same colour sensation using less energy. In the colour samples we evaluated, we show that we can achieve up to 10 times less power consumption while achieving a colour match. Given that one cannot change the emission spectrum of a display after fabrication, we propose the use of a multi-primary colour display to achieve this. We present two indices for quantifying the metameric capacity of such a display and its ability to save energy. The emission spectrum of a quantum dot (QD) based device is very narrow. Previous work in the literature suggested that narrow bandwidth spectra can lead to observer metameric breakdown; different observers disagreeing on the perceived ‘colour’ of a spectrum. We show that this might not be the case, using modern colour science tools, and show how metameric breakdown in a display could be minimised by carefully choosing the primary emission wavelengths. The limited colour acuity of human vision implies that people cannot notice small differences in colour. This fact has been used to create approximate colour transformation algorithms that subtly change colours in images such that they consume less energy when displayed on an emissive pixel display without causing unacceptable visual artefacts. We conducted a user study to gather information about the effect of one such colour transform called Crayon. We present a method for effectively picking the optimal transform parameters for Crayon, based on the user study results. The method presented calculates these parameters based on the properties of the image being transformed such that the power saving can be maximised while minimising the loss of image quality. The user study results show that we can achieve up to 50% power saving with a majority of the study participants reporting a negligible degradation in image quality in the transformed images. We additionally investigate a hypothesis that was presented stating that images with large amounts of highly luminous pixels cause increased power consumption in OLED displays due to localised display heating. We show that this hypothesis is wrong. We also investigate if sub-pixel rendering in Pentile displays can be used to reduce display power consumption by intentionally turning off random sub-pixels. However, we present a negative result showing that even single-pixel artefacts are observable on the test platform and thus, this cannot be used to improve display power efficiency. The narrow-band optical emissions of QD based devices mixed with their ability to be fabricated through solution processing can be used to mix multiple QDs together to build devices that generate arbitrary spectral shapes. We show how to use this property in an numerical optimisation based design framework to create lighting devices with a high colour rendering index (CRI). We evaluate the effects of different cost functions and initialisation strategies, and show that, we are able to design devices with a CRI > 96 using only four different QD primaries. We use a charge-transport based simulator to asses the electric properties of the designed devices. We also showcase initial work done on a modular software interface and a material library we developed for this simulator.EPSRC DTP studentship award RG84040:EP/N509620/

Optimising Light Source Spectrum to Reduce the Energy Absorbed by Objects

Light is used to illuminate objects in the built environment. Humans can only observe light reflected from an object. Light absorbed by an object turns into heat and does not contribute to visibility. Since the spectral output of the new lighting technologies can be tuned, it is possible to imagine a lighting system that detects the colours of objects and emits customised light to minimise the absorbed energy. Previous optimisation studies investigated the use of narrowband LEDs to maximise the efficiency and colour quality of a light source. While these studies aimed to tune a white light source for general use, the lighting system proposed here minimises the energy consumed by lighting by detecting colours of objects and emitting customised light onto each coloured part of the object. This thesis investigates the feasibility of absorption-minimising light source spectra and their impact on the colour appearance of objects and energy consumption. Two computational studies were undertaken to form the theoretical basis of the absorption-minimising light source spectra. Computational simulations show that the theoretical single-peak spectra can lower the energy consumption up to around 38 % to 62 %, and double-peak test spectra can result in energy savings up to 71 %, without causing colour shifts. In these studies, standard reference illuminants, theoretical test spectra and coloured test samples were used. These studies are followed by the empirical evidence collected from two psychophysical experiments. Data from the experiments show that observers find the colour appearance of objects equally natural and attractive under spectrally optimised spectra and reference white light sources. An increased colour difference, to a certain extent, is found acceptable, which allows even higher energy savings. However, the translucent nature of some objects may negatively affect the results

Colour measurement and colour reproduction systems.

Thesis (M.Sc.Eng.)-University of Natal, Durban, 1987.Techniques of colour measurement and colour reproduction are important in a wide range of commercial and social activities in most modern economies. Their study thus constitutes one of the major areas of interest to the CIE. The project described in this thesis began as an outgrowth of studies of new types of light sources and of the colorimetry of colour-TV systems; plus a conviction that modern TV cameras can operate effectively with a wide range of different illuminating spectra. It was soon evident that two important prerequisites for this research were: an understanding of the processes of human colour vision; and a knowledge of the standard, international, colorimetric terminology of the CIE. These topics are discussed fully in the text. Also included is a review of modern gas-discharge lamps, the~y properties, and their applications. Both high-pressure (HID) types and low-pressure (fluorescent-tube) types are considered. Because of the need to measure the colours of surfaces and their TV reproductions as accurately as possible, various forms of colorimeter were examined, leading to the choice of a spectrophotometer system for this work. The design, construction, and evaluation of an original spetrophotometer system (the UND Spectrophotometer) are described fully in the text. Finally, attention is given to the operation of a television system under nonstandard lighting. Twelve different light sources were evaluated as TV ((taking" illuminants, using both subjective and colorimetric methods of assessment. The experimental results tend to confirm that colorimetric methods are unsuited to colour reproduction evaluation, and that subjective methods are more meaningful. A subjective scale of colour reproduction performance was established, and it was found to correlate closely with the CIE general colour rendering index (Ra) for the various test lamps. The work reported herein predates similar experiments with TV lighting by other workers, and it includes a wider range of light sources. In spite of differences in experimental technique, however, there is broad agreement with their general results

Quantifying colors at micrometer scale by colorimetric microscopy (C-Microscopy) approach

The color is the primal property of the objects around us and is direct manifestation of light-matter interactions. The color information is used in many different fields of science, technology and industry to investigate material properties or for identification of concentrations of substances. Usually the color information is used as a global parameter in a macro scale. To quantitatively measure color information in micro scale one needs to use dedicated microscope spectrophotometers or specialized micro-reflectance setups. Here, the Colorimetric Microscopy (C-Microscopy) approach based on digital optical microscopy and a free software is presented. The C-Microscopy approach uses color calibrated image and colorimetric calculations to obtain physically meaningful quantities i.e., dominant wavelength and excitation purity maps at micro level scale. This allows for the discovery of the local color details of samples surfaces. Later, to fully characterize the optical properties, the hyperspectral reflectance data at micro scale (reflectance as a function of wavelength for a each point) are colorimetrically recovered. The C-Microscopy approach was successfully applied to various types of samples i.e., two metamorphic rocks unakite and lapis lazuli, which are mixtures of different minerals; and to the surface of gold 99.999 % pellet, which exhibits different types of surface features. The C-Microscopy approach could be used to quantify the local optical properties changes of various materials at microscale in an accessible way. The approach is freely available as a set of python jupyter notebooks

Balancing Fidelity and Performance in Iridal Light Transport Simulations Aimed at Interactive Applications

Specific light transport models based on first-principles approaches have been proposed for complex organic materials such as human skin and blood. The driving force behind these efforts has been the high-fidelity reproduction of material appearance attributes without one having to rely on the manipulation of ad hoc parameters. These models, however, are usually considered excessively time consuming for rendering applications requiring interactive rates. In this thesis, we address this open problem with respect to one of the most challenging of these organic materials, namely the human iris. More specifically, we present a framework that consists in the careful configuration of algorithms employed by a biophysically-based iridal light transport model on the CUDA (Compute Unified Device Architecture) parallel computing platform. We then investigate the sensitivity of iridal appearance attributes to key model running parameters, namely spectral resolution and number of sample rays, in order to obtain a practical balance between appearance fidelity and performance on this platform. The results of our investigation indicate that predictive light transport simulations can be effectively employed in the generation of iridal images that are not only believable, but also controlled by biophysically meaningful parameters. Although our investigation is centered at the human iris, we believe that it can be viewed as a proof of concept, and the proposed configuration strategies and parameter space explorations can be employed to obtain similar results for other organic materials