Stereo disparity improves color constancy

AbstractBinocular disparity is an aspect of natural viewing. This research investigates whether disparity affects surface color perception. Achromatic settings were obtained and compared for two stereograms of a scene with specular reflections, one stereogram with binocular disparity and one without it (cyclopean view). Binocular disparity was found to improve color constancy. Next, the geometry of specular highlights, which is distorted without binocular disparity, was specifically examined. Measurements compared color constancy with specular reflections that were either normal (with stereo disparity) or distorted (cyclopean view of the specularities). No significant change in constancy was found due to the geometrical distortion of specular highlights that occurs without stereo disparity, suggesting that constancy depends on other features of the percept affected by disparity. The results are discussed in terms of illuminant estimation in surface color perception

Low levels of specularity support operational color constancy, particularly when surface and illumination geometry can be inferred

We tested whether surface specularity alone supports operational color constancy—the ability to discriminate changes in illumination or reflectance. Observers viewed short animations of illuminant or reflectance changes in rendered scenes containing a single spherical surface and were asked to classify the change. Performance improved with increasing specularity, as predicted from regularities in chromatic statistics. Peak performance was impaired by spatial rearrangements of image pixels that disrupted the perception of illuminated surfaces but was maintained with increased surface complexity. The characteristic chromatic transformations that are available with nonzero specularity are useful for operational color constancy, particularly if accompanied by appropriate perceptual organization

Motion of glossy objects does not promote separation of lighting and surface colour

The surface properties of an object, such as texture, glossiness or colour, provide important cues to its identity. However, the actual visual stimulus received by the eye is determined by both the properties of the object and the illumination. We tested whether operational colour constancy for glossy objects (the ability to distinguish changes in spectral reflectance of the object, from changes in the spectrum of the illumination) was affected by rotational motion of either the object or the light source. The different chromatic and geometric properties of the specular and diffuse reflections provide the basis for this discrimination, and we systematically varied specularity to control the available information. Observers viewed animations of isolated objects undergoing either lighting or surface-based spectral transformations accompanied by motion. By varying the axis of rotation, and surface patterning or geometry, we manipulated: (i) motion-related information about the scene, (ii) relative motion between the surface patterning and the specular reflection of the lighting, and (iii) image disruption caused by this motion. Despite large individual differences in performance with static stimuli, motion manipulations neither improved nor degraded performance. As motion significantly disrupts frameby-frame low-level image statistics, we infer that operational constancy depends on a high-level scene interpretation, which is maintained in all condition

Colour Constancy: Cues, Priors and Development

Colour is crucial for detecting, recognising, and interacting with objects. However, the reflected wavelength of light ("colour") varies vastly depending on the illumination. Whilst adults can judge colours as relatively invariant under changing illuminations (colour constancy), much remains unknown, which this thesis aims to resolve. Firstly, previous studies have shown adults can use certain cues to estimate surface colour. However, one proposed cue - specular highlights - has been little researched so this is explored here. Secondly, the existing data on a daylight prior for colour constancy remain inconclusive so we aimed to further investigate this. Finally, no studies have investigated the development of colour constancy during childhood so the third aim is to determine at what age colour constancy becomes adult-like. In the introduction, existing research is discussed, including cues to the illuminant, daylight priors, and the development of perceptual constancies. The second chapter contains three experiments conducted to determine whether adults can use a specular highlight cue and/ or daylight prior to aid colour constancy. Results showed adults can use specular highlights when other cues are weakened. Evidence for a daylight prior was weak. In the third chapter the development of colour constancy during childhood was investigated by developing a novel child-friendly task. Children had higher constancy than adults, and evidence for a daylight prior was mixed. The final experimental chapter used the task developed in Chapter 3 to ask whether children can use specular highlights as a cue for colour constancy. Testing was halted early due to the coronavirus pandemic, yet the data obtained suggest that children are negatively impacted by specular highlights. Finally, in the general discussion, the results of the six experiments are brought together to draw conclusions regarding the use of cues and priors, and the development of colour constancy. Implications and future directions for research are discussed

Illuminant Estimation by Voting

Obtaining an estimate of the illuminant color is an important component in many image analysis applications. Due to the complexity of the problem many restrictive assumptions are commonly applied, making the existing illuminant estimation methodologies not widely applicable on natural images. We propose a methodology which analyzes a large number of regions in an image. An illuminant estimate is obtained independently from each region and a global illumination color is computed by consensus. Each region itself is mainly composed by pixels which simultaneously exhibit both diffuse and specular reflection. This allows for a larger inclusion of pixels than purely specularitybased methods, while avoiding, at the same time, some of the restrictive assumptions of purely diffuse-based approaches. As such, our technique is particularly well-suited for analyzing real-world images. Experiments with laboratory data show that our methodology outperforms 75 % of other illuminant estimation methods. On natural images, the algorithm is very stable and provides qualitatively correct estimates. 1

Spectral image analysis for measuring ripeness of tomatoes

In this study, spectral images of five ripeness stages of tomatoes have been recorded and analyzed. The electromagnetic spectrum between 396 and 736 nm was recorded in 257 bands (every 1.3 nm). Results show that spectral images offer more discriminating power than standard RGB images for measuring ripeness stages of tomatoes. The classification error of individual pixels was reduced from 51% to 19%. Using a gray reference, the reflectance can be made invariant to the light source and even object geometry, which makes it possible to have comparable classification results over a large range of illumination conditions. Experimental results show that, although the error rate increases from 19% to 35% when using different light sources, it is still considerably below the 51% for RGB under a single light sourc

Automated detection of effective scene illuminant chromaticity from specular highlights in digital images

An advanced, automated method is presented for determining an effective scene illuminant chromaticity (scene illuminant plus imaging system variables) from specular highlights in digital images subsequent to image capture. Underlying theories are presented based on a two component reflection model where the scene illuminant relative spectral power distribution is preserved in the specular component. Related methodologies for extracting scene illuminant information as well as alternative methods for achieving color constancy are presented along with factors which inhibit successful implementation. Following, development of a more robust algorithm is discussed. This algorithm is based on locating the center of convergence of a radial line pattern in the two-dimensional chromaticity histogram which theoretically identifies the effective scene illuminant chromaticity. This is achieved by using a radiality index to quantify the relative correlation between a radial mask and the histogram radial line pattern at discrete chromaticity coordinates within a specified search region. The coordinates associated with the strongest radiality index are adopted to represent the effective scene illuminant chromaticity. For a set of controlled test images, the physics-based specular highlight algorithm determined effective scene illuminant chromaticities to a level of accuracy which was nearly three times better than that of a benchmark statistically-based gray-world algorithm. The primary advantage of the specular highlight algorithm was its sustained performance when presented with image conditions of dominant colors, weak specular reflections, and strong interreflections