A Contrast/Filling-In Model of 3-D Lightness Perception

Wallach's ratio hypothesis states that local luminance ratios clr!termine lightness perception under variable illumination. While local luminance ratios successfully discount gradual variations in illumination (illumination constancy or Type I constancy), they fail to explain lightness constancy in general. Some examples of failures of the ratio hypothesis include effects suggesting the coplanar ratio hypothesis (Gilchrist 1977), "assimilation" effects, and configural effects such as the Benary cross, and White's illusion. The present article extends the Boundary Contour System/Feature Contour System (BCS/FCS) approach to provide an explanation of these effects in terms of a neural model of 3-D lightness perception. Lightness constancy of objects in front of different backgrounds (background constancy or Type II constancy) is used to provide functional constraints to the theory and suggest a contrast negation hypothesis which states that ratio measures between coplanar regions are given more weight in the determination of lightness. Simulations of the model applied to several stimuli including Benary cross and White's illusion show that contrast negation mechanisms modulate illumination constancy mechanisms to extend the explanatory power of the model. The model is also used to devise new stimuli that test theoretical predictions

Colour appearance descriptors for image browsing and retrieval

In this paper, we focus on the development of whole-scene colour appearance descriptors for classification to be used in browsing applications. The descriptors can classify a whole-scene image into various categories of semantically-based colour appearance. Colour appearance is an important feature and has been extensively used in image-analysis, retrieval and classification. By using pre-existing global CIELAB colour histograms, firstly, we try to develop metrics for wholescene colour appearance: “colour strength”, “high/low lightness” and “multicoloured”. Secondly we propose methods using these metrics either alone or combined to classify whole-scene images into five categories of appearance: strong, pastel, dark, pale and multicoloured. Experiments show positive results and that the global colour histogram is actually useful and can be used for whole-scene colour appearance classification. We have also conducted a small-scale human evaluation test on whole-scene colour appearance. The results show, with suitable threshold settings, the proposed methods can describe the whole-scene colour appearance of images close to human classification. The descriptors were tested on thousands of images from various scenes: paintings, natural scenes, objects, photographs and documents. The colour appearance classifications are being integrated into an image browsing system which allows them to also be used to refine browsing

The colour of life: novel visualisations of population Lifestyles

Colour permeates our daily lives, yet we rarely take notice of it. In this work we utilise the SenseCam (a visual lifelogging tool), to investigte the predominant colours in one million minutes of human life that a group of 20 individuals encounter throughout their normal daily activities. We also compare the colours that different groups of people are exposed to in their typical days. This information is presented in using a novel colour-wheel visualisation which is a new means of illustrating that people are exposed to bright colours over longer durations of time during summer months, and more dark colours during winter months

Von Bezold assimilation effect reverses in stereoscopic conditions

Lightness contrast and lightness assimilation are opposite phenomena: in contrast, grey targets appear darker when bordering bright surfaces (inducers) rather than dark ones; in assimilation, the opposite occurs. The question is: which visual process favours the occurrence of one phenomenon over the other? Researchers provided three answers to this question. The first asserts that both phenomena are caused by peripheral processes; the second attributes their occurrence to central processes; and the third claims that contrast involves central processes, whilst assimilation involves peripheral ones. To test these hypotheses, an experiment on an IT system equipped with goggles for stereo vision was run. Observers were asked to evaluate the lightness of a grey target, and two variables were systematically manipulated: (i) the apparent distance of the inducers; and (ii) brightness of the inducers. The retinal stimulation was kept constant throughout, so that the peripheral processes remained the same. The results show that the lightness of the target depends on both variables. As the retinal stimulation was kept constant, we conclude that central mechanisms are involved in both lightness contrast and lightness assimilation

Von Bezold assimilation effect reverses in stereoscopic conditions

Lightness contrast and lightness assimilation are opposite phenomena: in contrast, grey targets appear darker when bordering bright surfaces (inducers) rather than dark ones; in assimilation, the opposite occurs. The question is: which visual process favours the occurrence of one phenomenon over the other? Researchers provided three answers to this question. The first asserts that both phenomena are caused by peripheral processes; the second attributes their occurrence to central processes; and the third claims that contrast involves central processes, whilst assimilation involves peripheral ones. To test these hypotheses, an experiment on an IT system equipped with goggles for stereo vision was run. Observers were asked to evaluate the lightness of a grey target, and two variables were systematically manipulated: (i) the apparent distance of the inducers; and (ii) brightness of the inducers. The retinal stimulation was kept constant throughout, so that the peripheral processes remained the same. The results show that the lightness of the target depends on both variables. As the retinal stimulation was kept constant, we conclude that central mechanisms are involved in both lightness contrast and lightness assimilation

Colour Text Segmentation in Web Images Based on Human Perception

There is a significant need to extract and analyse the text in images on Web documents, for effective indexing, semantic analysis and even presentation by non-visual means (e.g., audio). This paper argues that the challenging segmentation stage for such images benefits from a human perspective of colour perception in preference to RGB colour space analysis. The proposed approach enables the segmentation of text in complex situations such as in the presence of varying colour and texture (characters and background). More precisely, characters are segmented as distinct regions with separate chromaticity and/or lightness by performing a layer decomposition of the image. The method described here is a result of the authors’ systematic approach to approximate the human colour perception characteristics for the identification of character regions. In this instance, the image is decomposed by performing histogram analysis of Hue and Lightness in the HLS colour space and merging using information on human discrimination of wavelength and luminance

Redefining A in RGBA: Towards a Standard for Graphical 3D Printing

Advances in multimaterial 3D printing have the potential to reproduce various visual appearance attributes of an object in addition to its shape. Since many existing 3D file formats encode color and translucency by RGBA textures mapped to 3D shapes, RGBA information is particularly important for practical applications. In contrast to color (encoded by RGB), which is specified by the object's reflectance, selected viewing conditions and a standard observer, translucency (encoded by A) is neither linked to any measurable physical nor perceptual quantity. Thus, reproducing translucency encoded by A is open for interpretation. In this paper, we propose a rigorous definition for A suitable for use in graphical 3D printing, which is independent of the 3D printing hardware and software, and which links both optical material properties and perceptual uniformity for human observers. By deriving our definition from the absorption and scattering coefficients of virtual homogeneous reference materials with an isotropic phase function, we achieve two important properties. First, a simple adjustment of A is possible, which preserves the translucency appearance if an object is re-scaled for printing. Second, determining the value of A for a real (potentially non-homogeneous) material, can be achieved by minimizing a distance function between light transport measurements of this material and simulated measurements of the reference materials. Such measurements can be conducted by commercial spectrophotometers used in graphic arts. Finally, we conduct visual experiments employing the method of constant stimuli, and derive from them an embedding of A into a nearly perceptually uniform scale of translucency for the reference materials.Comment: 20 pages (incl. appendices), 20 figures. Version with higher quality images: https://cloud-ext.igd.fraunhofer.de/s/pAMH67XjstaNcrF (main article) and https://cloud-ext.igd.fraunhofer.de/s/4rR5bH3FMfNsS5q (appendix). Supplemental material including code: https://cloud-ext.igd.fraunhofer.de/s/9BrZaj5Uh5d0cOU/downloa

Semi-automated detection of surface degradation on bridges based on a level set method

Due to the effect of climate factors, natural phenomena and human usage, buildings and infrastructures are subject of progressive degradation. The deterioration of these structures has to be monitored in order to avoid hazards for human beings and for the natural environment in their neighborhood. Hence, on the one hand, monitoring such infrastructures is of primarily importance. On the other hand, unfortunately, nowadays this monitoring effort is mostly done by expert and skilled personnel, which follow the overall data acquisition, analysis and result reporting process, making the whole monitoring procedure quite expensive for the public (and private, as well) agencies. This paper proposes the use of a partially user-assisted procedure in order to reduce the monitoring cost and to make the obtained result less subjective as well. The developed method relies on the use of images acquired with standard cameras by even inexperienced personnel. The deterioration on the infrastructure surface is detected by image segmentation based on a level sets method. The results of the semi-automated analysis procedure are remapped on a 3D model of the infrastructure obtained by means of a terrestrial laser scanning acquisition. The proposed method has been successfully tested on a portion of a road bridge in Perarolo di Cadore (BL), Italy

Scene extraction in motion pictures

This paper addresses the challenge of bridging the semantic gap between the rich meaning users desire when they query to locate and browse media and the shallowness of media descriptions that can be computed in today\u27s content management systems. To facilitate high-level semantics-based content annotation and interpretation, we tackle the problem of automatic decomposition of motion pictures into meaningful story units, namely scenes. Since a scene is a complicated and subjective concept, we first propose guidelines from fill production to determine when a scene change occurs. We then investigate different rules and conventions followed as part of Fill Grammar that would guide and shape an algorithmic solution for determining a scene. Two different techniques using intershot analysis are proposed as solutions in this paper. In addition, we present different refinement mechanisms, such as film-punctuation detection founded on Film Grammar, to further improve the results. These refinement techniques demonstrate significant improvements in overall performance. Furthermore, we analyze errors in the context of film-production techniques, which offer useful insights into the limitations of our method