On Adaptive Non-Linarity for Color Discrimination and Chromatic Adaptation

Assuming that the photoreceptor response of the human visual system is adaptive and non-linear, we can derive mathematical properties that can account for both color discrimination and chromatic adaptation. This could be due to the photoreceptors’ response to illumination, which is non-linear and varies according to the adaptation state. Assuming the Naka-Rushton nonlinear function and an automatic gain control function, we can derive color discrimination and chromatic adaptation data. We extend the discussion to a three layer model of retinal color processing, and show how we could predict corresponding color data

Texture Segregation in Chromatic Element-Arrangement Patterns

We compare the perceived segregation of element-arrangement patterns1 which are composed of two types of squanes arranged in vertical stripes in the top and bottom regions and in a checkerboard in the middle region. The squares in a pattern are either equal in luminance and differing in hue or equal in hue and differing in luminance. Perceived segregation of squares differing in hue is not predicted by their rated similarity, but rather by the square-root of the sum of the squares of the differences in the outputs of the L-M and L+M-S opponent channels. Adaptation to the background luminance affects judgements of perceived segregation but does not affect judgments of perceived similarity. For a given background luminance, perceived segregation is a linear function of cone contrasts. Perceived hue similarity is instead a linear function of cone excitations across the background luminances. High and low luminance backgrounds decrease the perceived segregation of patterns differing in luminance. A high luminance achromatic background decreases the perceived segregation of patterns differing in hue but a low luminance achromatic background does not. The results indicate that the adaptation luminance affects the contribution of luminance differences between the two types of squares to perceived segregation but not the contribution of hue differences. For element-arrangement patterns composed of squares of equal luminance that differ in hue, perceived segregation is associated with differences in the perceived brightness of the hues. The results are consistent with the findings that the perceived segregation in element-arrangement patterns is primarily a function of the early visual mechanisms that encode pattern differences prior to the specification of the forms of the squares and their properties.Office of Naval Research (N00014-91-J-4100, N00014-94-1-0597, N00014-95-1-0409); Advanced Research Projects Agency (N00014-92-J-4015); Air Force Office of Scientific Research (F49620-92-J-0334); National Science Foundation (IIU-94-01659

Digital Color Imaging

This paper surveys current technology and research in the area of digital color imaging. In order to establish the background and lay down terminology, fundamental concepts of color perception and measurement are first presented us-ing vector-space notation and terminology. Present-day color recording and reproduction systems are reviewed along with the common mathematical models used for representing these devices. Algorithms for processing color images for display and communication are surveyed, and a forecast of research trends is attempted. An extensive bibliography is provided

A Model of Local Adaptation

The visual system constantly adapts to different luminance levels when viewing natural scenes. The state of visual adaptation is the key parameter in many visual models. While the time-course of such adaptation is well understood, there is little known about the spatial pooling that drives the adaptation signal. In this work we propose a new empirical model of local adaptation, that predicts how the adaptation signal is integrated in the retina. The model is based on psychophysical measurements on a high dynamic range (HDR) display. We employ a novel approach to model discovery, in which the experimental stimuli are optimized to find the most predictive model. The model can be used to predict the steady state of adaptation, but also conservative estimates of the visibility(detection) thresholds in complex images.We demonstrate the utility of the model in several applications, such as perceptual error bounds for physically based rendering, determining the backlight resolution for HDR displays, measuring the maximum visible dynamic range in natural scenes, simulation of afterimages, and gaze-dependent tone mapping

Visual Learning In The Perception Of Texture: Simple And Contingent Aftereffects Of Texture Density

Novel results elucidating the magnitude, binocularity and retinotopicity of aftereffects of visual texture density adaptation are reported as is a new contingent aftereffect of texture density which suggests that the perception of visual texture density is quite malleable. Texture aftereffects contingent upon orientation, color and temporal sequence are discussed. A fourth effect is demonstrated in which auditory contingencies are shown to produce a different kind of visual distortion. The merits and limitations of error-correction and classical conditioning theories of contingent adaptation are reviewed. It is argued that a third kind of theory which emphasizes coding efficiency and informational considerations merits close attention. It is proposed that malleability in the registration of texture information can be understood as part of the functional adaptability of perception

Color-Perception-Guided Display Power Reduction for Virtual Reality

Battery life is an increasingly urgent challenge for today's untethered VR and AR devices. However, the power efficiency of head-mounted displays is naturally at odds with growing computational requirements driven by better resolution, refresh rate, and dynamic ranges, all of which reduce the sustained usage time of untethered AR/VR devices. For instance, the Oculus Quest 2, under a fully-charged battery, can sustain only 2 to 3 hours of operation time. Prior display power reduction techniques mostly target smartphone displays. Directly applying smartphone display power reduction techniques, however, degrades the visual perception in AR/VR with noticeable artifacts. For instance, the "power-saving mode" on smartphones uniformly lowers the pixel luminance across the display and, as a result, presents an overall darkened visual perception to users if directly applied to VR content. Our key insight is that VR display power reduction must be cognizant of the gaze-contingent nature of high field-of-view VR displays. To that end, we present a gaze-contingent system that, without degrading luminance, minimizes the display power consumption while preserving high visual fidelity when users actively view immersive video sequences. This is enabled by constructing a gaze-contingent color discrimination model through psychophysical studies, and a display power model (with respect to pixel color) through real-device measurements. Critically, due to the careful design decisions made in constructing the two models, our algorithm is cast as a constrained optimization problem with a closed-form solution, which can be implemented as a real-time, image-space shader. We evaluate our system using a series of psychophysical studies and large-scale analyses on natural images. Experiment results show that our system reduces the display power by as much as 24% with little to no perceptual fidelity degradation

The components of colour vision

Colour perception is formed of many different components, such as colour discrimination, colour constancy, colour term naming, and the dimensions of colour (hue, chroma and lightness). It is a ‘toolbox’ of processes, not one cohesive function. Some of the components of colour vision develop into adult-like function over childhood, but they do not necessarily mature at the same speed. The studies in this thesis investigate adult, child and infant colour perception and cognition. Paper 1 finds a relationship between colour constancy and colour term naming in three- to four-year-old children. This relationship has wider implications for the co-development of language and perception. Paper 2 (Rogers, Knoblauch & Franklin, 2016) uses the technique of Maximum Likelihood Conjoint Measurement (MLCM) in adult participants to investigate the interaction between lightness and chroma in perception. Paper 3 combines MLCM analysis with preferential looking methods to compare interaction of lightness and chroma in infant and adult participants. This study paves the way for the use of MLCM and eye-tracking for studying other dimensions in development such as face perception, language, surface and shape. Paper 4 investigates why discrimination is poorest along the blue-yellow direction of cone opponent space (also known as the daylight locus). We tested the theory that this is adaptive for colour constancy by comparing illumination discrimination to surface discrimination in adult participants. We found equally poor discrimination for blue-yellow in both conditions, suggesting colour constancy is not the only explanatory factor. Together, these papers add to our understanding of the key components of colour vision over the life span and how perception of colour depends on various contextual and individual factors. Furthermore, this thesis develops novel applications of experimental techniques, and paves the way for these methods to be used to study other cognitive and developmental domains

Modelling Colour Appearance: Applications in Skin Image Perception

Humans are trichromatic, and yet their perception of colours is rich and complex. The research presented in this thesis explores the process of colour appearance of uniform patches and natural polychromatic stimuli. This is done through the measurement and analysis of the achromatic locus (Chapter 2), modelling of chromatic adaptation in a large dataset of unique hues settings (Chapter 3), and measurement of thresholds for uniform and polychromatic stimuli derived from simulated skin images (Chapter 4). Chapter 2 proposes a novel navigation scheme based on unique hues for traversing colour space. The results show that when colour adjustments are made using this novel scheme, the variability of achromatic settings made by observers is reduced compared to the classical method of making colour adjustments along the cardinal axes of the CIELUV colour space. This result holds across the tested luminance levels (5,20,50 cd/m^2) in each of the three tested ambient illumination conditions – dark, simulated daylight and cool white fluorescent lighting. The analysis also shows that the direction of maximum variance of the achromatic settings lies along the daylight locus. Chapter 3 evaluates models of chromatic adaptation by using unique hues settings measured under different ambient illumination conditions. It is shown that a simple diagonal model in cone excitation space is the most efficient in terms of the trade-off between accuracy and degrees of freedom. It is also found that diagonal and linear models show similar performances, reiterating their theoretical equivalence. Performances of these diagonalisable models are found to be worse for UR and UG unique hue planes compared to UY and UB planes. Chapter 4 presents a set of three experiments reporting estimations of perceptual thresholds for polychromatic and uniform stimuli in a 3-D chromaticity-luminance colour space. The first experiment reports thresholds for simulated skin images and uniform stimuli of the corresponding mean CIELAB colour. The second and third experiments investigate the effect of ambient illumination and the location of the stimuli in colour space. The thresholds for the polychromatic stimuli are found to be consistently higher than those for the uniform patches, for both the chromatic, and the luminance projections. The area of the chromaticity ellipses shows a gradual increase with distance from the illuminant chromaticity. The orientations of these ellipses for simulated skin are found to align with the vector joining the mean patch chromaticity and the illuminant chromaticity