Models for discriminating image blur from loss of contrast

Observers can discriminate between blurry and low-contrast images (Morgan, 2017). Wang and Simoncelli (2004) demonstrated that a code for blur is inherent to the phase relationships between localized pattern detectors of different scale. To test whether human observers actually use local phase coherence when discriminating between image blur and loss of contrast, we compared phase-scrambled chessboards with unscrambled chessboards. Although both stimuli had identical amplitude spectra, local phase coherence was disrupted by phase-scrambling. Human observers were required to concurrently detect and identify (as contrast or blur) image manipulations in the 2x2 forced-choice paradigm (Nachmias & Weber, 1975; Watson & Robson, 1981) traditionally considered to be a litmus test for "labelled lines" (i.e. detection mechanisms that can be distinguished on the basis of their preferred stimuli). Phase scrambling reduced some observers’ ability to discriminate between blur and a reduction in contrast. However, none of our observers produced data consistent with Watson & Robson’s most stringent test for labelled lines, regardless whether phases were scrambled or not. Models of performance fit significantly better when either a) the blur detector also responded to contrast modulations, b) the contrast detector also responded to blur modulations, or c) noise in the two detectors was anticorrelate

A Reverse Hierarchy Model for Predicting Eye Fixations

A number of psychological and physiological evidences suggest that early visual attention works in a coarse-to-fine way, which lays a basis for the reverse hierarchy theory (RHT). This theory states that attention propagates from the top level of the visual hierarchy that processes gist and abstract information of input, to the bottom level that processes local details. Inspired by the theory, we develop a computational model for saliency detection in images. First, the original image is downsampled to different scales to constitute a pyramid. Then, saliency on each layer is obtained by image super-resolution reconstruction from the layer above, which is defined as unpredictability from this coarse-to-fine reconstruction. Finally, saliency on each layer of the pyramid is fused into stochastic fixations through a probabilistic model, where attention initiates from the top layer and propagates downward through the pyramid. Extensive experiments on two standard eye-tracking datasets show that the proposed method can achieve competitive results with state-of-the-art models.Comment: CVPR 2014, 27th IEEE Conference on Computer Vision and Pattern Recognition (CVPR). CVPR 201

Concurrent investigation of global motion and form processing in amblyopia: an equivalent noise approach

PURPOSE: Directly comparing the motion and form processing in neurologic disorders has remained difficult due to the limitations in the experimental stimulus. In the current study, motion and form processing in amblyopia was characterized using random dot stimuli in different noise levels to parse out the effect of local and global processing on motion and form perception. METHODS: A total of 17 amblyopes (8 anisometropic and 9 strabismic), and 12 visually normal subjects monocularly estimated the global direction of motion and global orientation in random dot kinematograms (RDK) and Glass patterns (Glass), whose directions/orientations were drawn from normal distributions with a range of means and variances that served as external noise. Direction/orientation discrimination thresholds were measured without noise first then variance threshold was measured at the multiples of the direction/orientation threshold. The direction/orientation and variance thresholds were modelled to estimate internal noise and sampling efficiency parameters. RESULTS: Overall, the thresholds for Glass were higher than RDK for all subjects. The thresholds for both Glass and RDK were higher in the strabismic eyes compared with the fellow and normal eyes. On the other hand, the thresholds for anisometropic amblyopic eyes were similar to the normal eyes. The worse performance of strabismic amblyopes was best explained by relatively low sampling efficiency compared with other groups (P < 0.05). CONCLUSIONS: A deficit in global motion and form perception was only evident in strabismic amblyopia. Contrary to the dorsal stream deficiency hypothesis assumed in other developmental disorders, deficits were present in both motion (dorsal) and form (ventral) processing

Cortical Processing of Global Form, Motion and Biological Motion Under Low Light Levels

Advances in potential treatments for rod and cone dystrophies have increased the need to understand the contributions of rods and cones to higher-level cortical vision. We measured form, motion and biological motion coherence thresholds and EEG steady-state visual evoked potentials (SSVEP) responses under light conditions ranging from photopic to scotopic. Low light increased thresholds for all three kinds of stimuli; however, global form thresholds were relatively more impaired than those for global motion or biological motion. SSVEP responses to coherent global form and motion were reduced in low light, and motion responses showed a shift in topography from the midline to more lateral locations. Contrast sensitivity measures confirmed that basic visual processing was also affected by low light. However, comparison with contrast sensitivity function (CSF) reductions achieved by optical blur indicated that these were insufficient to explain the pattern of results, although the temporal properties of the rod system may also play a role. Overall, mid-level processing in extra-striate areas is differentially affected by light level, in ways that cannot be explained in terms of low-level spatiotemporal sensitivity. A topographical shift in scotopic motion SSVEP responses may reflect either changes to inhibitory feedback mechanisms between V1 and extra-striate regions or a reduction of input to the visual cortex. These results provide insight into how higher-level cortical vision is normally organised in absence of cone input, and provide a basis for comparison with patients with cone dystrophies, before and after treatments aiming to restore cone function