Object Detection Through Exploration With A Foveated Visual Field

We present a foveated object detector (FOD) as a biologically-inspired alternative to the sliding window (SW) approach which is the dominant method of search in computer vision object detection. Similar to the human visual system, the FOD has higher resolution at the fovea and lower resolution at the visual periphery. Consequently, more computational resources are allocated at the fovea and relatively fewer at the periphery. The FOD processes the entire scene, uses retino-specific object detection classifiers to guide eye movements, aligns its fovea with regions of interest in the input image and integrates observations across multiple fixations. Our approach combines modern object detectors from computer vision with a recent model of peripheral pooling regions found at the V1 layer of the human visual system. We assessed various eye movement strategies on the PASCAL VOC 2007 dataset and show that the FOD performs on par with the SW detector while bringing significant computational cost savings.Comment: An extended version of this manuscript was published in PLOS Computational Biology (October 2017) at https://doi.org/10.1371/journal.pcbi.100574

The Effect of Viewing Eccentricity on Enumeration

Visual acuity and contrast sensitivity progressively diminish with increasing viewing eccentricity. Here we evaluated how visual enumeration is affected by visual eccentricity, and whether subitizing capacity, the accurate enumeration of a small number (∼3) of items, decreases with more eccentric viewing. Participants enumerated gratings whose (1) stimulus size was constant across eccentricity, and (2) whose stimulus size scaled by a cortical magnification factor across eccentricity. While we found that enumeration accuracy and precision decreased with increasing eccentricity, cortical magnification scaling of size neutralized the deleterious effects of increasing eccentricity. We found that size scaling did not affect subitizing capacities, which were nearly constant across all eccentricities. We also found that size scaling modulated the variation coefficients, a normalized metric of enumeration precision, defined as the standard deviation divided by the mean response. Our results show that the inaccuracy and imprecision associated with increasing viewing eccentricity is due to limitations in spatial resolution. Moreover, our results also support the notion that the precise number system is restricted to small numerosities (represented by the subitizing limit), while the approximate number system extends across both small and large numerosities (indexed by variation coefficients) at large eccentricities

Understanding disability glare: light scatter and retinal illuminance as predictors of sensitivity to contrast

The presence of a bright light in the visual field has two main effects on the retinal image: reduced contrast and increased retinal illuminance due to scattered light; the latter can, under some conditions, lead to an improvement in retinal sensitivity. The combined effect remains poorly understood, particularly at low light levels. A psychophysical flicker-cancellation test was used to measure the amount and angular distribution of scattered light in the eye for 40 observers. Contrast thresholds were measured using a functional contrast sensitivity test. Pupil-plane glare-source illuminances (i.e. 0, 1.35, 19.21 lm/m2), eccentricities (5°, 10°, 15°), and background luminances (1, 2.6, 26 cd/m2) were investigated. Visual performance was better than predicted, based on loss of retinal image contrast caused by scattered light, particularly in the mesopic range. Prediction accuracy improved significantly when the expected increase in retinal sensitivity in the presence of scattered light was also incorporated in the model

Spatial and Temporal Dynamics of Attentional Guidance during Inefficient Visual Search

Spotting a prey or a predator is crucial in the natural environment and relies on the ability to extract quickly pertinent visual information. The experimental counterpart of this behavior is visual search (VS) where subjects have to identify a target amongst several distractors. In difficult VS tasks, it has been found that the reaction time (RT) is influenced by salience factors, such as the target-distractor similarity, and this finding is usually regarded as evidence for a guidance of attention by preattentive mechanisms. However, the use of RT measurements, a parameter which depends on multiple factors, allows only very indirect inferences about the underlying attentional mechanisms. The purpose of the present study was to determine the influence of salience factors on attentional guidance during VS, by measuring directly attentional allocation. We studied attention allocation by using a dual covert VS task in subjects who had 1) to detect a target amongst different items and 2) to report letters briefly flashed inside those items at different delays. As predicted, we showed that parallel processes guide attention towards the most relevant item by virtue of both goal-directed and stimulus-driven factors, and we demonstrated that this attentional selection is a prerequisite for target detection. In addition, we show that when the target is characterized by two features (conjunction VS), the goal-directed effects of both features are initially combined into a unique salience value, but at a later stage, grouping phenomena interact with the salience computation, and lead to the selection of a whole group of items. These results, in line with Guided Search Theory, show that efficient and rapid preattentive processes guide attention towards the most salient item, allowing to reduce the number of attentional shifts needed to find the target

A First- and Second-Order Motion Energy Analysis of Peripheral Motion Illusions Leads to Further Evidence of “Feature Blur” in Peripheral Vision

Anatomical and physiological differences between the central and peripheral visual systems are well documented. Recent findings have suggested that vision in the periphery is not just a scaled version of foveal vision, but rather is relatively poor at representing spatial and temporal phase and other visual features. Shapiro, Lu, Huang, Knight, and Ennis (2010) have recently examined a motion stimulus (the “curveball illusion”) in which the shift from foveal to peripheral viewing results in a dramatic spatial/temporal discontinuity. Here, we apply a similar analysis to a range of other spatial/temporal configurations that create perceptual conflict between foveal and peripheral vision.To elucidate how the differences between foveal and peripheral vision affect super-threshold vision, we created a series of complex visual displays that contain opposing sources of motion information. The displays (referred to as the peripheral escalator illusion, peripheral acceleration and deceleration illusions, rotating reversals illusion, and disappearing squares illusion) create dramatically different perceptions when viewed foveally versus peripherally. We compute the first-order and second-order directional motion energy available in the displays using a three-dimensional Fourier analysis in the (x, y, t) space. The peripheral escalator, acceleration and deceleration illusions and rotating reversals illusion all show a similar trend: in the fovea, the first-order motion energy and second-order motion energy can be perceptually separated from each other; in the periphery, the perception seems to correspond to a combination of the multiple sources of motion information. The disappearing squares illusion shows that the ability to assemble the features of Kanisza squares becomes slower in the periphery.The results lead us to hypothesize “feature blur” in the periphery (i.e., the peripheral visual system combines features that the foveal visual system can separate). Feature blur is of general importance because humans are frequently bringing the information in the periphery to the fovea and vice versa

Visual Performance Fields: Frames of Reference

Performance in most visual discrimination tasks is better along the horizontal than the vertical meridian (Horizontal-Vertical Anisotropy, HVA), and along the lower than the upper vertical meridian (Vertical Meridian Asymmetry, VMA), with intermediate performance at intercardinal locations. As these inhomogeneities are prevalent throughout visual tasks, it is important to understand the perceptual consequences of dissociating spatial reference frames. In all studies of performance fields so far, allocentric environmental references and egocentric observer reference frames were aligned. Here we quantified the effects of manipulating head-centric and retinotopic coordinates on the shape of visual performance fields. When observers viewed briefly presented radial arrays of Gabors and discriminated the tilt of a target relative to homogeneously oriented distractors, performance fields shifted with head tilt (Experiment 1), and fixation (Experiment 2). These results show that performance fields shift in-line with egocentric referents, corresponding to the retinal location of the stimulus

Proteomics Mapping of Cord Blood Identifies Haptoglobin “Switch-On” Pattern as Biomarker of Early-Onset Neonatal Sepsis in Preterm Newborns

Intra-amniotic infection and/or inflammation (IAI) are important causes of preterm birth and early-onset neonatal sepsis (EONS). A prompt and accurate diagnosis of EONS is critical for improved neonatal outcomes. We sought to explore the cord blood proteome and identify biomarkers and functional protein networks characterizing EONS in preterm newborns.We studied a prospective cohort of 180 premature newborns delivered May 2004-September 2009. A proteomics discovery phase employing two-dimensional differential gel electrophoresis (2D-DIGE) and mass spectrometry identified 19 differentially-expressed proteins in cord blood of newborns with culture-confirmed EONS (n = 3) versus GA-matched controls (n = 3). Ontological classifications of the proteins included transfer/carrier, immunity/defense, protease/extracellular matrix. The 1(st)-level external validation conducted in the remaining 174 samples confirmed elevated haptoglobin and haptoglobin-related protein immunoreactivity (Hp&HpRP) in newborns with EONS (presumed and culture-confirmed) independent of GA at birth and birthweight (P<0.001). Western blot concurred in determining that EONS babies had conspicuous Hp&HpRP bands in cord blood ("switch-on pattern") as opposed to non-EONS newborns who had near-absent "switch-off pattern" (P<0.001). Fetal Hp phenotype independently impacted Hp&HpRP. A bayesian latent-class analysis (LCA) was further used for unbiased classification of all 180 cases based on probability of "antenatal IAI exposure" as latent variable. This was then subjected to 2(nd)-level validation against indicators of adverse short-term neonatal outcome. The optimal LCA algorithm combined Hp&HpRP switch pattern (most input), interleukin-6 and neonatal hematological indices yielding two non-overlapping newborn clusters with low (≤20%) versus high (≥70%) probability of IAI exposure. This approach reclassified ∼30% of clinical EONS diagnoses lowering the number needed to harm and increasing the odds ratios for several adverse outcomes including intra-ventricular hemorrhage.Antenatal exposure to IAI results in precocious switch-on of Hp&HpRP expression. As EONS biomarker, cord blood Hp&HpRP has potential to improve the selection of newborns for prompt and targeted treatment at birth