Object Detection Through Exploration With A Foveated Visual Field

We present a foveated object detector (FOD) as a biologically-inspired alternative to the sliding window (SW) approach which is the dominant method of search in computer vision object detection. Similar to the human visual system, the FOD has higher resolution at the fovea and lower resolution at the visual periphery. Consequently, more computational resources are allocated at the fovea and relatively fewer at the periphery. The FOD processes the entire scene, uses retino-specific object detection classifiers to guide eye movements, aligns its fovea with regions of interest in the input image and integrates observations across multiple fixations. Our approach combines modern object detectors from computer vision with a recent model of peripheral pooling regions found at the V1 layer of the human visual system. We assessed various eye movement strategies on the PASCAL VOC 2007 dataset and show that the FOD performs on par with the SW detector while bringing significant computational cost savings.Comment: An extended version of this manuscript was published in PLOS Computational Biology (October 2017) at https://doi.org/10.1371/journal.pcbi.100574

An Image Statistics–Based Model for Fixation Prediction

The problem of predicting where people look at, or equivalently salient region detection, has been related to the statistics of several types of low-level image features. Among these features, contrast and edge information seem to have the highest correlation with the fixation locations. The contrast distribution of natural images can be adequately characterized using a two-parameter Weibull distribution. This distribution catches the structure of local contrast and edge frequency in a highly meaningful way. We exploit these observations and investigate whether the parameters of the Weibull distribution constitute a simple model for predicting where people fixate when viewing natural images. Using a set of images with associated eye movements, we assess the joint distribution of the Weibull parameters at fixated and non-fixated regions. Then, we build a simple classifier based on the log-likelihood ratio between these two joint distributions. Our results show that as few as two values per image region are already enough to achieve a performance comparable with the state-of-the-art in bottom-up saliency prediction

Bias adjustment and ensemble recalibration methods for seasonal forecasting: a comprehensive intercomparison using the C3S dataset

This work presents a comprehensive intercomparison of diferent alternatives for the calibration of seasonal forecasts, ranging from simple bias adjustment (BA)-e.g. quantile mapping-to more sophisticated ensemble recalibration (RC) methods- e.g. non-homogeneous Gaussian regression, which build on the temporal correspondence between the climate model and the corresponding observations to generate reliable predictions. To be as critical as possible, we validate the raw model and the calibrated forecasts in terms of a number of metrics which take into account diferent aspects of forecast quality (association, accuracy, discrimination and reliability). We focus on one-month lead forecasts of precipitation and temperature from four state-of-the-art seasonal forecasting systems, three of them included in the Copernicus Climate Change Service dataset (ECMWF-SEAS5, UK Met Ofce-GloSea5 and Météo France-System5) for boreal winter and summer over two illustrative regions with diferent skill characteristics (Europe and Southeast Asia). Our results indicate that both BA and RC methods efectively correct the large raw model biases, which is of paramount importance for users, particularly when directly using the climate model outputs to run impact models, or when computing climate indices depending on absolute values/thresholds. However, except for particular regions and/or seasons (typically with high skill), there is only marginal added value-with respect to the raw model outputs-beyond this bias removal. For those cases, RC methods can outperform BA ones, mostly due to an improvement in reliability. Finally, we also show that whereas an increase in the number of members only modestly afects the results obtained from calibration, longer hindcast periods lead to improved forecast quality, particularly for RC methods.This work has been funded by the C3S activity on Evaluation and Quality Control for seasonal forecasts. JMG was partially supported by the project MULTI-SDM (CGL2015-66583-R, MINECO/FEDER). FJDR was partially funded by the H2020 EUCP project (GA 776613)

What is the role of the film viewer? The effects of narrative comprehension and viewing task on gaze control in film

Film is ubiquitous, but the processes that guide viewers' attention while viewing film narratives are poorly understood. In fact, many film theorists and practitioners disagree on whether the film stimulus (bottom-up) or the viewer (top-down) is more important in determining how we watch movies. Reading research has shown a strong connection between eye movements and comprehension, and scene perception studies have shown strong effects of viewing tasks on eye movements, but such idiosyncratic top-down control of gaze in film would be anathema to the universal control mainstream filmmakers typically aim for. Thus, in two experiments we tested whether the eye movements and comprehension relationship similarly held in a classic film example, the famous opening scene of Orson Welles' Touch of Evil (Welles & Zugsmith, Touch of Evil, 1958). Comprehension differences were compared with more volitionally controlled task-based effects on eye movements. To investigate the effects of comprehension on eye movements during film viewing, we manipulated viewers' comprehension by starting participants at different points in a film, and then tracked their eyes. Overall, the manipulation created large differences in comprehension, but only produced modest differences in eye movements. To amplify top-down effects on eye movements, a task manipulation was designed to prioritize peripheral scene features: a map task. This task manipulation created large differences in eye movements when compared to participants freely viewing the clip for comprehension. Thus, to allow for strong, volitional top-down control of eye movements in film, task manipulations need to make features that are important to narrative comprehension irrelevant to the viewing task. The evidence provided by this experimental case study suggests that filmmakers' belief in their ability to create systematic gaze behavior across viewers is confirmed, but that this does not indicate universally similar comprehension of the film narrative

Overt Attention and Context Factors: The Impact of Repeated Presentations, Image Type, and Individual Motivation

The present study investigated the dynamic of the attention focus during observation of different categories of complex scenes and simultaneous consideration of individuals' memory and motivational state. We repeatedly presented four types of complex visual scenes in a pseudo-randomized order and recorded eye movements. Subjects were divided into groups according to their motivational disposition in terms of action orientation and individual rating of scene interest

Evolution and Optimality of Similar Neural Mechanisms for Perception and Action during Search

A prevailing theory proposes that the brain's two visual pathways, the ventral and dorsal, lead to differing visual processing and world representations for conscious perception than those for action. Others have claimed that perception and action share much of their visual processing. But which of these two neural architectures is favored by evolution? Successful visual search is life-critical and here we investigate the evolution and optimality of neural mechanisms mediating perception and eye movement actions for visual search in natural images. We implement an approximation to the ideal Bayesian searcher with two separate processing streams, one controlling the eye movements and the other stream determining the perceptual search decisions. We virtually evolved the neural mechanisms of the searchers' two separate pathways built from linear combinations of primary visual cortex receptive fields (V1) by making the simulated individuals' probability of survival depend on the perceptual accuracy finding targets in cluttered backgrounds. We find that for a variety of targets, backgrounds, and dependence of target detectability on retinal eccentricity, the mechanisms of the searchers' two processing streams converge to similar representations showing that mismatches in the mechanisms for perception and eye movements lead to suboptimal search. Three exceptions which resulted in partial or no convergence were a case of an organism for which the targets are equally detectable across the retina, an organism with sufficient time to foveate all possible target locations, and a strict two-pathway model with no interconnections and differential pre-filtering based on parvocellular and magnocellular lateral geniculate cell properties. Thus, similar neural mechanisms for perception and eye movement actions during search are optimal and should be expected from the effects of natural selection on an organism with limited time to search for food that is not equi-detectable across its retina and interconnected perception and action neural pathways

Preclinical and randomized phase I studies of plitidepsin in adults hospitalized with COVID-19

Plitidepsin, a marine-derived cyclic-peptide, inhibits SARS-CoV-2 replication at nanomolar concentrations by targeting the host protein eukaryotic translation elongation factor 1A. Here, we show that plitidepsin distributes preferentially to lung over plasma, with similar potency against across several SARS-CoV-2 variants in preclinical studies. Simultaneously, in this randomized, parallel, open-label, proof-of-concept study (NCT04382066) conducted in 10 Spanish hospitals between May and November 2020, 46 adult hospitalized patients with confirmed SARS-CoV-2 infection received either 1.5 mg (n = 15), 2.0 mg (n = 16), or 2.5 mg (n = 15) plitidepsin once daily for 3 d. The primary objective was safety; viral load kinetics, mortality, need for increased respiratory support, and dose selection were secondary end points. One patient withdrew consent before starting procedures; 45 initiated treatment; one withdrew because of hypersensitivity. Two Grade 3 treatment-related adverse events were observed (hypersensitivity and diarrhea). Treatment-related adverse events affecting more than 5% of patients were nausea (42.2%), vomiting (15.6%), and diarrhea (6.7%). Mean viral load reductions from baseline were 1.35, 2.35, 3.25, and 3.85 log10 at days 4, 7, 15, and 31. Nonmechanical invasive ventilation was required in 8 of 44 evaluable patients (16.0%); six patients required intensive care support (13.6%), and three patients (6.7%) died (COVID-19-related). Plitidepsin has a favorable safety profile in patients with COVID-19

Predicting Eye Fixations on Complex Visual Stimuli Using Local Symmetry

Most bottom-up models that predict human eye fixations are based on contrast features. The saliency model of Itti, Koch and Niebur is an example of such contrast-saliency models. Although the model has been successfully compared to human eye fixations, we show that it lacks preciseness in the prediction of fixations on mirror-symmetrical forms. The contrast model gives high response at the borders, whereas human observers consistently look at the symmetrical center of these forms. We propose a saliency model that predicts eye fixations using local mirror symmetry. To test the model, we performed an eye-tracking experiment with participants viewing complex photographic images and compared the data with our symmetry model and the contrast model. The results show that our symmetry model predicts human eye fixations significantly better on a wide variety of images including many that are not selected for their symmetrical content. Moreover, our results show that especially early fixations are on highly symmetrical areas of the images. We conclude that symmetry is a strong predictor of human eye fixations and that it can be used as a predictor of the order of fixation

Introgression and rapid species turnover in sympatric damselflies

<p>Abstract</p> <p>Background</p> <p>Studying contemporary hybridization increases our understanding of introgression, adaptation and, ultimately, speciation. The sister species <it>Ischnura elegans </it>and <it>I. graellsii </it>(Odonata: Coenagrionidae) are ecologically, morphologically and genetically similar and hybridize. Recently, <it>I. elegans </it>has colonized northern Spain, creating a broad sympatric region with <it>I. graellsii</it>. Here, we review the distribution of both species in Iberia and evaluate the degree of introgression of <it>I. graellsii </it>into <it>I. elegans </it>using six microsatellite markers (442 individuals from 26 populations) and five mitochondrial genes in sympatric and allopatric localities. Furthermore, we quantify the effect of hybridization on the frequencies of the genetically controlled colour polymorphism in females of both species.</p> <p>Results</p> <p>In a principal component analysis of the microsatellite data, the first two principal components summarised almost half (41%) of the total genetic variation. The first axis revealed a clear separation of <it>I. graellsii </it>and <it>I</it>. <it>elegans </it>populations, while the second axis separated <it>I. elegans </it>populations. Admixture analyses showed extensive hybridization and introgression in <it>I. elegans </it>populations, consistent with <it>I. elegans </it>backcrosses and occasional F₁-hybrids, suggesting hybridization is on-going. More specifically, approximately 58% of the 166 Spanish <it>I. elegans </it>individuals were assigned to the <it>I. elegans </it>backcross category, whereas not a single of those individuals was assigned to the backcross with <it>I. graellsii</it>. The mitochondrial genes held little genetic variation, and the most common haplotype was shared by the two species.</p> <p>Conclusions</p> <p>The results suggest rapid species turnover in sympatric regions in favour of <it>I. elegans</it>, corroborating previous findings that <it>I. graellsii </it>suffers a mating disadvantage in sympatry with <it>I. elegans</it>. Examination of morph frequency dynamics indicates that hybridization is likely to have important implications for the maintenance of multiple female morphs, in particular during the initial period of hybridization.</p