Object Segmentation from Motion Discontinuities and Temporal Occlusions–A Biologically Inspired Model

BACKGROUND: Optic flow is an important cue for object detection. Humans are able to perceive objects in a scene using only kinetic boundaries, and can perform the task even when other shape cues are not provided. These kinetic boundaries are characterized by the presence of motion discontinuities in a local neighbourhood. In addition, temporal occlusions appear along the boundaries as the object in front covers the background and the objects that are spatially behind it. METHODOLOGY/PRINCIPAL FINDINGS: From a technical point of view, the detection of motion boundaries for segmentation based on optic flow is a difficult task. This is due to the problem that flow detected along such boundaries is generally not reliable. We propose a model derived from mechanisms found in visual areas V1, MT, and MSTl of human and primate cortex that achieves robust detection along motion boundaries. It includes two separate mechanisms for both the detection of motion discontinuities and of occlusion regions based on how neurons respond to spatial and temporal contrast, respectively. The mechanisms are embedded in a biologically inspired architecture that integrates information of different model components of the visual processing due to feedback connections. In particular, mutual interactions between the detection of motion discontinuities and temporal occlusions allow a considerable improvement of the kinetic boundary detection. CONCLUSIONS/SIGNIFICANCE: A new model is proposed that uses optic flow cues to detect motion discontinuities and object occlusion. We suggest that by combining these results for motion discontinuities and object occlusion, object segmentation within the model can be improved. This idea could also be applied in other models for object segmentation. In addition, we discuss how this model is related to neurophysiological findings. The model was successfully tested both with artificial and real sequences including self and object motion

Short-Term Memory Trace in Rapidly Adapting Synapses of Inferior Temporal Cortex

Visual short-term memory tasks depend upon both the inferior temporal cortex (ITC) and the prefrontal cortex (PFC). Activity in some neurons persists after the first (sample) stimulus is shown. This delay-period activity has been proposed as an important mechanism for working memory. In ITC neurons, intervening (nonmatching) stimuli wipe out the delay-period activity; hence, the role of ITC in memory must depend upon a different mechanism. Here, we look for a possible mechanism by contrasting memory effects in two architectonically different parts of ITC: area TE and the perirhinal cortex. We found that a large proportion (80%) of stimulus-selective neurons in area TE of macaque ITCs exhibit a memory effect during the stimulus interval. During a sequential delayed matching-to-sample task (DMS), the noise in the neuronal response to the test image was correlated with the noise in the neuronal response to the sample image. Neurons in perirhinal cortex did not show this correlation. These results led us to hypothesize that area TE contributes to short-term memory by acting as a matched filter. When the sample image appears, each TE neuron captures a static copy of its inputs by rapidly adjusting its synaptic weights to match the strength of their individual inputs. Input signals from subsequent images are multiplied by those synaptic weights, thereby computing a measure of the correlation between the past and present inputs. The total activity in area TE is sufficient to quantify the similarity between the two images. This matched filter theory provides an explanation of what is remembered, where the trace is stored, and how comparison is done across time, all without requiring delay period activity. Simulations of a matched filter model match the experimental results, suggesting that area TE neurons store a synaptic memory trace during short-term visual memory

Does Presentation Format Influence Visual Size Discrimination in Tufted Capuchin Monkeys (Sapajus spp.)?

Most experimental paradigms to study visual cognition in humans and non-human species are based on discrimination tasks involving the choice between two or more visual stimuli. To this end, different types of stimuli and procedures for stimuli presentation are used, which highlights the necessity to compare data obtained with different methods. The present study assessed whether, and to what extent, capuchin monkeys\u27 ability to solve a size discrimination problem is influenced by the type of procedure used to present the problem. Capuchins\u27 ability to generalise knowledge across different tasks was also evaluated. We trained eight adult tufted capuchin monkeys to select the larger of two stimuli of the same shape and different sizes by using pairs of food items (Experiment 1), computer images (Experiment 1) and objects (Experiment 2). Our results indicated that monkeys achieved the learning criterion faster with food stimuli compared to both images and objects. They also required consistently fewer trials with objects than with images. Moreover, female capuchins had higher levels of acquisition accuracy with food stimuli than with images. Finally, capuchins did not immediately transfer the solution of the problem acquired in one task condition to the other conditions. Overall, these findings suggest that - even in relatively simple visual discrimination problems where a single perceptual dimension (i.e., size) has to be judged - learning speed strongly depends on the mode of presentation

Subliminal stimuli in the near absence of attention influence top-down cognitive control

Recent research has shown that visual stimuli can influence cognitive control functions, even if subjects are unaware of the identity of the stimuli. However, in those previous studies, subjects actively attended to the location of the subliminal stimuli. Here we assessed the role of endogenous spatial attention in such paradigms. We required subjects to quickly prepare for one of two numerical judgment tasks on the basis of the direction of motion in patches of moving dots presented in cued spatial locations. We found that irrelevant motion patches presented in the uncued spatial locations also influenced task performance. Motion in the uncued patches was weak and did not affect the perception of the cued patches. Further analyses suggested that the effect of priming by the uncued stimuli was present even for subjects who could only discriminate such stimuli at chance level. Three additional experiments confirmed that subjects paid minimal attention to the uncued locations, in that the subjects could not perform simple discriminations of conjunctions of features in those locations

Early Category-Specific Cortical Activation Revealed by Visual Stimulus Inversion

Visual categorization may already start within the first 100-ms after stimulus onset, in contrast with the long-held view that during this early stage all complex stimuli are processed equally and that category-specific cortical activation occurs only at later stages. The neural basis of this proposed early stage of high-level analysis is however poorly understood. To address this question we used magnetoencephalography and anatomically-constrained distributed source modeling to monitor brain activity with millisecond-resolution while subjects performed an orientation task on the upright and upside-down presented images of three different stimulus categories: faces, houses and bodies. Significant inversion effects were found for all three stimulus categories between 70–100-ms after picture onset with a highly category-specific cortical distribution. Differential responses between upright and inverted faces were found in well-established face-selective areas of the inferior occipital cortex and right fusiform gyrus. In addition, early category-specific inversion effects were found well beyond visual areas. Our results provide the first direct evidence that category-specific processing in high-level category-sensitive cortical areas already takes place within the first 100-ms of visual processing, significantly earlier than previously thought, and suggests the existence of fast category-specific neocortical routes in the human brain

Finding the engram.

Many attempts have been made to localize the physical trace of a memory, or engram, in the brain. However, until recently, engrams have remained largely elusive. In this Review, we develop four defining criteria that enable us to critically assess the recent progress that has been made towards finding the engram. Recent \u27capture\u27 studies use novel approaches to tag populations of neurons that are active during memory encoding, thereby allowing these engram-associated neurons to be manipulated at later times. We propose that findings from these capture studies represent considerable progress in allowing us to observe, erase and express the engram

Somatosensory System Deficits in Schizophrenia Revealed by MEG during a Median-Nerve Oddball Task

Although impairments related to somatosensory perception are common in schizophrenia, they have rarely been examined in functional imaging studies. In the present study, magnetoencephalography (MEG) was used to identify neural networks that support attention to somatosensory stimuli in healthy adults and abnormalities in these networks in patient with schizophrenia. A median-nerve oddball task was used to probe attention to somatosensory stimuli, and an advanced, high-resolution MEG source-imaging method was applied to assess activity throughout the brain. In nineteen healthy subjects, attention-related activation was seen in a sensorimotor network involving primary somatosensory (S1), secondary somatosensory (S2), primary motor (M1), pre-motor (PMA), and paracentral lobule (PCL) areas. A frontal–parietal–temporal “attention network”, containing dorsal- and ventral–lateral prefrontal cortex (DLPFC and VLPFC), orbitofrontal cortex (OFC), anterior cingulate cortex (ACC), superior parietal lobule (SPL), inferior parietal lobule (IPL)/supramarginal gyrus (SMG), and temporal lobe areas, was also activated. Seventeen individuals with schizophrenia showed early attention-related hyperactivations in S1 and M1 but hypo-activation in S1, S2, M1, and PMA at later latency in the sensorimotor network. Within this attention network, hypoactivation was found in SPL, DLPFC, orbitofrontal cortex, and the dorsal aspect of ACC. Hyperactivation was seen in SMG/IPL, frontal pole, and the ventral aspect of ACC in patients. These findings link attention-related somatosensory deficits to dysfunction in both sensorimotor and frontal–parietal–temporal networks in schizophrenia

Search for gravitational waves from Scorpius X-1 in the second Advanced LIGO observing run with an improved hidden Markov model

We present results from a semicoherent search for continuous gravitational waves from the low-mass x-ray binary Scorpius X-1, using a hidden Markov model (HMM) to track spin wandering. This search improves on previous HMM-based searches of LIGO data by using an improved frequency domain matched filter, the J-statistic, and by analyzing data from Advanced LIGO's second observing run. In the frequency range searched, from 60 to 650 Hz, we find no evidence of gravitational radiation. At 194.6 Hz, the most sensitive search frequency, we report an upper limit on gravitational wave strain (at 95% confidence) of h095%=3.47×10-25 when marginalizing over source inclination angle. This is the most sensitive search for Scorpius X-1, to date, that is specifically designed to be robust in the presence of spin wandering. © 2019 American Physical Society