Cortical Dynamics of Contextually-Cued Attentive Visual Learning and Search: Spatial and Object Evidence Accumulation

How do humans use predictive contextual information to facilitate visual search? How are consistently paired scenic objects and positions learned and used to more efficiently guide search in familiar scenes? For example, a certain combination of objects can define a context for a kitchen and trigger a more efficient search for a typical object, such as a sink, in that context. A neural model, ARTSCENE Search, is developed to illustrate the neural mechanisms of such memory-based contextual learning and guidance, and to explain challenging behavioral data on positive/negative, spatial/object, and local/distant global cueing effects during visual search. The model proposes how global scene layout at a first glance rapidly forms a hypothesis about the target location. This hypothesis is then incrementally refined by enhancing target-like objects in space as a scene is scanned with saccadic eye movements. The model clarifies the functional roles of neuroanatomical, neurophysiological, and neuroimaging data in visual search for a desired goal object. In particular, the model simulates the interactive dynamics of spatial and object contextual cueing in the cortical What and Where streams starting from early visual areas through medial temporal lobe to prefrontal cortex. After learning, model dorsolateral prefrontal cortical cells (area 46) prime possible target locations in posterior parietal cortex based on goalmodulated percepts of spatial scene gist represented in parahippocampal cortex, whereas model ventral prefrontal cortical cells (area 47/12) prime possible target object representations in inferior temporal cortex based on the history of viewed objects represented in perirhinal cortex. The model hereby predicts how the cortical What and Where streams cooperate during scene perception, learning, and memory to accumulate evidence over time to drive efficient visual search of familiar scenes.CELEST, an NSF Science of Learning Center (SBE-0354378); SyNAPSE program of Defense Advanced Research Projects Agency (HR0011-09-3-0001, HR0011-09-C-0011

5-HT2a receptor in mPFC influences context-guided reconsolidation of object memory in perirhinal cortex

Context-dependent memories may guide adaptive behavior relaying in previous experience while updating stored information through reconsolidation. Retrieval can be triggered by partial and shared cues. When the cue is presented, the most relevant memory should be updated. In a contextual version of the object recognition task, we examined the effect of medial PFC (mPFC) serotonin 2a receptor (5-HT2aR) blockade during retrieval in reconsolidation of competing objects memories. We found that mPFC 5-HT2aR controls retrieval and reconsolidation of object memories in the perirhinal cortex (PRH), but not in the dorsal hippocampus in rats. Also, reconsolidation of objects memories in PRH required a functional interaction between the ventral hippocampus and the mPFC. Our results indicate that in the presence of conflicting information at retrieval, mPFC 5-HT2aR may facilitate top-down context-guided control over PRH to control the behavioral response and object memory reconsolidation.Fil: Morici, Juan Facundo. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Houssay. Instituto de Fisiología y Biofísica Bernardo Houssay. Universidad de Buenos Aires. Facultad de Medicina. Instituto de Fisiología y Biofísica Bernardo Houssay; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Houssay. Instituto de Neurociencia Cognitiva. Fundación Favaloro. Instituto de Neurociencia Cognitiva; ArgentinaFil: Miranda, Magdalena. Universidad de Buenos Aires. Facultad de Medicina. Instituto de Biología Celular y Neurociencias; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Houssay. Instituto de Neurociencia Cognitiva. Fundación Favaloro. Instituto de Neurociencia Cognitiva; ArgentinaFil: Gallo, Francisco Tomás. Universidad de Buenos Aires. Facultad de Medicina. Instituto de Biología Celular y Neurociencias; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Houssay. Instituto de Neurociencia Cognitiva. Fundación Favaloro. Instituto de Neurociencia Cognitiva; ArgentinaFil: Zanoni Saad, María Belén. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Houssay. Instituto de Neurociencia Cognitiva. Fundación Favaloro. Instituto de Neurociencia Cognitiva; Argentina. Universidad Favaloro; ArgentinaFil: Bekinschtein, Pedro Alejandro. Universidad de Buenos Aires. Facultad de Medicina. Instituto de Biología Celular y Neurociencias; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Houssay. Instituto de Neurociencia Cognitiva. Fundación Favaloro. Instituto de Neurociencia Cognitiva; ArgentinaFil: Weisstaub, Noelia V.. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Houssay. Instituto de Fisiología y Biofísica Bernardo Houssay. Universidad de Buenos Aires. Facultad de Medicina. Instituto de Fisiología y Biofísica Bernardo Houssay; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Houssay. Instituto de Neurociencia Cognitiva. Fundación Favaloro. Instituto de Neurociencia Cognitiva; Argentin

Review: Object vision in a structured world

In natural vision, objects appear at typical locations, both with respect to visual space (e.g., an airplane in the upper part of a scene) and other objects (e.g., a lamp above a table). Recent studies have shown that object vision is strongly adapted to such positional regularities. In this review we synthesize these developments, highlighting that adaptations to positional regularities facilitate object detection and recognition, and sharpen the representations of objects in visual cortex. These effects are pervasive across various types of high-level content. We posit that adaptations to real-world structure collectively support optimal usage of limited cortical processing resources. Taking positional regularities into account will thus be essential for understanding efficient object vision in the real world

How affordances associated with a distractor object affect compatibility effects: a study with the computational model TRoPICALS.

Seeing an object activates both visual and action codes in the brain. Crucial evidence supporting this view is the observation of object to response compatibility effects: perception of an object can facilitate or interfere with the execution of an action (e.g., grasping) even when the viewer has no intention of interacting with the object. TRoPICALS is a computational model that proposes some general principles about the brain mechanisms underlying compatibility effects, in particular the idea that top-down bias from prefrontal cortex, and whether it conflicts or not with the actions afforded by an object, plays a key role in such phenomena. Experiments on compatibility effects using a target and a distractor object show the usual positive compatibility effect of the target, but also an interesting negative compatibility effect of the distractor: responding with a grip compatible with the distractor size produces slower reaction times than the incompatible case. Here, we present an enhanced version of TRoPICALS that reproduces and explains these new results. This explanation is based on the idea that the prefrontal cortex plays a double role in its top-down guidance of action selection producing: (a) a positive bias in favour of the action requested by the experimental task; (b) a negative bias directed to inhibiting the action evoked by the distractor. The model also provides testable predictions on the possible consequences of damage to volitional circuits such as in Parkinsonian patients

Effects of Temporal and Spatial Context Within the Macaque Face-Processing System

Temporal and spatial context play a key role in vision as a whole, and in face perception specifically. However, little is known about the neurophysiological mechanisms by which contextual cues exert their effects. Anatomically distinct face patches in the macaque brain analyze facial form, and studies of the activity within these patches have begun to clarify the neural machinery that underlies facial perception. This system provides a uniquely valuable opportunity to study how context affects the perception of form. We used functional magnetic resonance imaging (fMRI) to investigate the brain activity of macaque monkeys while they viewed faces placed in either temporal or spatial context. Facial motion transmits rich and ethologically vital information, but the way that the brain interprets such natural temporal context is poorly understood. Facial motion activates the face patches and surrounding areas, yet it is not known whether this motion is processed by its own specialized neural machinery, and if so, what that machinery’s organization might be. To address these questions, we monitored the brain activity of macaque monkeys while they viewed low- and high-level motion and form stimuli. We found that, beyond classical motion areas and the known face patch system, moving faces recruited a heretofore-unrecognized face patch. Although all face patches displayed distinctive selectivity for face motion over object motion, only two face patches preferred naturally moving faces, while three others preferred randomized, rapidly varying sequences of facial form. This functional divide was anatomically specific, segregating dorsal from ventral face patches, thereby revealing a new organizational principle of the macaque face-processing system. Like facial motion, bodies can provide valuable social context, revealing emotion and identity. Little is known about the joint processing of faces and bodies, even though there is reason to believe that their neural representations are intertwined. To identify interaction between the neural representations of face and body, we monitored the brain activity of the same monkeys while they viewed pictures of whole monkeys, isolated monkey heads, and isolated monkey bodies. We found that certain areas, including anterior face patches, responded more to whole monkeys than would be predicted by summing the separate responses to isolated heads and isolated bodies. The supralinear response was specific to viewing the conjunction of head and body; heads placed atop nonbody objects did not evoke this activity signature. However, a supralinear context response was elicited by pixelated, ambiguous faces presented on bodies. The size of this response suggests that the supralinear signal in this case did not result from the disambiguation of the ambiguous faces. These studies of contextually evoked activity within the macaque face processing system deepen our understanding of the cortical organization of both visual context and face processing, and identify promising sites for future research into the mechanisms underlying these critical aspects of perception

Distinct patterns of functional and effective connectivity between perirhinal cortex and other cortical regions in recognition memory and perceptual discrimination.

Traditionally, the medial temporal lobe (MTL) is thought to be dedicated to declarative memory. Recent evidence challenges this view, suggesting that perirhinal cortex (PrC), which interfaces the MTL with the ventral visual pathway, supports highly integrated object representations in recognition memory and perceptual discrimination. Even with comparable representational demands, perceptual and memory tasks differ in numerous task demands and the subjective experience they evoke. Here, we tested whether such differences are reflected in distinct patterns of connectivity between PrC and other cortical regions, including differential involvement of prefrontal control processes. We examined functional magnetic resonance imaging data for closely matched perceptual and recognition memory tasks for faces that engaged right PrC equivalently. Multivariate seed analyses revealed distinct patterns of interactions: Right ventrolateral prefrontal and posterior cingulate cortices exhibited stronger functional connectivity with PrC in recognition memory; fusiform regions were part of the pattern that displayed stronger functional connectivity with PrC in perceptual discrimination. Structural equation modeling revealed distinct patterns of effective connectivity that allowed us to constrain interpretation of these findings. Overall, they demonstrate that, even when MTL structures show similar involvement in recognition memory and perceptual discrimination, differential neural mechanisms are reflected in the interplay between the MTL and other cortical regions

The neuroscience of vision-based grasping: a functional review for computational modeling and bio-inspired robotics

The topic of vision-based grasping is being widely studied using various techniques and with different goals in humans and in other primates. The fundamental related findings are reviewed in this paper, with the aim of providing researchers from different fields, including intelligent robotics and neural computation, a comprehensive but accessible view on the subject. A detailed description of the principal sensorimotor processes and the brain areas involved in them is provided following a functional perspective, in order to make this survey especially useful for computational modeling and bio-inspired robotic application

Relevance to self: A brief review and framework of neural systems underlying appraisal

We argue that many similar findings observed in cognitive, affective, and social neuroimaging research may compose larger processes central to generating self-relevance. In support of this, recent findings from these research domains were reviewed to identify common systemic activation patterns. Superimposition of these patterns revealed evidence for large-scale supramodal processes, which are argued to mediate appraisal of self-relevant content irrespective of specific stimulus types (e.g. words, pictures) and task domains (e.g. induction of reward, fear, pain, etc.). Furthermore, we distinguish between two top-down sub-systems involved in appraisal of self-relevance, one that orients pre-attentive biasing information (e.g. anticipatory or mnemonic) to salient or explicitly self-relevant phenomena, and another that engages introspective processes (e.g. self-reflection, evaluation, recollection) either in conjunction with or independent of the former system. Based on aggregate patterns of activation derived from the reviewed studies, processes in a ventral medial prefrontal cortex (MPFC)-subcortical network appear to track with the former pathway, and processes in a dorsal MPFC-cortical-subcortical network with the latter. As a whole, the purpose of this framework is to re-conceive the functionality of these systems in terms of supramodal processes that more directly reflect the influences of relevance to the self. © 2007 Elsevier Ltd. All rights reserved