Cortical Dynamics of Contextually-Cued Attentive Visual Learning and Search: Spatial and Object Evidence Accumulation

How do humans use predictive contextual information to facilitate visual search? How are consistently paired scenic objects and positions learned and used to more efficiently guide search in familiar scenes? For example, a certain combination of objects can define a context for a kitchen and trigger a more efficient search for a typical object, such as a sink, in that context. A neural model, ARTSCENE Search, is developed to illustrate the neural mechanisms of such memory-based contextual learning and guidance, and to explain challenging behavioral data on positive/negative, spatial/object, and local/distant global cueing effects during visual search. The model proposes how global scene layout at a first glance rapidly forms a hypothesis about the target location. This hypothesis is then incrementally refined by enhancing target-like objects in space as a scene is scanned with saccadic eye movements. The model clarifies the functional roles of neuroanatomical, neurophysiological, and neuroimaging data in visual search for a desired goal object. In particular, the model simulates the interactive dynamics of spatial and object contextual cueing in the cortical What and Where streams starting from early visual areas through medial temporal lobe to prefrontal cortex. After learning, model dorsolateral prefrontal cortical cells (area 46) prime possible target locations in posterior parietal cortex based on goalmodulated percepts of spatial scene gist represented in parahippocampal cortex, whereas model ventral prefrontal cortical cells (area 47/12) prime possible target object representations in inferior temporal cortex based on the history of viewed objects represented in perirhinal cortex. The model hereby predicts how the cortical What and Where streams cooperate during scene perception, learning, and memory to accumulate evidence over time to drive efficient visual search of familiar scenes.CELEST, an NSF Science of Learning Center (SBE-0354378); SyNAPSE program of Defense Advanced Research Projects Agency (HR0011-09-3-0001, HR0011-09-C-0011

Multisensory information facilitates reaction speed by enlarging activity difference between superior colliculus hemispheres in rats

Animals can make faster behavioral responses to multisensory stimuli than to unisensory stimuli. The superior colliculus (SC), which receives multiple inputs from different sensory modalities, is considered to be involved in the initiation of motor responses. However, the mechanism by which multisensory information facilitates motor responses is not yet understood. Here, we demonstrate that multisensory information modulates competition among SC neurons to elicit faster responses. We conducted multiunit recordings from the SC of rats performing a two-alternative spatial discrimination task using auditory and/or visual stimuli. We found that a large population of SC neurons showed direction-selective activity before the onset of movement in response to the stimuli irrespective of stimulation modality. Trial-by-trial correlation analysis showed that the premovement activity of many SC neurons increased with faster reaction speed for the contraversive movement, whereas the premovement activity of another population of neurons decreased with faster reaction speed for the ipsiversive movement. When visual and auditory stimuli were presented simultaneously, the premovement activity of a population of neurons for the contraversive movement was enhanced, whereas the premovement activity of another population of neurons for the ipsiversive movement was depressed. Unilateral inactivation of SC using muscimol prolonged reaction times of contraversive movements, but it shortened those of ipsiversive movements. These findings suggest that the difference in activity between the SC hemispheres regulates the reaction speed of motor responses, and multisensory information enlarges the activity difference resulting in faster responses

The effects of TMS over dorsolateral prefrontal cortex on multiple visual object memory across fixation and saccades

Trans-saccadic memory, the process by which the visual system maintains the spatial position and features of objects across eye movements, is thought to be a form of visual working memory (Irwin, 1991). It has been shown that TMS over the frontal and parietal eye fields degrades trans-saccadic memory of multiple object features (Prime et al., 2008, 2010). We used a similar TMS protocol to investigate whether dorsolateral prefrontal cortex (DLPFC) is also involved in trans-saccadic memory. We predicted that performance would be disrupted similarly during either fixation or saccades. Instead, we found both task and hemisphere-dependent effects. During fixation, TMS over left DLPFC produced inconsistent effects, whereas TMS over right DLPFC reduced performance, consistent with its known role in working memory (Goldman-Rakic, 1987). In contrast, TMS over both sides of DLPFC enhanced trans-saccadic memory, suggesting a dis-inhibition of trans-saccadic processing. These results suggest that visual working memory during fixation and trans-saccadic memory may be supported by different, but interacting, neural circuits

Fast detector/first responder : interactions between the superior colliculus-pulvinar pathway and stimuli relevant to primates

Primates are distinguished from other mammals by their heavy reliance on the visual sense, which occurred as a result of natural selection continually favoring those individuals whose visual systems were more responsive to challenges in the natural world. Here we describe two independent but also interrelated visual systems, one cortical and the other subcortical, both of which have been modified and expanded in primates for different functions. Available evidence suggests that while the cortical visual system mainly functions to give primates the ability to assess and adjust to fluid social and ecological environments, the subcortical visual system appears to function as a rapid detector and first responder when time is of the essence, i.e., when survival requires very quick action. We focus here on the subcortical visual system with a review of behavioral and neurophysiological evidence that demonstrates its sensitivity to particular, often emotionally charged, ecological and social stimuli, i.e., snakes and fearful and aggressive facial expressions in conspecifics. We also review the literature on subcortical involvement during another, less emotional, situation that requires rapid detection and response—visually guided reaching and grasping during locomotion—to further emphasize our argument that the subcortical visual system evolved as a rapid detector/first responder, a function that remains in place today. Finally, we argue that investigating deficits in this subcortical system may provide greater understanding of Parkinson's disease and Autism Spectrum disorders (ASD)

Mirror Activity in the Macaque Motor System

Mirror neurons (MirNs) within ventral premotor cortex (PMv) and primary motor cortex (M1), including pyramidal tract neurons (PTNs) projecting to the spinal cord, modulate their activity during both the execution and observation of motor acts. However, movement is not produced in the latter condition, and mirror responses cannot be explained by lowlevel muscle activity. Relatively reduced activity in M1 during observation may help to suppress movement. Here, we examined the extent to which activity at different stages of action observation reflects grasp representation and suppression of movement across multiple levels of the mirror system in monkeys and humans. We recorded MirNs in M1 and F5 (rostral PMv), including identified PTNs, in two macaque monkeys as they performed, observed, and withheld reach-to-grasp actions. Time-varying population activity was more distinct between execution and observation in M1 than in F5, and M1 activity in the lead-up to the observation of movement onset shared parallels with movement withholding activity. In separate experiments, modulation of short-latency responses evoked in hand muscles by pyramidal tract stimulation revealed modest grasp-specific facilitation at the spinal level during grasp observation. This contrasted with a relative suppression of excitability prior to observed movement onset or when monkeys simply withheld movement. Additional cortical recording experiments examined how contextual factors, such as observing to imitate, observing while engaged in action, or observation with reduced visual information, modulated mirror activity in M1 and F5. Finally, single-pulse transcranial magnetic stimulation (TMS) in healthy human volunteers was used to examine changes in corticospinal excitability (CSE) during action observation and withholding. Overall, the results reveal distinctions in the profile of mirror activity across premotor and motor areas. While F5 maintains a more abstract representation of grasp independent of the acting agent, a balance of excitation and inhibition in motor cortex and spinal circuitry during action observation may support a flexible dissociation between initiation of grasping actions and representation of observed grasp

Cortico-spinal modularity in the parieto-frontal system: a new perspective on action control

: Classical neurophysiology suggests that the motor cortex (MI) has a unique role in action control. In contrast, this review presents evidence for multiple parieto-frontal spinal command modules that can bypass MI. Five observations support this modular perspective: (i) the statistics of cortical connectivity demonstrate functionally-related clusters of cortical areas, defining functional modules in the premotor, cingulate, and parietal cortices; (ii) different corticospinal pathways originate from the above areas, each with a distinct range of conduction velocities; (iii) the activation time of each module varies depending on task, and different modules can be activated simultaneously; (iv) a modular architecture with direct motor output is faster and less metabolically expensive than an architecture that relies on MI, given the slow connections between MI and other cortical areas; (v) lesions of the areas composing parieto-frontal modules have different effects from lesions of MI. Here we provide examples of six cortico-spinal modules and functions they subserve: module 1) arm reaching, tool use and object construction; module 2) spatial navigation and locomotion; module 3) grasping and observation of hand and mouth actions; module 4) action initiation, motor sequences, time encoding; module 5) conditional motor association and learning, action plan switching and action inhibition; module 6) planning defensive actions. These modules can serve as a library of tools to be recombined when faced with novel tasks, and MI might serve as a recombinatory hub. In conclusion, the availability of locally-stored information and multiple outflow paths supports the physiological plausibility of the proposed modular perspective

Change blindness: eradication of gestalt strategies

Arrays of eight, texture-defined rectangles were used as stimuli in a one-shot change blindness (CB) task where there was a 50% chance that one rectangle would change orientation between two successive presentations separated by an interval. CB was eliminated by cueing the target rectangle in the first stimulus, reduced by cueing in the interval and unaffected by cueing in the second presentation. This supports the idea that a representation was formed that persisted through the interval before being 'overwritten' by the second presentation (Landman et al, 2003 Vision Research 43149–164]. Another possibility is that participants used some kind of grouping or Gestalt strategy. To test this we changed the spatial position of the rectangles in the second presentation by shifting them along imaginary spokes (by ±1 degree) emanating from the central fixation point. There was no significant difference seen in performance between this and the standard task [F(1,4)=2.565, p=0.185]. This may suggest two things: (i) Gestalt grouping is not used as a strategy in these tasks, and (ii) it gives further weight to the argument that objects may be stored and retrieved from a pre-attentional store during this task