Reward sharpens orientation coding independently on attention

Rewarding improves performance. Is it due to modulations of the output modules of the neural systems or are there mechanisms favoring more 'generous' inputs? Some recent study included V1 in the the circuitry of reward-based modulations, but the effects of reward can easily be confused with effects of attention. Here we address this issue with a psychophysical dual task to control attention while orientation sensitivity on targets associated to different levels of reward is measured. We found that different reward rates improve orientation discrimination and sharpen the internal response distributions. Data are unaffected by changing attentional load nor by dissociating the feature of the reward cue from the feature relevant for the task. This suggests that reward may act independently on attention by modulating the activity of early sensory stages, perhaps V1, through a SNR improvement of task-relevant channels. Reward acts like attention, but using separate channels

Linking Visual Development and Learning to Information Processing: Preattentive and Attentive Brain Dynamics

National Science Foundation (SBE-0354378); Office of Naval Research (N00014-95-1-0657

Reward Sharpens Orientation Coding Independently of Attention

It has long been known that rewarding improves performance. However it is unclear whether this is due to high level modulations in the output modules of associated neural systems or due to low level mechanisms favoring more “generous” inputs? Some recent studies suggest that primary sensory areas, including V1 and A1, may form part of the circuitry of reward-based modulations, but there is no data indicating whether reward can be dissociated from attention or cross-trial forms of perceptual learning. Here we address this issue with a psychophysical dual task, to control attention, while perceptual performance on oriented targets associated with different levels of reward is assessed by measuring both orientation discrimination thresholds and behavioral tuning functions for tilt values near threshold. We found that reward, at any rate, improved performance. However, higher reward rates showed an improvement of orientation discrimination thresholds by about 50% across conditions and sharpened behavioral tuning functions. Data were unaffected by changing the attentional load and by dissociating the feature of the reward cue from the task-relevant feature. These results suggest that reward may act within the span of a single trial independently of attention by modulating the activity of early sensory stages through a improvement of the signal-to-noise ratio of task-relevant channels

Linking Visual Cortical Development to Visual Perception

Defense Advanced Research Projects Agency and the Office of Naval Research (N00014-95-1-0409); National Science Foundation (IRI-97-20333); Office of Naval Research (N00014-95-1-0657

Probabilistic modeling of eye movement data during conjunction search via feature-based attention

Where the eyes fixate during search is not random; rather, gaze reflects the combination of information about the target and the visual input. It is not clear, however, what information about a target is used to bias the underlying neuronal responses. We here engage subjects in a variety of simple conjunction search tasks while tracking their eye movements. We derive a generative model that reproduces these eye movements and calculate the conditional probabilities that observers fixate, given the target, on or near an item in the display sharing a specific feature with the target. We use these probabilities to infer which features were biased by top-down attention: Color seems to be the dominant stimulus dimension for guiding search, followed by object size, and lastly orientation. We use the number of fixations it took to find the target as a measure of task difficulty. We find that only a model that biases multiple feature dimensions in a hierarchical manner can account for the data. Contrary to common assumptions, memory plays almost no role in search performance. Our model can be fit to average data of multiple subjects or to individual subjects. Small variations of a few key parameters account well for the intersubject differences. The model is compatible with neurophysiological findings of V4 and frontal eye fields (FEF) neurons and predicts the gain modulation of these cells

Change blindness: eradication of gestalt strategies

Arrays of eight, texture-defined rectangles were used as stimuli in a one-shot change blindness (CB) task where there was a 50% chance that one rectangle would change orientation between two successive presentations separated by an interval. CB was eliminated by cueing the target rectangle in the first stimulus, reduced by cueing in the interval and unaffected by cueing in the second presentation. This supports the idea that a representation was formed that persisted through the interval before being 'overwritten' by the second presentation (Landman et al, 2003 Vision Research 43149–164]. Another possibility is that participants used some kind of grouping or Gestalt strategy. To test this we changed the spatial position of the rectangles in the second presentation by shifting them along imaginary spokes (by ±1 degree) emanating from the central fixation point. There was no significant difference seen in performance between this and the standard task [F(1,4)=2.565, p=0.185]. This may suggest two things: (i) Gestalt grouping is not used as a strategy in these tasks, and (ii) it gives further weight to the argument that objects may be stored and retrieved from a pre-attentional store during this task

Reducing bias in auditory duration reproduction by integrating the reproduced signal

Duration estimation is known to be far from veridical and to differ for sensory estimates and motor reproduction. To investigate how these differential estimates are integrated for estimating or reproducing a duration and to examine sensorimotor biases in duration comparison and reproduction tasks, we compared estimation biases and variances among three different duration estimation tasks: perceptual comparison, motor reproduction, and auditory reproduction (i.e. a combined perceptual-motor task). We found consistent overestimation in both motor and perceptual-motor auditory reproduction tasks, and the least overestimation in the comparison task. More interestingly, compared to pure motor reproduction, the overestimation bias was reduced in the auditory reproduction task, due to the additional reproduced auditory signal. We further manipulated the signal-to-noise ratio (SNR) in the feedback/comparison tones to examine the changes in estimation biases and variances. Considering perceptual and motor biases as two independent components, we applied the reliability-based model, which successfully predicted the biases in auditory reproduction. Our findings thus provide behavioral evidence of how the brain combines motor and perceptual information together to reduce duration estimation biases and improve estimation reliability

Alpha-band rhythms in visual task performance: phase-locking by rhythmic sensory stimulation

Oscillations are an important aspect of neuronal activity. Interestingly, oscillatory patterns are also observed in behaviour, such as in visual performance measures after the presentation of a brief sensory event in the visual or another modality. These oscillations in visual performance cycle at the typical frequencies of brain rhythms, suggesting that perception may be closely linked to brain oscillations. We here investigated this link for a prominent rhythm of the visual system (the alpha-rhythm, 8-12 Hz) by applying rhythmic visual stimulation at alpha-frequency (10.6 Hz), known to lead to a resonance response in visual areas, and testing its effects on subsequent visual target discrimination. Our data show that rhythmic visual stimulation at 10.6 Hz: 1) has specific behavioral consequences, relative to stimulation at control frequencies (3.9 Hz, 7.1 Hz, 14.2 Hz), and 2) leads to alpha-band oscillations in visual performance measures, that 3) correlate in precise frequency across individuals with resting alpha-rhythms recorded over parieto-occipital areas. The most parsimonious explanation for these three findings is entrainment (phase-locking) of ongoing perceptually relevant alpha-band brain oscillations by rhythmic sensory events. These findings are in line with occipital alpha-oscillations underlying periodicity in visual performance, and suggest that rhythmic stimulation at frequencies of intrinsic brain-rhythms can be used to reveal influences of these rhythms on task performance to study their functional roles

Cortical Dynamics of Contextually-Cued Attentive Visual Learning and Search: Spatial and Object Evidence Accumulation

How do humans use predictive contextual information to facilitate visual search? How are consistently paired scenic objects and positions learned and used to more efficiently guide search in familiar scenes? For example, a certain combination of objects can define a context for a kitchen and trigger a more efficient search for a typical object, such as a sink, in that context. A neural model, ARTSCENE Search, is developed to illustrate the neural mechanisms of such memory-based contextual learning and guidance, and to explain challenging behavioral data on positive/negative, spatial/object, and local/distant global cueing effects during visual search. The model proposes how global scene layout at a first glance rapidly forms a hypothesis about the target location. This hypothesis is then incrementally refined by enhancing target-like objects in space as a scene is scanned with saccadic eye movements. The model clarifies the functional roles of neuroanatomical, neurophysiological, and neuroimaging data in visual search for a desired goal object. In particular, the model simulates the interactive dynamics of spatial and object contextual cueing in the cortical What and Where streams starting from early visual areas through medial temporal lobe to prefrontal cortex. After learning, model dorsolateral prefrontal cortical cells (area 46) prime possible target locations in posterior parietal cortex based on goalmodulated percepts of spatial scene gist represented in parahippocampal cortex, whereas model ventral prefrontal cortical cells (area 47/12) prime possible target object representations in inferior temporal cortex based on the history of viewed objects represented in perirhinal cortex. The model hereby predicts how the cortical What and Where streams cooperate during scene perception, learning, and memory to accumulate evidence over time to drive efficient visual search of familiar scenes.CELEST, an NSF Science of Learning Center (SBE-0354378); SyNAPSE program of Defense Advanced Research Projects Agency (HR0011-09-3-0001, HR0011-09-C-0011

Short-term memory of temporal aspects of noxious and innocuous thermal sensation : psychophysical and fMRI studies

La douleur peut être considérée comme un système de protection qui signale une menace et qui nous avertit des dégâts imminents aux tissus. En tant que mécanisme de défense, il nécessite l'apprentissage et la mémoire des expériences du passé pour la survie et les comportements liés à la douleur. Par conséquent, notre expérience de la douleur actuelle est fortement influencée par les expériences antérieures et l'apprentissage. Cependant, malgré son importance, notre compréhension actuelle de l'interaction entre le système de la douleur et le système de mémoire est très limitée. La mémoire de la douleur est un sujet de recherche très vaste. Il nécessite une compréhension des mécanismes impliqués à chaque étape du système de mémoire (mémoire immédiate, à court terme et à long terme) et l'interaction entre eux. Parmi les étapes multiples de la mémoire, la mémoire à court terme de la douleur est une zone qui est moins recherchée, alors qu'il existe une énorme quantité de recherche neuroscientifique dans la mémoire à court terme sur d'autres modalités, en particulier la vision. L'étude de la mémoire à court terme de la douleur est particulièrement importante car cette trace de la mémoire à court terme de la douleur est ensuite convertie en mémoire à long terme et affecte ensuite les expériences futures de la douleur. Cette thèse est largement axée sur la mémoire à court terme de la douleur. La complexité et la multi dimensionnalité de la douleur ajoutent encore un autre élément à la recherche sur la mémoire de la douleur. Par exemple, la trace de la mémoire de la douleur peut contenir des traces de mémoire de diverses composantes de la douleur telles que la réponse sensorielle affective, cognitive et motrice et l'interaction entre elles. Par conséquent, une première étape dans l'exploration neuroscientifique de la mémoire de la douleur nécessite la réduction de l'expérience de la douleur tout en englobant tous ces différents composants à un seul composant. Dans la recherche présentée ici, nous avons généralement examiné cela par des instructions d'attention ‘ top-down’ pour assister à la dimension sensorielle de la douleur. La recherche précédente sur la mémoire à court terme de la douleur a également porté principalement sur la dimension sensorielle de la douleur. Cependant, parmi les dimensions sensorielles de la douleur, la mémoire à court terme de l'intensité et de la dimension spatiale de la douleur a fait l'objet de recherches antérieures. Malgré son importance, la dimension temporelle de la douleur est restée complètement inexplorée dans la recherche sur la mémoire de la douleur. La recherche menée dans cette thèse est consacrée à l'exploration de la mémoire à court terme de la durée de la douleur. La durée de la douleur peut être suivie de manière indépendante, mais peut également être suivie conjointement avec la dimension d'intensité telle que le suivi dynamique de l'intensité de la douleur dans le temps. Les études menées dans cette thèse traitent spécifiquement du traitement isolé de la durée de la douleur ainsi que du traitement conjoint de la dimension durée / intensité de la douleur. La première étude psychophysique a exploré la nature de la représentation mentale du modèle de mémoire de la douleur thermique dynamique et a également été conçue pour aborder les différences de la dimension sensorielle et affective de la douleur thermique dans la mémoire à court terme. La deuxième étude psychophysique portait sur les propriétés de la mémoire à court terme de la sensation thermique non douloureux en comparant le suivi dynamique de la sensation et le suivi isolé de la durée d'un événement thermique non douloureux. La troisième étude poursuit l'exploration du traitement dynamique de la durée conjointement avec l'intensité par rapport au traitement isolé de la durée dans la mémoire à court terme en utilisant des stimuli thermiques douloureuse une résonance magnétique fonctionnelle (IRMF). Dans l'ensemble, les résultats des études psychophysiques ont montré une transformation significative de la durée et de la dynamique de la sensation thermique douloureux et non-douloureux dans la mémoire à court terme; comme la perte d'informations somatosensorielles temporelles en mémoire. Nous avons en outre montré une amélioration du rappel de la durée dans le suivi dynamique de la durée, en comparaison avec le suivi de la durée isolée. Nous avons également montré des différences dans les corrélats neuronaux de la mémoire à court terme de la durée de douleur par rapport à la dynamique de douleur. L'étude de l'IRMF a montré des similitudes frappantes dans les corrélats neuronaux sous-jacents à la mémoire à court terme de douleur et d'autres modalités telles que la contribution des coticés fronto-pariétales ainsi que les corticaux sensoriels impliqués dans le traitement perceptuel.Pain can be viewed as a protective system that signals threat and alerts us to impending tissue damage. As a defense mechanism, it necessitates the learning and memory of past painful experiences for survival and pain-related behavior. Therefore our current pain experience is heavily influenced by previous experiences and learning. However, despite its importance, our current understanding of the interaction between the pain system and the memory system is very limited. Pain memory is a very broad topic of research on its own. It requires an understanding of the mechanisms involved at each stage of the memory system (immediate, short-term, and long-term memory), and the interaction among them. Among the multiple stages of memory, the short-term memory of pain is an area that is less researched, while there are enormous amount of neuroscientific research in short-term memory of other modalities, particularly vision. Investigation of the short-term memory of pain is especially important as the short-term memory trace of pain is converted to long-term memory and subsequently affects future pain experiences. This thesis is broadly focused on the short-term memory of pain. The complexity and multi-dimensionality of pain adds yet another element to the research on pain memory. For example, the memory trace of pain may contain memory traces of various components of pain such as sensory, affective, cognitive, and motoric responses, and the interactions among them. Therefore, an initial step in the neuroscientific exploration of pain memory requires narrowing down the pain experience, which encompasses all of these various components, to one single component. In the research presented here, we achieved this using top-down attentional instructions to attend to the sensory component of pain. The previous research on short-term memory of pain also focused mainly on the sensory component of pain. However, within the sensory component of pain the short-term memory of intensity and spatial dimension of pain has been the focus of previous research. Despite its importance, the temporal dimension of pain remained completely unexplored in pain memory research. Thus, the research conducted in this thesis is devoted to the exploration of short-term memory of the duration of pain. Pain duration can be tracked independently, but it can also be tracked conjointly with intensity, such as in dynamic tracking of pain intensity over time. The studies addressed in this thesis examined the isolated processing of pain duration as well as conjoint processing of the duration and intensity of pain. The first psychophysical study explored the nature of the mental representation of the memory template of dynamic thermal pain sensation and, additionally, addressed the differences between the sensory versus affective dimensions of thermal pain sensation in short-term memory. The second psychophysical study focused on properties of the short-term memory of innocuous thermal sensation by comparing dynamic tracking of sensation versus isolated tracking of duration of an innocuous thermal event. The third study explored the dynamic processing of duration conjointly with intensity, versus the isolated processing of duration in short-term memory, using noxious thermal stimuli and functional magnetic resonance imaging (fMRI). Overall, the results of the psychophysical studies showed significant transformation of duration and dynamics information of noxious and innocuous thermal sensation in short-term memory, such as loss of temporal somatosensory information. Additionally, we showed improvement in duration recall during dynamic tracking versus isolated tracking of duration. The fMRI study revealed differences in neural correlates of short-term memory of pain duration versus pain dynamics. Importantly, it also showed striking similarities between neural correlates underlying the short-term memory of pain and those underlying other modalities, such as a contribution of fronto-parietal cortices as well as sensory cortices involved in perceptual processing