Within-trial effects of stimulus-reward associations

While a globally energizing influence of motivation has long been appreciated in psychological research, a series of more recent studies has described motivational influences on specific cognitive operations ranging from visual attention, to cognitive control, to memory formation. In the majority of these studies, a cue predicts the potential to win money in a subsequent task, thus allowing for modulations of proactive task preparation. Here we describe some recent studies using tasks that communicate reward availability without such cues by directly associating specific task features with reward. Despite abolishing the cue-based preparation phase, these studies show similar performance benefits. Given the clear difference in temporal structure, a central question is how these behavioral effects are brought about, and in particular whether control processes can rapidly be enhanced reactively. We present some evidence in favor of this notion. Although additional influences, for example sensory prioritization of reward-related features, could contribute to the reward-related performance benefits, those benefits seem to strongly rely on enhancements of control processes during task execution. Still, for a better mechanistic understanding of reward benefits in these two principal paradigms (cues vs. no cues), more work is needed that directly compares the underlying processes. We anticipate that reward benefits can be brought about in a very flexible fashion depending on the exact nature of the reward manipulation and task, and that a better understanding of these processes will not only be relevant for basic motivation research, but that it can also be valuable for educational and psychopathological contexts

Consciosusness in Cognitive Architectures. A Principled Analysis of RCS, Soar and ACT-R

This report analyses the aplicability of the principles of consciousness developed in the ASys project to three of the most relevant cognitive architectures. This is done in relation to their aplicability to build integrated control systems and studying their support for general mechanisms of real-time consciousness.\ud To analyse these architectures the ASys Framework is employed. This is a conceptual framework based on an extension for cognitive autonomous systems of the General Systems Theory (GST).\ud A general qualitative evaluation criteria for cognitive architectures is established based upon: a) requirements for a cognitive architecture, b) the theoretical framework based on the GST and c) core design principles for integrated cognitive conscious control systems

Abnormal proactive and reactive cognitive control during conflict processing in major depression

According to the Dual Mechanisms of Control framework, cognitive control consists of two complementary components: proactive control refers to anticipatory maintenance of goal-relevant information, whereas reactive control acts as a correction mechanism that is activated when a conflict occurs. Possibly, the well-known diminished inhibitory control in response to negative stimuli in Major Depressive Disorder (MDD) patients stems from a breakdown in proactive control, and/or anomalies in reactive cognitive control. In our study, MDD patients specifically showed increased response latencies when actively inhibiting a dominant response to a sad compared with a happy face. This condition was associated with a longer duration of a dominant ERP topography (800-900 ms poststimulus onset) and a stronger activity in the bilateral dorsal anterior cingulate cortex, reflecting abnormal reactive control when inhibiting attention to a negative stimulus. Moreover, MDD patients showed abnormalities in proactive cognitive control when preparing for the upcoming imperative stimulus (abnormal modulation of the contingent negative variation component), accompanied by more activity in brain regions belonging to the default mode network. All together, deficits to inhibit attention to negative information in MDD might originate from an abnormal use of both proactive resources and reactive control processes. This document is copyrighted by the American Psychological Association or one of its allied publishers. This article is intended solely for the personal use of the individual user and is not to be disseminated broadly

Visual salience of the stop signal affects the neuronal dynamics of controlled inhibition

The voluntary control of movement is often tested by using the countermanding, or stop-signal task that sporadically requires the suppression of a movement in response to an incoming stop-signal. Neurophysiological recordings in monkeys engaged in the countermanding task have shown that dorsal premotor cortex (PMd) is implicated in movement control. An open question is whether and how the perceptual demands inherent the stop-signal affects inhibitory performance and their underlying neuronal correlates. To this aim we recorded multi-unit activity (MUA) from the PMd of two male monkeys performing a countermanding task in which the salience of the stop-signals was modulated. Consistently to what has been observed in humans, we found that less salient stimuli worsened the inhibitory performance. At the neuronal level, these behavioral results were subtended by the following modulations: when the stop-signal was not noticeable compared to the salient condition the preparatory neuronal activity in PMd started to be affected later and with a less sharp dynamic. This neuronal pattern is probably the consequence of a less efficient inhibitory command useful to interrupt the neural dynamic that supports movement generation in PMd

Motivational context for response inhibition influences proactive involvement of attention

Motoric inhibition is ingrained in human cognition and implicated in pervasive neurological diseases and disorders. The present electroencephalographic (EEG) study investigated proactive motivational adjustments in attention during response inhibition. We compared go-trial data from a stop-signal task, in which infrequently presented stop-signals required response cancellation without extrinsic incentives ("standard-stop"), to data where a monetary reward was posted on some stop-signals ("rewarded-stop"). A novel EEG analysis was used to directly model the covariation between response time and the attention-related N1 component. A positive relationship between response time and N1 amplitudes was found in the standard-stop context, but not in the rewarded-stop context. Simultaneously, average go-trial N1 amplitudes were larger in the rewarded-stop context. This suggests that down-regulation of go-signal-directed attention is dynamically adjusted in the standard-stop trials, but is overridden by a more generalized increase in attention in reward-motivated trials. Further, a diffusion process model indicated that behavior between contexts was the result of partially opposing evidence accumulation processes. Together these analyses suggest that response inhibition relies on dynamic and flexible proactive adjustments of low-level processes and that contextual changes can alter their interplay. This could prove to have ramifications for clinical disorders involving deficient response inhibition and impulsivity

The Complementary Brain: From Brain Dynamics To Conscious Experiences

How do our brains so effectively achieve adaptive behavior in a changing world? Evidence is reviewed that brains are organized into parallel processing streams with complementary properties. Hierarchical interactions within each stream and parallel interactions between streams create coherent behavioral representations that overcome the complementary deficiencies of each stream and support unitary conscious experiences. This perspective suggests how brain design reflects the organization of the physical world with which brains interact, and suggests an alternative to the computer metaphor suggesting that brains are organized into independent modules. Examples from perception, learning, cognition, and action are described, and theoretical concepts and mechanisms by which complementarity is accomplished are summarized.Defense Advanced Research Projects and the Office of Naval Research (N00014-95-1-0409); National Science Foundation (ITI-97-20333); Office of Naval Research (N00014-95-1-0657

SOVEREIGN: An Autonomous Neural System for Incrementally Learning Planned Action Sequences to Navigate Towards a Rewarded Goal

How do reactive and planned behaviors interact in real time? How are sequences of such behaviors released at appropriate times during autonomous navigation to realize valued goals? Controllers for both animals and mobile robots, or animats, need reactive mechanisms for exploration, and learned plans to reach goal objects once an environment becomes familiar. The SOVEREIGN (Self-Organizing, Vision, Expectation, Recognition, Emotion, Intelligent, Goaloriented Navigation) animat model embodies these capabilities, and is tested in a 3D virtual reality environment. SOVEREIGN includes several interacting subsystems which model complementary properties of cortical What and Where processing streams and which clarify similarities between mechanisms for navigation and arm movement control. As the animat explores an environment, visual inputs are processed by networks that are sensitive to visual form and motion in the What and Where streams, respectively. Position-invariant and sizeinvariant recognition categories are learned by real-time incremental learning in the What stream. Estimates of target position relative to the animat are computed in the Where stream, and can activate approach movements toward the target. Motion cues from animat locomotion can elicit head-orienting movements to bring a new target into view. Approach and orienting movements are alternately performed during animat navigation. Cumulative estimates of each movement are derived from interacting proprioceptive and visual cues. Movement sequences are stored within a motor working memory. Sequences of visual categories are stored in a sensory working memory. These working memories trigger learning of sensory and motor sequence categories, or plans, which together control planned movements. Predictively effective chunk combinations are selectively enhanced via reinforcement learning when the animat is rewarded. Selected planning chunks effect a gradual transition from variable reactive exploratory movements to efficient goal-oriented planned movement sequences. Volitional signals gate interactions between model subsystems and the release of overt behaviors. The model can control different motor sequences under different motivational states and learns more efficient sequences to rewarded goals as exploration proceeds.Riverside Reserach Institute; Defense Advanced Research Projects Agency (N00014-92-J-4015); Air Force Office of Scientific Research (F49620-92-J-0225); National Science Foundation (IRI 90-24877, SBE-0345378); Office of Naval Research (N00014-92-J-1309, N00014-91-J-4100, N00014-01-1-0624, N00014-01-1-0624); Pacific Sierra Research (PSR 91-6075-2