Speed/Accuracy Trade-Off between the Habitual and the Goal-Directed Processes

Instrumental responses are hypothesized to be of two kinds: habitual and goal-directed, mediated by the sensorimotor and the associative cortico-basal ganglia circuits, respectively. The existence of the two heterogeneous associative learning mechanisms can be hypothesized to arise from the comparative advantages that they have at different stages of learning. In this paper, we assume that the goal-directed system is behaviourally flexible, but slow in choice selection. The habitual system, in contrast, is fast in responding, but inflexible in adapting its behavioural strategy to new conditions. Based on these assumptions and using the computational theory of reinforcement learning, we propose a normative model for arbitration between the two processes that makes an approximately optimal balance between search-time and accuracy in decision making. Behaviourally, the model can explain experimental evidence on behavioural sensitivity to outcome at the early stages of learning, but insensitivity at the later stages. It also explains that when two choices with equal incentive values are available concurrently, the behaviour remains outcome-sensitive, even after extensive training. Moreover, the model can explain choice reaction time variations during the course of learning, as well as the experimental observation that as the number of choices increases, the reaction time also increases. Neurobiologically, by assuming that phasic and tonic activities of midbrain dopamine neurons carry the reward prediction error and the average reward signals used by the model, respectively, the model predicts that whereas phasic dopamine indirectly affects behaviour through reinforcing stimulus-response associations, tonic dopamine can directly affect behaviour through manipulating the competition between the habitual and the goal-directed systems and thus, affect reaction time

The role of impulsivity in the aetiology of drug dependence: reward sensitivity versus automaticity

Journal ArticleResearch Support, Non-U.S. Gov'tCopyright © The Author(s) 2011.RATIONALE: Impulsivity has long been known as a risk factor for drug dependence, but the mechanisms underpinning this association are unclear. Impulsivity may confer hypersensitivity to drug reinforcement which establishes higher rates of instrumental drug-seeking and drug-taking behaviour, or may confer a propensity for automatic (non-intentional) control over drug-seeking/taking and thus intransigence to clinical intervention. METHOD: The current study sought to distinguish these two accounts by measuring Barratt Impulsivity and craving to smoke in 100 smokers prior to their completion of an instrumental concurrent choice task for tobacco (to measure the rate of drug-seeking) and an ad libitum smoking test (to measure the rate of drug-taking-number of puffs consumed). RESULTS: The results showed that impulsivity was not associated with higher rates of drug-seeking/taking, but individual differences in smoking uptake and craving were. Rather, nonplanning impulsivity moderated (decreased) the relationship between craving and drug-taking, but not drug-seeking. CONCLUSIONS: These data suggest that whereas the uptake of drug use is mediated by hypervaluation of the drug as an instrumental goal, the orthogonal trait nonplanning impulsivity confers a propensity for automatic control over well-practiced drug-taking behaviour.MR

Suppression of p75 Neurotrophin Receptor Surface Expression with Intrabodies Influences Bcl-xL mRNA Expression and Neurite Outgrowth in PC12 Cells

Background: Although p75 neurotrophin receptor (p75NTR) is the first neurotrophin receptor isolated, its diverse physiological functions and signaling have remained elusive for many years. Loss-of-function phenotypic analyses for p75NTR were mainly focused at the genetic level; however these approaches were impacted by off-target effect, insufficient stability, unspecific stress response or alternative active splicing products. In this study, p75NTR surface expression was suppressed for the first time at the protein level by endoplasmic reticulum (ER) retained intrabodies. Results: Three monoclonal recombinant antibody fragments (scFv) with affinities in the low nanomolar range to murine p75NTR were isolated by antibody phage display. To suppress p75NTR cell surface expression, the encoding genes of these scFvs extended by the ER retention peptide KDEL were transiently transfected into the neuron-like rat pheochromocytoma cell line PC12 and the mouse neuroblastoma x mouse spinal cord hybrid cell line NSC19. The ER retained intrabody construct, SH325-G7-KDEL, mediated a downregulation of p75NTR cell surface expression as shown by flow cytometry. This effect was maintained over a period of at least eight days without activating an unfolded protein response (UPR). Moreover, the ER retention of p75NTR resulted in downregulation of mRNA levels of the anti-apoptotic protein Bcl-xL as well as in strong inhibition of NGF-induced neurite outgrowth in PC12 cells. Conclusion: The ER retained intrabody SH325-G7-KDEL not only induces phenotypic knockdown of this p75NTR but als

Heterologous Expression of Membrane Proteins: Choosing the Appropriate Host

International audienceBACKGROUND: Membrane proteins are the targets of 50% of drugs, although they only represent 1% of total cellular proteins. The first major bottleneck on the route to their functional and structural characterisation is their overexpression; and simply choosing the right system can involve many months of trial and error. This work is intended as a guide to where to start when faced with heterologous expression of a membrane protein. METHODOLOGY/PRINCIPAL FINDINGS: The expression of 20 membrane proteins, both peripheral and integral, in three prokaryotic (E. coli, L. lactis, R. sphaeroides) and three eukaryotic (A. thaliana, N. benthamiana, Sf9 insect cells) hosts was tested. The proteins tested were of various origins (bacteria, plants and mammals), functions (transporters, receptors, enzymes) and topologies (between 0 and 13 transmembrane segments). The Gateway system was used to clone all 20 genes into appropriate vectors for the hosts to be tested. Culture conditions were optimised for each host, and specific strategies were tested, such as the use of Mistic fusions in E. coli. 17 of the 20 proteins were produced at adequate yields for functional and, in some cases, structural studies. We have formulated general recommendations to assist with choosing an appropriate system based on our observations of protein behaviour in the different hosts. CONCLUSIONS/SIGNIFICANCE: Most of the methods presented here can be quite easily implemented in other laboratories. The results highlight certain factors that should be considered when selecting an expression host. The decision aide provided should help both newcomers and old-hands to select the best system for their favourite membrane protein

Ubiquitous molecular substrates for associative learning and activity-dependent neuronal facilitation.

Recent evidence suggests that many of the molecular cascades and substrates that contribute to learning-related forms of neuronal plasticity may be conserved across ostensibly disparate model systems. Notably, the facilitation of neuronal excitability and synaptic transmission that contribute to associative learning in Aplysia and Hermissenda, as well as associative LTP in hippocampal CA1 cells, all require (or are enhanced by) the convergence of a transient elevation in intracellular Ca2+ with transmitter binding to metabotropic cell-surface receptors. This temporal convergence of Ca2+ and G-protein-stimulated second-messenger cascades synergistically stimulates several classes of serine/threonine protein kinases, which in turn modulate receptor function or cell excitability through the phosphorylation of ion channels. We present a summary of the biophysical and molecular constituents of neuronal and synaptic facilitation in each of these three model systems. Although specific components of the underlying molecular cascades differ across these three systems, fundamental aspects of these cascades are widely conserved, leading to the conclusion that the conceptual semblance of these superficially disparate systems is far greater than is generally acknowledged. We suggest that the elucidation of mechanistic similarities between different systems will ultimately fulfill the goal of the model systems approach, that is, the description of critical and ubiquitous features of neuronal and synaptic events that contribute to memory induction

The dynamics of a pre-mRNA splicing factor in living cells

Pre-mRNA splicing is a predominantly co-transcriptional event which involves a large number of essential splicing factors. Within the mammalian cell nucleus, most splicing factors are concentrated in 20-40 distinct domains called speckles. The function of speckles and the organization of cellular transcription and pre-mRNA splicing in vivo are not well understood. We have investigated the dynamic properties of splicing factors in nuclei of living cells. Here we show that speckles are highly dynamic structures that respond specifically to activation of nearby genes. These dynamic events are dependent on RNA polymerase II transcription, and are sensitive to inhibitors of protein kinases and Ser/Thr phosphatases. When single genes are transcriptionally activated in living cells, splicing factors leave speckles in peripheral extensions and accumulate at the new sites of transcription. We conclude that one function of speckles is to supply splicing factors to active genes. Our observations demonstrate that the interphase nucleus is far more dynamic in nature than previously assumed