Invasion speeds for structured populations in fluctuating environments

We live in a time where climate models predict future increases in environmental variability and biological invasions are becoming increasingly frequent. A key to developing effective responses to biological invasions in increasingly variable environments will be estimates of their rates of spatial spread and the associated uncertainty of these estimates. Using stochastic, stage-structured, integro-difference equation models, we show analytically that invasion speeds are asymptotically normally distributed with a variance that decreases in time. We apply our methods to a simple juvenile-adult model with stochastic variation in reproduction and an illustrative example with published data for the perennial herb, \emph{Calathea ovandensis}. These examples buttressed by additional analysis reveal that increased variability in vital rates simultaneously slow down invasions yet generate greater uncertainty about rates of spatial spread. Moreover, while temporal autocorrelations in vital rates inflate variability in invasion speeds, the effect of these autocorrelations on the average invasion speed can be positive or negative depending on life history traits and how well vital rates ``remember'' the past

Reinforcement learning or active inference?

This paper questions the need for reinforcement learning or control theory when optimising behaviour. We show that it is fairly simple to teach an agent complicated and adaptive behaviours using a free-energy formulation of perception. In this formulation, agents adjust their internal states and sampling of the environment to minimize their free-energy. Such agents learn causal structure in the environment and sample it in an adaptive and self-supervised fashion. This results in behavioural policies that reproduce those optimised by reinforcement learning and dynamic programming. Critically, we do not need to invoke the notion of reward, value or utility. We illustrate these points by solving a benchmark problem in dynamic programming; namely the mountain-car problem, using active perception or inference under the free-energy principle. The ensuing proof-of-concept may be important because the free-energy formulation furnishes a unified account of both action and perception and may speak to a reappraisal of the role of dopamine in the brain

Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement

Activation of dopamine receptors in forebrain regions, for minutes or longer, is known to be sufficient for positive reinforcement of stimuli and actions. However, the firing rate of dopamine neurons is increased for only about 200 milliseconds following natural reward events that are better than expected, a response which has been described as a “reward prediction error” (RPE). Although RPE drives reinforcement learning (RL) in computational models, it has not been possible to directly test whether the transient dopamine signal actually drives RL. Here we have performed optical stimulation of genetically targeted ventral tegmental area (VTA) dopamine neurons expressing Channelrhodopsin-2 (ChR2) in mice. We mimicked the transient activation of dopamine neurons that occurs in response to natural reward by applying a light pulse of 200 ms in VTA. When a single light pulse followed each self-initiated nose poke, it was sufficient in itself to cause operant reinforcement. Furthermore, when optical stimulation was delivered in separate sessions according to a predetermined pattern, it increased locomotion and contralateral rotations, behaviors that are known to result from activation of dopamine neurons. All three of the optically induced operant and locomotor behaviors were tightly correlated with the number of VTA dopamine neurons that expressed ChR2, providing additional evidence that the behavioral responses were caused by activation of dopamine neurons. These results provide strong evidence that the transient activation of dopamine neurons provides a functional reward signal that drives learning, in support of RL theories of dopamine function

Model-based parametric study of frontostriatal abnormalities in schizophrenia patients

<p>Abstract</p> <p>Background</p> <p>Several studies have suggested that the activity of the prefrontal cortex (PFC) and the dopamine (DA) release in the striatum has an inverse relationship. One would attribute this relationship primarily to the circuitry comprised of the glutamatergic projection from the PFC to the striatum and the GABAergic projection from the striatum to the midbrain DA nucleus. However, this circuitry has not characterized satisfactorily yet, so that no quantitative analysis has ever been made on the activities of the PFC and the striatum and also the DA release in the striatum.</p> <p>Methods</p> <p>In this study, a system dynamics model of the corticostriatal system with dopaminergic innervations is constructed to describe the relationships between the activities of the PFC and the striatum and the DA release in the striatum. By taking published receptor imaging data from schizophrenia patients and healthy subjects into this model, this article analyzes the effects of striatal D2 receptor activation on the balance of the activity and neurotransmission in the frontostriatal system of schizophrenic patients in comparison with healthy controls.</p> <p>Results</p> <p>The model predicts that the suppressive effect by D2 receptors at the terminals of the glutamatergic afferents to the striatum from the PFC enhances the hypofrontality-induced elevation of striatal DA release by at most 83%. The occupancy-based estimation of the 'optimum' D2 receptor occupancy by antipsychotic drugs is 52%. This study further predicts that patients with lower PFC activity tend to have greater improvement of positive symptoms following antipsychotic medication.</p> <p>Conclusion</p> <p>This model-based parametric study would be useful for system-level analysis of the brains with psychiatric diseases. It will be able to make reliable prediction of clinical outcome when sufficient data will be available.</p

P2 receptors are involved in the mediation of motivation-related behavior

The importance of purinergic signaling in the intact mesolimbic–mesocortical circuit of the brain of freely moving rats is reviewed. In the rat, an endogenous ADP/ATPergic tone reinforces the release of dopamine from the axon terminals in the nucleus accumbens as well as from the somatodendritic region of these neurons in the ventral tegmental area, as well as the release of glutamate, probably via P2Y1 receptor stimulation. Similar mechanisms may regulate the release of glutamate in both areas of the brain. Dopamine and glutamate determine in concert the activity of the accumbal GABAergic, medium-size spiny neurons thought to act as an interface between the limbic cortex and the extrapyramidal motor system. These neurons project to the pallidal and mesencephalic areas, thereby mediating the behavioral reaction of the animal in response to a motivation-related stimulus. There is evidence that extracellular ADP/ATP promotes goal-directed behavior, e.g., intention and feeding, via dopamine, probably via P2Y1 receptor stimulation. Accumbal P2 receptor-mediated glutamatergic mechanisms seem to counteract the dopaminergic effects on behavior. Furthermore, adaptive changes of motivation-related behavior, e.g., by chronic succession of starvation and feeding or by repeated amphetamine administration, are accompanied by changes in the expression of the P2Y1 receptor, thought to modulate the sensitivity of the animal to respond to certain stimuli

Dopamine Signaling Is Essential for Precise Rates of Locomotion by C. elegans

Dopamine is an important neuromodulator in both vertebrates and invertebrates. We have found that reduced dopamine signaling can cause a distinct abnormality in the behavior of the nematode C. elegans, which has only eight dopaminergic neurons. Using an automated particle-tracking system for the analysis of C. elegans locomotion, we observed that individual wild-type animals made small adjustments to their speed to maintain constant rates of locomotion. By contrast, individual mutant animals defective in the synthesis of dopamine made larger adjustments to their speeds, resulting in large fluctuations in their rates of locomotion. Mutants defective in dopamine signaling also frequently exhibited both abnormally high and abnormally low average speeds. The ability to make small adjustments to speed was restored to these mutants by treatment with dopamine. These behaviors depended on the D2-like dopamine receptor DOP-3 and the G-protein subunit GOA-1. We suggest that C. elegans and other animals, including humans, might share mechanisms by which dopamine restricts motor activity levels and coordinates movement

Chromosome-Biased Binding and Gene Regulation by the Caenorhabditis elegans DRM Complex

DRM is a conserved transcription factor complex that includes E2F/DP and pRB family proteins and plays important roles in development and cancer. Here we describe new aspects of DRM binding and function revealed through genome-wide analyses of the Caenorhabditis elegans DRM subunit LIN-54. We show that LIN-54 DNA-binding activity recruits DRM to promoters enriched for adjacent putative E2F/DP and LIN-54 binding sites, suggesting that these two DNA–binding moieties together direct DRM to its target genes. Chromatin immunoprecipitation and gene expression profiling reveals conserved roles for DRM in regulating genes involved in cell division, development, and reproduction. We find that LIN-54 promotes expression of reproduction genes in the germline, but prevents ectopic activation of germline-specific genes in embryonic soma. Strikingly, C. elegans DRM does not act uniformly throughout the genome: the DRM recruitment motif, DRM binding, and DRM-regulated embryonic genes are all under-represented on the X chromosome. However, germline genes down-regulated in lin-54 mutants are over-represented on the X chromosome. We discuss models for how loss of autosome-bound DRM may enhance germline X chromosome silencing. We propose that autosome-enriched binding of DRM arose in C. elegans as a consequence of germline X chromosome silencing and the evolutionary redistribution of germline-expressed and essential target genes to autosomes. Sex chromosome gene regulation may thus have profound evolutionary effects on genome organization and transcriptional regulatory networks.National Institutes of Health (U.S.) (grant GM24663)National Institutes of Health (U.S.) (grant DK068429)National Institutes of Health (U.S.) (grant GM082971)National Institutes of Health (U.S.) (grant GM076378

Both the Caspase CSP-1 and a Caspase-Independent Pathway Promote Programmed Cell Death in Parallel to the Canonical Pathway for Apoptosis in Caenorhabditis elegans

Caspases are cysteine proteases that can drive apoptosis in metazoans and have critical functions in the elimination of cells during development, the maintenance of tissue homeostasis, and responses to cellular damage. Although a growing body of research suggests that programmed cell death can occur in the absence of caspases, mammalian studies of caspase-independent apoptosis are confounded by the existence of at least seven caspase homologs that can function redundantly to promote cell death. Caspase-independent programmed cell death is also thought to occur in the invertebrate nematode Caenorhabditis elegans. The C. elegans genome contains four caspase genes (ced-3, csp-1, csp-2, and csp-3), of which only ced-3 has been demonstrated to promote apoptosis. Here, we show that CSP-1 is a pro-apoptotic caspase that promotes programmed cell death in a subset of cells fated to die during C. elegans embryogenesis. csp-1 is expressed robustly in late pachytene nuclei of the germline and is required maternally for its role in embryonic programmed cell deaths. Unlike CED-3, CSP-1 is not regulated by the APAF-1 homolog CED-4 or the BCL-2 homolog CED-9, revealing that csp-1 functions independently of the canonical genetic pathway for apoptosis. Previously we demonstrated that embryos lacking all four caspases can eliminate cells through an extrusion mechanism and that these cells are apoptotic. Extruded cells differ from cells that normally undergo programmed cell death not only by being extruded but also by not being engulfed by neighboring cells. In this study, we identify in csp-3; csp-1; csp-2 ced-3 quadruple mutants apoptotic cell corpses that fully resemble wild-type cell corpses: these caspase-deficient cell corpses are morphologically apoptotic, are not extruded, and are internalized by engulfing cells. We conclude that both caspase-dependent and caspase-independent pathways promote apoptotic programmed cell death and the phagocytosis of cell corpses in parallel to the canonical apoptosis pathway involving CED-3 activation.Howard Hughes Medical InstituteDamon Runyon Cancer Research FoundationCharles A. King Trus

Coordinated Activity of Ventral Tegmental Neurons Adapts to Appetitive and Aversive Learning

Our understanding of how value-related information is encoded in the ventral tegmental area (VTA) is based mainly on the responses of individual putative dopamine neurons. In contrast to cortical areas, the nature of coordinated interactions between groups of VTA neurons during motivated behavior is largely unknown. These interactions can strongly affect information processing, highlighting the importance of investigating network level activity. We recorded the activity of multiple single units and local field potentials (LFP) in the VTA during a task in which rats learned to associate novel stimuli with different outcomes. We found that coordinated activity of VTA units with either putative dopamine or GABA waveforms was influenced differently by rewarding versus aversive outcomes. Specifically, after learning, stimuli paired with a rewarding outcome increased the correlation in activity levels between unit pairs whereas stimuli paired with an aversive outcome decreased the correlation. Paired single unit responses also became more redundant after learning. These response patterns flexibly tracked the reversal of contingencies, suggesting that learning is associated with changing correlations and enhanced functional connectivity between VTA neurons. Analysis of LFP recorded simultaneously with unit activity showed an increase in the power of theta oscillations when stimuli predicted reward but not an aversive outcome. With learning, a higher proportion of putative GABA units were phase locked to the theta oscillations than putative dopamine units. These patterns also adapted when task contingencies were changed. Taken together, these data demonstrate that VTA neurons organize flexibly as functional networks to support appetitive and aversive learning