Model-based learning protects against forming habits.

Studies in humans and rodents have suggested that behavior can at times be "goal-directed"-that is, planned, and purposeful-and at times "habitual"-that is, inflexible and automatically evoked by stimuli. This distinction is central to conceptions of pathological compulsion, as in drug abuse and obsessive-compulsive disorder. Evidence for the distinction has primarily come from outcome devaluation studies, in which the sensitivity of a previously learned behavior to motivational change is used to assay the dominance of habits versus goal-directed actions. However, little is known about how habits and goal-directed control arise. Specifically, in the present study we sought to reveal the trial-by-trial dynamics of instrumental learning that would promote, and protect against, developing habits. In two complementary experiments with independent samples, participants completed a sequential decision task that dissociated two computational-learning mechanisms, model-based and model-free. We then tested for habits by devaluing one of the rewards that had reinforced behavior. In each case, we found that individual differences in model-based learning predicted the participants' subsequent sensitivity to outcome devaluation, suggesting that an associative mechanism underlies a bias toward habit formation in healthy individuals.This work was funded by a Sir Henry Wellcome Postdoctoral Fellowship (101521/Z/12/Z) awarded to C.M.G. ND is supported by a Scholar Award from the McDonnell FoundationThe authors report no conflicts of interest and declare no competing financial interests.This is the final published version. It first appeared at http://link.springer.com/article/10.3758%2Fs13415-015-0347-6

The Nature of Belief-Directed Exploratory Choice in Human Decision-Making

In non-stationary environments, there is a conflict between exploiting currently favored options and gaining information by exploring lesser-known options that in the past have proven less rewarding. Optimal decision-making in such tasks requires considering future states of the environment (i.e., planning) and properly updating beliefs about the state of the environment after observing outcomes associated with choices. Optimal belief-updating is reflective in that beliefs can change without directly observing environmental change. For example, after 10 s elapse, one might correctly believe that a traffic light last observed to be red is now more likely to be green. To understand human decision-making when rewards associated with choice options change over time, we develop a variant of the classic “bandit” task that is both rich enough to encompass relevant phenomena and sufficiently tractable to allow for ideal actor analysis of sequential choice behavior. We evaluate whether people update beliefs about the state of environment in a reflexive (i.e., only in response to observed changes in reward structure) or reflective manner. In contrast to purely “random” accounts of exploratory behavior, model-based analyses of the subjects’ choices and latencies indicate that people are reflective belief updaters. However, unlike the Ideal Actor model, our analyses indicate that people’s choice behavior does not reflect consideration of future environmental states. Thus, although people update beliefs in a reflective manner consistent with the Ideal Actor, they do not engage in optimal long-term planning, but instead myopically choose the option on every trial that is believed to have the highest immediate payoff

Individual differences in naturalistic learning link negative emotionality to the development of anxiety

Organisms learn from prediction errors (PEs) to predict the future. Laboratory studies using small financial outcomes find that humans use PEs to update expectations and link individual differences in PE-based learning to internalizing disorders. Because of the low-stakes outcomes in most tasks, it is unclear whether PE learning emerges in naturalistic, high-stakes contexts and whether individual differences in PE learning predict psychopathology risk. Using experience sampling to assess 625 college students\u27 expected exam grades, we found evidence of PE-based learning and a general tendency to discount negative PEs, an optimism bias. However, individuals with elevated negative emotionality, a personality trait linked to the development of anxiety disorders, displayed a global pessimism and learning differences that impeded accurate expectations and predicted future anxiety symptoms. A sensitivity to PEs combined with an aversion to negative PEs may result in a pessimistic and inaccurate model of the world, leading to anxiety

Genomic Profiling of Advanced-Stage, Metaplastic Breast Carcinoma by Next-Generation Sequencing Reveals Frequent, Targetable Genomic Abnormalities and Potential New Treatment Options

Context.— Metastatic metaplastic breast carcinoma (MPBC) is an uncommon, but aggressive, tumor resistant to conventional chemotherapy. Objective.— To learn whether next-generation sequencing could identify potential targets of therapy for patients with relapsed and metastatic MPBC. Design.— Hybridization capture of 3769 exons from 236 cancer-related genes and 47 introns of 19 genes commonly rearranged in cancer was applied to a minimum of 50 ng of DNA extracted from 20 MPBC formalin-fixed, paraffin-embedded specimens and sequenced to high uniform coverage. Results.— The 20 patients with MPBC had a median age of 62 years (range, 42–86 years). There were 9 squamous (45%), 9 chondroid (45%), and 2 spindle cell (10%) MPBCs, all of which were high grade. Ninety-three genomic alterations were identified, (range, 1–11) with 19 of the 20 cases (95%) harboring an alteration that could potentially lead to a targeted treatment option. The most-common alterations were in TP53 (n = 69; 75%), PIK3CA (n = 37; 40%), MYC (n = 28; 30%), MLL2 (n = 28; 30%), PTEN (n = 23; 25%), CDKN2A/B (n = 19; 20%), CCND3 (n = 14; 15%), CCNE1 (n = 9; 10%), EGFR (n = 9; 10%), and KDM6A (n = 9; 10%); AKT3, CCND1, CCND2, CDK4, FBXW7, FGFR1, HRAS, NF1, PIK3R1, and SRC were each altered in a single case. All 16 MPBCs (100%) that were negative for ERBB2 (HER2) overexpression by immunohistochemistry and/or ERBB2 (HER2) amplification by fluorescence in situ hybridization were also uniformly (100%) negative for ERBB2 amplification by next-generation sequencing–based copy-number assessment. Conclusions.— Our results indicate that genomic profiling using next-generation sequencing can identify clinically meaningful alterations that have the potential to guide targeted treatment decisions in most patients with metastatic MPBC

Researching the use of force: The background to the international project

This article provides the background to an international project on use of force by the police that was carried out in eight countries. Force is often considered to be the defining characteristic of policing and much research has been conducted on the determinants, prevalence and control of the use of force, particularly in the United States. However, little work has looked at police officers’ own views on the use of force, in particular the way in which they justify it. Using a hypothetical encounter developed for this project, researchers in each country conducted focus groups with police officers in which they were encouraged to talk about the use of force. The results show interesting similarities and differences across countries and demonstrate the value of using this kind of research focus and methodology

Different paths to the modern state in Europe: the interaction between domestic political economy and interstate competition

Theoretical work on state formation and capacity has focused mostly on early modern Europe and on the experience of western European states during this period. While a number of European states monopolized domestic tax collection and achieved gains in state capacity during the early modern era, for others revenues stagnated or even declined, and these variations motivated alternative hypotheses for determinants of fiscal and state capacity. In this study we test the basic hypotheses in the existing literature making use of the large date set we have compiled for all of the leading states across the continent. We find strong empirical support for two prevailing threads in the literature, arguing respectively that interstate wars and changes in economic structure towards an urbanized economy had positive fiscal impact. Regarding the main point of contention in the theoretical literature, whether it was representative or authoritarian political regimes that facilitated the gains in fiscal capacity, we do not find conclusive evidence that one performed better than the other. Instead, the empirical evidence we have gathered lends supports to the hypothesis that when under pressure of war, the fiscal performance of representative regimes was better in the more urbanized-commercial economies and the fiscal performance of authoritarian regimes was better in rural-agrarian economie

Ultrasound enhanced prehospital thrombolysis using microbubbles infusion in patients with acute ST elevation myocardial infarction: Rationale and design of the Sonolysis study

Contains fulltext : 70525.pdf (publisher's version ) (Open Access)ABSTRACT: BACKGROUND -: Experimental studies have shown that ultrasound contrast agents enhance the effectiveness of thrombolytic agents in the presence of ultrasound in vitro and in vivo. Recently, we have launched a clinical pilot study, called "Sonolysis", to study this effect in patients with ST-elevation myocardial infarction based on proximal lesions of the infarct-related artery. METHODS/DESIGN -: In our multicenter, randomized, placebo controlled clinical trial we will include patients between 18 and 80 years of age with their first ST-elevation myocardial infarction based on a proximal lesion of the infarct-related artery. After receiving a single bolus alteplase 50 mg IV (Actilyse(R) Boehringer Ingelheim GmbH), a loading dose of aspirin 500 mg, and heparin 5000 IU in the ambulance according to the prehospital thrombolysis protocol, patients, following oral informed consent, are randomized to undergo 15 minutes of pulsatile ultrasound with intravenous administration of ultrasound contrast agent or placebo without ultrasound. Afterwards coronary angiography and, if indicated, percutaneous coronary intervention will take place. A total of 60 patients will be enrolled in approximately 1 year.The primary endpoints are based on the coronary angiogram and consist of TIMI flow, corrected TIMI frame count, and myocardial blush grade. Follow-up includes 12-lead ECG, 2D-echocardiography, cardiac MRI, and enzyme markers to obtain our secondary endpoints, including the infarct size, wall motion abnormalities, and the global left ventricular function. DISCUSSION -: The Sonolysis study is the first multicenter, randomized, placebo controlled clinical trial investigating the therapeutic application of ultrasound and microbubbles in acute ST-elevation myocardial infarction patients. A positive finding may stimulate further research and technical innovations to implement the treatment in the ambulance and maybe obtain even more patency at an earlier stage. TRIAL REGISTRATION -: Trialregister NTR161

A Role for Alström Syndrome Protein, Alms1, in Kidney Ciliogenesis and Cellular Quiescence

Premature truncation alleles in the ALMS1 gene are a frequent cause of human Alström syndrome. Alström syndrome is a rare disorder characterized by early obesity and sensory impairment, symptoms shared with other genetic diseases affecting proteins of the primary cilium. ALMS1 localizes to centrosomes and ciliary basal bodies, but truncation mutations in Alms1/ALMS1 do not preclude formation of cilia. Here, we show that in vitro knockdown of Alms1 in mice causes stunted cilia on kidney epithelial cells and prevents these cells from increasing calcium influx in response to mechanical stimuli. The stunted-cilium phenotype can be rescued with a 5′ fragment of the Alms1 cDNA, which resembles disease-associated alleles. In a mouse model of Alström syndrome, Alms1 protein can be stably expressed from the mutant allele and is required for cilia formation in primary cells. Aged mice developed specific loss of cilia from the kidney proximal tubules, which is associated with foci of apoptosis or proliferation. As renal failure is a common cause of mortality in Alström syndrome patients, we conclude that this disease should be considered as a further example of the class of renal ciliopathies: wild-type or mutant alleles of the Alström syndrome gene can support normal kidney ciliogenesis in vitro and in vivo, but mutant alleles are associated with age-dependent loss of kidney primary cilia

Footprints of Inversions at Present and Past Pseudoautosomal Boundaries in Human Sex Chromosomes

The human sex chromosomes have stopped recombining gradually, which has left five evolutionary strata on the X chromosome. Y inversions are thought to have suppressed X–Y recombination but clear evidence is missing. Here, we looked for such evidence by focusing on a region—the X-added region (XAR)—that includes the pseudoautosomal region and the most recent strata 3 to 5. We estimated and analyzed the whole set of parsimonious scenarios of Y inversions given the gene order in XAR and its Y homolog. Comparing these to scenarios for simulated sequences suggests that the strata 4 and 5 were formed by Y inversions. By comparing the X and Y DNA sequences, we found clear evidence of two Y inversions associated with duplications that coincide with the boundaries of strata 4 and 5. Divergence between duplicates is in agreement with the timing of strata 4 and 5 formation. These duplicates show a complex pattern of gene conversion that resembles the pattern previously found for AMELXY, a stratum 3 locus. This suggests that this locus—despite AMELY being unbroken—was possibly involved in a Y inversion that formed stratum 3. However, no clear evidence supporting the formation of stratum 3 by a Y inversion was found, probably because this stratum is too old for such an inversion to be detectable. Our results strongly support the view that the most recent human strata have arisen by Y inversions and suggest that inversions have played a major role in the differentiation of our sex chromosomes

Cloning and Functional Studies of a Splice Variant of CYP26B1 Expressed in Vascular Cells

Background: All-trans retinoic acid (atRA) plays an essential role in the regulation of gene expression, cell growth and differentiation and is also important for normal cardiovascular development but may in turn be involved in cardiovascular diseases, i.e. atherosclerosis and restenosis. The cellular atRA levels are under strict control involving several cytochromes P450 isoforms (CYPs). CYP26 may be the most important regulator of atRA catabolism in vascular cells. The present study describes the molecular cloning, characterization and function of atRA-induced expression of a spliced variant of the CYP26B1 gene. Methodology/Principal Findings: The coding region of the spliced CYP26B1 lacking exon 2 was amplified from cDNA synthesized from atRA-treated human aortic smooth muscle cells and sequenced. Both the spliced variant and full length CYP26B1 was found to be expressed in cultured human endothelial and smooth muscle cells, and in normal and atherosclerotic vessel. atRA induced both variants of CYP26B1 in cultured vascular cells. Furthermore, the levels of spliced mRNA transcript were 4.5 times higher in the atherosclerotic lesion compared to normal arteries and the expression in the lesions was increased 20-fold upon atRA treatment. The spliced CYP26B1 still has the capability to degrade atRA, but at an initial rate one-third that of the corresponding full length enzyme. Transfection of COS-1 and THP-1 cells with the CYP26B1 spliced variant indicated either an increase or a decrease in the catabolism of atRA, probably depending on the expression of other atRA catabolizing enzymes in the cells. Conclusions/Significance: Vascular cells express the spliced variant of CYP26B1 lacking exon 2 and it is also increased in atherosclerotic lesions. The spliced variant displays a slower and reduced degradation of atRA as compared to the full-length enzyme. Further studies are needed, however, to clarify the substrate specificity and role of the CYP26B1 splice variant in health and disease