Retrospective model-based inference guides model-free credit assignment

An extensive reinforcement learning literature shows that organisms assign credit efficiently, even under conditions of state uncertainty. However, little is known about credit-assignment when state uncertainty is subsequently resolved. Here, we address this problem within the framework of an interaction between model-free (MF) and model-based (MB) control systems. We present and support experimentally a theory of MB retrospective-inference. Within this framework, a MB system resolves uncertainty that prevailed when actions were taken thus guiding an MF credit-assignment. Using a task in which there was initial uncertainty about the lotteries that were chosen, we found that when participants’ momentary uncertainty about which lottery had generated an outcome was resolved by provision of subsequent information, participants preferentially assigned credit within a MF system to the lottery they retrospectively inferred was responsible for this outcome. These findings extend our knowledge about the range of MB functions and the scope of system interactions

An Updated Algorithm for the Generation of Neutral Landscapes by Spectral Synthesis

Background: Patterns that arise from an ecological process can be driven as much from the landscape over which the process is run as it is by some intrinsic properties of the process itself. The disentanglement of these effects is aided if it possible to run models of the process over artificial landscapes with controllable spatial properties. A number of different methods for the generation of so-called ‘neutral landscapes’ have been developed to provide just such a tool. Of these methods, a particular class that simulate fractional Brownian motion have shown particular promise. The existing methods of simulating fractional Brownian motion suffer from a number of problems however: they are often not easily generalisable to an arbitrary number of dimensions and produce outputs that can exhibit some undesirable artefacts. Methodology: We describe here an updated algorithm for the generation of neutral landscapes by fractional Brownian motion that do not display such undesirable properties. Using Monte Carlo simulation we assess the anisotropic properties of landscapes generated using the new algorithm described in this paper and compare it against a popular benchmark algorithm. Conclusion/Significance: The results show that the existing algorithm creates landscapes with values strongly correlated in the diagonal direction and that the new algorithm presented here corrects this artefact. A number of extensions of the algorithm described here are also highlighted: we describe how the algorithm can be employed to generate landscapes that display different properties in different dimensions and how they can be combined with an environmental gradient to produce landscapes that combine environmental variation at the local and macro scales

Cardiopulmonary exercise testing and cardiopulmonary morbidity in patients undergoing major head and neck surgery

Cardiopulmonary exercise testing (CPET) is used as a risk stratification tool for patients undergoing major surgery. In this study, we investigated the role of CPET in predicting day five cardiopulmonary morbidity in patients undergoing head and neck surgery. This observational cohort study included 230 adults. We recorded preoperative CPET variables and day five postoperative cardiopulmonary morbidity. Full data from 187 patients were analysed; 43 patients either had incomplete data sets or declined surgery/CPET. One hundred and nineteen patients (63.6%) developed cardiopulmonary morbidity at day five. Increased preoperative heart rate and duration of surgery were independently associated with day five cardiopulmonary morbidity. Those with such morbidity also had lower peak V̇O2 11.4 (IQR 8.4-18.0) vs 16.0 (IQR 14.0-19.7) ml.kg-1.min-1, P<0.0001 and V̇O2 at AT 10.6 (IQR 9.1-13.1) vs 11.5 (IQR 10.5-13.0) ml.kg-1.min-1, p=0.03. Logistic regression model containing peak V̇O2 and duration of surgery demonstrated that increased peak V̇O2 was associated with a reduction in the likelihood of cardiopulmonary complications OR 0.92 (95%CI 0.87 to 0.96), p=0.001. The area under the receiver operating characteristic curve for this model was 0.75(95%CI 0.68 to 0.82), p<0.0001, 64% sensitivity, 81% specificity. CPET can help to predict day five cardiopulmonary morbidity in the patients undergoing head and neck surgery. A model containing peak V̇O2 allowed identification of those with such complications

Complexity in decision making: Determining university library opening hours

Making decisions on academic library opening hours is complex with many pressures on managers. This research surveys senior academic library managers from the UK, using a questionnaire to reveal views on library opening hours, the decision making process, and the pressures which influenced their decisions. A variety of factors were found, in particular satisfying undergraduate demands. The research also revealed the sources of information important in making decisions on opening hours and the influence of ‘political’ issues in the decision making process. Some institutions remove complexity by utilising 24/7 opening, though this is not an option for many

Transcriptional control of the multi-drug transporter ABCB1 by transcription factor Sp3 in different human tissues

The ATP-binding cassette (ABC) transporter ABCB1, encoded by the multidrug resistance gene MDR1, is expressed on brain microvascular endothelium and several types of epithelium, but not on endothelia outside the CNS. It is an essential component of the blood-brain barrier. The aim of this study was to identify cell-specific controls on the transcription of MDR1 in human brain endothelium. Reporter assays identified a region of 500bp around the transcription start site that was optimally active in brain endothelium. Chromatin immunoprecipitation identified Sp3 and TFIID associated with this region and EMSA (electrophoretic mobility shift assays) confirmed that Sp3 binds preferentially to an Sp-target site (GC-box) on the MDR1 promoter in brain endothelium. This result contrasts with findings in other cell types and with the colon carcinoma line Caco-2, in which Sp1 preferentially associates with the MDR1 promoter. Differences in MDR1 transcriptional control between brain endothelium and Caco-2 could not be explained by the relative abundance of Sp1:Sp3 nor by the ratio of Sp3 variants, because activating variants of Sp3 were present in both cell types. However differential binding of other transcription factors was also detected in two additional upstream regions of the MDR1 promoter. Identification of cell-specific controls on the transcription of MDR1 indicates that it may be possible to modulate multi-drug resistance on tumours, while leaving the blood brain barrier intact

Efficacy of EGFR Inhibition Is Modulated by Model, Sex, Genetic Background and Diet: Implications for Preclinical Cancer Prevention and Therapy Trials

Molecule-targeted therapies are being widely developed and deployed, but they are frequently less effective in clinical trials than predicted based upon preclinical studies. Frequently, only a single model or genetic background is utilized using diets that are not relevant to that consumed by most cancer patients, which may contribute to the lack of predictability of many preclinical therapeutic studies. Inhibition of epidermal growth factor receptor (EGFR) in colorectal cancer was used to investigate potential causes for low predictive values of many preclinical studies. The efficacy of the small molecule EGFR inhibitor AG1478 was evaluated using two mouse models, ApcMin/+ and azoxymethane (AOM), both sexes on three genetic backgrounds, C57BL/6J (B6) and A/J (A) inbred strains and AB6F1 hybrids, and two diets, standard chow (STD) or Western-style diet (WD). AG1478 has significant anti-tumor activity in the B6-ApcMin/+ model with STD but only moderately on the WD and in the AOM model on an A background with a WD but not STD. On the F1 hybrid background AG1478 is effective in the ApcMin/+ model with either STD or WD, but has only moderate efficacy in the AOM model with either diet. Sex differences were also observed. Unexpectedly, the level of liver EGFR phosphorylation inhibition by AG1478 was not positively correlated with inhibition of tumor growth in the AOM model. Model-dependent interactions between genetic background and diet can dramatically impact preclinical results, and indicate that low predictive values of preclinical studies can be attributed to study designs that do not account for the heterogeneous patient population or the diets they consume. Better-designed preclinical studies should lead to more accurate predictions of therapeutic response in the clinic

Acute kidney disease and renal recovery : consensus report of the Acute Disease Quality Initiative (ADQI) 16 Workgroup

Consensus definitions have been reached for both acute kidney injury (AKI) and chronic kidney disease (CKD) and these definitions are now routinely used in research and clinical practice. The KDIGO guideline defines AKI as an abrupt decrease in kidney function occurring over 7 days or less, whereas CKD is defined by the persistence of kidney disease for a period of > 90 days. AKI and CKD are increasingly recognized as related entities and in some instances probably represent a continuum of the disease process. For patients in whom pathophysiologic processes are ongoing, the term acute kidney disease (AKD) has been proposed to define the course of disease after AKI; however, definitions of AKD and strategies for the management of patients with AKD are not currently available. In this consensus statement, the Acute Disease Quality Initiative (ADQI) proposes definitions, staging criteria for AKD, and strategies for the management of affected patients. We also make recommendations for areas of future research, which aim to improve understanding of the underlying processes and improve outcomes for patients with AKD

The ghost sex-life of the paedogenetic beetle Micromalthus debilis

Genetic and sexual systems can be evolutionarily dynamic within and among clades. However, identifying the processes responsible for switches between, for instance, sexual and asexual reproduction, or cyclic and non-cyclic life histories remains challenging. When animals evolve parthenogenetic reproduction, information about the sexual mating system becomes lost. Here we report an extraordinary case where we have been able to resurrect sexual adults in a species of beetle that reproduces by parthenogenetic paedogenesis, without the production of adults. Via heat treatment, we were able to artificially induce adult beetles of Micromalthus debilis in order to describe its pre-paedogenetic mating system. Adults showed a highly female biased sex ratio, out-breeding behaviour, and sex-role reversal. Paedogenetic larvae of Micromalthus are infected with the endosymbiotic bacteria Rickettsia and Wolbachia. Clear signs of vestigialization in adults are concurrent with the loss of adults. Our data suggest an ancient female sex ratio bias that predated the loss of adults, perhaps associated with endosymbionts. We propose a model for the transition from a haplodiploid cyclical parthenogenetic life history to parthenogenetic paedogenesis. Paedogenetic development induces a new mechanism of sex ratio bias in midges, wasps and beetles

Stress-Induced Reinstatement of Drug Seeking: 20 Years of Progress

In human addicts, drug relapse and craving are often provoked by stress. Since 1995, this clinical scenario has been studied using a rat model of stress-induced reinstatement of drug seeking. Here, we first discuss the generality of stress-induced reinstatement to different drugs of abuse, different stressors, and different behavioral procedures. We also discuss neuropharmacological mechanisms, and brain areas and circuits controlling stress-induced reinstatement of drug seeking. We conclude by discussing results from translational human laboratory studies and clinical trials that were inspired by results from rat studies on stress-induced reinstatement. Our main conclusions are (1) The phenomenon of stress-induced reinstatement, first shown with an intermittent footshock stressor in rats trained to self-administer heroin, generalizes to other abused drugs, including cocaine, methamphetamine, nicotine, and alcohol, and is also observed in the conditioned place preference model in rats and mice. This phenomenon, however, is stressor specific and not all stressors induce reinstatement of drug seeking. (2) Neuropharmacological studies indicate the involvement of corticotropin-releasing factor (CRF), noradrenaline, dopamine, glutamate, kappa/dynorphin, and several other peptide and neurotransmitter systems in stress-induced reinstatement. Neuropharmacology and circuitry studies indicate the involvement of CRF and noradrenaline transmission in bed nucleus of stria terminalis and central amygdala, and dopamine, CRF, kappa/dynorphin, and glutamate transmission in other components of the mesocorticolimbic dopamine system (ventral tegmental area, medial prefrontal cortex, orbitofrontal cortex, and nucleus accumbens). (3) Translational human laboratory studies and a recent clinical trial study show the efficacy of alpha-2 adrenoceptor agonists in decreasing stress-induced drug craving and stress-induced initial heroin lapse

Relationships within aphids Cinara (Cupressobium) (Hemiptera) based on mitochondrial and nuclear DNA sequences

The relationships between Cinara (Cupressobium) aphids inhabiting woody parts and leaves of conifers belonging to Cupressaceae have been studied using a mitochondrial gene (COI) and a nuclear gene (EF1-α). Based on the COI sequences, genetic distances between species ranged from 5.6 % between Cinara (C.) tujafilina (del Guercio) and Cinara (C.) juniperi (De Geer) to 10.5 % between C. (C.) tujafilina and Cinara (C.) mordvilkoi (Pašek). Genetic distances among EF1-α sequences were lower and showed from 0.1 % between C. cupressi and C. juniperi to 2.3 % between C. tujafilina and C. mordvilkoi. Molecular phylogenetic trees were constructed using the Bayesian inference (BI) phylogenetic analysis and maximum parsimony (MP) criterion. Phylogenetic trees obtained based on COI and EF1-α marker genes created two sister clades. Our results indicate that Cinara (Cupressobium) are a monophyletic group of aphids. Phylogenetic relationships amongst Cupressobium aphids do not result from the association with the host plant, but from the feeding site on the host plant or an ability to change the microhabitat on the plant. As closely related species inhabit similar microhabitats on different host plants, it suggests that the host switching is the main mode of speciation in this subgenus