Retrospective model-based inference guides model-free credit assignment

An extensive reinforcement learning literature shows that organisms assign credit efficiently, even under conditions of state uncertainty. However, little is known about credit-assignment when state uncertainty is subsequently resolved. Here, we address this problem within the framework of an interaction between model-free (MF) and model-based (MB) control systems. We present and support experimentally a theory of MB retrospective-inference. Within this framework, a MB system resolves uncertainty that prevailed when actions were taken thus guiding an MF credit-assignment. Using a task in which there was initial uncertainty about the lotteries that were chosen, we found that when participants’ momentary uncertainty about which lottery had generated an outcome was resolved by provision of subsequent information, participants preferentially assigned credit within a MF system to the lottery they retrospectively inferred was responsible for this outcome. These findings extend our knowledge about the range of MB functions and the scope of system interactions

Perturbation of Mouse Retinal Vascular Morphogenesis by Anthrax Lethal Toxin

Lethal factor, the enzymatic moiety of anthrax lethal toxin (LeTx) is a protease that inactivates mitogen activated protein kinase kinases (MEK or MKK). In vitro and in vivo studies demonstrate LeTx targets endothelial cells. However, the effects of LeTx on endothelial cells are incompletely characterized. To gain insight into this process we used a developmental model of vascularization in the murine retina. We hypothesized that application of LeTx would disrupt normal retinal vascularization, specifically during the angiogenic phase of vascular development. By immunoblotting and immunofluorescence microscopy we observed that MAPK activation occurs in a spatially and temporally regulated manner during retinal vascular development. Intravitreal administration of LeTx caused an early delay (4 d post injection) in retinal vascular development that was marked by reduced penetration of vessels into distal regions of the retina as well as failure of sprouting vessels to form the deep and intermediate plexuses within the inner retina. In contrast, later stages (8 d post injection) were characterized by the formation of abnormal vascular tufts that co-stained with phosphorylated MAPK in the outer retinal region. We also observed a significant increase in the levels of secreted VEGF in the vitreous 4 d and 8 d after LeTx injection. In contrast, the levels of over 50 cytokines other cytokines, including bFGF, EGF, MCP-1, and MMP-9, remained unchanged. Finally, co-injection of VEGF-neutralizing antibodies significantly decreased LeTx-induced neovascular growth. Our studies not only reveal that MAPK signaling plays a key role in retinal angiogenesis but also that perturbation of MAPK signaling by LeTx can profoundly alter vascular morphogenesis

The Cognitive Role of the Globus Pallidus interna; Insights from Disease States.

The motor symptoms of both Parkinson's disease and focal dystonia arise from dysfunction of the basal ganglia, and are improved by pallidotomy or deep brain stimulation of the Globus Pallidus interna (GPi). However, Parkinson's disease is associated with a greater degree of basal ganglia-dependent learning impairment than dystonia. We attempt to understand this observation in terms of a comparison of the electrophysiology of the output of the basal ganglia between the two conditions. We use the natural experiment offered by Deep Brain Stimulation to compare GPi local field potential responses in subjects with Parkinson's disease compared to subjects with dystonia performing a forced-choice decision-making task with sensory feedback. In dystonic subjects, we found that auditory feedback was associated with the presence of high gamma oscillations nestled on a negative deflection, morphologically similar to sharp wave ripple complexes described in human rhinal cortex. These were not present in Parkinson's disease subjects. The temporal properties of the high gamma burst were modified by incorrect trial performance compared to correct trial performance. Both groups exhibited a robust low frequency response to 'incorrect' trial performance in dominant GPi but not non-dominant GPi at theta frequency. Our results suggest that cellular processes associated with striatum-dependent memory function may be selectively impaired in Parkinson's disease even if dopaminergic drugs are administered, but that error detection mechanisms are preserved

Measurement of the Bottom-Strange Meson Mixing Phase in the Full CDF Data Set

We report a measurement of the bottom-strange meson mixing phase \beta_s using the time evolution of B0_s -> J/\psi (->\mu+\mu-) \phi (-> K+ K-) decays in which the quark-flavor content of the bottom-strange meson is identified at production. This measurement uses the full data set of proton-antiproton collisions at sqrt(s)= 1.96 TeV collected by the Collider Detector experiment at the Fermilab Tevatron, corresponding to 9.6 fb-1 of integrated luminosity. We report confidence regions in the two-dimensional space of \beta_s and the B0_s decay-width difference \Delta\Gamma_s, and measure \beta_s in [-\pi/2, -1.51] U [-0.06, 0.30] U [1.26, \pi/2] at the 68% confidence level, in agreement with the standard model expectation. Assuming the standard model value of \beta_s, we also determine \Delta\Gamma_s = 0.068 +- 0.026 (stat) +- 0.009 (syst) ps-1 and the mean B0_s lifetime, \tau_s = 1.528 +- 0.019 (stat) +- 0.009 (syst) ps, which are consistent and competitive with determinations by other experiments.Comment: 8 pages, 2 figures, Phys. Rev. Lett 109, 171802 (2012

Positional Cloning of “Lisch-like”, a Candidate Modifier of Susceptibility to Type 2 Diabetes in Mice

In 404 Lepob/ob F2 progeny of a C57BL/6J (B6) x DBA/2J (DBA) intercross, we mapped a DBA-related quantitative trait locus (QTL) to distal Chr1 at 169.6 Mb, centered about D1Mit110, for diabetes-related phenotypes that included blood glucose, HbA1c, and pancreatic islet histology. The interval was refined to 1.8 Mb in a series of B6.DBA congenic/subcongenic lines also segregating for Lepob. The phenotypes of B6.DBA congenic mice include reduced β-cell replication rates accompanied by reduced β-cell mass, reduced insulin/glucose ratio in blood, reduced glucose tolerance, and persistent mild hypoinsulinemic hyperglycemia. Nucleotide sequence and expression analysis of 14 genes in this interval identified a predicted gene that we have designated “Lisch-like” (Ll) as the most likely candidate. The gene spans 62.7 kb on Chr1qH2.3, encoding a 10-exon, 646–amino acid polypeptide, homologous to Lsr on Chr7qB1 and to Ildr1 on Chr16qB3. The largest isoform of Ll is predicted to be a transmembrane molecule with an immunoglobulin-like extracellular domain and a serine/threonine-rich intracellular domain that contains a 14-3-3 binding domain. Morpholino knockdown of the zebrafish paralog of Ll resulted in a generalized delay in endodermal development in the gut region and dispersion of insulin-positive cells. Mice segregating for an ENU-induced null allele of Ll have phenotypes comparable to the B.D congenic lines. The human ortholog, C1orf32, is in the middle of a 30-Mb region of Chr1q23-25 that has been repeatedly associated with type 2 diabetes

Liverpool telescope 2: a new robotic facility for rapid transient follow-up

The Liverpool Telescope is one of the world's premier facilities for time domain astronomy. The time domain landscape is set to radically change in the coming decade, with surveys such as LSST providing huge numbers of transient detections on a nightly basis; transient detections across the electromagnetic spectrum from other facilities such as SVOM, SKA and CTA; and the era of `multi-messenger astronomy', wherein events are detected via non-electromagnetic means, such as gravitational wave emission. We describe here our plans for Liverpool Telescope 2: a new robotic telescope designed to capitalise on this new era of time domain astronomy. LT2 will be a 4-metre class facility co-located with the LT at the Observatorio del Roque de Los Muchachos on the Canary island of La Palma. The telescope will be designed for extremely rapid response: the aim is that the telescope will take data within 30 seconds of the receipt of a trigger from another facility. The motivation for this is twofold: firstly it will make it a world-leading facility for the study of fast fading transients and explosive phenomena discovered at early times. Secondly, it will enable large-scale programmes of low-to-intermediate resolution spectral classification of transients to be performed with great efficiency. In the target-rich environment of the LSST era, minimising acquisition overheads will be key to maximising the science gains from any follow-up programme. The telescope will have a diverse instrument suite which is simultaneously mounted for automatic changes, but it is envisaged that the primary instrument will be an intermediate resolution, optical/infrared spectrograph for scientific exploitation of transients discovered with the next generation of synoptic survey facilities. In this paper we outline the core science drivers for the telescope, and the requirements for the optical and mechanical design

The importance of the cellular stress response in the pathogenesis and treatment of type 2 diabetes

Organisms have evolved to survive rigorous environments and are not prepared to thrive in a world of caloric excess and sedentary behavior. A realization that physical exercise (or lack of it) plays a pivotal role in both the pathogenesis and therapy of type 2 diabetes mellitus (t2DM) has led to the provocative concept of therapeutic exercise mimetics. A decade ago, we attempted to simulate the beneficial effects of exercise by treating t2DM patients with 3 weeks of daily hyperthermia, induced by hot tub immersion. The short-term intervention had remarkable success, with a 1 % drop in HbA1, a trend toward weight loss, and improvement in diabetic neuropathic symptoms. An explanation for the beneficial effects of exercise and hyperthermia centers upon their ability to induce the cellular stress response (the heat shock response) and restore cellular homeostasis. Impaired stress response precedes major metabolic defects associated with t2DM and may be a near seminal event in the pathogenesis of the disease, tipping the balance from health into disease. Heat shock protein inducers share metabolic pathways associated with exercise with activation of AMPK, PGC1-a, and sirtuins. Diabetic therapies that induce the stress response, whether via heat, bioactive compounds, or genetic manipulation, improve or prevent all of the morbidities and comorbidities associated with the disease. The agents reduce insulin resistance, inflammatory cytokines, visceral adiposity, and body weight while increasing mitochondrial activity, normalizing membrane structure and lipid composition, and preserving organ function. Therapies restoring the stress response can re-tip the balance from disease into health and address the multifaceted defects associated with the disease

Study of multi-muon events produced in p\bar{p} interactions at \sqrt{s}=1.96 TeV

68 pages, 46 figures, 11 tables. Submitted to Phys. Rev. D. Removed typos from the authors' listWe report the results of a study of multi-muon events produced at the Fermilab Tevatron collider and acquired with the CDF II detector using a dedicated dimuon trigger. The production cross section and kinematics of events in which both muon candidates are produced inside the beam pipe of radius 1.5 cm are successfully modeled by known processes which include heavy flavor production. In contrast, we are presently unable to fully account for the number and properties of the remaining events, in which at least one muon candidate is produced outside of the beam pipe, in terms of the same understanding of the CDF II detector, trigger, and event reconstruction.Peer reviewe