On sequential Bayesian inference for continual learning

Sequential Bayesian inference can be used for continual learning to prevent catastrophic forgetting of past tasks and provide an informative prior when learning new tasks. We revisit sequential Bayesian inference and assess whether using the previous task’s posterior as a prior for a new task can prevent catastrophic forgetting in Bayesian neural networks. Our first contribution is to perform sequential Bayesian inference using Hamiltonian Monte Carlo. We propagate the posterior as a prior for new tasks by approximating the posterior via fitting a density estimator on Hamiltonian Monte Carlo samples. We find that this approach fails to prevent catastrophic forgetting, demonstrating the difficulty in performing sequential Bayesian inference in neural networks. From there, we study simple analytical examples of sequential Bayesian inference and CL and highlight the issue of model misspecification, which can lead to sub-optimal continual learning performance despite exact inference. Furthermore, we discuss how task data imbalances can cause forgetting. From these limitations, we argue that we need probabilistic models of the continual learning generative process rather than relying on sequential Bayesian inference over Bayesian neural network weights. Our final contribution is to propose a simple baseline called Prototypical Bayesian Continual Learning, which is competitive with the best performing Bayesian continual learning methods on class incremental continual learning computer vision benchmarks

Gametocyte carriage in Plasmodium falciparum-infected travellers.

BACKGROUND: Gametocytes are the sexual stage of Plasmodium parasites. The determinants of gametocyte carriage have been studied extensively in endemic areas, but have rarely been explored in travellers with malaria. The incidence of gametocytaemia, and factors associated with gametocyte emergence in adult travellers with Plasmodium falciparum malaria was investigated at the Hospital for Tropical Diseases in London. METHODS: Clinical, parasitological and demographic data for all patients presenting with P. falciparum malaria between January 2001 and December 2011 were extracted from a prospective database. These data were supplemented by manual searches of laboratory records and patient case notes. RESULTS: Seven hundred and seventy three adult patients with laboratory-confirmed P. falciparum malaria were identified. Four hundred and sixty five (60%) were born in a country where malaria is endemic. Patients presented to hospital a median of four days into their illness. The median maximum parasite count was 0.4%. One hundred and ninety six patients (25%) had gametocytes; 94 (12%) on admission, and 102 (13%) developing during treatment. Gametocytaemia on admission was associated with anaemia and a lower maximum parasitaemia. Patients with gametocytes at presentation were less likely to have thrombocytopenia or severe malaria. Patients who developed gametocytes during treatment were more likely to have had parasitaemia of long duration, a high maximum parasitaemia and to have had severe malaria. There was no apparent association between the appearance of gametocytes and treatment regimen. CONCLUSIONS: The development of gametocytaemia in travellers with P. falciparum is associated with factors similar to those reported among populations in endemic areas. These data suggest that acquired immunity to malaria is not the only determinant of patterns of gametocyte carriage among patients with the disease

Book Reviews

DISSENT IN THE SUPREME COURT-A CHRONOLOGY. By Percival E. Jackson. ADMINISTRATIVE JUSTICE. By Philippe Nonet . MOMENT OF MADNESS: THE PEOPLE VS. JACK RUBY. By Elmer Gertz

Differential DNA methylation in Pacific oyster reproductive tissue in response to ocean acidification

© The Author(s), 2022. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Venkataraman, Y. R., White, S. J., & Roberts, S. B. Differential DNA methylation in Pacific oyster reproductive tissue in response to ocean acidification. BMC Genomics, 23(1), (2022): 556, https://doi.org/10.1186/s12864-022-08781-5.Background There is a need to investigate mechanisms of phenotypic plasticity in marine invertebrates as negative effects of climate change, like ocean acidification, are experienced by coastal ecosystems. Environmentally-induced changes to the methylome may regulate gene expression, but methylome responses can be species- and tissue-specific. Tissue-specificity has implications for gonad tissue, as gonad-specific methylation patterns may be inherited by offspring. We used the Pacific oyster (Crassostrea gigas) — a model for understanding pH impacts on bivalve molecular physiology due to its genomic resources and importance in global aquaculture— to assess how low pH could impact the gonad methylome. Oysters were exposed to either low pH (7.31 ± 0.02) or ambient pH (7.82 ± 0.02) conditions for 7 weeks. Whole genome bisulfite sequencing was used to identify methylated regions in female oyster gonad samples. C- > T single nucleotide polymorphisms were identified and removed to ensure accurate methylation characterization. Results Analysis of gonad methylomes revealed a total of 1284 differentially methylated loci (DML) found primarily in genes, with several genes containing multiple DML. Gene ontologies for genes containing DML were involved in development and stress response, suggesting methylation may promote gonad growth homeostasis in low pH conditions. Additionally, several of these genes were associated with cytoskeletal structure regulation, metabolism, and protein ubiquitination — commonly-observed responses to ocean acidification. Comparison of these DML with other Crassostrea spp. exposed to ocean acidification demonstrates that similar pathways, but not identical genes, are impacted by methylation. Conclusions Our work suggests DNA methylation may have a regulatory role in gonad and larval development, which would shape adult and offspring responses to low pH stress. Combined with existing molluscan methylome research, our work further supports the need for tissue- and species-specific studies to understand the potential regulatory role of DNA methylation.This work was funded by National Science Foundation award 1634167 to SBR. The Hall Conservation Genetics Research Fund (YRV) supported sequencing for this project

Photochemistry of 2-thiooxazole: a plausible prebiotic precursor to RNA nucleotides

Potentially prebiotic chemical reactions leading to RNA nucleotides involve periods of UV irradiation, which are necessary to promote selectivity and destroy biologially irrelevant side products. Nevertheless, UV light has only been applied to promote specific stages of prebiotic reactions and its effect on complete prebiotic reaction sequences has not been extensively studied. Here, we report on an experimental and computational investigation of the photostability of 2-thiooxazole (2-TO), a potential precursor of pyrimidine and 8-oxopurine nucleotides on early Earth. Our UV-irradiation experiments resulted in rapid decomposition of 2-TO into unidentified small molecule photoproducts. We further clarify the underlying photochemistry by means of accurate ab initio calculations and surface hopping molecular dynamics simulations. Overall, the computational results show efficient rupture of the aromatic ring upon the photoexcitation of 2-TO via breaking of the C-O bond. Consequently, the initial stage of the divergent prebiotic synthesis of pyrimidine and 8-oxopurine nucleotides would require periodic shielding from UV light either with sun screening chromophores or through a planetary scenario that would protect 2-TO until it is transformed into a more stable intermediate compound, e.g. oxazolidinone thione