Hieros: Hierarchical Imagination on Structured State Space Sequence World Models

One of the biggest challenges to modern deep reinforcement learning (DRL) algorithms is sample efficiency. Many approaches learn a world model in order to train an agent entirely in imagination, eliminating the need for direct environment interaction during training. However, these methods often suffer from either a lack of imagination accuracy, exploration capabilities, or runtime efficiency. We propose Hieros, a hierarchical policy that learns time abstracted world representations and imagines trajectories at multiple time scales in latent space. Hieros uses an S5 layer-based world model, which predicts next world states in parallel during training and iteratively during environment interaction. Due to the special properties of S5 layers, our method can train in parallel and predict next world states iteratively during imagination. This allows for more efficient training than RNN-based world models and more efficient imagination than Transformer-based world models. We show that our approach outperforms the state of the art in terms of mean and median normalized human score on the Atari 100k benchmark, and that our proposed world model is able to predict complex dynamics very accurately. We also show that Hieros displays superior exploration capabilities compared to existing approaches.Comment: Submitted to ICLR 2024, 23 pages, 11 figures, code available at: https://github.com/Snagnar/Hiero

Adaptation Advantage to Climate Change Impacts on Road Infrastructure in Africa through 2100

The African continent is facing the potential of a US$183.6 billion liability to repair and maintain roads damaged from temperature and precipitation changes related to climate change through 2100. As detailed, the central part of the continent faces the greatest impact from climate change with countries facing an average cost of US$22 million annually, if they adopt a proactive adaptation policy and a US$54 million annual average, if a reactive approach is adopted. Additionally, countries face an average loss of opportunity to expand road networks from a low of 22 per cent to a high of 235 per cent in the central region.infrastructure, climate change, roads, cost estimates

Different Outcomes of Experimental Hepatitis E Virus Infection in Diverse Mouse Strains, Wistar Rats, and Rabbits

Hepatitis E virus (HEV) is the causative agent of acute hepatitis E in humans in developing countries, but autochthonous cases of zoonotic genotype 3 (HEV-3) infection also occur in industrialized countries. In contrast to swine, rats, and rabbits, natural HEV infections in mice have not yet been demonstrated. The pig represents a well-established large animal model for HEV-3 infection, but a suitable small animal model mimicking natural HEV-3 infection is currently missing. Therefore, we experimentally inoculated C57BL/6 mice (wild-type, IFNAR−/−, CD4−/−, CD8−/−) and BALB/c nude (nu/nu) mice, Wistar rats, and European rabbits with a wild boar-derived HEV-3 strain and monitored virus replication and shedding, as well as humoral immune responses. HEV RNA and anti-HEV antibodies were detected in one and two out of eight of the rats and all rabbits inoculated, respectively, but not in any of the mouse strains tested. Remarkably, immunosuppressive dexamethasone treatment of rats did not enhance their susceptibility to HEV infection. In rabbits, immunization with recombinant HEV-3 and ratHEV capsid proteins induced protection against HEV-3 challenge. In conclusion, the rabbit model for HEV-3 infection may serve as a suitable alternative to the non-human primate and swine models, and as an appropriate basis for vaccine evaluation studies

Twenty-First-Century Changes in U.S. Regional Heavy Precipitation Frequency Based on Resolved Atmospheric Patterns

Precipitation-gauge observations and atmospheric reanalysis are combined to develop an analogue method for detecting heavy precipitation events based on prevailing large-scale atmospheric conditions. Combinations of atmospheric variables for circulation (geopotential height and wind vector) and moisture (surface specific humidity, column and up to 500-hPa precipitable water) are examined to construct analogue schemes for the winter [December-February (DJF)] of the "Pacific Coast California" (PCCA) region and the summer [June-August (JJA)] of the Midwestern United States (MWST). The detection diagnostics of analogue schemes are calibrated with 1979-2005 and validated with 2006-14 NASA Modern-Era Retrospective Analysis for Research and Applications (MERRA). All analogue schemes are found to significantly improve upon MERRA precipitation in characterizing the occurrence and interannual variations of observed heavy precipitation events in the MWST. When evaluated with the late twentieth-century climate model simulations from phase 5 of the Coupled Model Intercomparison Project (CMIP5), all analogue schemes produce model medians of heavy precipitation frequency that are more consistent with observations and have smaller intermodel discrepancies than model-based precipitation. Under the representative concentration pathways (RCP) 4.5 and 8.5 scenarios, the CMIP5-based analogue schemes produce trends in heavy precipitation occurrence through the twenty-first century that are consistent with model-based precipitation, but with smaller intermodel disparity. The median trends in heavy precipitation frequency are positive for DJF over PCCA but are slightly negative for JJA over MWST. Overall, the analyses highlight the potential of the analogue as a powerful diagnostic tool for model deficiencies and its complementarity to an evaluation of heavy precipitation frequency based on model precipitation alone.National Science Foundation (U.S.) (MacroSystems Biology Program Grant NSF-AES EF#1137306)United States. Department of Energy (Integrated Framework for Climate Change Assessment DE-FG02-94ER61937)National Science Foundation (U.S.) (NSF-AGS-1552195)United States. National Aeronautics and Space Administration (Energy and Water Cycle Study Research Announcement NNH07ZDA001N

Properties of amphiphilic terminally substituted conjugated nonaene- and 2-docosylnonaene carboxylic acids in monolayers at the air-water interface

In the present communication, we report thesynthesis of conjugated nonaene- and 2-docosylnonaene carboxylic acids with different terminal substituents. These substituents have been chosen so that their spectroscopic properties differ from those of the polyene chain; they also have specific electron donor, electron acceptor or redox properties to allow for specific and selective excitation (energy intake). Because of the amphiphilic character of these compounds, pressure-area isotherms were determined in monolayers at the air-water interface

Multiple Horizontal Gene Transfer Events and Domain Fusions Have Created Novel Regulatory and Metabolic Networks in the Oomycete Genome

Complex enzymes with multiple catalytic activities are hypothesized to have evolved from more primitive precursors. Global analysis of the Phytophthora sojae genome using conservative criteria for evaluation of complex proteins identified 273 novel multifunctional proteins that were also conserved in P. ramorum. Each of these proteins contains combinations of protein motifs that are not present in bacterial, plant, animal, or fungal genomes. A subset of these proteins were also identified in the two diatom genomes, but the majority of these proteins have formed after the split between diatoms and oomycetes. Documentation of multiple cases of domain fusions that are common to both oomycetes and diatom genomes lends additional support for the hypothesis that oomycetes and diatoms are monophyletic. Bifunctional proteins that catalyze two steps in a metabolic pathway can be used to infer the interaction of orthologous proteins that exist as separate entities in other genomes. We postulated that the novel multifunctional proteins of oomycetes could function as potential Rosetta Stones to identify interacting proteins of conserved metabolic and regulatory networks in other eukaryotic genomes. However ortholog analysis of each domain within our set of 273 multifunctional proteins against 39 sequenced bacterial and eukaryotic genomes, identified only 18 candidate Rosetta Stone proteins. Thus the majority of multifunctional proteins are not Rosetta Stones, but they may nonetheless be useful in identifying novel metabolic and regulatory networks in oomycetes. Phylogenetic analysis of all the enzymes in three pathways with one or more novel multifunctional proteins was conducted to determine the probable origins of individual enzymes. These analyses revealed multiple examples of horizontal transfer from both bacterial genomes and the photosynthetic endosymbiont in the ancestral genome of Stramenopiles. The complexity of the phylogenetic origins of these metabolic pathways and the paucity of Rosetta Stones relative to the total number of multifunctional proteins suggests that the proteome of oomycetes has few features in common with other Kingdoms