Flatland: a Lightweight First-Person 2-D Environment for Reinforcement Learning

Flatlandis a simple, lightweight environment for fastprototyping and testing of reinforcement learning agents. It is oflower complexity compared to similar 3D platforms (e.g. Deep-Mind Lab or VizDoom), but emulates physical properties of thereal world, such as continuity, multi-modal partially-observablestates with first-person view and coherent physics. We proposeto use it as an intermediary benchmark for problems related toLifelong Learning.Flatlandis highly customizable and offers awide range of task difficulty to extensively evaluate the propertiesof artificial agents. We experiment with three reinforcementlearning baseline agents and show that they can rapidly solvea navigation task inFlatland. A video of an agent acting inFlatlandis available here: https://youtu.be/I5y6Y2ZypdA

Flatland: a Lightweight First-Person 2-D Environment for Reinforcement Learning

Flatlandis a simple, lightweight environment for fastprototyping and testing of reinforcement learning agents. It is oflower complexity compared to similar 3D platforms (e.g. Deep-Mind Lab or VizDoom), but emulates physical properties of thereal world, such as continuity, multi-modal partially-observablestates with first-person view and coherent physics. We proposeto use it as an intermediary benchmark for problems related toLifelong Learning.Flatlandis highly customizable and offers awide range of task difficulty to extensively evaluate the propertiesof artificial agents. We experiment with three reinforcementlearning baseline agents and show that they can rapidly solvea navigation task inFlatland. A video of an agent acting inFlatlandis available here: https://youtu.be/I5y6Y2ZypdA

Effect of permafrost thawing on organic carbon and trace element colloidal speciation in the thermokarst lakes of western Siberia

To examine the mechanisms of carbon mobilization and biodegradation during permafrost thawing and to establish a link between organic carbon (OC) and other chemical and microbiological parameters in forming thermokarst (thaw) lakes, we studied the biogeochemistry of OC and trace elements (TEs) in a chronosequence of small lakes that are being formed due to permafrost thawing in the northern part of western Siberia. Twenty lakes and small ponds of various sizes and ages were sampled for dissolved and colloidal organic carbon, metals and culturable heterotrophic bacterial cell number. We observed a sequence of ecosystems from peat thawing and palsa degradation due to permafrost subsidence in small ponds to large, km-size lakes that are subject to drainage to, finally, the khasyrey (drained lake) formation. There is a systematic evolution of both total dissolved and colloidal concentration of OC and TEs in the lake water along with the chronosequence of lake development that may be directly linked to the microbial mineralization of dissolved organic matter and the liberation of the inorganic components (Fe, Al, and TEs) from the organo-mineral colloids. <br><br> In this chronosequence of lake development, we observed an apparent decrease in the relative proportion of low molecular weight <1 kDa (1 kDa ~ 1 nm) OC concentration along with a decrease in the concentration of total dissolved (<0.45 μm) OC. This decrease was accompanied by an increase in the small size organic ligands (probably autochthonous exometabolites produced by the phytoplankton) and a simultaneous decrease in the proportion of large-size organic (humic) complexes of allochthonous (soil) origin. This evolution may be due to the activity of heterotrophic bacterioplankton that use allochthonous organic matter and dissolved nutrients originating from peat lixiviation. Most insoluble TEs demonstrate a systematic decrease in concentration during filtration (5 μm, 0.45 μm) exhibiting a similar pattern among different samples. At the same time, there is an increase in the relative proportion of large size particles over the <1 kDa fraction for most insoluble elements along the chronosequence of lake evolution. TEs are likely to be bound to colloidal OC and coprecipitate with the mineral (Fe, Al) part of the colloids. Upon progressive consumption of dissolved OC by the heterotrophic bacteria, there is liberation of Fe, Al, and insoluble TEs in the water column that may be subjected to coagulation in the form of particles or large-size mineral colloids

Empiricism Without the Senses: How the Instrument Replaced the Eye

On receiving news of Galileo’s observations of the four satellites of Jupiter and the rugged face of the moon through his newly invented perspicillum, Kepler in great excitement exclaimed: Therefore let Galileo take his stand by Kepler’s side. Let the former observe the moon with his face turned skyward, while the latter studies the sun by looking down at a screen (lest the lens injure his eyes). Let each employ his own device, and from this partnership may there some day arise an absolutely perfect theory of the distances. This Hollywood-like scene of the two astronomers marching hand in hand toward the dawn of a new scientific era was no attempt by Kepler to appropriate Galileo’s success or to diminish the novelty of the telescope. On the contrary, Kepler repeatedly asserted how short sighted he was in misjudging the potential for astronomical observations inherent in lenses, and how radically Galileo’s instrument transformed the science of astronomy. It was a deep sense of recognition that beyond their different scientific temperaments and projects, they shared a common agenda of a new mode of empirical engagement with the phenomenal world: the instrument. For Kepler and Galileo, empirical investigation was no longer a direct engagement with nature, but an essentially mediated endeavor. The new instruments were not to assist the human senses, but to replace them

Circuit Quantum Electrodynamics of Granular Aluminum Resonators

The introduction of crystalline defects or dopants can give rise to so-called "dirty superconductors", characterized by reduced coherence length and quasiparticle mean free path. In particular, granular superconductors such as Granular Aluminum (GrAl), consisting of remarkably uniform grains connected by Josephson contacts have attracted interest since the sixties thanks to their rich phase diagram and practical advantages, like increased critical temperature, critical field, and kinetic inductance. Here we report the measurement and modeling of circuit quantum electrodynamics properties of GrAl microwave resonators in a wide frequency range, up to the spectral superconducting gap. Interestingly, we observe self-Kerr coefficients ranging from $10^{-2}$ Hz to $10^5$ Hz, within an order of magnitude from analytic calculations based on GrAl microstructure. This amenable nonlinearity, combined with the relatively high quality factors in the $10^5$ range, open new avenues for applications in quantum information processing and kinetic inductance detectors.Comment: 7 pages, 4 figures, supplementary informatio

Towards a Processual Microbial Ontology

types: ArticleStandard microbial evolutionary ontology is organized according to a nested hierarchy of entities at various levels of biological organization. It typically detects and defines these entities in relation to the most stable aspects of evolutionary processes, by identifying lineages evolving by a process of vertical inheritance from an ancestral entity. However, recent advances in microbiology indicate that such an ontology has important limitations. The various dynamics detected within microbiological systems reveal that a focus on the most stable entities (or features of entities) over time inevitably underestimates the extent and nature of microbial diversity. These dynamics are not the outcome of the process of vertical descent alone. Other processes, often involving causal interactions between entities from distinct levels of biological organisation, or operating at different time scales, are responsible not only for the destabilisation of pre-existing entities, but also for the emergence and stabilisation of novel entities in the microbial world. In this article we consider microbial entities as more or less stabilised functional wholes, and sketch a network-based ontology that can represent a diverse set of processes including, for example, as well as phylogenetic relations, interactions that stabilise or destabilise the interacting entities, spatial relations, ecological connections, and genetic exchanges. We use this pluralistic framework for evaluating (i) the existing ontological assumptions in evolution (e.g. whether currently recognized entities are adequate for understanding the causes of change and stabilisation in the microbial world), and (ii) for identifying hidden ontological kinds, essentially invisible from within a more limited perspective. We propose to recognize additional classes of entities that provide new insights into the structure of the microbial world, namely ‘‘processually equivalent’’ entities, ‘‘processually versatile’’ entities, and ‘‘stabilized’’ entities.Economic and Social Research Council, U

Behavior and Impact of Zirconium in the Soil–Plant System: Plant Uptake and Phytotoxicity

Because of the large number of sites they pollute, toxic metals that contaminate terrestrial ecosystems are increasingly of environmental and sanitary concern (Uzu et al. 2010, 2011; Shahid et al. 2011a, b, 2012a). Among such metals is zirconium (Zr), which has the atomic number 40 and is a transition metal that resembles titanium in physical and chemical properties (Zaccone et al. 2008). Zr is widely used in many chemical industry processes and in nuclear reactors (Sandoval et al. 2011; Kamal et al. 2011), owing to its useful properties like hardness, corrosion-resistance and permeable to neutrons (Mushtaq 2012). Hence, the recent increased use of Zr by industry, and the occurrence of the Chernobyl and Fukashima catastrophe have enhanced environmental levels in soil and waters (Yirchenko and Agapkina 1993; Mosulishvili et al. 1994 ; Kruglov et al. 1996)