854 research outputs found

    Online Meta-learning by Parallel Algorithm Competition

    Full text link
    The efficiency of reinforcement learning algorithms depends critically on a few meta-parameters that modulates the learning updates and the trade-off between exploration and exploitation. The adaptation of the meta-parameters is an open question in reinforcement learning, which arguably has become more of an issue recently with the success of deep reinforcement learning in high-dimensional state spaces. The long learning times in domains such as Atari 2600 video games makes it not feasible to perform comprehensive searches of appropriate meta-parameter values. We propose the Online Meta-learning by Parallel Algorithm Competition (OMPAC) method. In the OMPAC method, several instances of a reinforcement learning algorithm are run in parallel with small differences in the initial values of the meta-parameters. After a fixed number of episodes, the instances are selected based on their performance in the task at hand. Before continuing the learning, Gaussian noise is added to the meta-parameters with a predefined probability. We validate the OMPAC method by improving the state-of-the-art results in stochastic SZ-Tetris and in standard Tetris with a smaller, 10×\times10, board, by 31% and 84%, respectively, and by improving the results for deep Sarsa(λ\lambda) agents in three Atari 2600 games by 62% or more. The experiments also show the ability of the OMPAC method to adapt the meta-parameters according to the learning progress in different tasks.Comment: 15 pages, 10 figures. arXiv admin note: text overlap with arXiv:1702.0311

    Interannual variability of photosynthesis across Africa and its attribution

    Get PDF
    Africa is thought to be a large source of interannual variability in the global carbon cycle, only vaguely attributed to climate fluctuations. This study uses a biophysical model, Simple Biosphere, to examine in detail what specific factors, physiological (acute stress from low soil water, temperature, or low humidity) and biophysical (low vegetation radiation use), are responsible for spatiotemporal patterns of photosynthesis across the African continent during the period 1982-2003. Acute soil water stress emerges as the primary factor driving interannual variability of photosynthesis for most of Africa. Southern savannas and woodlands are a particular hot spot of interannual variability in photosynthesis, owing to high rainfall variability and photosynthetic potential but intermediate annual rainfall. Surprisingly low interannual variability of photosynthesis in much of the Sudano-Sahelian zone derives from relatively low vegetation cover, pronounced humidity stress, and somewhat lower rainfall variability, whereas perennially wet conditions diminish interannual variability in photosynthesis across much of the Congo Basin and coastal West Africa. Though not of focus here, the coefficient of variation in photosynthesis is notably high in drylands and desert margins (i.e., Sahel, Greater Horn, Namib, and Kalahari) having implications for supply of food and fiber. These findings emphasize that when considering impacts of climate change and land surface feedbacks to the atmosphere, it is important to recognize how vegetation, climate, and soil characteristics may conspire to filter or dampen ecosystem responses to hydroclimatic variability. Copyright 2008 by the American Geophysical Union

    Development of a lightweight camera for high altitude platform systems

    Get PDF
    We describe the development of a lightweight, high-resolution surveillance camera for deployment on high altitude platform systems. The instrument is designed to operate at an altitude of ∼20 km and has an expected ground resolution of better than 120 mm with an appropriate sensor. While designed specifically for imaging at visible wavelengths, it is shown that the design is capable of diffraction-limited imaging at NIR and SWIR wavelengths up to 2.5 μm. We have combined a range of materials from aluminum and titanium alloys through to carbon fiber reinforced plastic to produce an instrument with structural components that match the thermal expansion of the optical glasses used. The use of these materials has resulted in an instrument that weighs <2 kg, including a sensor package, and is designed to weigh <3 kg once integrated with an enclosure and actuated gimbal. The successful testing of two prototype systems is described, including several design outcomes from the program intended for implementation in advance of flight trials

    Single-crystal Ih Ice Surfaces Unveil Connection between Macroscopic and Molecular Structure

    Get PDF
    Physics and chemistry of ice surfaces are not only of fundamental interest but also have important impacts on biological and environmental processes. As ice surfaces—particularly the two prism faces—come under greater scrutiny, it is increasingly important to connect the macroscopic faces with the molecular-level structure. The microscopic structure of the ubiquitous ice Ih crystal is well-known. It consists of stacked layers of chair-form hexagonal rings referred to as molecular hexagons. Crystallographic unit cells can be assembled into a regular right hexagonal prism. The bases are labeled crystallographic hexagons. The two hexagons are rotated 30° with respect to each other. The linkage between the familiar macroscopic shape of hexagonal snowflakes and either hexagon is not obvious per se. This report presents experimental data directly connecting the macroscopic shape of ice crystals and the microscopic hexagons. Large ice single crystals were used to fabricate samples with the basal, primary prism, or secondary prism faces exposed at the surface. In each case, the same sample was used to capture both a macroscopic etch pit image and an electron backscatter diffraction (EBSD) orientation density function (ODF) plot. Direct comparison of the etch pit image and the ODF plot compellingly connects the macroscopic etch pit hexagonal profile to the crystallographic hexagon. The most stable face at the ice–water interface is the smallest area face at the ice–vapor interface. A model based on the molecular structure of the prism faces accounts for this switch

    The Samurai Project: verifying the consistency of black-hole-binary waveforms for gravitational-wave detection

    Get PDF
    We quantify the consistency of numerical-relativity black-hole-binary waveforms for use in gravitational-wave (GW) searches with current and planned ground-based detectors. We compare previously published results for the (ℓ=2,∣m∣=2)(\ell=2,| m | =2) mode of the gravitational waves from an equal-mass nonspinning binary, calculated by five numerical codes. We focus on the 1000M (about six orbits, or 12 GW cycles) before the peak of the GW amplitude and the subsequent ringdown. We find that the phase and amplitude agree within each code's uncertainty estimates. The mismatch between the (ℓ=2,∣m∣=2)(\ell=2,| m| =2) modes is better than 10−310^{-3} for binary masses above 60M⊙60 M_{\odot} with respect to the Enhanced LIGO detector noise curve, and for masses above 180M⊙180 M_{\odot} with respect to Advanced LIGO, Virgo and Advanced Virgo. Between the waveforms with the best agreement, the mismatch is below 2×10−42 \times 10^{-4}. We find that the waveforms would be indistinguishable in all ground-based detectors (and for the masses we consider) if detected with a signal-to-noise ratio of less than ≈14\approx14, or less than ≈25\approx25 in the best cases.Comment: 17 pages, 9 figures. Version accepted by PR

    A Complete Expression Profile of Matrix-Degrading Metalloproteinases in Dupuytren’s Disease

    Get PDF
    Dupuytren’s disease (DD) is a common fibrotic condition of the palmar fascia, leading to deposition of collagen-rich cords and finger contractions. The metzincin superfamily contains key enzymes in the turnover of collagen and other extracellular matrix macromolecules. A number of broad-spectrum matrix metalloproteinase inhibitors, used in cancer clinical trials, caused side effects of DD-like contractures. We tested the hypothesis that changes in the expression of specific metalloproteinases underlie or contribute to the fibrosis and contracture seen in DD. We collected tissue from patients with DD and used normal palmar fascia as a control. We profiled the expression of the entire matrix metalloproteinase (MMP), tissue inhibitor of metalloproteinases (TIMP), and a disintegrin and metalloproteinase domain with thrombospondin motif (ADAMTS) gene families in these tissues using real-time reverse-transcription polymerase chain reaction. A number of metalloproteinases and inhibitors are regulated in DD. The expression of 3 key collagenases, MMP1, MMP13, and MMP14 is increased significantly in the DD nodule, as is the expression of the collagen biosynthetic enzyme ADAMTS14. The expression of MMP7, an enzyme with broad substrate specificity, is increased in the DD nodule and remains equally expressed in the DD cord. TIMP1 expression is increased significantly in DD nodule compared with normal palmar fascia. This study measured the expression of all MMP, ADAMTS, and TIMP genes in DD. Contraction and fibrosis may result from: (1) increased collagen biosynthesis mediated by increased ADAMTS-14; (2) an increased level of TIMP-1 blocking MMP-1– and MMP-13–mediated collagenolysis; and (3) contraction enabled by MMP-14–mediated pericellular collagenolysis (and potentially MMP-7), which may escape inhibition by TIMP-1. The complete expression profile will provide a knowledge-based approach to novel therapeutics targeting these genes

    Transcriptional dynamics of pluripotent stem cell-derived endothelial cell differentiation revealed by single-cell RNA sequencing

    Get PDF
    Aims Pluripotent stem cell-derived endothelial cell products possess therapeutic potential in ischaemic vascular disease. However, the factors that drive endothelial differentiation from pluripotency and cellular specification are largely unknown. The aims of this study were to use single-cell RNA sequencing (scRNA-seq) to map the transcriptional landscape and cellular dynamics of directed differentiation of human embryonic stem cell-derived endothelial cells (hESC-EC) and to compare these cells to mature endothelial cells from diverse vascular beds. Methods and results A highly efficient directed 8-day differentiation protocol was used to generate a hESC-derived endothelial cell product (hESC-ECP), in which 66% of cells co-expressed CD31 and CD144. We observed largely homogeneous hESC and mesodermal populations at Days 0 and 4, respectively, followed by a rapid emergence of distinct endothelial and mesenchymal populations. Pseudotime trajectory identified transcriptional signatures of endothelial commitment and maturation during the differentiation process. Concordance in transcriptional signatures was verified by scRNA-seq analysis using both a second hESC line RC11, and an alternative hESC-EC differentiation protocol. In total, 105 727 cells were subjected to scRNA-seq analysis. Global transcriptional comparison revealed a transcriptional architecture of hESC-EC that differs from freshly isolated and cultured human endothelial cells and from organ-specific endothelial cells. Conclusion A transcriptional bifurcation into endothelial and mesenchymal lineages was identified, as well as novel transcriptional signatures underpinning commitment and maturation. The transcriptional architecture of hESC-ECP was distinct from mature and foetal human EC.This work was supported by the Medical Research Council [MRC Precision Medicine Doctoral Training Programme to I.R.M. and both the MRC Discovery Award and Programme grant (MC_PC_15075) and MRC Programme: Computational and Disease Genomics (MC_UU_00007/15) to C.P.P.], the Wellcome Trust [Wellcome Trust Senior Research Fellowship in Clinical Science (ref. 103749) to N.C.H.], the European Research Council [Advanced Grant VASCMIR (RE7644) to A.H.B.], and the British Heart Foundation [BHF CVR grant (RM/17/3/ 33381) and BHF Chair of Translational Cardiovascular Sciences to A.H.B.]

    Understanding water and energy fluxes in the Amazonia: Lessons from an observation-model intercomparison

    Get PDF
    Tropical forests are an important part of global water and energy cycles, but the mechanisms that drive seasonality of their land-atmosphere exchanges have proven challenging to capture in models. Here, we (1) report the seasonality of fluxes of latent heat (LE), sensible heat (H), and outgoing short and longwave radiation at four diverse tropical forest sites across Amazonia—along the equator from the Caxiuanã and Tapajós National Forests in the eastern Amazon to a forest near Manaus, and from the equatorial zone to the southern forest in Reserva Jaru; (2) investigate how vegetation and climate influence these fluxes; and (3) evaluate land surface model performance by comparing simulations to observations. We found that previously identified failure of models to capture observed dry-season increases in evapotranspiration (ET) was associated with model overestimations of (1) magnitude and seasonality of Bowen ratios (relative to aseasonal observations in which sensible was only 20%–30% of the latent heat flux) indicating model exaggerated water limitation, (2) canopy emissivity and reflectance (albedo was only 10%–15% of incoming solar radiation, compared to 0.15%–0.22% simulated), and (3) vegetation temperatures (due to underestimation of dry-season ET and associated cooling). These partially compensating model-observation discrepancies (e.g., higher temperatures expected from excess Bowen ratios were partially ameliorated by brighter leaves and more interception/evaporation) significantly biased seasonal model estimates of net radiation (Rn), the key driver of water and energy fluxes (LE ~ 0.6 Rn and H ~ 0.15 Rn), though these biases varied among sites and models. A better representation of energy-related parameters associated with dynamic phenology (e.g., leaf optical properties, canopy interception, and skin temperature) could improve simulations and benchmarking of current vegetation–atmosphere exchange and reduce uncertainty of regional and global biogeochemical models

    Mapping the developing human cardiac endothelium at single cell resolution identifies MECOM as a regulator of arteriovenous gene expression

    Get PDF
    AIMS: Coronary vasculature formation is a critical event during cardiac development, essential for heart function throughout perinatal and adult life. However, current understanding of coronary vascular development has largely been derived from transgenic mouse models. The aim of this study was to characterize the transcriptome of the human foetal cardiac endothelium using single-cell RNA sequencing (scRNA-seq) to provide critical new insights into the cellular heterogeneity and transcriptional dynamics that underpin endothelial specification within the vasculature of the developing heart. METHODS AND RESULTS: We acquired scRNA-seq data of over 10 000 foetal cardiac endothelial cells (ECs), revealing divergent EC subtypes including endocardial, capillary, venous, arterial, and lymphatic populations. Gene regulatory network analyses predicted roles for SMAD1 and MECOM in determining the identity of capillary and arterial populations, respectively. Trajectory inference analysis suggested an endocardial contribution to the coronary vasculature and subsequent arterialization of capillary endothelium accompanied by increasing MECOM expression. Comparative analysis of equivalent data from murine cardiac development demonstrated that transcriptional signatures defining endothelial subpopulations are largely conserved between human and mouse. Comprehensive characterization of the transcriptional response to MECOM knockdown in human embryonic stem cell-derived EC (hESC-EC) demonstrated an increase in the expression of non-arterial markers, including those enriched in venous EC. CONCLUSIONS: scRNA-seq of the human foetal cardiac endothelium identified distinct EC populations. A predicted endocardial contribution to the developing coronary vasculature was identified, as well as subsequent arterial specification of capillary EC. Loss of MECOM in hESC-EC increased expression of non-arterial markers, suggesting a role in maintaining arterial EC identity
    • …
    corecore