2,886 research outputs found

    A Deep Reinforcement Learning Approach to Rare Event Estimation

    Full text link
    An important step in the design of autonomous systems is to evaluate the probability that a failure will occur. In safety-critical domains, the failure probability is extremely small so that the evaluation of a policy through Monte Carlo sampling is inefficient. Adaptive importance sampling approaches have been developed for rare event estimation but do not scale well to sequential systems with long horizons. In this work, we develop two adaptive importance sampling algorithms that can efficiently estimate the probability of rare events for sequential decision making systems. The basis for these algorithms is the minimization of the Kullback-Leibler divergence between a state-dependent proposal distribution and a target distribution over trajectories, but the resulting algorithms resemble policy gradient and value-based reinforcement learning. We apply multiple importance sampling to reduce the variance of our estimate and to address the issue of multi-modality in the optimal proposal distribution. We demonstrate our approach on a control task with both continuous and discrete actions spaces and show accuracy improvements over several baselines

    Novel lung imaging biomarkers and skin gene expression subsetting in dasatinib treatment of systemic sclerosis-associated interstitial lung disease.

    Get PDF
    BackgroundThere are no effective treatments or validated clinical response markers in systemic sclerosis (SSc). We assessed imaging biomarkers and performed gene expression profiling in a single-arm open-label clinical trial of tyrosine kinase inhibitor dasatinib in patients with SSc-associated interstitial lung disease (SSc-ILD).MethodsPrimary objectives were safety and pharmacokinetics. Secondary outcomes included clinical assessments, quantitative high-resolution computed tomography (HRCT) of the chest, serum biomarker assays and skin biopsy-based gene expression subset assignments. Clinical response was defined as decrease of >5 or >20% from baseline in the modified Rodnan Skin Score (MRSS). Pulmonary function was assessed at baseline and day 169.ResultsDasatinib was well-tolerated in 31 patients receiving drug for a median of nine months. No significant changes in clinical assessments or serum biomarkers were seen at six months. By quantitative HRCT, 65% of patients showed no progression of lung fibrosis, and 39% showed no progression of total ILD. Among 12 subjects with available baseline and post-treatment skin biopsies, three were improvers and nine were non-improvers. Improvers mapped to the fibroproliferative or normal-like subsets, while seven out of nine non-improvers were in the inflammatory subset (p = 0.0455). Improvers showed stability in forced vital capacity (FVC) and diffusing capacity for carbon monoxide (DLCO), while both measures showed a decline in non-improvers (p = 0.1289 and p = 0.0195, respectively). Inflammatory gene expression subset was associated with higher baseline HRCT score (p = 0.0556). Non-improvers showed significant increase in lung fibrosis (p = 0.0313).ConclusionsIn patients with SSc-ILD dasatinib treatment was associated with acceptable safety profile but no significant clinical efficacy. Patients in the inflammatory gene expression subset showed increase in skin fibrosis, decreasing pulmonary function and worsening lung fibrosis during the study. These findings suggest that target tissue-specific gene expression analyses can help match patients and therapeutic interventions in heterogeneous diseases such as SSc, and quantitative HRCT is useful for assessing clinical outcomes.Trial registrationClinicaltrials.gov NCT00764309

    Monitoring Observations of the Jupiter-Family Comet 17P/Holmes during 2014 Perihelion Passage

    Full text link
    We performed a monitoring observation of a Jupiter-Family comet, 17P/Holmes, during its 2014 perihelion passage to investigate its secular change in activity. The comet has drawn the attention of astronomers since its historic outburst in 2007, and this occasion was its first perihelion passage since then. We analyzed the obtained data using aperture photometry package and derived the Afrho parameter, a proxy for the dust production rate. We found that Afrho showed asymmetric properties with respect to the perihelion passage: it increased moderately from 100 cm at the heliocentric distance r_h=2.6-3.1 AU to a maximal value of 185 cm at r_h = 2.2 AU (near the perihelion) during the inbound orbit, while dropping rapidly to 35 cm at r_h = 3.2 AU during the outbound orbit. We applied a model for characterizing dust production rates as a function of r_h and found that the fractional active area of the cometary nucleus had dropped from 20%-40% in 2008-2011 (around the aphelion) to 0.1%-0.3% in 2014-2015 (around the perihelion). This result suggests that a dust mantle would have developed rapidly in only one orbital revolution around the sun. Although a minor eruption was observed on UT 2015 January 26 at r_h = 3.0 AU, the areas excavated by the 2007 outburst would be covered with a layer of dust (<~ 10 cm depth) which would be enough to insulate the subsurface ice and to keep the nucleus in a state of low activity.Comment: 25 pages, 6 figures, 2 tables, ApJ accepted on December 29, 201

    Comparison of Hyperthermal Ground Laboratory Atomic Oxygen Erosion Yields With Those in Low Earth Orbit

    Get PDF
    The atomic oxygen erosion yields of 26 materials (all polymers except for pyrolytic graphite) were measured in two directed hyperthermal radio frequency (RF) plasma ashers operating at 30 or 35 kHz with air. The hyperthermal asher results were compared with thermal energy asher results and low Earth orbital (LEO) results from the Materials International Space Station Experiment 2 and 7 (MISSE 2 and 7) flight experiments. The hyperthermal testing was conducted to a significant portion of the atomic oxygen fluence similar polymers were exposed to during the MISSE 2 and 7 missions. Comparison of the hyperthermal asher prediction of LEO erosion yields with thermal energy asher erosion yields indicates that except for the fluorocarbon polymers of PTFE and FEP, the hyperthermal energy ashers are a much more reliable predictor of LEO erosion yield than thermal energy asher testing, by a factor of four

    QUT YuMi deadly maths: Making a difference in mathematics learning for Indigenous and non-Indigenous students

    Get PDF
    This paper describes and briefly analyses aspects of the Purposeful Rich Indigenous Mathematics Education Futures (PRIME Futures) YuMi Deadly Centre project within QUT. It is one of the six integrated elements of the Indigenous STEM Education project managed by CSIRO in partnership with the BHP Billiton Foundation. The PRIME Futures research project targets students from Foundation to Year 9 using the YuMi Deadly Maths approach to improve student outcomes in mathematics for schools with relatively high Indigenous populations. It encompasses a whole school change agenda with an emphasis on strengthening community engagement that fosters positive relationships and values Indigenous knowledges and ways of knowing

    Review of Cardiovascular Risk of Androgen Deprivation Therapy and the Influence of Race in Men with Prostate Cancer

    Get PDF
    Androgen deprivation therapy is the cornerstone of prostate cancer therapy. Recent studies have revealed an association between androgen deprivation therapy and cardiovascular adverse effects such as myocardial infarction and stroke. This review summarizes the available research on the cardiovascular risk of men using androgen deprivation therapy. We also discuss racial disparities surrounding both prostate cancer and cardiovascular disease, emphasizing the importance of biological/molecular and socioeconomic factors in assessing baseline risk in patients beginning androgen ablation. Based on the literature, we provide recommendations for monitoring patients who are at high risk for a cardiovascular adverse event while being treated on androgen deprivation therapy. This review aims to present the current research on androgen deprivation therapy and cardiovascular toxicity with an emphasis on racial disparities and provides a framework for clinicians to decrease the cardiovascular morbidity in men that are being treated with hormone therapy
    corecore