72 research outputs found

    Neuroevolutionary reinforcement learning for generalized control of simulated helicopters

    Get PDF
    This article presents an extended case study in the application of neuroevolution to generalized simulated helicopter hovering, an important challenge problem for reinforcement learning. While neuroevolution is well suited to coping with the domain’s complex transition dynamics and high-dimensional state and action spaces, the need to explore efficiently and learn on-line poses unusual challenges. We propose and evaluate several methods for three increasingly challenging variations of the task, including the method that won first place in the 2008 Reinforcement Learning Competition. The results demonstrate that (1) neuroevolution can be effective for complex on-line reinforcement learning tasks such as generalized helicopter hovering, (2) neuroevolution excels at finding effective helicopter hovering policies but not at learning helicopter models, (3) due to the difficulty of learning reliable models, model-based approaches to helicopter hovering are feasible only when domain expertise is available to aid the design of a suitable model representation and (4) recent advances in efficient resampling can enable neuroevolution to tackle more aggressively generalized reinforcement learning tasks

    The European 2015 drought from a hydrological perspective

    Get PDF
    In 2015 large parts of Europe were affected by drought. In this paper, we analyze the hydrological footprint (dynamic development over space and time) of the drought of 2015 in terms of both severity (magnitude) and spatial extent and compare it to the extreme drought of 2003. Analyses are based on a range of low flow and hydrological drought indices derived for about 800 streamflow records across Europe, collected in a community effort based on a common protocol. We compare the hydrological footprints of both events with the meteorological footprints, in order to learn from similarities and differences of both perspectives and to draw conclusions for drought management. The region affected by hydrological drought in 2015 differed somewhat from the drought of 2003, with its center located more towards eastern Europe. In terms of low flow magnitude, a region surrounding the Czech Republic was the most affected, with summer low flows that exhibited return intervals of 100 years and more. In terms of deficit volumes, the geographical center of the event was in southern Germany, where the drought lasted a particularly long time. A detailed spatial and temporal assessment of the 2015 event showed that the particular behavior in these regions was partly a result of diverging wetness preconditions in the studied catchments. Extreme droughts emerged where preconditions were particularly dry. In regions with wet preconditions, low flow events developed later and tended to be less severe. For both the 2003 and 2015 events, the onset of the hydrological drought was well correlated with the lowest flow recorded during the event (low flow magnitude), pointing towards a potential for early warning of the severity of streamflow drought. Time series of monthly drought indices (both streamflow- and climate-based indices) showed that meteorological and hydrological events developed differently in space and time, both in terms of extent and severity (magnitude). These results emphasize that drought is a hazard which leaves different footprints on the various components of the water cycle at different spatial and temporal scales. The difference in the dynamic development of meteorological and hydrological drought also implies that impacts on various water-use sectors and river ecology cannot be informed by climate indices alone. Thus, an assessment of drought impacts on water resources requires hydrological data in addition to drought indices based solely on climate data. The transboundary scale of the event also suggests that additional efforts need to be undertaken to make timely pan-European hydrological assessments more operational in the future

    Characterising droughts in Central America with uncertain hydro-meteorological data

    Get PDF
    Central America is frequently affected by droughts that cause significant socio-economic and environmental problems. Drought characterisation, monitoring and forecasting are potentially useful to support water resource management. Drought indices are designed for these purposes, but their ability to characterise droughts depends on the characteristics of the regional climate and the quality of the available data. Local comprehensive and high-quality observational networks of meteorological and hydrological data are not available, which limits the choice of drought indices and makes it important to assess available datasets. This study evaluated which combinations of drought index and meteorological dataset were most suitable for characterising droughts in the region. We evaluated the standardised precipitation index (SPI), a modified version of the deciles index (DI), the standardised precipitation evapotranspiration index (SPEI) and the effective drought index (EDI). These were calculated using precipitation data from the Climate Hazards Group Infra-Red Precipitation with Station (CHIRPS), the CRN073 dataset, the Climate Research Unit (CRU), ECMWF Reanalysis (ERA-Interim) and a regional station dataset, and temperature from the CRU and ERA-Interim datasets. The gridded meteorological precipitation datasets were compared to assess how well they captured key features of the regional climate. The performance of all the drought indices calculated with all the meteorological datasets was then evaluated against a drought index calculated using river discharge data. Results showed that the selection of database was more important than the selection of drought index and that the best combinations were the EDI and DI calculated with CHIRPS and CRN073. Results also highlighted the importance of including indices like SPEI for drought assessment in Central America.Universidad de Costa Rica/[805-B0-810]/UCR/Costa RicaUniversidad de Costa Rica/[805-A9-532]/UCR/Costa RicaUniversidad de Costa Rica/[805-B3-600]/UCR/Costa RicaUniversidad de Costa Rica/[805-B0-065]/UCR/Costa RicaUniversidad de Costa Rica/[805-B3-413]/UCR/Costa RicaUniversidad de Costa Rica/[805-B4-227]/UCR/Costa RicaUniversidad de Costa Rica/[805-B4-228]/UCR/Costa RicaUniversidad de Costa Rica/[805-B5-295]/UCR/Costa RicaUppsala University/[54100006]//SueciaMarie Curie Intra-European Fellowship/[No.329762]//EuropaUCR::Vicerrectoría de Investigación::Unidades de Investigación::Ciencias Básicas::Centro de Investigaciones Geofísicas (CIGEFI)UCR::Vicerrectoría de Docencia::Ciencias Básicas::Facultad de Ciencias::Escuela de Físic

    Characterisation of metabolic mutants with respect to their growth behaviour with different oxygen availabilities

    No full text
    Regulation of aerobic and anaerobic metabolism in E. coli is a well investigated topic and the regulators responsible for the switch between these growth scenarios are known. Several regulatory proteins activate or repress the expression of enzymes depending on the availability of oxygen. These enzymes are either directly involved in respiration or are metabolic enzymes like enzymes of the TCA-cycle. There is a complex interaction between the regulatory and the metabolic network which is until now not completely elucidated. We are aiming to an improved understanding of this interaction by applying a systems biological approach that couples quantitative biological experiments with mathematical modelling. Characterisation of metabolic and regulatory mutants should lead to a deeper understanding of the redox regulation in E. coli. In these mutants enzymes were knocked-out which catalyse for example specific reactions of the TCA-cycle. Mutant strains were characterised in a chemostat under defined conditions to obtain comparable results. Metabolic reactions were examined via measurement of oxygen consumption rates, production of fermentation products, biomass, redox state of the cells and energy charge, as well as the expression rate of specific enzymes via Real-Time PCR. Different oxygen concentrations were adjusted – aerobic, microaerobic and anaerobic conditions – and the reaction of the mutant strains to the changing environment was compared to the reaction of the wild type strain
    corecore