Benchmarking Quality-Diversity Algorithms on Neuroevolution for Reinforcement Learning

We present a Quality-Diversity benchmark suite for Deep Neuroevolution in Reinforcement Learning domains for robot control. The suite includes the definition of tasks, environments, behavioral descriptors, and fitness. We specify different benchmarks based on the complexity of both the task and the agent controlled by a deep neural network. The benchmark uses standard Quality-Diversity metrics, including coverage, QD-score, maximum fitness, and an archive profile metric to quantify the relation between coverage and fitness. We also present how to quantify the robustness of the solutions with respect to environmental stochasticity by introducing corrected versions of the same metrics. We believe that our benchmark is a valuable tool for the community to compare and improve their findings. The source code is available online: https://github.com/adaptive-intelligent-robotics/QDaxComment: Accepted at GECCO Workshop on Quality Diversity Algorithm Benchmark

Возможности радикального лечения варикотромбофлебита на фоне варикозной болезни и трофических язв

КОНЕЧНОСТИ НИЖНЕЙ ЯЗВАТРОМБОФЛЕБИТ /ХИРВАРИКОЗНАЯ ЯЗВАВАРИКОЗНОЕ РАСШИРЕНИЕ ВЕН /ОС

Automatic Calibration of Artificial Neural Networks for Zebrafish Collective Behaviours using a Quality Diversity Algorithm

During the last two decades, various models have been proposed for fish collective motion. These models are mainly developed to decipher the biological mechanisms of social interaction between animals. They consider very simple homogeneous unbounded environments and it is not clear that they can simulate accurately the collective trajectories. Moreover when the models are more accurate, the question of their scalability to either larger groups or more elaborate environments remains open. This study deals with learning how to simulate realistic collective motion of collective of zebrafish, using real-world tracking data. The objective is to devise an agent-based model that can be implemented on an artificial robotic fish that can blend into a collective of real fish. We present a novel approach that uses Quality Diversity algorithms, a class of algorithms that emphasise exploration over pure optimisation. In particular, we use CVT-MAP-Elites, a variant of the state-of-the-art MAP-Elites algorithm for high dimensional search space. Results show that Quality Diversity algorithms not only outperform classic evolutionary reinforcement learning methods at the macroscopic level (i.e. group behaviour), but are also able to generate more realistic biomimetic behaviours at the microscopic level (i.e. individual behaviour).Comment: 8 pages, 4 figures, 1 tabl

Employing external facilitation to implement cognitive behavioral therapy in VA clinics: a pilot study

<p>Abstract</p> <p>Background</p> <p>Although for more than a decade healthcare systems have attempted to provide evidence-based mental health treatments, the availability and use of psychotherapies remains low. A significant need exists to identify simple but effective implementation strategies to adopt complex practices within complex systems of care. Emerging evidence suggests that facilitation may be an effective integrative implementation strategy for adoption of complex practices. The current pilot examined the use of external facilitation for adoption of cognitive behavioral therapy (CBT) in 20 Department of Veteran Affairs (VA) clinics.</p> <p>Methods</p> <p>The 20 clinics were paired on facility characteristics, and 23 clinicians from these were trained in CBT. A clinic in each pair was randomly selected to receive external facilitation. Quantitative methods were used to examine the extent of CBT implementation in 10 clinics that received external facilitation compared with 10 clinics that did not, and to better understand the relationship between individual providers' characteristics and attitudes and their CBT use. Costs of external facilitation were assessed by tracking the time spent by the facilitator and therapists in activities related to implementing CBT. Qualitative methods were used to explore contextual and other factors thought to influence implementation.</p> <p>Results</p> <p>Examination of change scores showed that facilitated therapists averaged an increase of 19% [95% CI: (2, 36)] in self-reported CBT use from baseline, while control therapists averaged a 4% [95% CI: (-14, 21)] increase. Therapists in the facilitated condition who were not providing CBT at baseline showed the greatest increase (35%) compared to a control therapist who was not providing CBT at baseline (10%) or to therapists in either condition who were providing CBT at baseline (average 3%). Increased CBT use was unrelated to prior CBT training. Barriers to CBT implementation were therapists' lack of control over their clinic schedule and poor communication with clinical leaders.</p> <p>Conclusions</p> <p>These findings suggest that facilitation may help clinicians make complex practice changes such as implementing an evidence-based psychotherapy. Furthermore, the substantial increase in CBT usage among the facilitation group was achieved at a modest cost.</p

Assay strategies for the discovery and validation of therapeutics targeting <i>Brugia pahangi</i> Hsp90

The chemotherapy of lymphatic filariasis relies upon drugs such as diethylcarbamazine and ivermectin that largely target the microfilarial stages of the parasite, necessitating continued treatment over the long reproductive life span of the adult worm. The identification of compounds that target adult worms has been a long-term goal of WHO. Here we describe a fluorescence polarization assay for the identification of compounds that target Hsp90 in adult filarial worms. The assay was originally developed to identify inhibitors of Hsp90 in tumor cells, and relies upon the ability of small molecules to inhibit the binding of fluorescently labelled geldanamycin to Hsp90. We demonstrate that the assay works well with soluble extracts of Brugia, while extracts of the free-living nematode C. elegans fail to bind the probe, in agreement with data from other experiments. The assay was validated using known inhibitors of Hsp90 that compete with geldanamycin for binding to Hsp90, including members of the synthetic purine-scaffold series of compounds. The efficacy of some of these compounds against adult worms was confirmed in vitro. Moreover, the assay is sufficiently sensitive to differentiate between binding of purine-scaffold compounds to human and Brugia Hsp90. The assay is suitable for high-throughput screening and provides the first example of a format with the potential to identify novel inhibitors of Hsp90 in filarial worms and in other parasitic species where Hsp90 may be a target

Driving of Outer Belt Electron Loss by Solar Wind Dynamic Pressure Structures : Analysis of Balloon and Satellite Data

We present observations of similar to 10-60 min solar wind dynamic pressure structures that drive large-scale coherent similar to 20-100 keV electron loss from the outer radiation belt. A combination of simultaneous satellite and Balloon Array for Radiation-belt Relativistic Electron Losses (BARREL) observations on 11-12 January 2014 shows a close association between the pressure structures and precipitation as inferred from BARREL X-rays. Specifically, the structures drive radial ExB transport of electrons up to 1 Earth radii, modulating the free electron energy available for low-frequency plasmaspheric hiss growth, and subsequent hiss-induced loss cone scattering. The dynamic pressure structures, originating near the Sun and commonly observed advecting with the solar wind, are thus able to switch on scattering loss of electrons by hiss over a large spatial scale. Our results provide a direct link between solar wind pressure fluctuations and modulation of electron loss from the outer radiation belt and may explain long-period modulations and large-scale coherence of X-rays commonly observed in the BARREL data set. Plain Language Summary The Earth's low-density magnetosphere is a region of enclosed magnetic field lines that contains energetic electrons ranging from eV to MeV energies. These populations can be greatly enhanced in response to solar driving. Following enhancements, energetic electron populations are depleted on timescales of hours to days by various processes. One important depletion process occurs when an electromagnetic plasma wave called plasmaspheric hiss, which exists within a high plasma density region called the plasmasphere and its (occasional) radial extension called the plume, scatters energetic electrons into the atmosphere. In this paper, we show that these hiss waves can be switched on by compressions of the magnetosphere which occur in response to similar to 1 hr long pressure structures in the solar wind. These structures originate at or near the Sun and are very common in the solar wind at 1 AU. The newly excited hiss waves scatter electrons into the atmosphere where they are observed on balloon-borne X-ray detectors. Our results suggest that magnetospheric models that predict the loss of electrons from hiss waves may be improved by consideration of solar wind pressure-driven dynamics.Peer reviewe

Genome-wide analysis of ivermectin response by Onchocerca volvulus reveals that genetic drift and soft selective sweeps contribute to loss of drug sensitivity

Treatment of onchocerciasis using mass ivermectin administration has reduced morbidity and transmission throughout Africa and Central/South America. Mass drug administration is likely to exert selection pressure on parasites, and phenotypic and genetic changes in several Onchocerca volvulus populations from Cameroon and Ghana-exposed to more than a decade of regular ivermectin treatment-have raised concern that sub-optimal responses to ivermectin's anti-fecundity effect are becoming more frequent and may spread.Pooled next generation sequencing (Pool-seq) was used to characterise genetic diversity within and between 108 adult female worms differing in ivermectin treatment history and response. Genome-wide analyses revealed genetic variation that significantly differentiated good responder (GR) and sub-optimal responder (SOR) parasites. These variants were not randomly distributed but clustered in ~31 quantitative trait loci (QTLs), with little overlap in putative QTL position and gene content between the two countries. Published candidate ivermectin SOR genes were largely absent in these regions; QTLs differentiating GR and SOR worms were enriched for genes in molecular pathways associated with neurotransmission, development, and stress responses. Finally, single worm genotyping demonstrated that geographic isolation and genetic change over time (in the presence of drug exposure) had a significantly greater role in shaping genetic diversity than the evolution of SOR.This study is one of the first genome-wide association analyses in a parasitic nematode, and provides insight into the genomics of ivermectin response and population structure of O. volvulus. We argue that ivermectin response is a polygenically-determined quantitative trait (QT) whereby identical or related molecular pathways but not necessarily individual genes are likely to determine the extent of ivermectin response in different parasite populations. Furthermore, we propose that genetic drift rather than genetic selection of SOR is the underlying driver of population differentiation, which has significant implications for the emergence and potential spread of SOR within and between these parasite populations