Automatic Goal Discovery in Subgoal Monte Carlo Tree Search

Monte Carlo Tree Search (MCTS) is a heuristic search algorithm that can play a wide range of games without requiring any domain-specific knowledge. However, MCTS tends to struggle in very complicated games due to an exponentially increasing branching factor. A promising solution for this problem is to focus the search only on a small fraction of states. Subgoal Monte Carlo Tree Search (S-MCTS) achieves this by using a predefined subgoal-predicate that detects promising states called subgoals. However, not only does this make S-MCTS domain-dependent, but also it is often difficult to define a good predicate. In this paper, we propose using quality diversity (QD) algorithms to detect subgoals in real-time. Furthermore, we show how integrating QD-algorithms into S-MCTS significantly improves its performance in the Physical Travelling Salesmen Problem without requiring any domain-specific knowledge

Ocean warming threatens southern right whale population recovery

Funding: This work was supported by CAPES doctoral scholarship (M.A.), CAPES-PRINT grant 88887.370641/2019-00 (M.A.), CNPQ research grant 305573/2013-6 (P.C.S.-L.), and CNPQ research grant 407190/2012-0 (F.G.D.-J.). Funding for aerial surveys since 1971 was provided by numerous donors through Ocean Alliance and Instituto de Conservación de Ballenas such as Wildlife Conservation Society, National Geographic Society, World Wildlife Fund, Alfredo Fortabat Foundation, Turner Foundation, Canadian Whale Institute, I. Kerr, A. L. de Fortabat, S. Haney, A. and J. Moss, A. Morse, P. Singh, P. Logan, N. Griffis, and C. Walcott.Whales contribute to marine ecosystem functioning, and they may play a role in mitigating climate change and supporting the Antarctic krill (Euphausia superba) population, a keystone prey species that sustains the entire Southern Ocean (SO) ecosystem. By analyzing a five-decade (1971–2017) data series of individual southern right whales (SRWs; Eubalaena australis) photo-identified at Península Valdés, Argentina, we found a marked increase in whale mortality rates following El Niño events. By modeling how the population responds to changes in the frequency and intensity of El Niño events, we found that such events are likely to impede SRW population recovery and could even cause population decline. Such outcomes have the potential to disrupt food-web interactions in the SO, weakening that ecosystem’s contribution to the mitigation of climate change at a global scale.Publisher PDFPeer reviewe

Lepton Acceleration in Pulsar Wind Nebulae

Pulsar Wind Nebulae (PWNe) act as calorimeters for the relativistic pair winds emanating from within the pulsar light cylinder. Their radiative dissipation in various wavebands is significantly different from that of their pulsar central engines: the broadband spectra of PWNe possess characteristics distinct from those of pulsars, thereby demanding a site of lepton acceleration remote from the pulsar magnetosphere. A principal candidate for this locale is the pulsar wind termination shock, a putatively highly-oblique, ultra-relativistic MHD discontinuity. This paper summarizes key characteristics of relativistic shock acceleration germane to PWNe, using predominantly Monte Carlo simulation techniques that compare well with semi-analytic solutions of the diffusion-convection equation. The array of potential spectral indices for the pair distribution function is explored, defining how these depend critically on the parameters of the turbulent plasma in the shock environs. Injection efficiencies into the acceleration process are also addressed. Informative constraints on the frequency of particle scattering and the level of field turbulence are identified using the multiwavelength observations of selected PWNe. These suggest that the termination shock can be comfortably invoked as a principal injector of energetic leptons into PWNe without resorting to unrealistic properties for the shock layer turbulence or MHD structure.Comment: 19 pages, 5 figures, invited review to appear in Proc. of the inaugural ICREA Workshop on "The High-Energy Emission from Pulsars and their Systems" (2010), eds. N. Rea and D. Torres, (Springer Astrophysics and Space Science series

Integration of Expressed Sequence Tag Data Flanking Predicted RNA Secondary Structures Facilitates Novel Non-Coding RNA Discovery

Many computational methods have been used to predict novel non-coding RNAs (ncRNAs), but none, to our knowledge, have explicitly investigated the impact of integrating existing cDNA-based Expressed Sequence Tag (EST) data that flank structural RNA predictions. To determine whether flanking EST data can assist in microRNA (miRNA) prediction, we identified genomic sites encoding putative miRNAs by combining functional RNA predictions with flanking ESTs data in a model consistent with miRNAs undergoing cleavage during maturation. In both human and mouse genomes, we observed that the inclusion of flanking ESTs adjacent to and not overlapping predicted miRNAs significantly improved the performance of various methods of miRNA prediction, including direct high-throughput sequencing of small RNA libraries. We analyzed the expression of hundreds of miRNAs predicted to be expressed during myogenic differentiation using a customized microarray and identified several known and predicted myogenic miRNA hairpins. Our results indicate that integrating ESTs flanking structural RNA predictions improves the quality of cleaved miRNA predictions and suggest that this strategy can be used to predict other non-coding RNAs undergoing cleavage during maturation

A Putative Homologue of CDC20/CDH1 in the Malaria Parasite Is Essential for Male Gamete Development

Cell-cycle progression is governed by a series of essential regulatory proteins. Two major regulators are cell-division cycle protein 20 (CDC20) and its homologue, CDC20 homologue 1 (CDH1), which activate the anaphase-promoting complex/cyclosome (APC/C) in mitosis, and facilitate degradation of mitotic APC/C substrates. The malaria parasite, Plasmodium, is a haploid organism which, during its life-cycle undergoes two stages of mitosis; one associated with asexual multiplication and the other with male gametogenesis. Cell-cycle regulation and DNA replication in Plasmodium was recently shown to be dependent on the activity of a number of protein kinases. However, the function of cell division cycle proteins that are also involved in this process, such as CDC20 and CDH1 is totally unknown. Here we examine the role of a putative CDC20/CDH1 in the rodent malaria Plasmodium berghei (Pb) using reverse genetics. Phylogenetic analysis identified a single putative Plasmodium CDC20/CDH1 homologue (termed CDC20 for simplicity) suggesting that Plasmodium APC/C has only one regulator. In our genetic approach to delete the endogenous cdc20 gene of P. berghei, we demonstrate that PbCDC20 plays a vital role in male gametogenesis, but is not essential for mitosis in the asexual blood stage. Furthermore, qRT-PCR analysis in parasite lines with deletions of two kinase genes involved in male sexual development (map2 and cdpk4), showed a significant increase in cdc20 transcription in activated gametocytes. DNA replication and ultra structural analyses of cdc20 and map2 mutants showed similar blockage of nuclear division at the nuclear spindle/kinetochore stage. CDC20 was phosphorylated in asexual and sexual stages, but the level of modification was higher in activated gametocytes and ookinetes. Changes in global protein phosphorylation patterns in the Δcdc20 mutant parasites were largely different from those observed in the Δmap2 mutant. This suggests that CDC20 and MAP2 are both likely to play independent but vital roles in male gametogenesis

Iron Behaving Badly: Inappropriate Iron Chelation as a Major Contributor to the Aetiology of Vascular and Other Progressive Inflammatory and Degenerative Diseases

The production of peroxide and superoxide is an inevitable consequence of aerobic metabolism, and while these particular "reactive oxygen species" (ROSs) can exhibit a number of biological effects, they are not of themselves excessively reactive and thus they are not especially damaging at physiological concentrations. However, their reactions with poorly liganded iron species can lead to the catalytic production of the very reactive and dangerous hydroxyl radical, which is exceptionally damaging, and a major cause of chronic inflammation. We review the considerable and wide-ranging evidence for the involvement of this combination of (su)peroxide and poorly liganded iron in a large number of physiological and indeed pathological processes and inflammatory disorders, especially those involving the progressive degradation of cellular and organismal performance. These diseases share a great many similarities and thus might be considered to have a common cause (i.e. iron-catalysed free radical and especially hydroxyl radical generation). The studies reviewed include those focused on a series of cardiovascular, metabolic and neurological diseases, where iron can be found at the sites of plaques and lesions, as well as studies showing the significance of iron to aging and longevity. The effective chelation of iron by natural or synthetic ligands is thus of major physiological (and potentially therapeutic) importance. As systems properties, we need to recognise that physiological observables have multiple molecular causes, and studying them in isolation leads to inconsistent patterns of apparent causality when it is the simultaneous combination of multiple factors that is responsible. This explains, for instance, the decidedly mixed effects of antioxidants that have been observed, etc...Comment: 159 pages, including 9 Figs and 2184 reference

Effect of kelp gull harassment on southern right whale calf survival: a long-term capture–recapture analysis

Kelp gulls (Larus dominicanus) commonly feed on the skin and blubber of surfacing southern right whales (SRW, Eubalaena australis) in the near shore waters of Península Valdés (PV), Argentina. Mothers and especially calves respond to gull attacks by changing their swimming speeds, resting postures and overall behaviour. Gull-inflicted wounds per calf have increased markedly since the mid-1990s. Unusually high mortality of young calves occurred locally after 2003, and increasing evidence points to gull harassment as a factor contributing to the excess deaths. After leaving PV, calves undertake a long migration with their mothers to summer feeding areas; their health during this strenuous exertion is likely to affect their probabilities of first-year survival. To explore the effects of gull-inflicted wounds on calf survival, we analysed 44 capture–recapture observations between 1974 and 2017, for 597 whales photo-identified in their years of birth between 1974 and 2011. We found a marked decrease in first-year survival associated with an increase in wound severity over time. Our analysis supports recent studies indicating that gull harassment at PV may impact SRW population dynamics