Stochastic Reinforcement Learning

In reinforcement learning episodes, the rewards and punishments are often non-deterministic, and there are invariably stochastic elements governing the underlying situation. Such stochastic elements are often numerous and cannot be known in advance, and they have a tendency to obscure the underlying rewards and punishments patterns. Indeed, if stochastic elements were absent, the same outcome would occur every time and the learning problems involved could be greatly simplified. In addition, in most practical situations, the cost of an observation to receive either a reward or punishment can be significant, and one would wish to arrive at the correct learning conclusion by incurring minimum cost. In this paper, we present a stochastic approach to reinforcement learning which explicitly models the variability present in the learning environment and the cost of observation. Criteria and rules for learning success are quantitatively analyzed, and probabilities of exceeding the observation cost bounds are also obtained.Comment: AIKE 201

New insights about the evaluation of human sperm quality: the aromatase example.

Male contribution to the couple's infertility is at first evaluated by the routine examination of semen parameters upon optical microscopy providing valuable information for a rational initial diagnosis and for a clinical management of infertility. But the different forms of infertility defined according to the WHO criteria especially teratozoospermia are not always related to the chromatin structure or to the fertilization capacity. New investigations at the molecular level (transcript and protein) could be developed in order to understand the nature of sperm malformation responsible of human infertility and thus to evaluate the sperm quality. The profile analysis of spermatozoal transcripts could be considered as a fingerprint of the past spermatogenic events. The selection of representative transcripts of normal spermatozoa remains complex because a differential expression (increased, decreased or not modified levels) of specific transcripts has been revealed between immotile and motile sperm fractions issued from normozoospermic donors. Microarrays tests or real-time quantitative PCR could be helpful for the identification of factors involved in the male infertility. Differences in the expression of specific transcripts have been reported between normal and abnormal semen samples. With the aromatase example, we have noted a negative strong correlation between the amount of transcript and the percentage of abnormal forms especially in presence of head defects. Immunocytochemical procedures using fluorescent probes associated with either confocal microscopy or flow cytometry can be also helpful to proceed with further investigations about the localization of proteins in the compartmentalized spermatozoa or the acrosome reaction. The dual location of aromatase both in the equatorial segment, the mid-piece and the tail could explain the double role of this enzyme in acrosome reaction and motility

A Convenient Solution to Geometric Distortion and Its Application to Phoebe's Observations

International audienceA simple but effective approach is proposed for measuring the geometric distortion of a CCD field of view of a ground-based telescope. For three open clusters (M35, M67, and NGC 2324), 425 CCD frames taken by a 1 m telescope at the Yunnan Observatory are used to test this approach. It is found that the geometric distortion pattern depends strongly on the corresponding filter used. The geometric distortion is then used to correct the pixel positions for Phoebe, the ninth satellite of Saturn, and its reference stars imaged in 220 CCD frames taken by the same telescope. The standard deviation of the (O - C; observed minus computed) residuals of Phoebe is significantly improved after correcting the geometric distortions

Ultra-large bandwidth hollow-core guiding in all-silica Bragg fibers with nano-supports

We demonstrate a new class of hollow-core Bragg fibers that are composed of concentric cylindrical silica rings separated by nanoscale support bridges. We theoretically predict and experimentally observe hollow-core confinement over an octave frequency range. The bandwidth of bandgap guiding in this new class of Bragg fibers exceeds that of other hollow-core fibers reported in the literature. With only three rings of silica cladding layers, these Bragg fibers achieve propagation loss of the order of 1 dB/m.Comment: 9 pages including 5 figure

Prosociality and hoarding amid the COVID-19 pandemic : a tale of four countries

The COVID-19 pandemic is an unprecedented public health crisis that poses a challenge to humanity. Drawing on the stress and coping literature, we argue that people around the world alleviate their anxiety and stress induced by the pandemic through both prosocial and 'self-interested' hoarding behaviours. This cross-cultural survey study examined the pushing (threat perception) and pulling (moral identity) factors that predicted prosocial acts and hoarding, and subsequently psychological well-being. Data were collected from 9 April to 14 May 2020 from 251 participants in the United Kingdom (UK), 268 in the United States (US), 197 in Germany (DE), and 200 in Hong Kong (HK). Whereas threat perception was associated positively with both prosocial acts and hoarding, benevolent moral identity was associated positively with the former but not the latter behaviour. We also observed cross-cultural differences, such that both effects were stronger in more individualistic (UK, US) countries than less individualistic (HK, DE) ones. The findings shed light on the prosocial vs. self-interested behavioural responses of people in different cultures towards the same pandemic crisis

ORIGIN OF THE CHAOTIC MOTION OF THE SATURNIAN SATELLITE ATLAS

“The final publication is available at http://iopscience.iop.org/article/10.3847/0004-6256/151/5/122/meta

Isolation and fine mapping of Rps6: An intermediate host resistance gene in barley to wheat stripe rust

A plant may be considered a nonhost of a pathogen if all known genotypes of a plant species are resistant to all known isolates of a pathogen species. However, if a small number of genotypes are susceptible to some known isolates of a pathogen species this plant maybe considered an intermediate host. Barley (Hordeum vulgare) is an intermediate host for Puccinia striiformis f. sp. tritici (Pst), the causal agent of wheat stripe rust. We wanted to understand the genetic architecture underlying resistance to Pst and to determine whether any overlap exists with resistance to the host pathogen, Puccinia striiformis f. sp. hordei (Psh). We mapped Pst resistance to chromosome 7H and show that host and intermediate host resistance is genetically uncoupled. Therefore, we designate this resistance locus Rps6. We used phenotypic and genotypic selection on F2:3 families to isolate Rps6 and fine mapped the locus to a 0.1 cM region. Anchoring of the Rps6 locus to the barley physical map placed the region on two adjacent fingerprinted contigs. Efforts are now underway to sequence the minimal tiling path and to delimit the physical region harbouring Rps6. This will facilitate additional marker development and permit identification of candidate genes in the region