Reinforcement learning for personalized dialogue management

Language systems have been of great interest to the research community and have recently reached the mass market through various assistant platforms on the web. Reinforcement Learning methods that optimize dialogue policies have seen successes in past years and have recently been extended into methods that personalize the dialogue, e.g. take the personal context of users into account. These works, however, are limited to personalization to a single user with whom they require multiple interactions and do not generalize the usage of context across users. This work introduces a problem where a generalized usage of context is relevant and proposes two Reinforcement Learning (RL)-based approaches to this problem. The first approach uses a single learner and extends the traditional POMDP formulation of dialogue state with features that describe the user context. The second approach segments users by context and then employs a learner per context. We compare these approaches in a benchmark of existing non-RL and RL-based methods in three established and one novel application domain of financial product recommendation. We compare the influence of context and training experiences on performance and find that learning approaches generally outperform a handcrafted gold standard

Histone H3K9 Trimethylase Eggless Controls Germline Stem Cell Maintenance and Differentiation

Epigenetic regulation plays critical roles in the regulation of cell proliferation, fate determination, and survival. It has been shown to control self-renewal and lineage differentiation of embryonic stem cells. However, epigenetic regulation of adult stem cell function remains poorly defined. Drosophila ovarian germline stem cells (GSCs) are a productive adult stem cell system for revealing regulatory mechanisms controlling self-renewal and differentiation. In this study, we show that Eggless (Egg), a H3K9 methyltransferase in Drosophila, is required in GSCs for controlling self-renewal and in escort cells for regulating germ cell differentiation. egg mutant ovaries primarily exhibit germ cell differentiation defects in young females and gradually lose GSCs with time, indicating that Egg regulates both germ cell maintenance and differentiation. Marked mutant egg GSCs lack expression of trimethylated H3K9 (H3k9me3) and are rapidly lost from the niche, but their mutant progeny can still differentiate into 16-cell cysts, indicating that Egg is required intrinsically to control GSC self-renewal but not differentiation. Interestingly, BMP-mediated transcriptional repression of differentiation factor bam in marked egg mutant GSCs remains normal, indicating that Egg is dispensable for BMP signaling in GSCs. Normally, Bam and Bgcn interact with each other to promote GSC differentiation. Interestingly, marked double mutant egg bgcn GSCs are still lost, but their progeny are able to differentiate into 16-cell cysts though bgcn mutant GSCs normally do not differentiate, indicating that Egg intrinsically controls GSC self-renewal through repressing a Bam/Bgcn-independent pathway. Surprisingly, RNAi-mediated egg knockdown in escort cells leads to their gradual loss and a germ cell differentiation defect. The germ cell differentiation defect is at least in part attributed to an increase in BMP signaling in the germ cell differentiation niche. Therefore, this study has revealed the essential roles of histone H3K9 trimethylation in controlling stem cell maintenance and differentiation through distinct mechanisms

The disruption of proteostasis in neurodegenerative diseases

Cells count on surveillance systems to monitor and protect the cellular proteome which, besides being highly heterogeneous, is constantly being challenged by intrinsic and environmental factors. In this context, the proteostasis network (PN) is essential to achieve a stable and functional proteome. Disruption of the PN is associated with aging and can lead to and/or potentiate the occurrence of many neurodegenerative diseases (ND). This not only emphasizes the importance of the PN in health span and aging but also how its modulation can be a potential target for intervention and treatment of human diseases.info:eu-repo/semantics/publishedVersio

First measurement of the Hubble Constant from a Dark Standard Siren using the Dark Energy Survey Galaxies and the LIGO/Virgo Binary–Black-hole Merger GW170814

International audienceWe present a multi-messenger measurement of the Hubble constant H 0 using the binary–black-hole merger GW170814 as a standard siren, combined with a photometric redshift catalog from the Dark Energy Survey (DES). The luminosity distance is obtained from the gravitational wave signal detected by the Laser Interferometer Gravitational-Wave Observatory (LIGO)/Virgo Collaboration (LVC) on 2017 August 14, and the redshift information is provided by the DES Year 3 data. Black hole mergers such as GW170814 are expected to lack bright electromagnetic emission to uniquely identify their host galaxies and build an object-by-object Hubble diagram. However, they are suitable for a statistical measurement, provided that a galaxy catalog of adequate depth and redshift completion is available. Here we present the first Hubble parameter measurement using a black hole merger. Our analysis results in , which is consistent with both SN Ia and cosmic microwave background measurements of the Hubble constant. The quoted 68% credible region comprises 60% of the uniform prior range [20, 140] km s−1 Mpc−1, and it depends on the assumed prior range. If we take a broader prior of [10, 220] km s−1 Mpc−1, we find (57% of the prior range). Although a weak constraint on the Hubble constant from a single event is expected using the dark siren method, a multifold increase in the LVC event rate is anticipated in the coming years and combinations of many sirens will lead to improved constraints on H 0

Search for gravitational waves from Scorpius X-1 in the second Advanced LIGO observing run with an improved hidden Markov model

We present results from a semicoherent search for continuous gravitational waves from the low-mass x-ray binary Scorpius X-1, using a hidden Markov model (HMM) to track spin wandering. This search improves on previous HMM-based searches of LIGO data by using an improved frequency domain matched filter, the J-statistic, and by analyzing data from Advanced LIGO's second observing run. In the frequency range searched, from 60 to 650 Hz, we find no evidence of gravitational radiation. At 194.6 Hz, the most sensitive search frequency, we report an upper limit on gravitational wave strain (at 95% confidence) of h095%=3.47×10-25 when marginalizing over source inclination angle. This is the most sensitive search for Scorpius X-1, to date, that is specifically designed to be robust in the presence of spin wandering. © 2019 American Physical Society

Erratum: “Searches for Gravitational Waves from Known Pulsars at Two Harmonics in 2015–2017 LIGO Data” (2019, ApJ, 879, 10)

Due to an error at the publisher, in the published article the number of pulsars presented in the paper is incorrect in multiple places throughout the text. Specifically, "222" pulsars should be "221." Additionally, the number of pulsars for which we have EM observations that fully overlap with O1 and O2 changes from "168" to "167." Elsewhere, in the machine-readable table of Table 1 and in Table 2, the row corresponding to pulsar J0952-0607 should be excised as well. Finally, in the caption for Table 2 the number of pulsars changes from "188" to "187.

GW190412: Observation of a Binary-Black-Hole Coalescence with Asymmetric Masses

We report the observation of gravitational waves from a binary-black-hole coalescence during the first two weeks of LIGO’s and Virgo’s third observing run. The signal was recorded on April 12, 2019 at 05∶30∶44 UTC with a network signal-to-noise ratio of 19. The binary is different from observations during the first two observing runs most notably due to its asymmetric masses: a ∼30 M_⊙ black hole merged with a ∼8 M_⊙ black hole companion. The more massive black hole rotated with a dimensionless spin magnitude between 0.22 and 0.60 (90% probability). Asymmetric systems are predicted to emit gravitational waves with stronger contributions from higher multipoles, and indeed we find strong evidence for gravitational radiation beyond the leading quadrupolar order in the observed signal. A suite of tests performed on GW190412 indicates consistency with Einstein’s general theory of relativity. While the mass ratio of this system differs from all previous detections, we show that it is consistent with the population model of stellar binary black holes inferred from the first two observing runs

Properties and Astrophysical Implications of the 150 M_⊙ Binary Black Hole Merger GW190521

The gravitational-wave signal GW190521 is consistent with a binary black hole (BBH) merger source at redshift 0.8 with unusually high component masses, 85⁺²¹₋₁₄ M_⊙ and 66⁺¹⁷₋₁₈ M_⊙, compared to previously reported events, and shows mild evidence for spin-induced orbital precession. The primary falls in the mass gap predicted by (pulsational) pair-instability supernova theory, in the approximate range 65–120 M_⊙. The probability that at least one of the black holes in GW190521 is in that range is 99.0%. The final mass of the merger 142⁺²⁸₋₁₆ M_⊙) classifies it as an intermediate-mass black hole. Under the assumption of a quasi-circular BBH coalescence, we detail the physical properties of GW190521's source binary and its post-merger remnant, including component masses and spin vectors. Three different waveform models, as well as direct comparison to numerical solutions of general relativity, yield consistent estimates of these properties. Tests of strong-field general relativity targeting the merger-ringdown stages of the coalescence indicate consistency of the observed signal with theoretical predictions. We estimate the merger rate of similar systems to be 0.13_(-0.11)^(+0.30) Gpc⁻³ yr⁻¹. We discuss the astrophysical implications of GW190521 for stellar collapse and for the possible formation of black holes in the pair-instability mass gap through various channels: via (multiple) stellar coalescences, or via hierarchical mergers of lower-mass black holes in star clusters or in active galactic nuclei. We find it to be unlikely that GW190521 is a strongly lensed signal of a lower-mass black hole binary merger. We also discuss more exotic possible sources for GW190521, including a highly eccentric black hole binary, or a primordial black hole binary

Searches for gravitational waves from known pulsars at two harmonics in 2015-2017 LIGO data

International audienceWe present a search for gravitational waves from 222 pulsars with rotation frequencies ≳10 Hz. We use advanced LIGO data from its first and second observing runs spanning 2015–2017, which provides the highest-sensitivity gravitational-wave data so far obtained. In this search we target emission from both the l = m = 2 mass quadrupole mode, with a frequency at twice that of the pulsar’s rotation, and the l = 2, m = 1 mode, with a frequency at the pulsar rotation frequency. The search finds no evidence for gravitational-wave emission from any pulsar at either frequency. For the l = m = 2 mode search, we provide updated upper limits on the gravitational-wave amplitude, mass quadrupole moment, and fiducial ellipticity for 167 pulsars, and the first such limits for a further 55. For 20 young pulsars these results give limits that are below those inferred from the pulsars’ spin-down. For the Crab and Vela pulsars our results constrain gravitational-wave emission to account for less than 0.017% and 0.18% of the spin-down luminosity, respectively. For the recycled millisecond pulsar J0711−6830 our limits are only a factor of 1.3 above the spin-down limit, assuming the canonical value of 1038 kg m2 for the star’s moment of inertia, and imply a gravitational-wave-derived upper limit on the star’s ellipticity of 1.2 × 10−8. We also place new limits on the emission amplitude at the rotation frequency of the pulsars

GW190425 : observation of a compact binary coalescence with total mass ~ 3.4 M o

On 2019 April 25, the LIGO Livingston detector observed a compact binary coalescence with signal-to-noise ratio 12.9. The Virgo detector was also taking data that did not contribute to detection due to a low signal-to-noise ratio, but were used for subsequent parameter estimation. The 90% credible intervals for the component masses range from to if we restrict the dimensionless component spin magnitudes to be smaller than 0.05). These mass parameters are consistent with the individual binary components being neutron stars. However, both the source-frame chirp mass and the total mass of this system are significantly larger than those of any other known binary neutron star (BNS) system. The possibility that one or both binary components of the system are black holes cannot be ruled out from gravitational-wave data. We discuss possible origins of the system based on its inconsistency with the known Galactic BNS population. Under the assumption that the signal was produced by a BNS coalescence, the local rate of neutron star mergers is updated to 250-2810