Scale-free memory model for multiagent reinforcement learning. Mean field approximation and rock-paper-scissors dynamics

A continuous time model for multiagent systems governed by reinforcement learning with scale-free memory is developed. The agents are assumed to act independently of one another in optimizing their choice of possible actions via trial-and-error search. To gain awareness about the action value the agents accumulate in their memory the rewards obtained from taking a specific action at each moment of time. The contribution of the rewards in the past to the agent current perception of action value is described by an integral operator with a power-law kernel. Finally a fractional differential equation governing the system dynamics is obtained. The agents are considered to interact with one another implicitly via the reward of one agent depending on the choice of the other agents. The pairwise interaction model is adopted to describe this effect. As a specific example of systems with non-transitive interactions, a two agent and three agent systems of the rock-paper-scissors type are analyzed in detail, including the stability analysis and numerical simulation. Scale-free memory is demonstrated to cause complex dynamics of the systems at hand. In particular, it is shown that there can be simultaneously two modes of the system instability undergoing subcritical and supercritical bifurcation, with the latter one exhibiting anomalous oscillations with the amplitude and period growing with time. Besides, the instability onset via this supercritical mode may be regarded as "altruism self-organization". For the three agent system the instability dynamics is found to be rather irregular and can be composed of alternate fragments of oscillations different in their properties.Comment: 17 pages, 7 figur

Dynamic Assessment of Baroreflex Control of Heart Rate During Induction of Propofol Anesthesia Using a Point Process Method

In this article, we present a point process method to assess dynamic baroreflex sensitivity (BRS) by estimating the baroreflex gain as focal component of a simplified closed-loop model of the cardiovascular system. Specifically, an inverse Gaussian probability distribution is used to model the heartbeat interval, whereas the instantaneous mean is identified by linear and bilinear bivariate regressions on both the previous R−R intervals (RR) and blood pressure (BP) beat-to-beat measures. The instantaneous baroreflex gain is estimated as the feedback branch of the loop with a point-process filter, while the RRBP feedforward transfer function representing heart contractility and vasculature effects is simultaneously estimated by a recursive least-squares filter. These two closed-loop gains provide a direct assessment of baroreflex control of heart rate (HR). In addition, the dynamic coherence, cross bispectrum, and their power ratio can also be estimated. All statistical indices provide a valuable quantitative assessment of the interaction between heartbeat dynamics and hemodynamics. To illustrate the application, we have applied the proposed point process model to experimental recordings from 11 healthy subjects in order to monitor cardiovascular regulation under propofol anesthesia. We present quantitative results during transient periods, as well as statistical analyses on steady-state epochs before and after propofol administration. Our findings validate the ability of the algorithm to provide a reliable and fast-tracking assessment of BRS, and show a clear overall reduction in baroreflex gain from the baseline period to the start of propofol anesthesia, confirming that instantaneous evaluation of arterial baroreflex control of HR may yield important implications in clinical practice, particularly during anesthesia and in postoperative care.National Institutes of Health (U.S.) (Grant R01-HL084502)National Institutes of Health (U.S.) (Grant K25-NS05758)National Institutes of Health (U.S.) (Grant DP2- OD006454)National Institutes of Health (U.S.) (Grant T32NS048005)National Institutes of Health (U.S.) (Grant T32NS048005)National Institutes of Health (U.S.) (Grant R01-DA015644)Massachusetts General Hospital (Clinical Research Center, UL1 Grant RR025758

Search for Gravitational Waves Associated with Gamma-Ray Bursts Detected by Fermi and Swift during the LIGO-Virgo Run O3b

We search for gravitational-wave signals associated with gamma-ray bursts (GRBs) detected by the Fermi and Swift satellites during the second half of the third observing run of Advanced LIGO and Advanced Virgo (2019 November 1 15:00 UTC-2020 March 27 17:00 UTC). We conduct two independent searches: A generic gravitational-wave transients search to analyze 86 GRBs and an analysis to target binary mergers with at least one neutron star as short GRB progenitors for 17 events. We find no significant evidence for gravitational-wave signals associated with any of these GRBs. A weighted binomial test of the combined results finds no evidence for subthreshold gravitational-wave signals associated with this GRB ensemble either. We use several source types and signal morphologies during the searches, resulting in lower bounds on the estimated distance to each GRB. Finally, we constrain the population of low-luminosity short GRBs using results from the first to the third observing runs of Advanced LIGO and Advanced Virgo. The resulting population is in accordance with the local binary neutron star merger rate. © 2022. The Author(s). Published by the American Astronomical Society

Narrowband Searches for Continuous and Long-duration Transient Gravitational Waves from Known Pulsars in the LIGO-Virgo Third Observing Run

Isolated neutron stars that are asymmetric with respect to their spin axis are possible sources of detectable continuous gravitational waves. This paper presents a fully coherent search for such signals from eighteen pulsars in data from LIGO and Virgo's third observing run (O3). For known pulsars, efficient and sensitive matched-filter searches can be carried out if one assumes the gravitational radiation is phase-locked to the electromagnetic emission. In the search presented here, we relax this assumption and allow both the frequency and the time derivative of the frequency of the gravitational waves to vary in a small range around those inferred from electromagnetic observations. We find no evidence for continuous gravitational waves, and set upper limits on the strain amplitude for each target. These limits are more constraining for seven of the targets than the spin-down limit defined by ascribing all rotational energy loss to gravitational radiation. In an additional search, we look in O3 data for long-duration (hours-months) transient gravitational waves in the aftermath of pulsar glitches for six targets with a total of nine glitches. We report two marginal outliers from this search, but find no clear evidence for such emission either. The resulting duration-dependent strain upper limits do not surpass indirect energy constraints for any of these targets. © 2022. The Author(s). Published by the American Astronomical Society

Combination of searches for heavy spin-1 resonances using 139 fb−1 of proton-proton collision data at √s = 13 TeV with the ATLAS detector

A combination of searches for new heavy spin-1 resonances decaying into diferent pairings of W, Z, or Higgs bosons, as well as directly into leptons or quarks, is presented. The data sample used corresponds to 139 fb−1 of proton-proton collisions at √s = 13 TeV collected during 2015–2018 with the ATLAS detector at the CERN Large Hadron Collider. Analyses selecting quark pairs (qq, bb, tt¯, and tb) or third-generation leptons (τν and τ τ ) are included in this kind of combination for the frst time. A simplifed model predicting a spin-1 heavy vector-boson triplet is used. Cross-section limits are set at the 95% confdence level and are compared with predictions for the benchmark model. These limits are also expressed in terms of constraints on couplings of the heavy vector-boson triplet to quarks, leptons, and the Higgs boson. The complementarity of the various analyses increases the sensitivity to new physics, and the resulting constraints are stronger than those from any individual analysis considered. The data exclude a heavy vector-boson triplet with mass below 5.8 TeV in a weakly coupled scenario, below 4.4 TeV in a strongly coupled scenario, and up to 1.5 TeV in the case of production via vector-boson fusion

Searches for exclusive Higgs boson decays into D⁎γ and Z boson decays into D0γ and Ks0γ in pp collisions at √s = 13 TeV with the ATLAS detector

Searches for exclusive decays of the Higgs boson into D⁎γ and of the Z boson into D0γ and Ks0γ can probe flavour-violating Higgs boson and Z boson couplings to light quarks. Searches for these decays are performed with a pp collision data sample corresponding to an integrated luminosity of 136.3 fb−1 collected at s=13TeV between 2016–2018 with the ATLAS detector at the CERN Large Hadron Collider. In the D⁎γ and D0γ channels, the observed (expected) 95% confidence-level upper limits on the respective branching fractions are B(H→D⁎γ)<1.0(1.2)×10−3, B(Z→D0γ)<4.0(3.4)×10−6, while the corresponding results in the Ks0γ channel are B(Z→Ks0γ)<3.1(3.0)×10−6

Measurement of vector boson production cross sections and their ratios using pp collisions at √s = 13.6 TeV with the ATLAS detector

Abstract available from publisher's website