Scale-free memory model for multiagent reinforcement learning. Mean field approximation and rock-paper-scissors dynamics

A continuous time model for multiagent systems governed by reinforcement learning with scale-free memory is developed. The agents are assumed to act independently of one another in optimizing their choice of possible actions via trial-and-error search. To gain awareness about the action value the agents accumulate in their memory the rewards obtained from taking a specific action at each moment of time. The contribution of the rewards in the past to the agent current perception of action value is described by an integral operator with a power-law kernel. Finally a fractional differential equation governing the system dynamics is obtained. The agents are considered to interact with one another implicitly via the reward of one agent depending on the choice of the other agents. The pairwise interaction model is adopted to describe this effect. As a specific example of systems with non-transitive interactions, a two agent and three agent systems of the rock-paper-scissors type are analyzed in detail, including the stability analysis and numerical simulation. Scale-free memory is demonstrated to cause complex dynamics of the systems at hand. In particular, it is shown that there can be simultaneously two modes of the system instability undergoing subcritical and supercritical bifurcation, with the latter one exhibiting anomalous oscillations with the amplitude and period growing with time. Besides, the instability onset via this supercritical mode may be regarded as "altruism self-organization". For the three agent system the instability dynamics is found to be rather irregular and can be composed of alternate fragments of oscillations different in their properties.Comment: 17 pages, 7 figur

Measurement of the azimuthal anisotropy of Y(1S) and Y(2S) mesons in PbPb collisions at √S^{S}NN = 5.02 TeV

The second-order Fourier coefficients (υ$_{2}$) characterizing the azimuthal distributions of Υ(1S) and Υ(2S) mesons produced in PbPb collisions at $\sqrt{s_{NN}}$ = 5.02 TeV are studied. The Υmesons are reconstructed in their dimuon decay channel, as measured by the CMS detector. The collected data set corresponds to an integrated luminosity of 1.7 nb$^{-1}$. The scalar product method is used to extract the υ$_{2}$ coefficients of the azimuthal distributions. Results are reported for the rapidity range |y| < 2.4, in the transverse momentum interval 0 < p$_{T}$ < 50 GeV/c, and in three centrality ranges of 10–30%, 30–50% and 50–90%. In contrast to the J/ψ mesons, the measured υ$_{2}$ values for the Υ mesons are found to be consistent with zero

Measurement of prompt D0^{0} and D‾\overline{D}0^{0} meson azimuthal anisotropy and search for strong electric fields in PbPb collisions at root SNN\sqrt{S_{NN}} = 5.02 TeV

The strong Coulomb field created in ultrarelativistic heavy ion collisions is expected to produce a rapiditydependent difference (Av2) in the second Fourier coefficient of the azimuthal distribution (elliptic flow, v2) between D0 (uc) and D0 (uc) mesons. Motivated by the search for evidence of this field, the CMS detector at the LHC is used to perform the first measurement of Av2. The rapidity-averaged value is found to be (Av2) = 0.001 ? 0.001 (stat)? 0.003 (syst) in PbPb collisions at ?sNN = 5.02 TeV. In addition, the influence of the collision geometry is explored by measuring the D0 and D0mesons v2 and triangular flow coefficient (v3) as functions of rapidity, transverse momentum (pT), and event centrality (a measure of the overlap of the two Pb nuclei). A clear centrality dependence of prompt D0 meson v2 values is observed, while the v3 is largely independent of centrality. These trends are consistent with expectations of flow driven by the initial-state geometry. ? 2021 The Author. Published by Elsevier B.V. This is an open access article under the CC BY licens

Performance of reconstruction and identification of τ leptons decaying to hadrons and vτ in pp collisions at √s=13 TeV

The algorithm developed by the CMS Collaboration to reconstruct and identify τ leptons produced in proton-proton collisions at √s=7 and 8 TeV, via their decays to hadrons and a neutrino, has been significantly improved. The changes include a revised reconstruction of π⁰ candidates, and improvements in multivariate discriminants to separate τ leptons from jets and electrons. The algorithm is extended to reconstruct τ leptons in highly Lorentz-boosted pair production, and in the high-level trigger. The performance of the algorithm is studied using proton-proton collisions recorded during 2016 at √s=13 TeV, corresponding to an integrated luminosity of 35.9 fb¯¹. The performance is evaluated in terms of the efficiency for a genuine τ lepton to pass the identification criteria and of the probabilities for jets, electrons, and muons to be misidentified as τ leptons. The results are found to be very close to those expected from Monte Carlo simulation

Performance of the CMS Level-1 trigger in proton-proton collisions at √s = 13 TeV

At the start of Run 2 in 2015, the LHC delivered proton-proton collisions at a center-of-mass energy of 13\TeV. During Run 2 (years 2015–2018) the LHC eventually reached a luminosity of 2.1× 10$^{34}$ cm$^{-2}$s$^{-1}$, almost three times that reached during Run 1 (2009–2013) and a factor of two larger than the LHC design value, leading to events with up to a mean of about 50 simultaneous inelastic proton-proton collisions per bunch crossing (pileup). The CMS Level-1 trigger was upgraded prior to 2016 to improve the selection of physics events in the challenging conditions posed by the second run of the LHC. This paper describes the performance of the CMS Level-1 trigger upgrade during the data taking period of 2016–2018. The upgraded trigger implements pattern recognition and boosted decision tree regression techniques for muon reconstruction, includes pileup subtraction for jets and energy sums, and incorporates pileup-dependent isolation requirements for electrons and tau leptons. In addition, the new trigger calculates high-level quantities such as the invariant mass of pairs of reconstructed particles. The upgrade reduces the trigger rate from background processes and improves the trigger efficiency for a wide variety of physics signals

Measurements of production cross sections of the Higgs boson in the four-lepton final state in proton–proton collisions at S\sqrt{S} = 13 TeV

Production cross sections of the Higgs boson are measured in the H -> ZZ -> 4l (l = e, mu) decay channel. A data sample of proton-proton collisions at a center-of-mass energy of 13 TeV, collected by the CMS detector at the LHC and corresponding to an integrated luminosity of 137 fb(-1) is used. The signal strength modifier mu, defined as the ratio of the Higgs boson production rate in the 4l channel to the standard model (SM) expectation, is measured to be mu = 0.94 +/- 0.07 (stat)(-0.08)(+0.09) (syst) at a fixed value of m(H) = 125.38 GeV. The signal strength modifiers for the individual Higgs boson production modes are also reported. The inclusive fiducial cross section for the H -> 4l process is measured to be 2.84(-0.22)(+0.23) (stat)(-0.21)(+0.26) (syst) fb, which is compatible with the SM prediction of 2.84 +/- 0.15 fb for the same fiducial region. Differential cross sections as a function of the transverse momentum and rapidity of the Higgs boson, the number of associated jets, and the transverse momentum of the leading associated jet are measured. A new set of cross section measurements in mutually exclusive categories targeted to identify production mechanisms and kinematical features of the events is presented. The results are in agreement with the SM predictions

Measurement of the Y(1S) pair production cross section and search for resonances decaying to Y(1S)μ⁺μ⁻ in proton-proton collisions at √s = 13 TeV

The fiducial cross section for Y(1S)pair production in proton-proton collisions at a center-of-mass energy of 13TeVin the region where both Y(1S)mesons have an absolute rapidity below 2.0 is measured to be 79 ± 11 (stat) ±6 (syst) ±3 (B)pbassuming the mesons are produced unpolarized. The last uncertainty corresponds to the uncertainty in the Y(1S)meson dimuon branching fraction. The measurement is performed in the final state with four muons using proton-proton collision data collected in 2016 by the CMS experiment at the LHC, corresponding to an integrated luminosity of 35.9fb$^{-1}$. This process serves as a standard model reference in a search for narrow resonances decaying to Y(1S)μ$^{+}$μ$^{-}$ in the same final state. Such a resonance could indicate the existence of a tetraquark that is a bound state of two bquarks and two b̅ antiquarks. The tetraquark search is performed for masses in the vicinity of four times the bottom quark mass, between 17.5 and 19.5GeV, while a generic search for other resonances is performed for masses between 16.5 and 27GeV. No significant excess of events compatible with a narrow resonance is observed in the data. Limits on the production cross section times branching fraction to four muons via an intermediate Y(1S)resonance are set as a function of the resonance mass

Pileup mitigation at CMS in 13 TeV data

With increasing instantaneous luminosity at the LHC come additional reconstruction challenges. At high luminosity, many collisions occur simultaneously within one proton-proton bunch crossing. The isolation of an interesting collision from the additional "pileup" collisions is needed for effective physics performance. In the CMS Collaboration, several techniques capable of mitigating the impact of these pileup collisions have been developed. Such methods include charged-hadron subtraction, pileup jet identification, isospin-based neutral particle "δβ" correction, and, most recently, pileup per particle identification. This paper surveys the performance of these techniques for jet and missing transverse momentum reconstruction, as well as muon isolation. The analysis makes use of data corresponding to 35.9 fb$^{-1}$ collected with the CMS experiment in 2016 at a center-of-mass energy of 13 TeV. The performance of each algorithm is discussed for up to 70 simultaneous collisions per bunch crossing. Significant improvements are found in the identification of pileup jets, the jet energy, mass, and angular resolution, missing transverse momentum resolution, and muon isolation when using pileup per particle identification