Scale-free memory model for multiagent reinforcement learning. Mean field approximation and rock-paper-scissors dynamics

A continuous time model for multiagent systems governed by reinforcement learning with scale-free memory is developed. The agents are assumed to act independently of one another in optimizing their choice of possible actions via trial-and-error search. To gain awareness about the action value the agents accumulate in their memory the rewards obtained from taking a specific action at each moment of time. The contribution of the rewards in the past to the agent current perception of action value is described by an integral operator with a power-law kernel. Finally a fractional differential equation governing the system dynamics is obtained. The agents are considered to interact with one another implicitly via the reward of one agent depending on the choice of the other agents. The pairwise interaction model is adopted to describe this effect. As a specific example of systems with non-transitive interactions, a two agent and three agent systems of the rock-paper-scissors type are analyzed in detail, including the stability analysis and numerical simulation. Scale-free memory is demonstrated to cause complex dynamics of the systems at hand. In particular, it is shown that there can be simultaneously two modes of the system instability undergoing subcritical and supercritical bifurcation, with the latter one exhibiting anomalous oscillations with the amplitude and period growing with time. Besides, the instability onset via this supercritical mode may be regarded as "altruism self-organization". For the three agent system the instability dynamics is found to be rather irregular and can be composed of alternate fragments of oscillations different in their properties.Comment: 17 pages, 7 figur

Alteration in the plasma concentration of a DAAO inhibitor, 3-methylpyrazole-5-carboxylic acid, in the ketamine-treated rats and the influence on the pharmacokinetics of plasma d-tryptophan

A determination method for 3-methylpyrazole-5-carboxylic acid (MPC), an inhibitor of d-amino acid oxidase (DAAO), in rat plasma was developed by using high-performance liquid chromatography-mass spectrometry (LC-MS). The structural isomer of MPC, 3-methylpyrazole-4-carboxylic acid, was used as an internal standard, and the intra- and inter-day accuracies and precisions were satisfactory for the determination of plasma MPC

Incised valley paleoenvironments interpreted by seismic stratigraphic approach in Patos Lagoon, Southern Brazil

<div><p>ABSTRACT: The Rio Grande do Sul (RS) coastal plain area (33,000 km 2 ) had its physiography modified several times through the Quaternary, responding to allogenic and autogenic forcings. The Patos Lagoon covers a significant area of RS coastal plain (10,000 km 2 ), where incised valleys were identified in previous works. About 1,000 km of high resolution (3.5 kHz) seismic profiles, radiocarbon datings, Standard Penetration Test (SPT) and gravity cores were analyzed to interpret the paleoenvironmental evolution as preserved in incised valley infills. Seismic facies were recognized by seismic parameters. The sediment cores were used to ground-truth the seismic interpretations and help in the paleoenvironmental identification. Key surfaces were established to detail the stratigraphical framework, and seismic facies were grouped into four seismic units, which one classified in respective system tracts within three depositional sequences. The oldest preserved deposits are predominantly fluvial and estuarine facies, representing the falling stage and lowstand system tracts. The Holocene transgressive records are dominated by muddy material, mainly represented by estuarine facies with local variations. The transgression culminated in Late Holocene deposits of Patos Lagoon, representing the highstand system tract. The depositional pattern of the vertical succession was controlled by eustatic variations, while the autogenic forcing (paleogeography and sediment supply) modulated the local facies variation.</p></div

Horizontal Branch Stars: The Interplay between Observations and Theory, and Insights into the Formation of the Galaxy

We review HB stars in a broad astrophysical context, including both variable and non-variable stars. A reassessment of the Oosterhoff dichotomy is presented, which provides unprecedented detail regarding its origin and systematics. We show that the Oosterhoff dichotomy and the distribution of globular clusters (GCs) in the HB morphology-metallicity plane both exclude, with high statistical significance, the possibility that the Galactic halo may have formed from the accretion of dwarf galaxies resembling present-day Milky Way satellites such as Fornax, Sagittarius, and the LMC. A rediscussion of the second-parameter problem is presented. A technique is proposed to estimate the HB types of extragalactic GCs on the basis of integrated far-UV photometry. The relationship between the absolute V magnitude of the HB at the RR Lyrae level and metallicity, as obtained on the basis of trigonometric parallax measurements for the star RR Lyrae, is also revisited, giving a distance modulus to the LMC of (m-M)_0 = 18.44+/-0.11. RR Lyrae period change rates are studied. Finally, the conductive opacities used in evolutionary calculations of low-mass stars are investigated. [ABRIDGED]Comment: 56 pages, 22 figures. Invited review, to appear in Astrophysics and Space Scienc

The making of English cricket cultures: Empire, globalization and (post) colonialism

The aim of this article is to understand how English cricket cultures have been made, negotiated and, ultimately, resisted in the context of (post) colonialism. I draw upon research undertaken with white and British Asian cricketers in Yorkshire to identify the place and significance of cricket within the everyday lives of British Asian communities. Over the last decade the number of British Asian cricketers progressing into the upper echelons of the game (mainly the English County Championship) has increased. Many within the game (mainly white people) have used these figures to argue that English cricket is now 'colour blind'. However, I argue that representation is not the equivalent to acceptance and integration, and present evidence to suggest that racial prejudice and discrimination, not to mention inaccurate and essentialized cultural stereotypes of British Asian cricketers, remain firmly and routinely embedded in aspects of the sport at all levels. I argue that the ability of British Asians to resist the hegemonic structures of white 'Englishness', by asserting their own distinctive post-colonial identities in cricket, is paramount to their everyday negotiations of power and racism. © 2011 Taylor & Francis

Physics of Solar Prominences: I - Spectral Diagnostics and Non-LTE Modelling

This review paper outlines background information and covers recent advances made via the analysis of spectra and images of prominence plasma and the increased sophistication of non-LTE (ie when there is a departure from Local Thermodynamic Equilibrium) radiative transfer models. We first describe the spectral inversion techniques that have been used to infer the plasma parameters important for the general properties of the prominence plasma in both its cool core and the hotter prominence-corona transition region. We also review studies devoted to the observation of bulk motions of the prominence plasma and to the determination of prominence mass. However, a simple inversion of spectroscopic data usually fails when the lines become optically thick at certain wavelengths. Therefore, complex non-LTE models become necessary. We thus present the basics of non-LTE radiative transfer theory and the associated multi-level radiative transfer problems. The main results of one- and two-dimensional models of the prominences and their fine-structures are presented. We then discuss the energy balance in various prominence models. Finally, we outline the outstanding observational and theoretical questions, and the directions for future progress in our understanding of solar prominences.Comment: 96 pages, 37 figures, Space Science Reviews. Some figures may have a better resolution in the published version. New version reflects minor changes brought after proof editin

External applicability of the Effect of ticagrelor on Health Outcomes in diabEtes Mellitus patients Intervention Study (THEMIS) trial: An analysis of patients with diabetes and coronary artery disease in the REduction of Atherothrombosis for Continued Health (REACH) registry

Aims: THEMIS is a double-blind, randomized trial of 19,220 patients with diabetes mellitus and stable coronary artery disease (CAD) comparing ticagrelor to placebo, in addition to aspirin. The present study aimed to describe the proportion of patients eligible and reasons for ineligibility for THEMIS within a population of patients with diabetes and CAD included in the Reduction of Atherothrombosis for Continued Health (REACH) registry. Methods and results: The THEMIS eligibility criteria were applied to REACH patients. THEMIS included patients ≥50 years with type 2 diabetes and stable CAD as determined by either a history of previous percutaneous coronary intervention, coronary artery bypass grafting, or documentation of angiographic stenosis of ≥50% of at least one coronary artery. Patients with prior myocardial infarction or stroke were excluded. In REACH, 10,156 patients had stable CAD and diabetes. Of these, 6515 (64.1%) patients had at least one exclusion criteria. From the remaining population, 784 patients did not meet inclusion criteria (7.7%) mainly due to absence of aspirin treatment (7.2%), yielding a ‘THEMIS-eligible population’ of 2857 patients (28.1% of patients with diabetes and stable CAD). The main reasons for exclusion were a history of myocardial infarction (53.1%), use of oral anticoagulation (14.5%), or history of stroke (12.9%). Among the 4208 patients with diabetes and a previous PCI, 1196 patients (28.4%) were eligible for inclusion in the THEMIS-PCI substudy. Conclusions: In a population of patients with diabetes and stable coronary artery disease, a sizeable proportion appear to be ‘THEMIS eligible.’ Clinical trial registration: http://www.clinicaltrials.gov identifier: NCT0199179

Measurement of the Bottom-Strange Meson Mixing Phase in the Full CDF Data Set

We report a measurement of the bottom-strange meson mixing phase \beta_s using the time evolution of B0_s -> J/\psi (->\mu+\mu-) \phi (-> K+ K-) decays in which the quark-flavor content of the bottom-strange meson is identified at production. This measurement uses the full data set of proton-antiproton collisions at sqrt(s)= 1.96 TeV collected by the Collider Detector experiment at the Fermilab Tevatron, corresponding to 9.6 fb-1 of integrated luminosity. We report confidence regions in the two-dimensional space of \beta_s and the B0_s decay-width difference \Delta\Gamma_s, and measure \beta_s in [-\pi/2, -1.51] U [-0.06, 0.30] U [1.26, \pi/2] at the 68% confidence level, in agreement with the standard model expectation. Assuming the standard model value of \beta_s, we also determine \Delta\Gamma_s = 0.068 +- 0.026 (stat) +- 0.009 (syst) ps-1 and the mean B0_s lifetime, \tau_s = 1.528 +- 0.019 (stat) +- 0.009 (syst) ps, which are consistent and competitive with determinations by other experiments.Comment: 8 pages, 2 figures, Phys. Rev. Lett 109, 171802 (2012