Scale-free memory model for multiagent reinforcement learning. Mean field approximation and rock-paper-scissors dynamics

A continuous time model for multiagent systems governed by reinforcement learning with scale-free memory is developed. The agents are assumed to act independently of one another in optimizing their choice of possible actions via trial-and-error search. To gain awareness about the action value the agents accumulate in their memory the rewards obtained from taking a specific action at each moment of time. The contribution of the rewards in the past to the agent current perception of action value is described by an integral operator with a power-law kernel. Finally a fractional differential equation governing the system dynamics is obtained. The agents are considered to interact with one another implicitly via the reward of one agent depending on the choice of the other agents. The pairwise interaction model is adopted to describe this effect. As a specific example of systems with non-transitive interactions, a two agent and three agent systems of the rock-paper-scissors type are analyzed in detail, including the stability analysis and numerical simulation. Scale-free memory is demonstrated to cause complex dynamics of the systems at hand. In particular, it is shown that there can be simultaneously two modes of the system instability undergoing subcritical and supercritical bifurcation, with the latter one exhibiting anomalous oscillations with the amplitude and period growing with time. Besides, the instability onset via this supercritical mode may be regarded as "altruism self-organization". For the three agent system the instability dynamics is found to be rather irregular and can be composed of alternate fragments of oscillations different in their properties.Comment: 17 pages, 7 figur

Detection of Borrelia-specific 16S rRNA sequence in total RNA extracted from Ixodes ricinus ticks

A reverse transcriptase - polymerase chain reaction based assay for Borrelia species detection in ticks was developed. The method was based on amplification of 552 nucleotide bases long sequence of 16S rRNA, targeted by Borrelia specific primers. In the present study, total RNA extracted from Ixodes ricinus ticks was used as template. The results showed higher sensitivity for Borrelia detection as compared to standard dark-field microscopy. Method specificity was confirmed by cloning and sequencing of obtained 552 base pairs long amplicons. Phylogenetic analysis of obtained sequences showed that they belong to B. lusitaniae and B. afzelii genospecies. RT-PCR based method presented in this paper could be very useful as a screening test for detecting pathogen presence, especially when in investigations is required extraction of total RNA from ticks

The influence of media violence on youth

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/83429/1/2003.Anderson_etal.InfluenceofMediaViolenceonYouth.PsychologicalScienceinthePublicInterest.pd

Whole-genome sequencing reveals host factors underlying critical COVID-19

Critical COVID-19 is caused by immune-mediated inflammatory lung injury. Host genetic variation influences the development of illness requiring critical care1 or hospitalization2,3,4 after infection with SARS-CoV-2. The GenOMICC (Genetics of Mortality in Critical Care) study enables the comparison of genomes from individuals who are critically ill with those of population controls to find underlying disease mechanisms. Here we use whole-genome sequencing in 7,491 critically ill individuals compared with 48,400 controls to discover and replicate 23 independent variants that significantly predispose to critical COVID-19. We identify 16 new independent associations, including variants within genes that are involved in interferon signalling (IL10RB and PLSCR1), leucocyte differentiation (BCL11A) and blood-type antigen secretor status (FUT2). Using transcriptome-wide association and colocalization to infer the effect of gene expression on disease severity, we find evidence that implicates multiple genes—including reduced expression of a membrane flippase (ATP11A), and increased expression of a mucin (MUC1)—in critical disease. Mendelian randomization provides evidence in support of causal roles for myeloid cell adhesion molecules (SELE, ICAM5 and CD209) and the coagulation factor F8, all of which are potentially druggable targets. Our results are broadly consistent with a multi-component model of COVID-19 pathophysiology, in which at least two distinct mechanisms can predispose to life-threatening disease: failure to control viral replication; or an enhanced tendency towards pulmonary inflammation and intravascular coagulation. We show that comparison between cases of critical illness and population controls is highly efficient for the detection of therapeutically relevant mechanisms of disease

Planning and Implementation Intention Interventions

This chapter provides resources and best-practice guidelines for planning interventions that have broad application to behaviors of everyday living. An overview of the theory and context for why planning is important to behavior change with a focus on current evidence is provided. Key definitions and research evidence of various planning concepts and techniques – action and preparatory planning, implementations intentions, and coping planning – are outlined. Subsequently, instructions are provided on how people can formulate effective planning interventions with examples of behaviors from various relevant prosocial, health, academic, and business contexts. Finally, current evidence and theory are provided with guidance on the types of planning interventions that may work in specific contexts and conditions, and on the moderators that may influence the effectiveness of each approach. Each section includes further details that are provided with worked examples of resources to use based on prior research and various modes of delivery (e.g., face-to-face, website, wearable devices)