49 research outputs found

    Learning partner selection rules that sustain cooperation in social dilemmas with the option of opting out

    Get PDF
    We study populations of self-interested agents playing a 2-person repeated Prisoner’s Dilemma game, with each player having the option of opting out of the interaction and choosing to be randomly assigned to another partner instead. The partner selection component makes these games akin to random matching, where defection is known to take over the entire population. Results in the literature have shown that, when forcing agents to obey a set partner selection rule known as Out-for-Tat, where defectors are systematically being broken ties with, cooperation can be sustained in the long run. In this paper, we remove this assumption and study agents that learn both action- and partner-selection strategies. Through multiagent reinforcement learning, we show that cooperation can be sustained without forcing agents to play predetermined strategies. Our simulations show that agents are capable of learning in-game strategies by themselves, such as Tit-for-Tat. What is more, they are also able to simultaneously discover cooperation-sustaining partner selection rules, notably Out-for-Tat, as well as other new rules that make cooperation prevail

    The stochastic evolutionary dynamics of softmax policy gradient in games

    Get PDF
    The theoretical underpinnings of multi-agent learning have recently attracted much attention. In this paper, we study the learning dynamics of the softmax policy gradient (PG) algorithm in multi-agent environments in the context of evolutionary game theory. We revisit the previous analyses based on mean dynamics and observe that previous models fail to characterize the effect of stochasticity. To this end, we propose a stochastic dynamics model to analyse the learning dynamics of PG under symmetric games. We model the parameter dynamics of the learning agent as a multidimensional Wiener process. Applying the Itô’s lemma, we obtain the corresponding policy dynamics for the agent. From that, we study the convergence behaviour of the policy dynamics under the self-play training scheme for learning in games. We work out the suffcient conditions for the stochastic stability of the pure Nash equilibrium strategy, and we evaluate the suffcient conditions for the existence of stationary distribution for strictly stable games. Moreover, we express the dynamics of the parameter distribution with the Fokker-Planck equation. In the experiments, we demonstrate that our stochastic dynamics model always provides a significantly more accurate description of the actual learning dynamics than the mean dynamics model across different games and settings

    Phenomic analysis of chronic granulomatous disease reveals more severe integumentary infections in X-Linked compared with autosomal recessive chronic granulomatous disease

    Get PDF
    BACKGROUND : Chronic granulomatous disease (CGD) is an inborn error of immunity (IEI), characterised by recurrent bacterial and fungal infections. It is inherited either in an Xlinked (XL) or autosomal recessive (AR) mode. Phenome refers to the entire set of phenotypes expressed, and its study allows us to generate new knowledge of the disease. The objective of the study is to reveal the phenomic differences between XL and AR-CGD by using Human Phenotype Ontology (HPO) terms. METHODS : We collected data on 117 patients with genetically diagnosed CGD from Asia and Africa referred to the Asian Primary Immunodeficiency Network (APID network). Only 90 patients with sufficient clinical information were included for phenomic analysis. We used HPO terms to describe all phenotypes manifested in the patients. RESULTS : XL-CGD patients had a lower age of onset, referral, clinical diagnosis, and genetic diagnosis compared with AR-CGD patients. The integument and central nervous system were more frequently affected in XL-CGD patients. Regarding HPO terms, perianal abscess, cutaneous abscess, and elevated hepatic transaminase were correlated with XL-CGD. A higher percentage of XL-CGD patients presented with BCGitis/BCGosis as their first manifestation. Among our CGD patients, lung was the most frequently infected organ, with gastrointestinal system and skin ranking second and third, respectively. Aspergillus species, Mycobacterium bovis, and Mycobacteirum tuberculosis were the most frequent pathogens to be found. CONCLUSION : Phenomic analysis confirmed that XL-CGD patients have more recurrent and aggressive infections compared with AR-CGD patients. Various phenotypic differences listed out can be used as clinical handles to distinguish XL or AR-CGD based on clinical features.The Society for Relief of Disabled Children and Jeffrey Modell Foundation.https://www.frontiersin.org/journals/immunologydm2022Paediatrics and Child Healt

    Robust estimation of bacterial cell count from optical density

    Get PDF
    Optical density (OD) is widely used to estimate the density of cells in liquid culture, but cannot be compared between instruments without a standardized calibration protocol and is challenging to relate to actual cell count. We address this with an interlaboratory study comparing three simple, low-cost, and highly accessible OD calibration protocols across 244 laboratories, applied to eight strains of constitutive GFP-expressing E. coli. Based on our results, we recommend calibrating OD to estimated cell count using serial dilution of silica microspheres, which produces highly precise calibration (95.5% of residuals <1.2-fold), is easily assessed for quality control, also assesses instrument effective linear range, and can be combined with fluorescence calibration to obtain units of Molecules of Equivalent Fluorescein (MEFL) per cell, allowing direct comparison and data fusion with flow cytometry measurements: in our study, fluorescence per cell measurements showed only a 1.07-fold mean difference between plate reader and flow cytometry data

    張永霖看世界 (2004年7月31日)

    Full text link
    由電台節目主持人張永霖及孔祥馨於香港電台第一台節目《張永霖看世界》內,與5位嶺南大學生伍穎彤 (Grace)、梁澤渝、黃德威、莊展寧 (Emily)、和何仲曦 (Johnny) 一起討論日本文化及分享他們對日本民族、生活時事等的看法

    Elastic modulus of muscle and tendon with shear wave ultrasound elastography: variations with different technical settings.

    Get PDF
    Standardization on Shear wave ultrasound elastography (SWUE) technical settings will not only ensure that the results are accurate, but also detect any differences over time that may be attributed to true physiological changes. The present study evaluated the variations of elastic modulus of muscle and tendon using SWUE when different technical aspects were altered. The results of this study indicated that variations of elastic modulus of muscle and tendon were found when different transducer's pressure and region of interest (ROI)'s size were applied. No significant differences in elastic modulus of the rectus femoris muscle and patellar tendon were found with different acquisition times of the SWUE sonogram. The SWUE on the muscle and tendon should be performed with the lightest transducer's pressure, a shorter acquisition time for the SWUE sonogram, while measuring the mean elastic modulus regardless the ROI's size
    corecore