Competing for Shareable Arms in Multi-Player Multi-Armed Bandits

Competitions for shareable and limited resources have long been studied with strategic agents. In reality, agents often have to learn and maximize the rewards of the resources at the same time. To design an individualized competing policy, we model the competition between agents in a novel multi-player multi-armed bandit (MPMAB) setting where players are selfish and aim to maximize their own rewards. In addition, when several players pull the same arm, we assume that these players averagely share the arms' rewards by expectation. Under this setting, we first analyze the Nash equilibrium when arms' rewards are known. Subsequently, we propose a novel SelfishMPMAB with Averaging Allocation (SMAA) approach based on the equilibrium. We theoretically demonstrate that SMAA could achieve a good regret guarantee for each player when all players follow the algorithm. Additionally, we establish that no single selfish player can significantly increase their rewards through deviation, nor can they detrimentally affect other players' rewards without incurring substantial losses for themselves. We finally validate the effectiveness of the method in extensive synthetic experiments.Comment: ICML 202

Rethinking the Evaluation Protocol of Domain Generalization

Domain generalization aims to solve the challenge of Out-of-Distribution (OOD) generalization by leveraging common knowledge learned from multiple training domains to generalize to unseen test domains. To accurately evaluate the OOD generalization ability, it is necessary to ensure that test data information is unavailable. However, the current domain generalization protocol may still have potential test data information leakage. This paper examines the potential risks of test data information leakage in two aspects of the current protocol: pretraining on ImageNet and oracle model selection. We propose that training from scratch and using multiple test domains would result in a more precise evaluation of OOD generalization ability. We also rerun the algorithms with the modified protocol and introduce a new leaderboard to encourage future research in domain generalization with a fairer comparison

High serum total cholesterol levels is a risk factor of ischemic stroke for general Japanese population: The JPHC study

Background:High serum total cholesterol levels represent a risk factor of ischemic stroke in Western countries. However, this association has not been thoroughly investigated in Asian populations where the incidence of stroke is high.Methods:Participants were 11,727 men and 21,742 women aged 40–69 years, all free of cardiovascular disease and cancer at baseline. During the median 12-year follow-up, we documented 612 ischemic stroke (293 lacunar infarction, 107 large-artery occlusive infarctions, and 168 embolic infarctions).Results:Excess risk of ischemic stroke was observed in men with serum total cholesterol levels of ≥6.21 mmol/L than those with the lowest category (<4.65 mmol/L), but not in women. The multivariable hazard ratios (HRs) and 95% confidence interval (95% CI) were 1.63 (1.14–2.35) for men and 1.03 (0.69–1.55) for women. The corresponding HRs of large-artery occlusive infarction were 2.86 (1.31–6.27) for men and 0.75 (0.28–2.01) for women. Serum total cholesterol levels were not associated with risk of lacunar or embolic infarction for either sex.Conclusions:High serum total cholesterol is a risk factor of ischemic stroke, specifically large-artery occlusive infarction for Japanese men

Alpha-adducin G460W polymorphism, urinary sodium excretion, and blood pressure in community-based samples

BackgroundThere is limited evidence on the gene–environmental interaction among α-adducin G460W gene polymorphism, sodium intake, and blood pressure (BP) levels in a general population. One hypothesis is that the association between G460W polymorphism and BP is more evident among persons with higher sodium intake than those with lower sodium intake.MethodsWe conducted a population-based cross-sectional study of 2823 men and women aged 30 to 74 years in a Japanese rural community to examine the association of the α-adducin G460W polymorphism with BP levels stratified by salt intake, as estimated by 24-h urine collection and dietary questionnaire.ResultsThere was no difference in systolic or diastolic BP levels among the GG, GW, and WW groups for women, but for men, mean systolic BP tended to be higher in the WW group than in the GG group. When we stratified men according to sodium excretion/intake, mean systolic BP was significantly higher in the WW group than in the GG group among men with higher urinary sodium excretion (138.8 v 133.6 mm Hg, P = .02) and tended to be higher among men with higher previous sodium intake. No genetic association was found among women or among men with lower urinary sodium excretion or lower sodium intake.ConclusionsThe α-adducin WW genotype was associated with higher systolic BP among men with a higher sodium intake

Vascular Dysfunction in Patients with Chronic Arsenosis Can Be Reversed by Reduction of Arsenic Exposure

Chronic arsenic exposure causes vascular diseases associated with systematic dysfunction of endogenous nitric oxide. Replacement of heavily arsenic-contaminated drinking water with low-arsenic water is a potential intervention strategy for arsenosis, although the reversibility of arsenic intoxication has not established. In the present study, we examined urinary excretion of cyclic guanosine 3′,5′-monophosphate (cGMP), a second messenger of the vasoactive effects of nitric oxide, and signs and symptoms for peripheral vascular function in 54 arsenosis patients before and after they were supplied with low-arsenic drinking water in an endemic area of chronic arsenic poisoning in Inner Mongolia, China. The arsenosis patients showed a marked decrease in urinary excretion of cGMP (mean ± SEM: male, 37.0 ± 6.1; female, 37.2 ± 5.4 nmol/mmol creatinine), and a 13-month period of consuming low-arsenic drinking water reversed this trend (male, 68.0 ± 5.6; female, 70.6 ± 3.0 nmol/mmol creatinine) and improved peripheral vascular response to cold stress. Our intervention study indicates that peripheral vascular disease in arsenosis patients can be reversed by exposure cessation and has important implications for the public health approach to arsenic exposure

Association between markers of arterial stiffness and atrial fibrillation in the Circulatory Risk in Communities Study (CIRCS).

Background and aims:Limited evidence is available on the association between markers of arterial stiffness and the prevalence of atrial fibrillation among Asian populations. Therefore, we examined those associations in the Japanese population.Methods:We conducted a cross-sectional population-based study of 4264 men and women aged 40-79 years. The augmentation index (AI), a marker of arterial stiffness, was calculated as the ratio of central pulse pressure/brachial pulse pressure, where the AI and central aortic pressure were measured by an automated tonometer: the HEM-9000AI device (Omron Healthcare co., Kyoto, Japan). Atrial fibrillation was estimated by the Minnesota codes using resting electrocardiograph (ECG).Results:The prevalence of atrial fibrillation and total arrhythmia were higher with larger AI values. These associations did not change after adjustment for known cardiovascular risk factors. The multivariable odd ratios (95% confidence intervals) in the highest versus lowest tertiles of AI were 3.4 (1.4-8.6, p for trend = 0.008) for atrial fibrillation and 1.8 (1.2-2.7, p for trend = 0.004) for total arrhythmia. There was no association of central or brachial pulse pressure levels with the prevalence of atrial fibrillation or total arrhythmia.ConclusionAI values, but not brachial or central pulse pressures, were positively associated with the prevalence of atrial fibrillation and total arrhythmia, independent of cardiovascular risk factors

Association of cigarette smoking with radial augmentation index: the Circulatory Risk in Communities Study (CIRCS)

This study aimed to assess the association of cigarette smoking with radial augmentation index among the Asian general population. We conducted a cross-sectional population-based study including 1593 men and 2671 women aged 40–79 years. Smoking status was ascertained through interviews, and the number of pack-years was calculated. The radial augmentation index was defined as the ratio of central pulse pressure to brachial pulse pressure, as measured using an automated tonometer: the HEM-9000AI (Omron Healthcare co., Kyoto, Japan). There was a higher prevalence of an increased radial augmentation index among current male smokers who smoked ≥ 30 cigarettes/day and all female smokers than among never smokers. After adjusting for known risk factors of atherosclerosis, the multivariable odds ratio (OR) [95% confidence interval (CI)] for a high radial augmentation index for current male smokers who smoked ≥30 cigarettes/day compared with never smokers was 1.9 (1.1–3.4). The multivariable OR (95% CI) for a high radial augmentation index for former female smokers and current female smokers compared with never smokers was 1.8 (1.2–2.7) and 2.5 (1.6–3.9), respectively. Moreover, smoking pack-years was positively associated with a high radial augmentation index in both sexes. There were no relationship between smoking status and high central or brachial pulse pressures among subjects of either sex. In conclusion, cigarette smoking and cumulative smoking exposure were positively associated with an increased radial augmentation index in men who smoked heavily and in women

Expression profiles of microRNAs in skeletal muscle of sheep by deep sequencing

Objective MicroRNAs are a class of endogenous small regulatory RNAs that regulate cell proliferation, differentiation and apoptosis. Recent studies on miRNAs are mainly focused on mice, human and pig. However, the studies on miRNAs in skeletal muscle of sheep are not comprehensive. Methods RNA-seq technology was used to perform genomic analysis of miRNAs in prenatal and postnatal skeletal muscle of sheep. Targeted genes were predicted using miRanda software and miRNA-mRNA interactions were verified by quantitative real-time polymerase chain reaction. To further investigate the function of miRNAs, candidate targeted genes were enriched for analysis using gene ontology (GO) and Kyoto encyclopedia of genes and genomes (KEGG) enrichment. Results The results showed total of 1,086 known miRNAs and 40 new candidate miRNAs were detected in prenatal and postnatal skeletal muscle of sheep. In addition, 345 miRNAs (151 up-regulated, 94 down-regulated) were differentially expressed. Moreover, miRanda software was performed to predict targeted genes of miRNAs, resulting in a total of 2,833 predicted targets, especially miR-381 which targeted multiple muscle-related mRNAs. Furthermore, GO and KEGG pathway analysis confirmed that targeted genes of miRNAs were involved in development of skeletal muscles. Conclusion This study supplements the miRNA database of sheep, which provides valuable information for further study of the biological function of miRNAs in sheep skeletal muscle