A Study of an Indirect Reward on Multi-agent Environments

AbstractIn a multi-agent learning where multiple agents are learning, there is a problem about an indirect reward that is how to distribute a reward to an agent that does not obtain a reward directly. We have shown the theorem [3] about “negative effect” of an indirect reward. This paper focuses on the “positive effect” of an indirect reward such as an elimination of the perceptual aliasing problem [1]. First, we describe the relationship the theorem [3] and the “positive effect” of the indirect reward. Next, we propose a method to eliminate the perceptual aliasing problem and show the effectiveness of the proposed method by numerical examples

Clinical impact of the loss of chromosome 7q on outcomes of patients with myelodysplastic syndromes treated with allogeneic hematopoietic stem cell transplantation

We conducted a nationwide retrospective study to evaluate the prognostic influence of +1, der(1;7)(q10;p10) [hereafter der(1;7)] and ?7/del(7q) after allogeneic hematopoietic stem cell transplantation (allo-HSCT) for de novo myelodysplastic syndromes (MDS). In this database, 69 MDS patients with der(1;7), 75 with ?7/del(7q), and 511 with normal karyotype (NK) underwent allo-HSCT at advanced disease status. The 3-year overall survival (OS) and cumulative incidence of relapse (CIR) were 50.4 and 19.4% for those with der(1;7), 36.2 and 38.4% for ?7/del(7q),and 51.1 and 20.7% for NK, respectively. In the multivariate analysis, the presence of ?7/del(7q) correlated with a significantly shorter OS (HR [95% CI], 1.38 [1.00?1.89]; P = 0.048) and higher CIR (HR, 2.11 [1.36?3.28]; P = 0.001) than those with NK. There were 23 patients with der(1;7), 29 with ?7/del(7q), and 347 with NK who underwent allo-HSCT at early disease status.The 3-year OS and CIR were as follows: 47.3 and 9.5% for the der(1;7) group, 70.5 and 13.8% for ?7/del(7q), and 70.9 and 5.6% for NK,respectively. No significant differences were observed in OS and CIR among three groups. The impact of the loss of chromosome 7q on OS and CIR may differ based on its type and disease status after allo-HSCT for MDS