Strategies for Using Proximal Policy Optimization in Mobile Puzzle Games

While traditionally a labour intensive task, the testing of game content is progressively becoming more automated. Among the many directions in which this automation is taking shape, automatic play-testing is one of the most promising thanks also to advancements of many supervised and reinforcement learning (RL) algorithms. However these type of algorithms, while extremely powerful, often suffer in production environments due to issues with reliability and transparency in their training and usage. In this research work we are investigating and evaluating strategies to apply the popular RL method Proximal Policy Optimization (PPO) in a casual mobile puzzle game with a specific focus on improving its reliability in training and generalization during game playing. We have implemented and tested a number of different strategies against a real-world mobile puzzle game (Lily's Garden from Tactile Games). We isolated the conditions that lead to a failure in either training or generalization during testing and we identified a few strategies to ensure a more stable behaviour of the algorithm in this game genre.Comment: 10 pages, 8 figures, to be published in 2020 Foundations of Digital Games conferenc

World Health Organization cardiovascular disease risk charts: revised models to estimate risk in 21 global regions

BACKGROUND: To help adapt cardiovascular disease risk prediction approaches to low-income and middle-income countries, WHO has convened an effort to develop, evaluate, and illustrate revised risk models. Here, we report the derivation, validation, and illustration of the revised WHO cardiovascular disease risk prediction charts that have been adapted to the circumstances of 21 global regions. METHODS: In this model revision initiative, we derived 10-year risk prediction models for fatal and non-fatal cardiovascular disease (ie, myocardial infarction and stroke) using individual participant data from the Emerging Risk Factors Collaboration. Models included information on age, smoking status, systolic blood pressure, history of diabetes, and total cholesterol. For derivation, we included participants aged 40-80 years without a known baseline history of cardiovascular disease, who were followed up until the first myocardial infarction, fatal coronary heart disease, or stroke event. We recalibrated models using age-specific and sex-specific incidences and risk factor values available from 21 global regions. For external validation, we analysed individual participant data from studies distinct from those used in model derivation. We illustrated models by analysing data on a further 123 743 individuals from surveys in 79 countries collected with the WHO STEPwise Approach to Surveillance. FINDINGS: Our risk model derivation involved 376 177 individuals from 85 cohorts, and 19 333 incident cardiovascular events recorded during 10 years of follow-up. The derived risk prediction models discriminated well in external validation cohorts (19 cohorts, 1 096 061 individuals, 25 950 cardiovascular disease events), with Harrell's C indices ranging from 0·685 (95% CI 0·629-0·741) to 0·833 (0·783-0·882). For a given risk factor profile, we found substantial variation across global regions in the estimated 10-year predicted risk. For example, estimated cardiovascular disease risk for a 60-year-old male smoker without diabetes and with systolic blood pressure of 140 mm Hg and total cholesterol of 5 mmol/L ranged from 11% in Andean Latin America to 30% in central Asia. When applied to data from 79 countries (mostly low-income and middle-income countries), the proportion of individuals aged 40-64 years estimated to be at greater than 20% risk ranged from less than 1% in Uganda to more than 16% in Egypt. INTERPRETATION: We have derived, calibrated, and validated new WHO risk prediction models to estimate cardiovascular disease risk in 21 Global Burden of Disease regions. The widespread use of these models could enhance the accuracy, practicability, and sustainability of efforts to reduce the burden of cardiovascular disease worldwide. FUNDING: World Health Organization, British Heart Foundation (BHF), BHF Cambridge Centre for Research Excellence, UK Medical Research Council, and National Institute for Health Research

Localization of a Gene for Peripheral Arterial Occlusive Disease to Chromosome 1p31

Peripheral arterial occlusive disease (PAOD) results from atherosclerosis of large and medium peripheral arteries, as well as the aorta, and has many risk factors, including smoking, diabetes, hypertension, and hyperlipidemia. PAOD often coexists with coronary artery disease and cerebrovascular disease. Cross-matching a population-based list of Icelandic patients with PAOD who had undergone angiography and/or revascularization procedures with a genealogy database of the entire Icelandic nation defined 116 extended families containing 272 patients. A genomewide scan with microsatellite markers revealed significant linkage to chromosome 1p31 with an allele-sharing LOD score of 3.93 (P=1.04×10(-5)). We designate this locus as “PAOD1.” Subtracting 35 patients with a history of stroke increased the LOD score to 4.93. This suggests that, although PAOD and other vascular diseases share risk factors, genetic factors specific to subtypes of vascular disease may exist