Local Environment Poisoning Attacks on Federated Reinforcement Learning

Federated learning (FL) has become a popular tool for solving traditional Reinforcement Learning (RL) tasks. The multi-agent structure addresses the major concern of data-hungry in traditional RL, while the federated mechanism protects the data privacy of individual agents. However, the federated mechanism also exposes the system to poisoning by malicious agents that can mislead the trained policy. Despite the advantage brought by FL, the vulnerability of Federated Reinforcement Learning (FRL) has not been well-studied before. In this work, we propose a general framework to characterize FRL poisoning as an optimization problem and design a poisoning protocol that can be applied to policy-based FRL. Our framework can also be extended to FRL with actor-critic as a local RL algorithm by training a pair of private and public critics. We provably show that our method can strictly hurt the global objective. We verify our poisoning effectiveness by conducting extensive experiments targeting mainstream RL algorithms and over various RL OpenAI Gym environments covering a wide range of difficulty levels. Within these experiments, we compare clean and baseline poisoning methods against our proposed framework. The results show that the proposed framework is successful in poisoning FRL systems and reducing performance across various environments and does so more effectively than baseline methods. Our work provides new insights into the vulnerability of FL in RL training and poses new challenges for designing robust FRL algorithm

Targeting Unc51-like Autophagy Activating Kinase 1 (ULK1) Overcomes Adaptive Drug Resistance in Acute Myelogenous Leukemia

UNLABELLED: Despite effective new therapies, adaptive resistance remains the main obstacle in acute myelogenous leukemia (AML) therapy. Autophagy induction is a key mechanism for adaptive resistance. Leukemic blasts at diagnosis express higher levels of the apical autophagy kinase ULK1 compared with normal hematopoietic cells. Exposure to chemotherapy and targeted agents upregulate ULK1, hence we hypothesize that developing ULK1 inhibitors may present the unique opportunity for clinical translation of autophagy inhibition. Accordingly, we demonstrate that ULK1 inhibition, by genetic and pharmacologic means, suppresses treatment-induced autophagy, overcomes adaptive drug-resistance, and synergizes with chemotherapy and emerging antileukemia agents like venetoclax (ABT-199). The study next aims at exploring the underlying mechanisms. Mechanistically, ULK1 inhibition downregulates MCL1 antiapoptotic gene, impairs mitochondrial function and downregulates components of the CD44-xCT system, resulting in impaired reactive oxygen species (ROS) mitigation, DNA damage, and apoptosis. For further validation, several mouse models of AML were generated. In these mouse models, ULK1 deficiency impaired leukemic cell homing and engraftment, delayed disease progression, and improved survival. Therefore, in the study, we validated our hypothesis and identified ULK1 as an important mediator of adaptive resistance to therapy and an ideal candidate for combination therapy in AML. Therefore, we propose ULK1 inhibition as a therapeutically relevant treatment option to overcome adaptive drug-resistance in AML. IMPLICATIONS: ULK1 drives a cell-intrinsic adaptive resistance in AML and targeting ULK1-mediated autophagy can synergize with existing and emerging AML therapies to overcome drug-resistance and induce apoptosis

Impact of aprotinin and renal function on mortality: a retrospective single center analysis

<p>Abstract</p> <p>Background</p> <p>An estimated up to 7% of high-risk cardiac surgery patients return to the operating room for bleeding. Aprotinin was used extensively as an antifibrinolytic agent in cardiac surgery patients for over 15 years and it showed efficacy in reducing bleeding. Aprotinin was removed from the market by the U.S. Food and Drug Administration after a large prospective, randomized clinical trial documented an increased mortality risk associated with the drug. Further debate arose when a meta-analysis of 211 randomized controlled trials showed no risk of renal failure or death associated with aprotinin. However, only patients with normal kidney function have been studied.</p> <p>Methods</p> <p>In this study, we look at a single center clinical trial using patients with varying degrees of baseline kidney function to answer the question: Does aprotinin increase odds of death given varying levels of preoperative kidney dysfunction?</p> <p>Results</p> <p>Based on our model, aprotinin use was associated with a 3.8-fold increase in odds of death one year later compared to no aprotinin use with p-value = 0.0018, regardless of level of preoperative kidney dysfunction after adjusting for other perioperative variables.</p> <p>Conclusions</p> <p>Lessons learned from our experience using aprotinin in the perioperative setting as an antifibrinolytic during open cardiac surgery should guide us in testing future antifibrinolytic drugs for not only efficacy of preventing bleeding, but for overall safety to the whole organism using long-term clinical outcome studies, including those with varying degree of baseline kidney function.</p

The importance of left ventricular function for long-term outcome after primary percutaneous coronary intervention

<p>Abstract</p> <p>Background</p> <p>In the present study we sought to determine the long-term prognostic value of left ventricular ejection fraction (LVEF), assessed by planar radionuclide ventriculography (PRV), after ST-elevation myocardial infarction (STEMI) treated with primary percutaneous coronary intervention (PPCI).</p> <p>Methods</p> <p>In total 925 patients underwent PRV for LVEF assessment after PPCI for myocardial infarction before discharge from the hospital. PRV was performed with a standard dose of 500 Mbq of ^99mTc-pertechnetate. Average follow-up time was 2.5 years.</p> <p>Results</p> <p>Mean (± SD) age was 60 ± 12 years. Mean (± SD) LVEF was 45.7 ± 12.2 %. 1 year survival was 97.3 % and 3 year survival was 94.2 %. Killip class, multi vessel-disease, previous cardiovascular events, peak creatin kinase and its MB fraction, age and LVEF proved to be univariate predictors of mortality. When entered in a forward conditional Cox regression model age and LVEF were independent predictors of 1 and 3 year mortality.</p> <p>Conclusion</p> <p>LVEF assessed by PRV is a powerful independent predictor of long term mortality after PPCI for STEMI.</p

Early Markers of Glycaemic Control in Children with Type 1 Diabetes Mellitus

Background: Type 1 diabetes mellitus (T1DM) may lead to severe long-term health consequences. In a longitudinal study, we aimed to identify factors present at diagnosis and 6 months later that were associated with glycosylated haemoglobin (HbA 1c) levels at 24 months after T1DM diagnosis, so that diabetic children at risk of poor glycaemic control may be identified. Methods: 229 children,15 years of age diagnosed with T1DM in the Auckland region were studied. Data collected at diagnosis were: age, sex, weight, height, ethnicity, family living arrangement, socio-economic status (SES), T1DM antibody titre, venous pH and bicarbonate. At 6 and 24 months after diagnosis we collected data on weight, height, HbA 1c level, and insulin dose. Results: Factors at diagnosis that were associated with higher HbA1c levels at 6 months: female sex (p,0.05), lower SES (p,0.01), non-European ethnicity (p,0.01) and younger age (p,0.05). At 24 months, higher HbA1c was associated with lower SES (p,0.001), Pacific Island ethnicity (p,0.001), not living with both biological parents (p,0.05), and greater BMI SDS (p,0.05). A regression equation to predict HbA1c at 24 months was consequently developed. Conclusions: Deterioration in glycaemic control shortly after diagnosis in diabetic children is particularly marked in Pacific Island children and in those not living with both biological parents. Clinicians need to be aware of factors associated wit

Apoptosis of CD4+CD25high T Cells in Type 1 Diabetes May Be Partially Mediated by IL-2 Deprivation

from T1D subjects. in T1D may be caught up in a relatively deficient cytokine milieu. function in subjects predisposed to T1D

Repositioning of the global epicentre of non-optimal cholesterol

High blood cholesterol is typically considered a feature of wealthy western countries(1,2). However, dietary and behavioural determinants of blood cholesterol are changing rapidly throughout the world(3) and countries are using lipid-lowering medications at varying rates. These changes can have distinct effects on the levels of high-density lipoprotein (HDL) cholesterol and non-HDL cholesterol, which have different effects on human health(4,5). However, the trends of HDL and non-HDL cholesterol levels over time have not been previously reported in a global analysis. Here we pooled 1,127 population-based studies that measured blood lipids in 102.6 million individuals aged 18 years and older to estimate trends from 1980 to 2018 in mean total, non-HDL and HDL cholesterol levels for 200 countries. Globally, there was little change in total or non-HDL cholesterol from 1980 to 2018. This was a net effect of increases in low- and middle-income countries, especially in east and southeast Asia, and decreases in high-income western countries, especially those in northwestern Europe, and in central and eastern Europe. As a result, countries with the highest level of non-HDL cholesterol-which is a marker of cardiovascular riskchanged from those in western Europe such as Belgium, Finland, Greenland, Iceland, Norway, Sweden, Switzerland and Malta in 1980 to those in Asia and the Pacific, such as Tokelau, Malaysia, The Philippines and Thailand. In 2017, high non-HDL cholesterol was responsible for an estimated 3.9 million (95% credible interval 3.7 million-4.2 million) worldwide deaths, half of which occurred in east, southeast and south Asia. The global repositioning of lipid-related risk, with non-optimal cholesterol shifting from a distinct feature of high-income countries in northwestern Europe, north America and Australasia to one that affects countries in east and southeast Asia and Oceania should motivate the use of population-based policies and personal interventions to improve nutrition and enhance access to treatment throughout the world.Peer reviewe

Height and body-mass index trajectories of school-aged children and adolescents from 1985 to 2019 in 200 countries and territories: a pooled analysis of 2181 population-based studies with 65 million participants

Summary Background Comparable global data on health and nutrition of school-aged children and adolescents are scarce. We aimed to estimate age trajectories and time trends in mean height and mean body-mass index (BMI), which measures weight gain beyond what is expected from height gain, for school-aged children and adolescents. Methods For this pooled analysis, we used a database of cardiometabolic risk factors collated by the Non-Communicable Disease Risk Factor Collaboration. We applied a Bayesian hierarchical model to estimate trends from 1985 to 2019 in mean height and mean BMI in 1-year age groups for ages 5–19 years. The model allowed for non-linear changes over time in mean height and mean BMI and for non-linear changes with age of children and adolescents, including periods of rapid growth during adolescence. Findings We pooled data from 2181 population-based studies, with measurements of height and weight in 65 million participants in 200 countries and territories. In 2019, we estimated a difference of 20 cm or higher in mean height of 19-year-old adolescents between countries with the tallest populations (the Netherlands, Montenegro, Estonia, and Bosnia and Herzegovina for boys; and the Netherlands, Montenegro, Denmark, and Iceland for girls) and those with the shortest populations (Timor-Leste, Laos, Solomon Islands, and Papua New Guinea for boys; and Guatemala, Bangladesh, Nepal, and Timor-Leste for girls). In the same year, the difference between the highest mean BMI (in Pacific island countries, Kuwait, Bahrain, The Bahamas, Chile, the USA, and New Zealand for both boys and girls and in South Africa for girls) and lowest mean BMI (in India, Bangladesh, Timor-Leste, Ethiopia, and Chad for boys and girls; and in Japan and Romania for girls) was approximately 9–10 kg/m2. In some countries, children aged 5 years started with healthier height or BMI than the global median and, in some cases, as healthy as the best performing countries, but they became progressively less healthy compared with their comparators as they grew older by not growing as tall (eg, boys in Austria and Barbados, and girls in Belgium and Puerto Rico) or gaining too much weight for their height (eg, girls and boys in Kuwait, Bahrain, Fiji, Jamaica, and Mexico; and girls in South Africa and New Zealand). In other countries, growing children overtook the height of their comparators (eg, Latvia, Czech Republic, Morocco, and Iran) or curbed their weight gain (eg, Italy, France, and Croatia) in late childhood and adolescence. When changes in both height and BMI were considered, girls in South Korea, Vietnam, Saudi Arabia, Turkey, and some central Asian countries (eg, Armenia and Azerbaijan), and boys in central and western Europe (eg, Portugal, Denmark, Poland, and Montenegro) had the healthiest changes in anthropometric status over the past 3·5 decades because, compared with children and adolescents in other countries, they had a much larger gain in height than they did in BMI. The unhealthiest changes—gaining too little height, too much weight for their height compared with children in other countries, or both—occurred in many countries in sub-Saharan Africa, New Zealand, and the USA for boys and girls; in Malaysia and some Pacific island nations for boys; and in Mexico for girls. Interpretation The height and BMI trajectories over age and time of school-aged children and adolescents are highly variable across countries, which indicates heterogeneous nutritional quality and lifelong health advantages and risks

Contributions of mean and shape of blood pressure distribution to worldwide trends and variations in raised blood pressure: A pooled analysis of 1018 population-based measurement studies with 88.6 million participants

© The Author(s) 2018. Background: Change in the prevalence of raised blood pressure could be due to both shifts in the entire distribution of blood pressure (representing the combined effects of public health interventions and secular trends) and changes in its high-blood-pressure tail (representing successful clinical interventions to control blood pressure in the hypertensive population). Our aim was to quantify the contributions of these two phenomena to the worldwide trends in the prevalence of raised blood pressure. Methods: We pooled 1018 population-based studies with blood pressure measurements on 88.6 million participants from 1985 to 2016. We first calculated mean systolic blood pressure (SBP), mean diastolic blood pressure (DBP) and prevalence of raised blood pressure by sex and 10-year age group from 20-29 years to 70-79 years in each study, taking into account complex survey design and survey sample weights, where relevant. We used a linear mixed effect model to quantify the association between (probittransformed) prevalence of raised blood pressure and age-group- and sex-specific mean blood pressure. We calculated the contributions of change in mean SBP and DBP, and of change in the prevalence-mean association, to the change in prevalence of raised blood pressure. Results: In 2005-16, at the same level of population mean SBP and DBP, men and women in South Asia and in Central Asia, the Middle East and North Africa would have the highest prevalence of raised blood pressure, and men and women in the highincome Asia Pacific and high-income Western regions would have the lowest. In most region-sex-age groups where the prevalence of raised blood pressure declined, one half or more of the decline was due to the decline in mean blood pressure. Where prevalence of raised blood pressure has increased, the change was entirely driven by increasing mean blood pressure, offset partly by the change in the prevalence-mean association. Conclusions: Change in mean blood pressure is the main driver of the worldwide change in the prevalence of raised blood pressure, but change in the high-blood-pressure tail of the distribution has also contributed to the change in prevalence, especially in older age groups

Worldwide trends in underweight and obesity from 1990 to 2022: a pooled analysis of 3663 population-representative studies with 222 million children, adolescents, and adults

Background Underweight and obesity are associated with adverse health outcomes throughout the life course. We estimated the individual and combined prevalence of underweight or thinness and obesity, and their changes, from 1990 to 2022 for adults and school-aged children and adolescents in 200 countries and territories. Methods We used data from 3663 population-based studies with 222 million participants that measured height and weight in representative samples of the general population. We used a Bayesian hierarchical model to estimate trends in the prevalence of different BMI categories, separately for adults (age ≥20 years) and school-aged children and adolescents (age 5–19 years), from 1990 to 2022 for 200 countries and territories. For adults, we report the individual and combined prevalence of underweight (BMI &lt;18·5 kg/m2) and obesity (BMI ≥30 kg/m2). For school&#x2;aged children and adolescents, we report thinness (BMI &lt;2 SD below the median of the WHO growth reference) and obesity (BMI &gt;2 SD above the median). Findings From 1990 to 2022, the combined prevalence of underweight and obesity in adults decreased in 11 countries (6%) for women and 17 (9%) for men with a posterior probability of at least 0·80 that the observed changes were true decreases. The combined prevalence increased in 162 countries (81%) for women and 140 countries (70%) for men with a posterior probability of at least 0·80. In 2022, the combined prevalence of underweight and obesity was highest in island nations in the Caribbean and Polynesia and Micronesia, and countries in the Middle East and north Africa. Obesity prevalence was higher than underweight with posterior probability of at least 0·80 in 177 countries (89%) for women and 145 (73%) for men in 2022, whereas the converse was true in 16 countries (8%) for women, and 39 (20%) for men. From 1990 to 2022, the combined prevalence of thinness and obesity decreased among girls in five countries (3%) and among boys in 15 countries (8%) with a posterior probability of at least 0·80, and increased among girls in 140 countries (70%) and boys in 137 countries (69%) with a posterior probability of at least 0·80. The countries with highest combined prevalence of thinness and obesity in school-aged children and adolescents in 2022 were in Polynesia and Micronesia and the Caribbean for both sexes, and Chile and Qatar for boys. Combined prevalence was also high in some countries in south Asia, such as India and Pakistan, where thinness remained prevalent despite having declined. In 2022, obesity in school-aged children and adolescents was more prevalent than thinness with a posterior probability of at least 0·80 among girls in 133 countries (67%) and boys in 125 countries (63%), whereas the converse was true in 35 countries (18%) and 42 countries (21%), respectively. In almost all countries for both adults and school-aged children and adolescents, the increases in double burden were driven by increases in obesity, and decreases in double burden by declining underweight or thinness. Interpretation The combined burden of underweight and obesity has increased in most countries, driven by an increase in obesity, while underweight and thinness remain prevalent in south Asia and parts of Africa. A healthy nutrition transition that enhances access to nutritious foods is needed to address the remaining burden of underweight while curbing and reversing the increase in obesit