Designing and implementing an automated grading workflow for providing personalized feedback to open-ended data science assignments

Open-ended assignments -- such as lab reports and semester-long projects -- provide data science and statistics students with opportunities for developing communication, critical thinking, and creativity skills. However, providing grades and qualitative feedback to open-ended assignments can be very time consuming and difficult to do consistently across students. In this paper, we discuss the steps of a typical grading workflow and highlight which steps can be automated in an approach that we define as an automated grading workflow. We illustrate how gradetools, a new R package, implements this approach within RStudio to facilitate efficient and consistent grading while providing individualized feedback. We hope that this work will help the community of data science and statistics educators use gradetools as their grading workflow assistant or develop their own tools for assisting their grading workflow.Comment: 24 pages, 3 figure

Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks, 1990-2015: a systematic analysis for the Global Burden of Disease Study 2015

Forouzanfar MH, Afshin A, Alexander LT, et al. Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks, 1990-2015: a systematic analysis for the Global Burden of Disease Study 2015. LANCET. 2016;388(10053):1659-1724.Background The Global Burden of Diseases, Injuries, and Risk Factors Study 2015 provides an up-to-date synthesis of the evidence for risk factor exposure and the attributable burden of disease. By providing national and subnational assessments spanning the past 25 years, this study can inform debates on the importance of addressing risks in context. Methods We used the comparative risk assessment framework developed for previous iterations of the Global Burden of Disease Study to estimate attributable deaths, disability-adjusted life-years (DALYs), and trends in exposure by age group, sex, year, and geography for 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks from 1990 to 2015. This study included 388 risk-outcome pairs that met World Cancer Research Fund-defined criteria for convincing or probable evidence. We extracted relative risk and exposure estimates from randomised controlled trials, cohorts, pooled cohorts, household surveys, census data, satellite data, and other sources. We used statistical models to pool data, adjust for bias, and incorporate covariates. We developed a metric that allows comparisons of exposure across risk factors-the summary exposure value. Using the counterfactual scenario of theoretical minimum risk level, we estimated the portion of deaths and DALYs that could be attributed to a given risk. We decomposed trends in attributable burden into contributions from population growth, population age structure, risk exposure, and risk-deleted cause-specific DALY rates. We characterised risk exposure in relation to a Socio-demographic Index (SDI). Findings Between 1990 and 2015, global exposure to unsafe sanitation, household air pollution, childhood underweight, childhood stunting, and smoking each decreased by more than 25%. Global exposure for several occupational risks, high body-mass index (BMI), and drug use increased by more than 25% over the same period. All risks jointly evaluated in 2015 accounted for 57.8% (95% CI 56.6-58.8) of global deaths and 41.2% (39.8-42.8) of DALYs. In 2015, the ten largest contributors to global DALYs among Level 3 risks were high systolic blood pressure (211.8 million [192.7 million to 231.1 million] global DALYs), smoking (148.6 million [134.2 million to 163.1 million]), high fasting plasma glucose (143.1 million [125.1 million to 163.5 million]), high BMI (120.1 million [83.8 million to 158.4 million]), childhood undernutrition (113.3 million [103.9 million to 123.4 million]), ambient particulate matter (103.1 million [90.8 million to 115.1 million]), high total cholesterol (88.7 million [74.6 million to 105.7 million]), household air pollution (85.6 million [66.7 million to 106.1 million]), alcohol use (85.0 million [77.2 million to 93.0 million]), and diets high in sodium (83.0 million [49.3 million to 127.5 million]). From 1990 to 2015, attributable DALYs declined for micronutrient deficiencies, childhood undernutrition, unsafe sanitation and water, and household air pollution; reductions in risk-deleted DALY rates rather than reductions in exposure drove these declines. Rising exposure contributed to notable increases in attributable DALYs from high BMI, high fasting plasma glucose, occupational carcinogens, and drug use. Environmental risks and childhood undernutrition declined steadily with SDI; low physical activity, high BMI, and high fasting plasma glucose increased with SDI. In 119 countries, metabolic risks, such as high BMI and fasting plasma glucose, contributed the most attributable DALYs in 2015. Regionally, smoking still ranked among the leading five risk factors for attributable DALYs in 109 countries; childhood underweight and unsafe sex remained primary drivers of early death and disability in much of sub-Saharan Africa. Interpretation Declines in some key environmental risks have contributed to declines in critical infectious diseases. Some risks appear to be invariant to SDI. Increasing risks, including high BMI, high fasting plasma glucose, drug use, and some occupational exposures, contribute to rising burden from some conditions, but also provide opportunities for intervention. Some highly preventable risks, such as smoking, remain major causes of attributable DALYs, even as exposure is declining. Public policy makers need to pay attention to the risks that are increasingly major contributors to global burden. Copyright (C) The Author(s). Published by Elsevier Ltd

Efficacy and safety of sparsentan versus irbesartan in patients with IgA nephropathy (PROTECT): 2-year results from a randomised, active-controlled, phase 3 trial

BackgroundSparsentan, a novel, non-immunosuppressive, single-molecule, dual endothelin angiotensin receptor antagonist, significantly reduced proteinuria versus irbesartan, an angiotensin II receptor blocker, at 36 weeks (primary endpoint) in patients with immunoglobulin A nephropathy in the phase 3 PROTECT trial's previously reported interim analysis. Here, we report kidney function and outcomes over 110 weeks from the double-blind final analysis.MethodsPROTECT, a double-blind, randomised, active-controlled, phase 3 study, was done across 134 clinical practice sites in 18 countries throughout the Americas, Asia, and Europe. Patients aged 18 years or older with biopsy-proven primary IgA nephropathy and proteinuria of at least 1·0 g per day despite maximised renin–angiotensin system inhibition for at least 12 weeks were randomly assigned (1:1) to receive sparsentan (target dose 400 mg oral sparsentan once daily) or irbesartan (target dose 300 mg oral irbesartan once daily) based on a permuted-block randomisation method. The primary endpoint was proteinuria change between treatment groups at 36 weeks. Secondary endpoints included rate of change (slope) of the estimated glomerular filtration rate (eGFR), changes in proteinuria, a composite of kidney failure (confirmed 40% eGFR reduction, end-stage kidney disease, or all-cause mortality), and safety and tolerability up to 110 weeks from randomisation. Secondary efficacy outcomes were assessed in the full analysis set and safety was assessed in the safety set, both of which were defined as all patients who were randomly assigned and received at least one dose of randomly assigned study drug. This trial is registered with ClinicalTrials.gov, NCT03762850.FindingsBetween Dec 20, 2018, and May 26, 2021, 203 patients were randomly assigned to the sparsentan group and 203 to the irbesartan group. One patient from each group did not receive the study drug and was excluded from the efficacy and safety analyses (282 [70%] of 404 included patients were male and 272 [67%] were White) . Patients in the sparsentan group had a slower rate of eGFR decline than those in the irbesartan group. eGFR chronic 2-year slope (weeks 6–110) was −2·7 mL/min per 1·73 m2 per year versus −3·8 mL/min per 1·73 m2 per year (difference 1·1 mL/min per 1·73 m2 per year, 95% CI 0·1 to 2·1; p=0·037); total 2-year slope (day 1–week 110) was −2·9 mL/min per 1·73 m2 per year versus −3·9 mL/min per 1·73 m2 per year (difference 1·0 mL/min per 1·73 m2 per year, 95% CI −0·03 to 1·94; p=0·058). The significant reduction in proteinuria at 36 weeks with sparsentan was maintained throughout the study period; at 110 weeks, proteinuria, as determined by the change from baseline in urine protein-to-creatinine ratio, was 40% lower in the sparsentan group than in the irbesartan group (−42·8%, 95% CI −49·8 to −35·0, with sparsentan versus −4·4%, −15·8 to 8·7, with irbesartan; geometric least-squares mean ratio 0·60, 95% CI 0·50 to 0·72). The composite kidney failure endpoint was reached by 18 (9%) of 202 patients in the sparsentan group versus 26 (13%) of 202 patients in the irbesartan group (relative risk 0·7, 95% CI 0·4 to 1·2). Treatment-emergent adverse events were well balanced between sparsentan and irbesartan, with no new safety signals.InterpretationOver 110 weeks, treatment with sparsentan versus maximally titrated irbesartan in patients with IgA nephropathy resulted in significant reductions in proteinuria and preservation of kidney function

Sparsentan in patients with IgA nephropathy: a prespecified interim analysis from a randomised, double-blind, active-controlled clinical trial

Background: Sparsentan is a novel, non-immunosuppressive, single-molecule, dual endothelin and angiotensin receptor antagonist being examined in an ongoing phase 3 trial in adults with IgA nephropathy. We report the prespecified interim analysis of the primary proteinuria efficacy endpoint, and safety. Methods: PROTECT is an international, randomised, double-blind, active-controlled study, being conducted in 134 clinical practice sites in 18 countries. The study examines sparsentan versus irbesartan in adults (aged ≥18 years) with biopsy-proven IgA nephropathy and proteinuria of 1·0 g/day or higher despite maximised renin-angiotensin system inhibitor treatment for at least 12 weeks. Participants were randomly assigned in a 1:1 ratio to receive sparsentan 400 mg once daily or irbesartan 300 mg once daily, stratified by estimated glomerular filtration rate at screening (30 to 1·75 g/day). The primary efficacy endpoint was change from baseline to week 36 in urine protein-creatinine ratio based on a 24-h urine sample, assessed using mixed model repeated measures. Treatment-emergent adverse events (TEAEs) were safety endpoints. All endpoints were examined in all participants who received at least one dose of randomised treatment. The study is ongoing and is registered with ClinicalTrials.gov, NCT03762850. Findings: Between Dec 20, 2018, and May 26, 2021, 404 participants were randomly assigned to sparsentan (n=202) or irbesartan (n=202) and received treatment. At week 36, the geometric least squares mean percent change from baseline in urine protein-creatinine ratio was statistically significantly greater in the sparsentan group (-49·8%) than the irbesartan group (-15·1%), resulting in a between-group relative reduction of 41% (least squares mean ratio=0·59; 95% CI 0·51-0·69; p<0·0001). TEAEs with sparsentan were similar to irbesartan. There were no cases of severe oedema, heart failure, hepatotoxicity, or oedema-related discontinuations. Bodyweight changes from baseline were not different between the sparsentan and irbesartan groups. Interpretation: Once-daily treatment with sparsentan produced meaningful reduction in proteinuria compared with irbesartan in adults with IgA nephropathy. Safety of sparsentan was similar to irbesartan. Future analyses after completion of the 2-year double-blind period will show whether these beneficial effects translate into a long-term nephroprotective potential of sparsentan. Funding: Travere Therapeutics

Efficacy and safety of sparsentan versus irbesartan in patients with IgA nephropathy (PROTECT): 2-year results from a randomised, active-controlled, phase 3 trial

Background Sparsentan, a novel, non-immunosuppressive, single-molecule, dual endothelin angiotensin receptor antagonist, significantly reduced proteinuria versus irbesartan, an angiotensin II receptor blocker, at 36 weeks (primary endpoint) in patients with immunoglobulin A nephropathy in the phase 3 PROTECT trial's previously reported interim analysis. Here, we report kidney function and outcomes over 110 weeks from the double-blind final analysis. Methods PROTECT, a double-blind, randomised, active-controlled, phase 3 study, was done across 134 clinical practice sites in 18 countries throughout the Americas, Asia, and Europe. Patients aged 18 years or older with biopsy-proven primary IgA nephropathy and proteinuria of at least 1·0 g per day despite maximised renin–angiotensin system inhibition for at least 12 weeks were randomly assigned (1:1) to receive sparsentan (target dose 400 mg oral sparsentan once daily) or irbesartan (target dose 300 mg oral irbesartan once daily) based on a permuted-block randomisation method. The primary endpoint was proteinuria change between treatment groups at 36 weeks. Secondary endpoints included rate of change (slope) of the estimated glomerular filtration rate (eGFR), changes in proteinuria, a composite of kidney failure (confirmed 40% eGFR reduction, end-stage kidney disease, or all-cause mortality), and safety and tolerability up to 110 weeks from randomisation. Secondary efficacy outcomes were assessed in the full analysis set and safety was assessed in the safety set, both of which were defined as all patients who were randomly assigned and received at least one dose of randomly assigned study drug. This trial is registered with ClinicalTrials.gov, NCT03762850. Findings Between Dec 20, 2018, and May 26, 2021, 203 patients were randomly assigned to the sparsentan group and 203 to the irbesartan group. One patient from each group did not receive the study drug and was excluded from the efficacy and safety analyses (282 [70%] of 404 included patients were male and 272 [67%] were White) . Patients in the sparsentan group had a slower rate of eGFR decline than those in the irbesartan group. eGFR chronic 2-year slope (weeks 6–110) was −2·7 mL/min per 1·73 m2 per year versus −3·8 mL/min per 1·73 m2 per year (difference 1·1 mL/min per 1·73 m2 per year, 95% CI 0·1 to 2·1; p=0·037); total 2-year slope (day 1–week 110) was −2·9 mL/min per 1·73 m2 per year versus −3·9 mL/min per 1·73 m2 per year (difference 1·0 mL/min per 1·73 m2 per year, 95% CI −0·03 to 1·94; p=0·058). The significant reduction in proteinuria at 36 weeks with sparsentan was maintained throughout the study period; at 110 weeks, proteinuria, as determined by the change from baseline in urine protein-to-creatinine ratio, was 40% lower in the sparsentan group than in the irbesartan group (−42·8%, 95% CI −49·8 to −35·0, with sparsentan versus −4·4%, −15·8 to 8·7, with irbesartan; geometric least-squares mean ratio 0·60, 95% CI 0·50 to 0·72). The composite kidney failure endpoint was reached by 18 (9%) of 202 patients in the sparsentan group versus 26 (13%) of 202 patients in the irbesartan group (relative risk 0·7, 95% CI 0·4 to 1·2). Treatment-emergent adverse events were well balanced between sparsentan and irbesartan, with no new safety signals. Interpretation Over 110 weeks, treatment with sparsentan versus maximally titrated irbesartan in patients with IgA nephropathy resulted in significant reductions in proteinuria and preservation of kidney function.</p

Global variation in postoperative mortality and complications after cancer surgery: a multicentre, prospective cohort study in 82 countries

© 2021 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY-NC-ND 4.0 licenseBackground: 80% of individuals with cancer will require a surgical procedure, yet little comparative data exist on early outcomes in low-income and middle-income countries (LMICs). We compared postoperative outcomes in breast, colorectal, and gastric cancer surgery in hospitals worldwide, focusing on the effect of disease stage and complications on postoperative mortality. Methods: This was a multicentre, international prospective cohort study of consecutive adult patients undergoing surgery for primary breast, colorectal, or gastric cancer requiring a skin incision done under general or neuraxial anaesthesia. The primary outcome was death or major complication within 30 days of surgery. Multilevel logistic regression determined relationships within three-level nested models of patients within hospitals and countries. Hospital-level infrastructure effects were explored with three-way mediation analyses. This study was registered with ClinicalTrials.gov, NCT03471494. Findings: Between April 1, 2018, and Jan 31, 2019, we enrolled 15 958 patients from 428 hospitals in 82 countries (high income 9106 patients, 31 countries; upper-middle income 2721 patients, 23 countries; or lower-middle income 4131 patients, 28 countries). Patients in LMICs presented with more advanced disease compared with patients in high-income countries. 30-day mortality was higher for gastric cancer in low-income or lower-middle-income countries (adjusted odds ratio 3·72, 95% CI 1·70–8·16) and for colorectal cancer in low-income or lower-middle-income countries (4·59, 2·39–8·80) and upper-middle-income countries (2·06, 1·11–3·83). No difference in 30-day mortality was seen in breast cancer. The proportion of patients who died after a major complication was greatest in low-income or lower-middle-income countries (6·15, 3·26–11·59) and upper-middle-income countries (3·89, 2·08–7·29). Postoperative death after complications was partly explained by patient factors (60%) and partly by hospital or country (40%). The absence of consistently available postoperative care facilities was associated with seven to 10 more deaths per 100 major complications in LMICs. Cancer stage alone explained little of the early variation in mortality or postoperative complications. Interpretation: Higher levels of mortality after cancer surgery in LMICs was not fully explained by later presentation of disease. The capacity to rescue patients from surgical complications is a tangible opportunity for meaningful intervention. Early death after cancer surgery might be reduced by policies focusing on strengthening perioperative care systems to detect and intervene in common complications. Funding: National Institute for Health Research Global Health Research Unit

Effects of hospital facilities on patient outcomes after cancer surgery: an international, prospective, observational study

© 2022 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY 4.0 licenseBackground: Early death after cancer surgery is higher in low-income and middle-income countries (LMICs) compared with in high-income countries, yet the impact of facility characteristics on early postoperative outcomes is unknown. The aim of this study was to examine the association between hospital infrastructure, resource availability, and processes on early outcomes after cancer surgery worldwide. Methods: A multimethods analysis was performed as part of the GlobalSurg 3 study—a multicentre, international, prospective cohort study of patients who had surgery for breast, colorectal, or gastric cancer. The primary outcomes were 30-day mortality and 30-day major complication rates. Potentially beneficial hospital facilities were identified by variable selection to select those associated with 30-day mortality. Adjusted outcomes were determined using generalised estimating equations to account for patient characteristics and country-income group, with population stratification by hospital. Findings: Between April 1, 2018, and April 23, 2019, facility-level data were collected for 9685 patients across 238 hospitals in 66 countries (91 hospitals in 20 high-income countries; 57 hospitals in 19 upper-middle-income countries; and 90 hospitals in 27 low-income to lower-middle-income countries). The availability of five hospital facilities was inversely associated with mortality: ultrasound, CT scanner, critical care unit, opioid analgesia, and oncologist. After adjustment for case-mix and country income group, hospitals with three or fewer of these facilities (62 hospitals, 1294 patients) had higher mortality compared with those with four or five (adjusted odds ratio [OR] 3·85 [95% CI 2·58–5·75]; p<0·0001), with excess mortality predominantly explained by a limited capacity to rescue following the development of major complications (63·0% vs 82·7%; OR 0·35 [0·23–0·53]; p<0·0001). Across LMICs, improvements in hospital facilities would prevent one to three deaths for every 100 patients undergoing surgery for cancer. Interpretation: Hospitals with higher levels of infrastructure and resources have better outcomes after cancer surgery, independent of country income. Without urgent strengthening of hospital infrastructure and resources, the reductions in cancer-associated mortality associated with improved access will not be realised. Funding: National Institute for Health and Care Research

Guidelines for the use and interpretation of assays for monitoring autophagy (4th edition)

In 2008, we published the first set of guidelines for standardizing research in autophagy. Since then, this topic has received increasing attention, and many scientists have entered the field. Our knowledge base and relevant new technologies have also been expanding. Thus, it is important to formulate on a regular basis updated guidelines for monitoring autophagy in different organisms. Despite numerous reviews, there continues to be confusion regarding acceptable methods to evaluate autophagy, especially in multicellular eukaryotes. Here, we present a set of guidelines for investigators to select and interpret methods to examine autophagy and related processes, and for reviewers to provide realistic and reasonable critiques of reports that are focused on these processes. These guidelines are not meant to be a dogmatic set of rules, because the appropriateness of any assay largely depends on the question being asked and the system being used. Moreover, no individual assay is perfect for every situation, calling for the use of multiple techniques to properly monitor autophagy in each experimental setting. Finally, several core components of the autophagy machinery have been implicated in distinct autophagic processes (canonical and noncanonical autophagy), implying that genetic approaches to block autophagy should rely on targeting two or more autophagy-related genes that ideally participate in distinct steps of the pathway. Along similar lines, because multiple proteins involved in autophagy also regulate other cellular pathways including apoptosis, not all of them can be used as a specific marker for bona fide autophagic responses. Here, we critically discuss current methods of assessing autophagy and the information they can, or cannot, provide. Our ultimate goal is to encourage intellectual and technical innovation in the field