Better Societal Impact Evaluation of Research. ENRESSH Brief: Societal Impact

Societal impact has not often been systematically included in research evaluation procedures. Where societal impact is included in research evaluation, it is often defined in a restrictive way relating exclusively to directly measurable economic returns. This limitation is especially important for research, which does not aim to generate direct profits but interacts with, adds value to, and makes sense of, society. This policy brief presents ten recommendations for the evaluation of societal impact with a special focus on how its evaluation can better facilitate research. These recommendations are based on the findings of a long-term multi-country project examining the interactions and roles of research and society across Europe with a special focus on the social sciences and humanities (SSH). Country case studies, conceptual analyses, and policy perspectives are presented in the edited volume “Accountability in Academic Life: European Perspectives on Societal Impact Evaluation” (Edward Elgar, 2023)

Antibodies to SARS-CoV-2 are associated with protection against reinfection

Background: The relationship between the presence of antibodies to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and the risk of subsequent reinfection remains unclear. Methods: We investigated the incidence of SARS-CoV-2 infection confirmed by polymerase chain reaction (PCR) in seropositive and seronegative health care workers attending testing of asymptomatic and symptomatic staff at Oxford University Hospitals in the United Kingdom. Baseline antibody status was determined by anti-spike (primary analysis) and anti-nucleocapsid IgG assays, and staff members were followed for up to 31 weeks. We estimated the relative incidence of PCR-positive test results and new symptomatic infection according to antibody status, adjusting for age, participant-reported gender, and changes in incidence over time. Results: A total of 12,541 health care workers participated and had anti-spike IgG measured; 11,364 were followed up after negative antibody results and 1265 after positive results, including 88 in whom seroconversion occurred during follow-up. A total of 223 anti-spike–seronegative health care workers had a positive PCR test (1.09 per 10,000 days at risk), 100 during screening while they were asymptomatic and 123 while symptomatic, whereas 2 anti-spike–seropositive health care workers had a positive PCR test (0.13 per 10,000 days at risk), and both workers were asymptomatic when tested (adjusted incidence rate ratio, 0.11; 95% confidence interval, 0.03 to 0.44; P=0.002). There were no symptomatic infections in workers with anti-spike antibodies. Rate ratios were similar when the anti-nucleocapsid IgG assay was used alone or in combination with the anti-spike IgG assay to determine baseline status. Conclusions: The presence of anti-spike or anti-nucleocapsid IgG antibodies was associated with a substantially reduced risk of SARS-CoV-2 reinfection in the ensuing 6 months. (Funded by the U.K. Government Department of Health and Social Care and others.

Manifesto for a better societal impact evaluation

Peer reviewe

Mortality and pulmonary complications in patients undergoing surgery with perioperative SARS-CoV-2 infection: an international cohort study

Background: The impact of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) on postoperative recovery needs to be understood to inform clinical decision making during and after the COVID-19 pandemic. This study reports 30-day mortality and pulmonary complication rates in patients with perioperative SARS-CoV-2 infection. Methods: This international, multicentre, cohort study at 235 hospitals in 24 countries included all patients undergoing surgery who had SARS-CoV-2 infection confirmed within 7 days before or 30 days after surgery. The primary outcome measure was 30-day postoperative mortality and was assessed in all enrolled patients. The main secondary outcome measure was pulmonary complications, defined as pneumonia, acute respiratory distress syndrome, or unexpected postoperative ventilation. Findings: This analysis includes 1128 patients who had surgery between Jan 1 and March 31, 2020, of whom 835 (74·0%) had emergency surgery and 280 (24·8%) had elective surgery. SARS-CoV-2 infection was confirmed preoperatively in 294 (26·1%) patients. 30-day mortality was 23·8% (268 of 1128). Pulmonary complications occurred in 577 (51·2%) of 1128 patients; 30-day mortality in these patients was 38·0% (219 of 577), accounting for 81·7% (219 of 268) of all deaths. In adjusted analyses, 30-day mortality was associated with male sex (odds ratio 1·75 [95% CI 1·28–2·40], p\textless0·0001), age 70 years or older versus younger than 70 years (2·30 [1·65–3·22], p\textless0·0001), American Society of Anesthesiologists grades 3–5 versus grades 1–2 (2·35 [1·57–3·53], p\textless0·0001), malignant versus benign or obstetric diagnosis (1·55 [1·01–2·39], p=0·046), emergency versus elective surgery (1·67 [1·06–2·63], p=0·026), and major versus minor surgery (1·52 [1·01–2·31], p=0·047). Interpretation: Postoperative pulmonary complications occur in half of patients with perioperative SARS-CoV-2 infection and are associated with high mortality. Thresholds for surgery during the COVID-19 pandemic should be higher than during normal practice, particularly in men aged 70 years and older. Consideration should be given for postponing non-urgent procedures and promoting non-operative treatment to delay or avoid the need for surgery. Funding: National Institute for Health Research (NIHR), Association of Coloproctology of Great Britain and Ireland, Bowel and Cancer Research, Bowel Disease Research Foundation, Association of Upper Gastrointestinal Surgeons, British Association of Surgical Oncology, British Gynaecological Cancer Society, European Society of Coloproctology, NIHR Academy, Sarcoma UK, Vascular Society for Great Britain and Ireland, and Yorkshire Cancer Research

Global urban environmental change drives adaptation in white clover

Urbanization transforms environments in ways that alter biological evolution. We examined whether urban environmental change drives parallel evolution by sampling 110,019 white clover plants from 6169 populations in 160 cities globally. Plants were assayed for a Mendelian antiherbivore defense that also affects tolerance to abiotic stressors. Urban-rural gradients were associated with the evolution of clines in defense in 47% of cities throughout the world. Variation in the strength of clines was explained by environmental changes in drought stress and vegetation cover that varied among cities. Sequencing 2074 genomes from 26 cities revealed that the evolution of urban-rural clines was best explained by adaptive evolution, but the degree of parallel adaptation varied among cities. Our results demonstrate that urbanization leads to adaptation at a global scale

Adding 6 months of androgen deprivation therapy to postoperative radiotherapy for prostate cancer: a comparison of short-course versus no androgen deprivation therapy in the RADICALS-HD randomised controlled trial

Background Previous evidence indicates that adjuvant, short-course androgen deprivation therapy (ADT) improves metastasis-free survival when given with primary radiotherapy for intermediate-risk and high-risk localised prostate cancer. However, the value of ADT with postoperative radiotherapy after radical prostatectomy is unclear. Methods RADICALS-HD was an international randomised controlled trial to test the efficacy of ADT used in combination with postoperative radiotherapy for prostate cancer. Key eligibility criteria were indication for radiotherapy after radical prostatectomy for prostate cancer, prostate-specific antigen less than 5 ng/mL, absence of metastatic disease, and written consent. Participants were randomly assigned (1:1) to radiotherapy alone (no ADT) or radiotherapy with 6 months of ADT (short-course ADT), using monthly subcutaneous gonadotropin-releasing hormone analogue injections, daily oral bicalutamide monotherapy 150 mg, or monthly subcutaneous degarelix. Randomisation was done centrally through minimisation with a random element, stratified by Gleason score, positive margins, radiotherapy timing, planned radiotherapy schedule, and planned type of ADT, in a computerised system. The allocated treatment was not masked. The primary outcome measure was metastasis-free survival, defined as distant metastasis arising from prostate cancer or death from any cause. Standard survival analysis methods were used, accounting for randomisation stratification factors. The trial had 80% power with two-sided α of 5% to detect an absolute increase in 10-year metastasis-free survival from 80% to 86% (hazard ratio [HR] 0·67). Analyses followed the intention-to-treat principle. The trial is registered with the ISRCTN registry, ISRCTN40814031, and ClinicalTrials.gov, NCT00541047. Findings Between Nov 22, 2007, and June 29, 2015, 1480 patients (median age 66 years [IQR 61–69]) were randomly assigned to receive no ADT (n=737) or short-course ADT (n=743) in addition to postoperative radiotherapy at 121 centres in Canada, Denmark, Ireland, and the UK. With a median follow-up of 9·0 years (IQR 7·1–10·1), metastasis-free survival events were reported for 268 participants (142 in the no ADT group and 126 in the short-course ADT group; HR 0·886 [95% CI 0·688–1·140], p=0·35). 10-year metastasis-free survival was 79·2% (95% CI 75·4–82·5) in the no ADT group and 80·4% (76·6–83·6) in the short-course ADT group. Toxicity of grade 3 or higher was reported for 121 (17%) of 737 participants in the no ADT group and 100 (14%) of 743 in the short-course ADT group (p=0·15), with no treatment-related deaths. Interpretation Metastatic disease is uncommon following postoperative bed radiotherapy after radical prostatectomy. Adding 6 months of ADT to this radiotherapy did not improve metastasis-free survival compared with no ADT. These findings do not support the use of short-course ADT with postoperative radiotherapy in this patient population

Duration of androgen deprivation therapy with postoperative radiotherapy for prostate cancer: a comparison of long-course versus short-course androgen deprivation therapy in the RADICALS-HD randomised trial

Background Previous evidence supports androgen deprivation therapy (ADT) with primary radiotherapy as initial treatment for intermediate-risk and high-risk localised prostate cancer. However, the use and optimal duration of ADT with postoperative radiotherapy after radical prostatectomy remains uncertain. Methods RADICALS-HD was a randomised controlled trial of ADT duration within the RADICALS protocol. Here, we report on the comparison of short-course versus long-course ADT. Key eligibility criteria were indication for radiotherapy after previous radical prostatectomy for prostate cancer, prostate-specific antigen less than 5 ng/mL, absence of metastatic disease, and written consent. Participants were randomly assigned (1:1) to add 6 months of ADT (short-course ADT) or 24 months of ADT (long-course ADT) to radiotherapy, using subcutaneous gonadotrophin-releasing hormone analogue (monthly in the short-course ADT group and 3-monthly in the long-course ADT group), daily oral bicalutamide monotherapy 150 mg, or monthly subcutaneous degarelix. Randomisation was done centrally through minimisation with a random element, stratified by Gleason score, positive margins, radiotherapy timing, planned radiotherapy schedule, and planned type of ADT, in a computerised system. The allocated treatment was not masked. The primary outcome measure was metastasis-free survival, defined as metastasis arising from prostate cancer or death from any cause. The comparison had more than 80% power with two-sided α of 5% to detect an absolute increase in 10-year metastasis-free survival from 75% to 81% (hazard ratio [HR] 0·72). Standard time-to-event analyses were used. Analyses followed intention-to-treat principle. The trial is registered with the ISRCTN registry, ISRCTN40814031, and ClinicalTrials.gov , NCT00541047 . Findings Between Jan 30, 2008, and July 7, 2015, 1523 patients (median age 65 years, IQR 60–69) were randomly assigned to receive short-course ADT (n=761) or long-course ADT (n=762) in addition to postoperative radiotherapy at 138 centres in Canada, Denmark, Ireland, and the UK. With a median follow-up of 8·9 years (7·0–10·0), 313 metastasis-free survival events were reported overall (174 in the short-course ADT group and 139 in the long-course ADT group; HR 0·773 [95% CI 0·612–0·975]; p=0·029). 10-year metastasis-free survival was 71·9% (95% CI 67·6–75·7) in the short-course ADT group and 78·1% (74·2–81·5) in the long-course ADT group. Toxicity of grade 3 or higher was reported for 105 (14%) of 753 participants in the short-course ADT group and 142 (19%) of 757 participants in the long-course ADT group (p=0·025), with no treatment-related deaths. Interpretation Compared with adding 6 months of ADT, adding 24 months of ADT improved metastasis-free survival in people receiving postoperative radiotherapy. For individuals who can accept the additional duration of adverse effects, long-course ADT should be offered with postoperative radiotherapy. Funding Cancer Research UK, UK Research and Innovation (formerly Medical Research Council), and Canadian Cancer Society

Projected impact of change in the percentage of energy from each NOVA group intake on cardiovascular disease mortality in Brazil: a modelling study

OBJECTIVE: Estimate reductions in cardiovascular mortality achievable through improvement in nutrient intakes according to processing level (NOVA classification), that is, reducing consumption of culinary ingredients (G2), processed (G3) and ultra-processed foods (G4) while encouraging consumption of unprocessed and minimally processed foods (G1). DESIGN: Modelling study. SETTING: General adult population of Brazil. PARTICIPANTS: Men and women aged 25 or more years (34 003) investigated in the Household Budget Survey 2017–2018, in the consumption data module. MAIN OUTCOME MEASURES: We used the IMPACT Food Policy Model to estimate the reduction in deaths from cardiovascular diseases (CVD) up to 2048 in five scenarios with reductions in saturated fat, trans fat, salt and added sugar intakes resulting from changes in NOVA groups. (1) The optimistic scenario modelised an increase in the energy intake provided by G1 and a reduction in the energy intake from G2, G3 and G4, return to previous levels. (2) The minimal scenario modelised a 3.7% increase in the energy intake from G1, and a reduction in the energy intake from G4 to the 2008–2009 level. (3) The modest scenario only modelised a 25.0% reduction of the energy intake from G2 and G3. (4) The intermediary scenario modelised the minimal scenario plus a 25.0% reduction in the energy intake from G2. (5) Finally, the advanced scenario modelised the minimal scenario plus a 25.0% reduction in the energy intake from G2 and G3. RESULTS: Proposed changes in the optimistic scenario could prevent or delay 52.8% CVD-related deaths by 2048. Changes modelled in the minimal, modest, intermediary and advanced scenarios may result in a 10.1%, 28.4%, 31.4% and 38.6% reduction in 2048 CVD mortality, respectively. CONCLUSIONS: Substantial health gains can be achieved by improving the diet, through plausible modifications aimed at the level of processing as a tool for Brazilian food policies

Manifesto for a better societal impact evaluation

In this chapter, ENRESSH collaborators write a “Manifesto for a Better Societal Impact” Evaluation. In this, authors have extracted key principles based on some conclusions from the individual country reports which are broken down and/or extrapolated into generalisable findings drawing from the cross-national comparison. In doing so, this manifesto explores what scholars and policymakers from other European countries, and indeed from far wider international backgrounds, can learn from those countries’ experiences and the cross-national comparison. The chapter also goes beyond analysis, in providing a series of condensed recommendations for the evaluation of societal impact in the SSH with a special focus on how the evaluation can impact the work of academics in a positive way. In this collaborative task, we have sought to simultaneously respect disciplinary differences in knowledge production practices as well as in societal functions of research, while making this process as visible as possible