Using ontologies to enhance human understandability of global post-hoc explanations of black-box models

The interest in explainable artificial intelligence has grown strongly in recent years because of the need to convey safety and trust in the ‘how’ and ‘why’ of automated decision-making to users. While a plethora of approaches has been developed, only a few focus on how to use domain knowledge and how this influences the understanding of explanations by users. In this paper, we show that by using ontologies we can improve the human understandability of global post-hoc explanations, presented in the form of decision trees. In particular, we introduce Trepan Reloaded, which builds on Trepan, an algorithm that extracts surrogate decision trees from black-box models. Trepan Reloaded includes ontologies, that model domain knowledge, in the process of extracting explanations to improve their understandability. We tested the understandability of the extracted explanations by humans in a user study with four different tasks. We evaluate the results in terms of response times and correctness, subjective ease of understanding and confidence, and similarity of free text responses. The results show that decision trees generated with Trepan Reloaded, taking into account domain knowledge, are significantly more understandable throughout than those generated by standard Trepan. The enhanced understandability of post-hoc explanations is achieved with little compromise on the accuracy with which the surrogate decision trees replicate the behaviour of the original neural network models

Developing a core outcome set for fistulising perianal Crohn's disease

OBJECTIVE: Lack of standardised outcomes hampers effective analysis and comparison of data when comparing treatments in fistulising perianal Crohn's disease (pCD). Development of a standardised set of outcomes would resolve these issues. This study provides the definitive core outcome set (COS) for fistulising pCD. DESIGN: Candidate outcomes were generated through a systematic review and patient interviews. Consensus was established via a three-round Delphi process using a 9-point Likert scale based on how important they felt it was in determining treatment success culminating in a final consensus meeting. Stakeholders were recruited nationally and grouped into three panels (surgeons and radiologists, gastroenterologists and IBD specialist nurses, and patients). Participants received feedback fromtheir panel(in the second round) andall participants(in the third round) to allow refinement of their scores. RESULTS: A total of 295 outcomes were identified from systematic reviews and interviews that were categorised into 92 domains. 187 stakeholders (response rate 78.5%) prioritised 49 outcomes through a three-round Delphi study.The final consensus meeting of 41 experts and patients generated agreement on an eight domain COS. The COS comprised three patient-reported outcome domains (quality of life, incontinence and a combined score of patient priorities) and five clinician-reported outcome domains (perianal disease activity, development of new perianal abscess/sepsis, new/recurrent fistula, unplanned surgery and faecal diversion). CONCLUSION: A fistulising pCD COS has been produced by all key stakeholders. Application of the COS will reduce heterogeneity in outcome reporting, thereby facilitating more meaningful comparisons between treatments, data synthesis and ultimately benefit patient care

Postnatal loss of Dlk1 imprinting in stem cells and niche astrocytes regulates neurogenesis.

The gene for the atypical NOTCH ligand delta-like homologue 1 (Dlk1) encodes membrane-bound and secreted isoforms that function in several developmental processes in vitro and in vivo. Dlk1, a member of a cluster of imprinted genes, is expressed from the paternally inherited chromosome. Here we show that mice that are deficient in Dlk1 have defects in postnatal neurogenesis in the subventricular zone: a developmental continuum that results in depletion of mature neurons in the olfactory bulb. We show that DLK1 is secreted by niche astrocytes, whereas its membrane-bound isoform is present in neural stem cells (NSCs) and is required for the inductive effect of secreted DLK1 on self-renewal. Notably, we find that there is a requirement for Dlk1 to be expressed from both maternally and paternally inherited chromosomes. Selective absence of Dlk1 imprinting in both NSCs and niche astrocytes is associated with postnatal acquisition of DNA methylation at the germ-line-derived imprinting control region. The results emphasize molecular relationships between NSCs and the niche astrocyte cells of the microenvironment, identifying a signalling system encoded by a single gene that functions coordinately in both cell types. The modulation of genomic imprinting in a stem-cell environment adds a new level of epigenetic regulation to the establishment and maintenance of the niche, raising wider questions about the adaptability, function and evolution of imprinting in specific developmental contexts

Impact of opioid-free analgesia on pain severity and patient satisfaction after discharge from surgery: multispecialty, prospective cohort study in 25 countries

Background: Balancing opioid stewardship and the need for adequate analgesia following discharge after surgery is challenging. This study aimed to compare the outcomes for patients discharged with opioid versus opioid-free analgesia after common surgical procedures.Methods: This international, multicentre, prospective cohort study collected data from patients undergoing common acute and elective general surgical, urological, gynaecological, and orthopaedic procedures. The primary outcomes were patient-reported time in severe pain measured on a numerical analogue scale from 0 to 100% and patient-reported satisfaction with pain relief during the first week following discharge. Data were collected by in-hospital chart review and patient telephone interview 1 week after discharge.Results: The study recruited 4273 patients from 144 centres in 25 countries; 1311 patients (30.7%) were prescribed opioid analgesia at discharge. Patients reported being in severe pain for 10 (i.q.r. 1-30)% of the first week after discharge and rated satisfaction with analgesia as 90 (i.q.r. 80-100) of 100. After adjustment for confounders, opioid analgesia on discharge was independently associated with increased pain severity (risk ratio 1.52, 95% c.i. 1.31 to 1.76; P < 0.001) and re-presentation to healthcare providers owing to side-effects of medication (OR 2.38, 95% c.i. 1.36 to 4.17; P = 0.004), but not with satisfaction with analgesia (beta coefficient 0.92, 95% c.i. -1.52 to 3.36; P = 0.468) compared with opioid-free analgesia. Although opioid prescribing varied greatly between high-income and low- and middle-income countries, patient-reported outcomes did not.Conclusion: Opioid analgesia prescription on surgical discharge is associated with a higher risk of re-presentation owing to side-effects of medication and increased patient-reported pain, but not with changes in patient-reported satisfaction. Opioid-free discharge analgesia should be adopted routinely

Developing a core outcome set for fistulising perianal Crohn's disease

Objective Lack of standardised outcomes hampers effective analysis and comparison of data when comparing treatments in fistulising perianal Crohn’s disease (pCD). Development of a standardised set of outcomes would resolve these issues. This study provides the definitive core outcome set (COS) for fistulising pCD. Design Candidate outcomes were generated through a systematic review and patient interviews. Consensus was established via a three-round Delphi process using a 9-point Likert scale based on how important they felt it was in determining treatment success culminating in a final consensus meeting. Stakeholders were recruited nationally and grouped into three panels (surgeons and radiologists, gastroenterologists and IBD specialist nurses, and patients). Participants received feedback from their panel (in the second round) and all participants (in the third round) to allow refinement of their scores. Results A total of 295 outcomes were identified from systematic reviews and interviews that were categorised into 92 domains. 187 stakeholders (response rate 78.5%) prioritised 49 outcomes through a three-round Delphi study. The final consensus meeting of 41 experts and patients generated agreement on an eight domain COS. The COS comprised three patient-reported outcome domains (quality of life, incontinence and a combined score of patient priorities) and five clinician-reported outcome domains (perianal disease activity, development of new perianal abscess/sepsis, new/recurrent fistula, unplanned surgery and faecal diversion). Conclusion A fistulising pCD COS has been produced by all key stakeholders. Application of the COS will reduce heterogeneity in outcome reporting, thereby facilitating more meaningful comparisons between treatments, data synthesis and ultimately benefit patient care

An immune dysfunction score for stratification of patients with acute infection based on whole-blood gene expression

Dysregulated host responses to infection can lead to organ dysfunction and sepsis, causing millions of global deaths each year. To alleviate this burden, improved prognostication and biomarkers of response are urgently needed. We investigated the use of whole-blood transcriptomics for stratification of patients with severe infection by integrating data from 3149 samples from patients with sepsis due to community-acquired pneumonia or fecal peritonitis admitted to intensive care and healthy individuals into a gene expression reference map. We used this map to derive a quantitative sepsis response signature (SRSq) score reflective of immune dysfunction and predictive of clinical outcomes, which can be estimated using a 7- or 12-gene signature. Last, we built a machine learning framework, SepstratifieR, to deploy SRSq in adult and pediatric bacterial and viral sepsis, H1N1 influenza, and COVID-19, demonstrating clinically relevant stratification across diseases and revealing some of the physiological alterations linking immune dysregulation to mortality. Our method enables early identification of individuals with dysfunctional immune profiles, bringing us closer to precision medicine in infection.peer-reviewe

Multiorgan MRI findings after hospitalisation with COVID-19 in the UK (C-MORE): a prospective, multicentre, observational cohort study

Introduction: The multiorgan impact of moderate to severe coronavirus infections in the post-acute phase is still poorly understood. We aimed to evaluate the excess burden of multiorgan abnormalities after hospitalisation with COVID-19, evaluate their determinants, and explore associations with patient-related outcome measures. Methods: In a prospective, UK-wide, multicentre MRI follow-up study (C-MORE), adults (aged ≥18 years) discharged from hospital following COVID-19 who were included in Tier 2 of the Post-hospitalisation COVID-19 study (PHOSP-COVID) and contemporary controls with no evidence of previous COVID-19 (SARS-CoV-2 nucleocapsid antibody negative) underwent multiorgan MRI (lungs, heart, brain, liver, and kidneys) with quantitative and qualitative assessment of images and clinical adjudication when relevant. Individuals with end-stage renal failure or contraindications to MRI were excluded. Participants also underwent detailed recording of symptoms, and physiological and biochemical tests. The primary outcome was the excess burden of multiorgan abnormalities (two or more organs) relative to controls, with further adjustments for potential confounders. The C-MORE study is ongoing and is registered with ClinicalTrials.gov, NCT04510025. Findings: Of 2710 participants in Tier 2 of PHOSP-COVID, 531 were recruited across 13 UK-wide C-MORE sites. After exclusions, 259 C-MORE patients (mean age 57 years [SD 12]; 158 [61%] male and 101 [39%] female) who were discharged from hospital with PCR-confirmed or clinically diagnosed COVID-19 between March 1, 2020, and Nov 1, 2021, and 52 non-COVID-19 controls from the community (mean age 49 years [SD 14]; 30 [58%] male and 22 [42%] female) were included in the analysis. Patients were assessed at a median of 5·0 months (IQR 4·2–6·3) after hospital discharge. Compared with non-COVID-19 controls, patients were older, living with more obesity, and had more comorbidities. Multiorgan abnormalities on MRI were more frequent in patients than in controls (157 [61%] of 259 vs 14 [27%] of 52; p<0·0001) and independently associated with COVID-19 status (odds ratio [OR] 2·9 [95% CI 1·5–5·8]; padjusted=0·0023) after adjusting for relevant confounders. Compared with controls, patients were more likely to have MRI evidence of lung abnormalities (p=0·0001; parenchymal abnormalities), brain abnormalities (p<0·0001; more white matter hyperintensities and regional brain volume reduction), and kidney abnormalities (p=0·014; lower medullary T1 and loss of corticomedullary differentiation), whereas cardiac and liver MRI abnormalities were similar between patients and controls. Patients with multiorgan abnormalities were older (difference in mean age 7 years [95% CI 4–10]; mean age of 59·8 years [SD 11·7] with multiorgan abnormalities vs mean age of 52·8 years [11·9] without multiorgan abnormalities; p<0·0001), more likely to have three or more comorbidities (OR 2·47 [1·32–4·82]; padjusted=0·0059), and more likely to have a more severe acute infection (acute CRP >5mg/L, OR 3·55 [1·23–11·88]; padjusted=0·025) than those without multiorgan abnormalities. Presence of lung MRI abnormalities was associated with a two-fold higher risk of chest tightness, and multiorgan MRI abnormalities were associated with severe and very severe persistent physical and mental health impairment (PHOSP-COVID symptom clusters) after hospitalisation. Interpretation: After hospitalisation for COVID-19, people are at risk of multiorgan abnormalities in the medium term. Our findings emphasise the need for proactive multidisciplinary care pathways, with the potential for imaging to guide surveillance frequency and therapeutic stratification

Secondary school admissions in England: policy and practice

This report presents the findings from the first part of a research project commissioned by the Research and Information on State Education (RISE) Trust with financial support from the Esmée Fairbairn Foundation. It aims to provide an analysis of secondary schools’ admissions criteria and practices in England in light of the new legislative and regulatory context; it focuses on admissions to Year 7 in 2008. In addition to examining admissions criteria and practices, the report also provides an analysis of the content of supplementary information forms parents may be required to complete