Learning through structure: towards deep neuromorphic knowledge graph embeddings

Computing latent representations for graph-structured data is an ubiquitous learning task in many industrial and academic applications ranging from molecule synthetization to social network analysis and recommender systems. Knowledge graphs are among the most popular and widely used data representations related to the Semantic Web. Next to structuring factual knowledge in a machine-readable format, knowledge graphs serve as the backbone of many artificial intelligence applications and allow the ingestion of context information into various learning algorithms. Graph neural networks attempt to encode graph structures in low-dimensional vector spaces via a message passing heuristic between neighboring nodes. Over the recent years, a multitude of different graph neural network architectures demonstrated ground-breaking performances in many learning tasks. In this work, we propose a strategy to map deep graph learning architectures for knowledge graph reasoning to neuromorphic architectures. Based on the insight that randomly initialized and untrained (i.e., frozen) graph neural networks are able to preserve local graph structures, we compose a frozen neural network with shallow knowledge graph embedding models. We experimentally show that already on conventional computing hardware, this leads to a significant speedup and memory reduction while maintaining a competitive performance level. Moreover, we extend the frozen architecture to spiking neural networks, introducing a novel, event-based and highly sparse knowledge graph embedding algorithm that is suitable for implementation in neuromorphic hardware.Comment: Accepted for publication at the International Conference on Neuromorphic Computing (ICNC 2021

Neuro-symbolic computing with spiking neural networks

Knowledge graphs are an expressive and widely used data structure due to their ability to integrate data from different domains in a sensible and machine-readable way. Thus, they can be used to model a variety of systems such as molecules and social networks. However, it still remains an open question how symbolic reasoning could be realized in spiking systems and, therefore, how spiking neural networks could be applied to such graph data. Here, we extend previous work on spike-based graph algorithms by demonstrating how symbolic and multi-relational information can be encoded using spiking neurons, allowing reasoning over symbolic structures like knowledge graphs with spiking neural networks. The introduced framework is enabled by combining the graph embedding paradigm and the recent progress in training spiking neural networks using error backpropagation. The presented methods are applicable to a variety of spiking neuron models and can be trained end-to-end in combination with other differentiable network architectures, which we demonstrate by implementing a spiking relational graph neural network.Comment: Accepted for publication at the International Conference on Neuromorphic Systems (ICONS) 202

Paediatric COVID-19 mortality: a database analysis of the impact of health resource disparity

Background The impact of the COVID-19 pandemic on paediatric populations varied between high-income countries (HICs) versus low-income to middle-income countries (LMICs). We sought to investigate differences in paediatric clinical outcomes and identify factors contributing to disparity between countries.Methods The International Severe Acute Respiratory and Emerging Infections Consortium (ISARIC) COVID-19 database was queried to include children under 19 years of age admitted to hospital from January 2020 to April 2021 with suspected or confirmed COVID-19 diagnosis. Univariate and multivariable analysis of contributing factors for mortality were assessed by country group (HICs vs LMICs) as defined by the World Bank criteria.Results A total of 12 860 children (3819 from 21 HICs and 9041 from 15 LMICs) participated in this study. Of these, 8961 were laboratory-confirmed and 3899 suspected COVID-19 cases. About 52% of LMICs children were black, and more than 40% were infants and adolescent. Overall in-hospital mortality rate (95% CI) was 3.3% [=(3.0% to 3.6%), higher in LMICs than HICs (4.0% (3.6% to 4.4%) and 1.7% (1.3% to 2.1%), respectively). There were significant differences between country income groups in intervention profile, with higher use of antibiotics, antivirals, corticosteroids, prone positioning, high flow nasal cannula, non-invasive and invasive mechanical ventilation in HICs. Out of the 439 mechanically ventilated children, mortality occurred in 106 (24.1%) subjects, which was higher in LMICs than HICs (89 (43.6%) vs 17 (7.2%) respectively). Pre-existing infectious comorbidities (tuberculosis and HIV) and some complications (bacterial pneumonia, acute respiratory distress syndrome and myocarditis) were significantly higher in LMICs compared with HICs. On multivariable analysis, LMIC as country income group was associated with increased risk of mortality (adjusted HR 4.73 (3.16 to 7.10)).Conclusion Mortality and morbidities were higher in LMICs than HICs, and it may be attributable to differences in patient demographics, complications and access to supportive and treatment modalities

Association of Country Income Level With the Characteristics and Outcomes of Critically Ill Patients Hospitalized With Acute Kidney Injury and COVID-19

Introduction: Acute kidney injury (AKI) has been identified as one of the most common and significant problems in hospitalized patients with COVID-19. However, studies examining the relationship between COVID-19 and AKI in low- and low-middle income countries (LLMIC) are lacking. Given that AKI is known to carry a higher mortality rate in these countries, it is important to understand differences in this population. Methods: This prospective, observational study examines the AKI incidence and characteristics of 32,210 patients with COVID-19 from 49 countries across all income levels who were admitted to an intensive care unit during their hospital stay. Results: Among patients with COVID-19 admitted to the intensive care unit, AKI incidence was highest in patients in LLMIC, followed by patients in upper-middle income countries (UMIC) and high-income countries (HIC) (53%, 38%, and 30%, respectively), whereas dialysis rates were lowest among patients with AKI from LLMIC and highest among those from HIC (27% vs. 45%). Patients with AKI in LLMIC had the largest proportion of community-acquired AKI (CA-AKI) and highest rate of in-hospital death (79% vs. 54% in HIC and 66% in UMIC). The association between AKI, being from LLMIC and in-hospital death persisted even after adjusting for disease severity. Conclusions: AKI is a particularly devastating complication of COVID-19 among patients from poorer nations where the gaps in accessibility and quality of healthcare delivery have a major impact on patient outcomes

Liver injury in hospitalized patients with COVID-19: An International observational cohort study

Background: Using a large dataset, we evaluated prevalence and severity of alterations in liver enzymes in COVID-19 and association with patient-centred outcomes.MethodsWe included hospitalized patients with confirmed or suspected SARS-CoV-2 infection from the International Severe Acute Respiratory and emerging Infection Consortium (ISARIC) database. Key exposure was baseline liver enzymes (AST, ALT, bilirubin). Patients were assigned Liver Injury Classification score based on 3 components of enzymes at admission: Normal; Stage I) Liver injury: any component between 1-3x upper limit of normal (ULN); Stage II) Severe liver injury: any component & GE;3x ULN. Outcomes were hospital mortality, utilization of selected resources, complications, and durations of hospital and ICU stay. Analyses used logistic regression with associations expressed as adjusted odds ratios (OR) with 95% confidence intervals (CI).ResultsOf 17,531 included patients, 46.2% (8099) and 8.2% (1430) of patients had stage 1 and 2 liver injury respectively. Compared to normal, stages 1 and 2 were associated with higher odds of mortality (OR 1.53 [1.37-1.71]; OR 2.50 [2.10-2.96]), ICU admission (OR 1.63 [1.48-1.79]; OR 1.90 [1.62-2.23]), and invasive mechanical ventilation (OR 1.43 [1.27-1.70]; OR 1.95 (1.55-2.45). Stages 1 and 2 were also associated with higher odds of developing sepsis (OR 1.38 [1.27-1.50]; OR 1.46 [1.25-1.70]), acute kidney injury (OR 1.13 [1.00-1.27]; OR 1.59 [1.32-1.91]), and acute respiratory distress syndrome (OR 1.38 [1.22-1.55]; OR 1.80 [1.49-2.17]).ConclusionsLiver enzyme abnormalities are common among COVID-19 patients and associated with worse outcomes

At-admission prediction of mortality and pulmonary embolism in an international cohort of hospitalised patients with COVID-19 using statistical and machine learning methods

By September 2022, more than 600 million cases of SARS-CoV-2 infection have been reported globally, resulting in over 6.5 million deaths. COVID-19 mortality risk estimators are often, however, developed with small unrepresentative samples and with methodological limitations. It is highly important to develop predictive tools for pulmonary embolism (PE) in COVID-19 patients as one of the most severe preventable complications of COVID-19. Early recognition can help provide life-saving targeted anti-coagulation therapy right at admission. Using a dataset of more than 800,000 COVID-19 patients from an international cohort, we propose a cost-sensitive gradient-boosted machine learning model that predicts occurrence of PE and death at admission. Logistic regression, Cox proportional hazards models, and Shapley values were used to identify key predictors for PE and death. Our prediction model had a test AUROC of 75.9% and 74.2%, and sensitivities of 67.5% and 72.7% for PE and all-cause mortality respectively on a highly diverse and held-out test set. The PE prediction model was also evaluated on patients in UK and Spain separately with test results of 74.5% AUROC, 63.5% sensitivity and 78.9% AUROC, 95.7% sensitivity. Age, sex, region of admission, comorbidities (chronic cardiac and pulmonary disease, dementia, diabetes, hypertension, cancer, obesity, smoking), and symptoms (any, confusion, chest pain, fatigue, headache, fever, muscle or joint pain, shortness of breath) were the most important clinical predictors at admission. Age, overall presence of symptoms, shortness of breath, and hypertension were found to be key predictors for PE using our extreme gradient boosted model. This analysis based on the, until now, largest global dataset for this set of problems can inform hospital prioritisation policy and guide long term clinical research and decision-making for COVID-19 patients globally. Our machine learning model developed from an international cohort can serve to better regulate hospital risk prioritisation of at-risk patients

Characteristics and outcomes of an international cohort of 600 000 hospitalized patients with COVID-19

Background: We describe demographic features, treatments and clinical outcomes in the International Severe Acute Respiratory and emerging Infection Consortium (ISARIC) COVID-19 cohort, one of the world's largest international, standardized data sets concerning hospitalized patients. Methods: The data set analysed includes COVID-19 patients hospitalized between January 2020 and January 2022 in 52 countries. We investigated how symptoms on admission, co-morbidities, risk factors and treatments varied by age, sex and other characteristics. We used Cox regression models to investigate associations between demographics, symptoms, co-morbidities and other factors with risk of death, admission to an intensive care unit (ICU) and invasive mechanical ventilation (IMV). Results: Data were available for 689 572 patients with laboratory-confirmed (91.1%) or clinically diagnosed (8.9%) SARS-CoV-2 infection from 52 countries. Age [adjusted hazard ratio per 10 years 1.49 (95% CI 1.48, 1.49)] and male sex [1.23 (1.21, 1.24)] were associated with a higher risk of death. Rates of admission to an ICU and use of IMV increased with age up to age 60 years then dropped. Symptoms, co-morbidities and treatments varied by age and had varied associations with clinical outcomes. The case-fatality ratio varied by country partly due to differences in the clinical characteristics of recruited patients and was on average 21.5%. Conclusions: Age was the strongest determinant of risk of death, with a ∼30-fold difference between the oldest and youngest groups; each of the co-morbidities included was associated with up to an almost 2-fold increase in risk. Smoking and obesity were also associated with a higher risk of death. The size of our international database and the standardized data collection method make this study a comprehensive international description of COVID-19 clinical features. Our findings may inform strategies that involve prioritization of patients hospitalized with COVID-19 who have a higher risk of death

Implementation of Recommendations on the Use of Corticosteroids in Severe COVID-19

Importance: Research diversity and representativeness are paramount in building trust, generating valid biomedical knowledge, and possibly in implementing clinical guidelines. Objectives: To compare variations over time and across World Health Organization (WHO) geographic regions of corticosteroid use for treatment of severe COVID-19; secondary objectives were to evaluate the association between the timing of publication of the RECOVERY (Randomised Evaluation of COVID-19 Therapy) trial (June 2020) and the WHO guidelines for corticosteroids (September 2020) and the temporal trends observed in corticosteroid use by region and to describe the geographic distribution of the recruitment in clinical trials that informed the WHO recommendation. Design, setting, and participants: This prospective cohort study of 434 851 patients was conducted between January 31, 2020, and September 2, 2022, in 63 countries worldwide. The data were collected under the auspices of the International Severe Acute Respiratory and Emerging Infections Consortium (ISARIC)-WHO Clinical Characterisation Protocol for Severe Emerging Infections. Analyses were restricted to patients hospitalized for severe COVID-19 (a subset of the ISARIC data set). Exposure: Corticosteroid use as reported to the ISARIC-WHO Clinical Characterisation Protocol for Severe Emerging Infections. Main outcomes and measures: Number and percentage of patients hospitalized with severe COVID-19 who received corticosteroids by time period and by WHO geographic region. Results: Among 434 851 patients with confirmed severe or critical COVID-19 for whom receipt of corticosteroids could be ascertained (median [IQR] age, 61.0 [48.0-74.0] years; 53.0% male), 174 307 (40.1%) received corticosteroids during the study period. Of the participants in clinical trials that informed the guideline, 91.6% were recruited from the United Kingdom. In all regions, corticosteroid use for severe COVID-19 increased, but this increase corresponded to the timing of the RECOVERY trial (time-interruption coefficient 1.0 [95% CI, 0.9-1.2]) and WHO guideline (time-interruption coefficient 1.9 [95% CI, 1.7-2.0]) publications only in Europe. At the end of the study period, corticosteroid use for treatment of severe COVID-19 was highest in the Americas (5421 of 6095 [88.9%]; 95% CI, 87.7-90.2) and lowest in Africa (31 588 of 185 191 [17.1%]; 95% CI, 16.8-17.3). Conclusions and relevance: The results of this cohort study showed that implementation of the guidelines for use of corticosteroids in the treatment of severe COVID-19 varied geographically. Uptake of corticosteroid treatment was lower in regions with limited clinical trial involvement. Improving research diversity and representativeness may facilitate timely knowledge uptake and guideline implementation

The value of open-source clinical science in pandemic response: lessons from ISARIC

International audienc