Development and validation of a prediction model for invasive bacterial infections in febrile children at European Emergency Departments : MOFICHE, a prospective observational study

Funding Information: Funding This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement no. 668303. The research was supported by the National Institute for Health Research Biomedical Research Centres at Imperial College London, Newcastle Hospitals NHS Foundation Trust and Newcastle University. Publisher Copyright: © 2021 Archives of Disease in ChildhoodObjectives: To develop and cross-validate a multivariable clinical prediction model to identify invasive bacterial infections (IBI) and to identify patient groups who might benefit from new biomarkers. Design: Prospective observational study. Setting: 12 emergency departments (EDs) in 8 European countries. Patients: Febrile children aged 0-18 years. Main outcome measures: IBI, defined as bacteraemia, meningitis and bone/joint infection. We derived and cross-validated a model for IBI using variables from the Feverkidstool (clinical symptoms, C reactive protein), neurological signs, non-blanching rash and comorbidity. We assessed discrimination (area under the receiver operating curve) and diagnostic performance at different risk thresholds for IBI: sensitivity, specificity, negative and positive likelihood ratios (LRs). Results: Of 16 268 patients, 135 (0.8%) had an IBI. The discriminative ability of the model was 0.84 (95% CI 0.81 to 0.88) and 0.78 (95% CI 0.74 to 0.82) in pooled cross-validations. The model performed well for the rule-out threshold of 0.1% (sensitivity 0.97 (95% CI 0.93 to 0.99), negative LR 0.1 (95% CI 0.0 to 0.2) and for the rule-in threshold of 2.0% (specificity 0.94 (95% CI 0.94 to 0.95), positive LR 8.4 (95% CI 6.9 to 10.0)). The intermediate thresholds of 0.1%-2.0% performed poorly (ranges: sensitivity 0.59-0.93, negative LR 0.14-0.57, specificity 0.52-0.88, positive LR 1.9-4.8) and comprised 9784 patients (60%). Conclusions: The rule-out threshold of this model has potential to reduce antibiotic treatment while the rule-in threshold could be used to target treatment in febrile children at the ED. In more than half of patients at intermediate risk, sensitive biomarkers could improve identification of IBI and potentially reduce unnecessary antibiotic prescriptions.publishersversionPeer reviewe

Diversity in the emergency care for febrile children in Europe : A questionnaire study

Publisher Copyright: © © Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.Objective To provide an overview of care in emergency departments (EDs) across Europe in order to interpret observational data and implement interventions regarding the management of febrile children. Design and setting An electronic questionnaire was sent to the principal investigators of an ongoing study (PERFORM (Personalised Risk assessment in Febrile illness to Optimise Real-life Management), www.perform2020.eu) in 11 European hospitals in eight countries: Austria, Germany, Greece, Latvia, the Netherlands, Slovenia, Spain and the UK. Outcome measures The questionnaire covered indicators in three domains: local ED quality (supervision, guideline availability, paper vs electronic health records), organisation of healthcare (primary care, immunisation), and local factors influencing or reflecting resource use (availability of point-of-care tests, admission rates). Results Reported admission rates ranged from 4% to 51%. In six settings (Athens, Graz, Ljubljana, Riga, Rotterdam, Santiago de Compostela), the supervising ED physicians were general paediatricians, in two (Liverpool, London) these were paediatric emergency physicians, in two (Nijmegen, Newcastle) supervision could take place by either a general paediatrician or a general emergency physician, and in one (München) this could be either a general paediatrician or a paediatric emergency physician. The supervising physician was present on site in all settings during office hours and in five out of eleven settings during out-of-office hours. Guidelines for fever and sepsis were available in all settings; however, the type of guideline that was used differed. Primary care was available in all settings during office hours and in eight during out-of-office hours. There were differences in routine immunisations as well as in additional immunisations that were offered; immunisation rates varied between and within countries. Conclusion Differences in local, regional and national aspects of care exist in the management of febrile children across Europe. This variability has to be considered when trying to interpret differences in the use of diagnostic tools, antibiotics and admission rates. Any future implementation of interventions or diagnostic tests will need to be aware of this European diversity.Peer reviewe

Emergency medical services utilisation among febrile children attending emergency departments across Europe: an observational multicentre study

Children constitute 6-10% of all patients attending the emergency department (ED) by emergency medical services (EMS). However, discordant EMS use in children occurs in 37-61% with fever as an important risk factor. We aimed to describe EMS utilisation among febrile children attending European EDs. This study is part of an observational multicentre study assessing management and outcome in febrile children up to 18 years (MOFICHE) attending twelve EDs in eight European countries. Discordant EMS use was defined as the absence of markers of urgency including intermediate/high triage urgency, advanced diagnostics, treatment, and admission in children transferred by EMS. Multivariable logistic regression analyses were performed for the association between (1) EMS use and markers of urgency, and (2) patient characteristics and discordant EMS use after adjusting all analyses for the covariates age, gender, visiting hours, presenting symptoms, and ED setting. A total of 5464 (15%, range 0.1-42%) children attended the ED by EMS. Markers of urgency were more frequently present in the EMS group compared with the non-EMS group. Discordant EMS use occurred in 1601 children (29%, range 1-59%). Age and gender were not associated with discordant EMS use, whereas neurological symptoms were associated with less discordant EMS use (aOR 0.2, 95%CI 0.1-0.2), and attendance out of office hours was associated with more discordant EMS use (aOR 1.6, 95%CI 1.4-1.9). Settings with higher percentage of self-referrals to the ED had more discordant EMS use (p < 0.05).  Conclusion: There is large practice variation in EMS use in febrile children attending European EDs. Markers of urgency were more frequently present in children in the EMS group. However, discordant EMS use occurred in 29%. Further research is needed on non-medical factors influencing discordant EMS use in febrile children across Europe, so that pre-emptive strategies can be implemented. What is Known: •Children constitute around 6-10% of all patients attending the emergency department by emergency medical services. •Discordant EMS use occurs in 37-61% of all children, with fever as most common presenting symptom for discordant EMS use in children. What is New: •There is large practice variation in EMS use among febrile children across Europe with discordance EMS use occurring in 29% (range 1-59%), which was associated with attendance during out of office hours and with settings with higher percentage of self-referrals to the ED. •Future research is needed focusing on non-medical factors (socioeconomic status, parental preferences and past experience, healthcare systems, referral pathways, out of hours services provision) that influence discordant EMS use in febrile children across Europe

Impact of a clinical decision rule on antibiotic prescription for children with suspected lower respiratory tract infections presenting to European emergency departments : a simulation study based on routine data

Publisher Copyright: © The Author(s) 2021. Published by Oxford University Press on behalf of the British Society for Antimicrobial Chemotherapy. All rights reserved. For permissions, please email: [email protected]: Discriminating viral from bacterial lower respiratory tract infections (LRTIs) in children is challenging thus commonly resulting in antibiotic overuse. The Feverkidstool, a validated clinical decision rule including clinical symptoms and C-reactive protein, safely reduced antibiotic use in children at low/intermediate risk for bacterial LRTIs in a multicentre trial at emergency departments (EDs) in the Netherlands. OBJECTIVES: Using routine data from an observational study, we simulated the impact of the Feverkidstool on antibiotic prescriptions compared with observed antibiotic prescriptions in children with suspected LRTIs at 12 EDs in eight European countries. METHODS: We selected febrile children aged 1 month to 5 years with respiratory symptoms and excluded upper respiratory tract infections. Using the Feverkidstool, we calculated individual risks for bacterial LRTI retrospectively. We simulated antibiotic prescription rates under different scenarios: (1) applying effect estimates on antibiotic prescription from the trial; and (2) varying both usage (50%-100%) and compliance (70%-100%) with the Feverkidstool's advice to withhold antibiotics in children at low/intermediate risk for bacterial LRTI (≤10%). RESULTS: Of 4938 children, 4209 (85.2%) were at low/intermediate risk for bacterial LRTI. Applying effect estimates from the trial, the Feverkidstool reduced antibiotic prescription from 33.5% to 24.1% [pooled risk difference: 9.4% (95% CI: 5.7%-13.1%)]. Simulating 50%-100% usage with 90% compliance resulted in risk differences ranging from 8.3% to 15.8%. Our simulations suggest that antibiotic prescriptions would be reduced in EDs with high baseline antibiotic prescription rates or predominantly (>85%) low/intermediate-risk children. CONCLUSIONS: Implementation of the Feverkidstool could reduce antibiotic prescriptions in children with suspected LRTIs in European EDs.publishersversionPeer reviewe

Diagnosis of Multisystem Inflammatory Syndrome in Children by a Whole-Blood Transcriptional Signature

Background: To identify a diagnostic blood transcriptomic signature that distinguishes multisystem inflammatory syndrome in children (MIS-C) from Kawasaki disease (KD), bacterial infections, and viral infections. Methods: Children presenting with MIS-C to participating hospitals in the United Kingdom and the European Union between April 2020 and April 2021 were prospectively recruited. Whole-blood RNA Sequencing was performed, contrasting the transcriptomes of children with MIS-C (n = 38) to those from children with KD (n = 136), definite bacterial (DB; n = 188) and viral infections (DV; n = 138). Genes significantly differentially expressed (SDE) between MIS-C and comparator groups were identified. Feature selection was used to identify genes that optimally distinguish MIS-C from other diseases, which were subsequently translated into RT-qPCR assays and evaluated in an independent validation set comprising MIS-C (n = 37), KD (n = 19), DB (n = 56), DV (n = 43), and COVID-19 (n = 39). Results: In the discovery set, 5696 genes were SDE between MIS-C and combined comparator disease groups. Five genes were identified as potential MIS-C diagnostic biomarkers (HSPBAP1, VPS37C, TGFB1, MX2, and TRBV11-2), achieving an AUC of 96.8% (95% CI: 94.6%–98.9%) in the discovery set, and were translated into RT-qPCR assays. The RT-qPCR 5-gene signature achieved an AUC of 93.2% (95% CI: 88.3%–97.7%) in the independent validation set when distinguishing MIS-C from KD, DB, and DV. Conclusions: MIS-C can be distinguished from KD, DB, and DV groups using a 5-gene blood RNA expression signature. The small number of genes in the signature and good performance in both discovery and validation sets should enable the development of a diagnostic test for MIS-C

A multi-platform approach to identify a blood-based host protein signature for distinguishing between bacterial and viral infections in febrile children (PERFORM): a multi-cohort machine learning study

Background: Differentiating between self-resolving viral infections and bacterial infections in children who are febrile is a common challenge, causing difficulties in identifying which individuals require antibiotics. Studying the host response to infection can provide useful insights and can lead to the identification of biomarkers of infection with diagnostic potential. This study aimed to identify host protein biomarkers for future development into an accurate, rapid point-of-care test that can distinguish between bacterial and viral infections, by recruiting children presenting to health-care settings with fever or a history of fever in the previous 72 h. Methods: In this multi-cohort machine learning study, patient data were taken from EUCLIDS, the Swiss Pediatric Sepsis study, the GENDRES study, and the PERFORM study, which were all based in Europe. We generated three high-dimensional proteomic datasets (SomaScan and two via liquid chromatography tandem mass spectrometry, referred to as MS-A and MS-B) using targeted and untargeted platforms (SomaScan and liquid chromatography mass spectrometry). Protein biomarkers were then shortlisted using differential abundance analysis, feature selection using forward selection-partial least squares (FS-PLS; 100 iterations), along with a literature search. Identified proteins were tested with Luminex and ELISA and iterative FS-PLS was done again (25 iterations) on the Luminex results alone, and the Luminex and ELISA results together. A sparse protein signature for distinguishing between bacterial and viral infections was identified from the selected proteins. The performance of this signature was finally tested using Luminex assays and by calculating disease risk scores. Findings: 376 children provided serum or plasma samples for use in the discovery of protein biomarkers. 79 serum samples were collected for the generation of the SomaScan dataset, 147 plasma samples for the MS-A dataset, and 150 plasma samples for the MS-B dataset. Differential abundance analysis, and the first round of feature selection using FS-PLS identified 35 protein biomarker candidates, of which 13 had commercial ELISA or Luminex tests available. 16 proteins with ELISA or Luminex tests available were identified by literature review. Further evaluation via Luminex and ELISA and the second round of feature selection using FS-PLS revealed a six-protein signature: three of the included proteins are elevated in bacterial infections (SELE, NGAL, and IFN-γ), and three are elevated in viral infections (IL18, NCAM1, and LG3BP). Performance testing of the signature using Luminex assays revealed area under the receiver operating characteristic curve values between 89·4% and 93·6%. Interpretation: This study has led to the identification of a protein signature that could be ultimately developed into a blood-based point-of-care diagnostic test for rapidly diagnosing bacterial and viral infections in febrile children. Such a test has the potential to greatly improve care of children who are febrile, ensuring that the correct individuals receive antibiotics

A multi-platform approach to identify a blood-based host protein signature for distinguishing between bacterial and viral infections in febrile children (PERFORM): a multi-cohort machine learning study.

BACKGROUND Differentiating between self-resolving viral infections and bacterial infections in children who are febrile is a common challenge, causing difficulties in identifying which individuals require antibiotics. Studying the host response to infection can provide useful insights and can lead to the identification of biomarkers of infection with diagnostic potential. This study aimed to identify host protein biomarkers for future development into an accurate, rapid point-of-care test that can distinguish between bacterial and viral infections, by recruiting children presenting to health-care settings with fever or a history of fever in the previous 72 h. METHODS In this multi-cohort machine learning study, patient data were taken from EUCLIDS, the Swiss Pediatric Sepsis study, the GENDRES study, and the PERFORM study, which were all based in Europe. We generated three high-dimensional proteomic datasets (SomaScan and two via liquid chromatography tandem mass spectrometry, referred to as MS-A and MS-B) using targeted and untargeted platforms (SomaScan and liquid chromatography mass spectrometry). Protein biomarkers were then shortlisted using differential abundance analysis, feature selection using forward selection-partial least squares (FS-PLS; 100 iterations), along with a literature search. Identified proteins were tested with Luminex and ELISA and iterative FS-PLS was done again (25 iterations) on the Luminex results alone, and the Luminex and ELISA results together. A sparse protein signature for distinguishing between bacterial and viral infections was identified from the selected proteins. The performance of this signature was finally tested using Luminex assays and by calculating disease risk scores. FINDINGS 376 children provided serum or plasma samples for use in the discovery of protein biomarkers. 79 serum samples were collected for the generation of the SomaScan dataset, 147 plasma samples for the MS-A dataset, and 150 plasma samples for the MS-B dataset. Differential abundance analysis, and the first round of feature selection using FS-PLS identified 35 protein biomarker candidates, of which 13 had commercial ELISA or Luminex tests available. 16 proteins with ELISA or Luminex tests available were identified by literature review. Further evaluation via Luminex and ELISA and the second round of feature selection using FS-PLS revealed a six-protein signature: three of the included proteins are elevated in bacterial infections (SELE, NGAL, and IFN-γ), and three are elevated in viral infections (IL18, NCAM1, and LG3BP). Performance testing of the signature using Luminex assays revealed area under the receiver operating characteristic curve values between 89·4% and 93·6%. INTERPRETATION This study has led to the identification of a protein signature that could be ultimately developed into a blood-based point-of-care diagnostic test for rapidly diagnosing bacterial and viral infections in febrile children. Such a test has the potential to greatly improve care of children who are febrile, ensuring that the correct individuals receive antibiotics. FUNDING European Union's Horizon 2020 research and innovation programme, the European Union's Seventh Framework Programme (EUCLIDS), Imperial Biomedical Research Centre of the National Institute for Health Research, the Wellcome Trust and Medical Research Foundation, Instituto de Salud Carlos III, Consorcio Centro de Investigación Biomédica en Red de Enfermedades Respiratorias, Grupos de Refeencia Competitiva, Swiss State Secretariat for Education, Research and Innovation

Availability and use of rapid diagnostic tests for the management of acute childhood infections in Europe : A cross-sectional survey of paediatricians

Background Point-of-care-tests (POCTs) have been advocated to optimise care in patients with infections but their actual use varies. This study aimed to estimate the variability in the adoption of current POCTs by paediatricians across Europe, and to explore the determinants of variability.Methods and findings A cross-sectional survey was conducted of hospital and primary care paediatricians, recruited through professional networks. Questions focused on the availability and use of currently available POCTs. Data were analysed descriptively and using Median Odds Ratio (MOR) to measure variation between countries. Multilevel regression modelling using changes in the area under the receiver operating characteristic curve of models were used to assess the contribution of individual or workplace versus country level factors, to the observed variation. The commonest POCT was urine dipsticks (UD) which were available to >80% of primary care and hospital paediatricians in 68% (13/19) and 79% (23/29) countries, respectively. Availability of all POCTs varied between countries. In primary care, the country (MOR) varied from 1.61 (95%CI: 1.04-2.58) for lactate to 7.28 (95%CI: 3.04-24.35) for UD. In hospitals, the country MOR varied from 1.37 (95%CI:1.04-1.80) for lactate to 11.93 (95%CI:3.35-72.23) for UD. Most paediatricians in primary care (69%, 795/1154) and hospital (81%, 962/1188) would use a diagnostic test in the case scenario of an infant with undifferentiated fever. Multilevel regression modelling showed that the country of work was more important in predicting both the availability and use of POCTs than individual or workplace characteristics.Conclusion There is substantial variability in the adoption of POCTs for the management of acute infections in children across Europe. To inform future implementation of both existing and innovative tests, further research is needed to understand what drives the variation between countries, the needs of frontline clinicians, and the role of diagnostic tests in the management of acute childhood infections.Peer reviewe

Relationship between molecular pathogen detection and clinical disease in febrile children across Europe:a multicentre, prospective observational study

Background: The PERFORM study aimed to understand causes of febrile childhood illness by comparing molecular pathogen detection with current clinical practice. Methods: Febrile children and controls were recruited on presentation to hospital in 9 European countries 2016–2020. Each child was assigned a standardized diagnostic category based on retrospective review of local clinical and microbiological data. Subsequently, centralised molecular tests (CMTs) for 19 respiratory and 27 blood pathogens were performed. Findings: Of 4611 febrile children, 643 (14%) were classified as definite bacterial infection (DB), 491 (11%) as definite viral infection (DV), and 3477 (75%) had uncertain aetiology. 1061 controls without infection were recruited. CMTs detected blood bacteria more frequently in DB than DV cases for N. meningitidis (OR: 3.37, 95% CI: 1.92–5.99), S. pneumoniae (OR: 3.89, 95% CI: 2.07–7.59), Group A streptococcus (OR 2.73, 95% CI 1.13–6.09) and E. coli (OR 2.7, 95% CI 1.02–6.71). Respiratory viruses were more common in febrile children than controls, but only influenza A (OR 0.24, 95% CI 0.11–0.46), influenza B (OR 0.12, 95% CI 0.02–0.37) and RSV (OR 0.16, 95% CI: 0.06–0.36) were less common in DB than DV cases. Of 16 blood viruses, enterovirus (OR 0.43, 95% CI 0.23–0.72) and EBV (OR 0.71, 95% CI 0.56–0.90) were detected less often in DB than DV cases. Combined local diagnostics and CMTs respectively detected blood viruses and respiratory viruses in 360 (56%) and 161 (25%) of DB cases, and virus detection ruled-out bacterial infection poorly, with predictive values of 0.64 and 0.68 respectively. Interpretation: Most febrile children cannot be conclusively defined as having bacterial or viral infection when molecular tests supplement conventional approaches. Viruses are detected in most patients with bacterial infections, and the clinical value of individual pathogen detection in determining treatment is low. New approaches are needed to help determine which febrile children require antibiotics. Funding: EU Horizon 2020 grant 668303.</p

Emergency medical services utilisation among febrile children attending emergency departments across Europe:an observational multicentre study

Children constitute 6–10% of all patients attending the emergency department (ED) by emergency medical services (EMS). However, discordant EMS use in children occurs in 37–61% with fever as an important risk factor. We aimed to describe EMS utilisation among febrile children attending European EDs. This study is part of an observational multicentre study assessing management and outcome in febrile children up to 18 years (MOFICHE) attending twelve EDs in eight European countries. Discordant EMS use was defined as the absence of markers of urgency including intermediate/high triage urgency, advanced diagnostics, treatment, and admission in children transferred by EMS. Multivariable logistic regression analyses were performed for the association between (1) EMS use and markers of urgency, and (2) patient characteristics and discordant EMS use after adjusting all analyses for the covariates age, gender, visiting hours, presenting symptoms, and ED setting. A total of 5464 (15%, range 0.1–42%) children attended the ED by EMS. Markers of urgency were more frequently present in the EMS group compared with the non-EMS group. Discordant EMS use occurred in 1601 children (29%, range 1–59%). Age and gender were not associated with discordant EMS use, whereas neurological symptoms were associated with less discordant EMS use (aOR 0.2, 95%CI 0.1–0.2), and attendance out of office hours was associated with more discordant EMS use (aOR 1.6, 95%CI 1.4–1.9). Settings with higher percentage of self-referrals to the ED had more discordant EMS use (p &lt; 0.05). Conclusion: There is large practice variation in EMS use in febrile children attending European EDs. Markers of urgency were more frequently present in children in the EMS group. However, discordant EMS use occurred in 29%. Further research is needed on non-medical factors influencing discordant EMS use in febrile children across Europe, so that pre-emptive strategies can be implemented. What is Known: •Children constitute around 6–10% of all patients attending the emergency department by emergency medical services. •Discordant EMS use occurs in 37–61% of all children, with fever as most common presenting symptom for discordant EMS use in children. What is New: •There is large practice variation in EMS use among febrile children across Europe with discordance EMS use occurring in 29% (range 1–59%), which was associated with attendance during out of office hours and with settings with higher percentage of self-referrals to the ED. •Future research is needed focusing on non-medical factors (socioeconomic status, parental preferences and past experience, healthcare systems, referral pathways, out of hours services provision) that influence discordant EMS use in febrile children across Europe.</p