Machine learning algorithms performed no better than regression models for prognostication in traumatic brain injury

Objective: We aimed to explore the added value of common machine learning (ML) algorithms for prediction of outcome for moderate and severe traumatic brain injury. Study Design and Setting: We performed logistic regression (LR), lasso regression, and ridge regression with key baseline predictors in the IMPACT-II database (15 studies, n = 11,022). ML algorithms included support vector machines, random forests, gradient boosting machines, and artificial neural networks and were trained using the same predictors. To assess generalizability of predictions, we performed internal, internal-external, and external validation on the recent CENTER-TBI study (patients with Glasgow Coma Scale <13, n = 1,554). Both calibration (calibration slope/intercept) and discrimination (area under the curve) was quantified. Results: In the IMPACT-II database, 3,332/11,022 (30%) died and 5,233(48%) had unfavorable outcome (Glasgow Outcome Scale less than 4). In the CENTER-TBI study, 348/1,554(29%) died and 651(54%) had unfavorable outcome. Discrimination and calibration varied widely between the studies and less so between the studied algorithms. The mean area under the curve was 0.82 for mortality and 0.77 for unfavorable outcomes in the CENTER-TBI study. Conclusion: ML algorithms may not outperform traditional regression approaches in a low-dimensional setting for outcome prediction after moderate or severe traumatic brain injury. Similar to regression-based prediction models, ML algorithms should be rigorously validated to ensure applicability to new populations

Primary versus early secondary referral to a specialized neurotrauma center in patients with moderate/severe traumatic brain injury: a CENTER TBI study

Funder: ZNS - Hannelore Kohl Stiftung; doi: http://dx.doi.org/10.13039/501100007731Funder: Integra LifeSciences CorporationFunder: OneMindAbstract: Background: Prehospital care for patients with traumatic brain injury (TBI) varies with some emergency medical systems recommending direct transport of patients with moderate to severe TBI to hospitals with specialist neurotrauma care (SNCs). The aim of this study is to assess variation in levels of early secondary referral within European SNCs and to compare the outcomes of directly admitted and secondarily transferred patients. Methods: Patients with moderate and severe TBI (Glasgow Coma Scale < 13) from the prospective European CENTER-TBI study were included in this study. All participating hospitals were specialist neuroscience centers. First, adjusted between-country differences were analysed using random effects logistic regression where early secondary referral was the dependent variable, and a random intercept for country was included. Second, the adjusted effect of early secondary referral on survival to hospital discharge and functional outcome [6 months Glasgow Outcome Scale Extended (GOSE)] was estimated using logistic and ordinal mixed effects models, respectively. Results: A total of 1347 moderate/severe TBI patients from 53 SNCs in 18 European countries were included. Of these 1347 patients, 195 (14.5%) were admitted after early secondary referral. Secondarily referred moderate/severe TBI patients presented more often with a CT abnormality: mass lesion (52% vs. 34%), midline shift (54% vs. 36%) and acute subdural hematoma (77% vs. 65%). After adjusting for case-mix, there was a large European variation in early secondary referral, with a median OR of 1.69 between countries. Early secondary referral was not associated with functional outcome (adjusted OR 1.07, 95% CI 0.78–1.69), nor with survival at discharge (1.05, 0.58–1.90). Conclusions: Across Europe, substantial practice variation exists in the proportion of secondarily referred TBI patients at SNCs that is not explained by case mix. Within SNCs early secondary referral does not seem to impact functional outcome and survival after stabilisation in a non-specialised hospital. Future research should identify which patients with TBI truly benefit from direct transportation

How do 66 European institutional review boards approve one protocol for an international prospective observational study on traumatic brain injury? Experiences from the CENTER-TBI study

Abstract: Background: The European Union (EU) aims to optimize patient protection and efficiency of health-care research by harmonizing procedures across Member States. Nonetheless, further improvements are required to increase multicenter research efficiency. We investigated IRB procedures in a large prospective European multicenter study on traumatic brain injury (TBI), aiming to inform and stimulate initiatives to improve efficiency. Methods: We reviewed relevant documents regarding IRB submission and IRB approval from European neurotrauma centers participating in the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI). Documents included detailed information on IRB procedures and the duration from IRB submission until approval(s). They were translated and analyzed to determine the level of harmonization of IRB procedures within Europe. Results: From 18 countries, 66 centers provided the requested documents. The primary IRB review was conducted centrally (N = 11, 61%) or locally (N = 7, 39%) and primary IRB approval was obtained after one (N = 8, 44%), two (N = 6, 33%) or three (N = 4, 23%) review rounds with a median duration of respectively 50 and 98 days until primary IRB approval. Additional IRB approval was required in 55% of countries and could increase duration to 535 days. Total duration from submission until required IRB approval was obtained was 114 days (IQR 75–224) and appeared to be shorter after submission to local IRBs compared to central IRBs (50 vs. 138 days, p = 0.0074). Conclusion: We found variation in IRB procedures between and within European countries. There were differences in submission and approval requirements, number of review rounds and total duration. Research collaborations could benefit from the implementation of more uniform legislation and regulation while acknowledging local cultural habits and moral values between countries

Tracheal intubation in traumatic brain injury

Background: We aimed to study the associations between pre- and in-hospital tracheal intubation and outcomes in traumatic brain injury (TBI), and whether the association varied according to injury severity. Methods: Data from the international prospective pan-European cohort study, Collaborative European NeuroTrauma Effectiveness Research for TBI (CENTER-TBI), were used (n=4509). For prehospital intubation, we excluded self-presenters. For in-hospital intubation, patients whose tracheas were intubated on-scene were excluded. The association between intubation and outcome was analysed with ordinal regression with adjustment for the International Mission for Prognosis and Analysis of Clinical Trials in TBI variables and extracranial injury. We assessed whether the effect of intubation varied by injury severity by testing the added value of an interaction term with likelihood ratio tests. Results: In the prehospital analysis, 890/3736 (24%) patients had their tracheas intubated at scene. In the in-hospital analysis, 460/2930 (16%) patients had their tracheas intubated in the emergency department. There was no adjusted overall effect on functional outcome of prehospital intubation (odds ratio=1.01; 95% confidence interval, 0.79–1.28; P=0.96), and the adjusted overall effect of in-hospital intubation was not significant (odds ratio=0.86; 95% confidence interval, 0.65–1.13; P=0.28). However, prehospital intubation was associated with better functional outcome in patients with higher thorax and abdominal Abbreviated Injury Scale scores (P=0.009 and P=0.02, respectively), whereas in-hospital intubation was associated with better outcome in patients with lower Glasgow Coma Scale scores (P=0.01): in-hospital intubation was associated with better functional outcome in patients with Glasgow Coma Scale scores of 10 or lower. Conclusion: The benefits and harms of tracheal intubation should be carefully evaluated in patients with TBI to optimise benefit. This study suggests that extracranial injury should influence the decision in the prehospital setting, and level of consciousness in the in-hospital setting. Clinical trial registration: NCT02210221

Occurrence and timing of withdrawal of life-sustaining measures in traumatic brain injury patients: a CENTER-TBI study

Funder: National Institute for Health Research (UK)Abstract: Background: In patients with severe brain injury, withdrawal of life-sustaining measures (WLSM) is common in intensive care units (ICU). WLSM constitutes a dilemma: instituting WLSM too early could result in death despite the possibility of an acceptable functional outcome, whereas delaying WLSM could unnecessarily burden patients, families, clinicians, and hospital resources. We aimed to describe the occurrence and timing of WLSM, and factors associated with timing of WLSM in European ICUs in patients with traumatic brain injury (TBI). Methods: The CENTER-TBI Study is a prospective multi-center cohort study. For the current study, patients with traumatic brain injury (TBI) admitted to the ICU and aged 16 or older were included. Occurrence and timing of WLSM were documented. For the analyses, we dichotomized timing of WLSM in early (< 72 h after injury) versus later (≥ 72 h after injury) based on recent guideline recommendations. We assessed factors associated with initiating WLSM early versus later, including geographic region, center, patient, injury, and treatment characteristics with univariable and multivariable (mixed effects) logistic regression. Results: A total of 2022 patients aged 16 or older were admitted to the ICU. ICU mortality was 13% (n = 267). Of these, 229 (86%) patients died after WLSM, and were included in the analyses. The occurrence of WLSM varied between regions ranging from 0% in Eastern Europe to 96% in Northern Europe. In 51% of the patients, WLSM was early. Patients in the early WLSM group had a lower maximum therapy intensity level (TIL) score than patients in the later WLSM group (median of 5 versus 10) The strongest independent variables associated with early WLSM were one unreactive pupil (odds ratio (OR) 4.0, 95% confidence interval (CI) 1.3–12.4) or two unreactive pupils (OR 5.8, CI 2.6–13.1) compared to two reactive pupils, and an Injury Severity Score (ISS) if over 41 (OR per point above 41 = 1.1, CI 1.0–1.1). Timing of WLSM was not significantly associated with region or center. Conclusion: WLSM occurs early in half of the patients, mostly in patients with severe TBI affecting brainstem reflexes who were severely injured. We found no regional or center influences in timing of WLSM. Whether WLSM is always appropriate or may contribute to a self-fulfilling prophecy requires further research and argues for reluctance to institute WLSM early in case of any doubt on prognosis

Frequency of fatigue and its changes in the first 6 months after traumatic brain injury: results from the CENTER-TBI study

Background: Fatigue is one of the most commonly reported subjective symptoms following traumatic brain injury (TBI). The aims were to assess frequency of fatigue over the first 6 months after TBI, and examine whether fatigue changes could be predicted by demographic characteristics, injury severity and comorbidities. Methods: Patients with acute TBI admitted to 65 trauma centers were enrolled in the study Collaborative European NeuroTrauma Effectiveness Research in TBI (CENTER-TBI). Subj

Informed consent procedures in patients with an acute inability to provide informed consent

Purpose: Enrolling traumatic brain injury (TBI) patients with an inability to provide informed consent in research is challenging. Alternatives to patient consent are not sufficiently embedded in European and national legislation, which allows procedural variation and bias. We aimed to quantify variations in informed consent policy and practice. Methods: Variation was explored in the CENTER-TBI study. Policies were reported by using a questionnaire and national legislation. Data on used informed consent procedures were available for 4498 patients from 57 centres across 17 European countries. Results: Variation in the use of informed consent procedur

Frequency and predictors of headache in the first 12 months after traumatic brain injury: results from CENTER-TBI

Background: Headache is a prevalent and debilitating symptom following traumatic brain injury (TBI). Large-scale, prospective cohort studies are needed to establish long-term headache prevalence and associated factors after TBI. This study aimed to assess the frequency and severity of headache after TBI and determine whether sociodemographic factors, injury severity characteristics, and pre- and post-injury comorbidities predicted changes in headache frequency and severity during the first 12 months after injury. Methods: A large patient sample from the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) prospective observational cohort study was used. Patients were stratified based on their clinical care pathway: admitted to an emergency room (ER), a ward (ADM) or an intensive care unit (ICU) in the acute phase. Headache was assessed using a single item from the Rivermead Post-Concussion Symptoms Questionnaire measured at baseline, 3, 6 and 12 months after injury. Mixed-effect logistic regression analyses were applied to investigate changes in headache frequency and associated predictors. Results: A total of 2,291 patients responded to the headache item at baseline. At study enrolment, 59.3% of patients reported acute headache, with similar frequencies across all strata. Female patients and those aged up to 40 years reported a higher frequency of headache at baseline compared to males and older adults. The frequency of severe headache was highest in patients admitted to the ICU. The frequency of headache in the ER stratum decreased substantially from baseline to 3 months and remained from 3 to 6 months. Similar trajectory trends were observed in the ICU and ADM strata across 12 months. Younger age, more severe TBI, fatigue, neck pain and vision problems were among the predictors of more severe headache over time. More than 25% of patients experienced headache at 12 months after injury. Conclusions: Headache is a common symptom after TBI, especially in female and younger patients. It typically decreases in the first 3 months before stabilising. However, more than a quarter of patients still experienced headache at 12 months after injury. Translational research is needed to advance the clinical decision-making process and improve targeted medical treatment for headache. Trial registration: ClinicalTrials.gov NCT02210221.</p