Machine learning algorithms performed no better than regression models for prognostication in traumatic brain injury

Objective: We aimed to explore the added value of common machine learning (ML) algorithms for prediction of outcome for moderate and severe traumatic brain injury. Study Design and Setting: We performed logistic regression (LR), lasso regression, and ridge regression with key baseline predictors in the IMPACT-II database (15 studies, n = 11,022). ML algorithms included support vector machines, random forests, gradient boosting machines, and artificial neural networks and were trained using the same predictors. To assess generalizability of predictions, we performed internal, internal-external, and external validation on the recent CENTER-TBI study (patients with Glasgow Coma Scale <13, n = 1,554). Both calibration (calibration slope/intercept) and discrimination (area under the curve) was quantified. Results: In the IMPACT-II database, 3,332/11,022 (30%) died and 5,233(48%) had unfavorable outcome (Glasgow Outcome Scale less than 4). In the CENTER-TBI study, 348/1,554(29%) died and 651(54%) had unfavorable outcome. Discrimination and calibration varied widely between the studies and less so between the studied algorithms. The mean area under the curve was 0.82 for mortality and 0.77 for unfavorable outcomes in the CENTER-TBI study. Conclusion: ML algorithms may not outperform traditional regression approaches in a low-dimensional setting for outcome prediction after moderate or severe traumatic brain injury. Similar to regression-based prediction models, ML algorithms should be rigorously validated to ensure applicability to new populations

Variation in Structure and Process of Care in Traumatic Brain Injury: Provider Profiles of European Neurotrauma Centers Participating in the CENTER-TBI Study.

INTRODUCTION: The strength of evidence underpinning care and treatment recommendations in traumatic brain injury (TBI) is low. Comparative effectiveness research (CER) has been proposed as a framework to provide evidence for optimal care for TBI patients. The first step in CER is to map the existing variation. The aim of current study is to quantify variation in general structural and process characteristics among centers participating in the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) study. METHODS: We designed a set of 11 provider profiling questionnaires with 321 questions about various aspects of TBI care, chosen based on literature and expert opinion. After pilot testing, questionnaires were disseminated to 71 centers from 20 countries participating in the CENTER-TBI study. Reliability of questionnaires was estimated by calculating a concordance rate among 5% duplicate questions. RESULTS: All 71 centers completed the questionnaires. Median concordance rate among duplicate questions was 0.85. The majority of centers were academic hospitals (n = 65, 92%), designated as a level I trauma center (n = 48, 68%) and situated in an urban location (n = 70, 99%). The availability of facilities for neuro-trauma care varied across centers; e.g. 40 (57%) had a dedicated neuro-intensive care unit (ICU), 36 (51%) had an in-hospital rehabilitation unit and the organization of the ICU was closed in 64% (n = 45) of the centers. In addition, we found wide variation in processes of care, such as the ICU admission policy and intracranial pressure monitoring policy among centers. CONCLUSION: Even among high-volume, specialized neurotrauma centers there is substantial variation in structures and processes of TBI care. This variation provides an opportunity to study effectiveness of specific aspects of TBI care and to identify best practices with CER approaches

Frequency of fatigue and its changes in the first 6 months after traumatic brain injury: results from the CENTER-TBI study

Background: Fatigue is one of the most commonly reported subjective symptoms following traumatic brain injury (TBI). The aims were to assess frequency of fatigue over the first 6 months after TBI, and examine whether fatigue changes could be predicted by demographic characteristics, injury severity and comorbidities. Methods: Patients with acute TBI admitted to 65 trauma centers were enrolled in the study Collaborative European NeuroTrauma Effectiveness Research in TBI (CENTER-TBI). Subj

Tracheal intubation in traumatic brain injury

Background: We aimed to study the associations between pre- and in-hospital tracheal intubation and outcomes in traumatic brain injury (TBI), and whether the association varied according to injury severity. Methods: Data from the international prospective pan-European cohort study, Collaborative European NeuroTrauma Effectiveness Research for TBI (CENTER-TBI), were used (n=4509). For prehospital intubation, we excluded self-presenters. For in-hospital intubation, patients whose tracheas were intubated on-scene were excluded. The association between intubation and outcome was analysed with ordinal regression with adjustment for the International Mission for Prognosis and Analysis of Clinical Trials in TBI variables and extracranial injury. We assessed whether the effect of intubation varied by injury severity by testing the added value of an interaction term with likelihood ratio tests. Results: In the prehospital analysis, 890/3736 (24%) patients had their tracheas intubated at scene. In the in-hospital analysis, 460/2930 (16%) patients had their tracheas intubated in the emergency department. There was no adjusted overall effect on functional outcome of prehospital intubation (odds ratio=1.01; 95% confidence interval, 0.79–1.28; P=0.96), and the adjusted overall effect of in-hospital intubation was not significant (odds ratio=0.86; 95% confidence interval, 0.65–1.13; P=0.28). However, prehospital intubation was associated with better functional outcome in patients with higher thorax and abdominal Abbreviated Injury Scale scores (P=0.009 and P=0.02, respectively), whereas in-hospital intubation was associated with better outcome in patients with lower Glasgow Coma Scale scores (P=0.01): in-hospital intubation was associated with better functional outcome in patients with Glasgow Coma Scale scores of 10 or lower. Conclusion: The benefits and harms of tracheal intubation should be carefully evaluated in patients with TBI to optimise benefit. This study suggests that extracranial injury should influence the decision in the prehospital setting, and level of consciousness in the in-hospital setting. Clinical trial registration: NCT02210221

Informed consent procedures in patients with an acute inability to provide informed consent

Purpose: Enrolling traumatic brain injury (TBI) patients with an inability to provide informed consent in research is challenging. Alternatives to patient consent are not sufficiently embedded in European and national legislation, which allows procedural variation and bias. We aimed to quantify variations in informed consent policy and practice. Methods: Variation was explored in the CENTER-TBI study. Policies were reported by using a questionnaire and national legislation. Data on used informed consent procedures were available for 4498 patients from 57 centres across 17 European countries. Results: Variation in the use of informed consent procedur

Variation in neurosurgical management of traumatic brain injury

Background: Neurosurgical management of traumatic brain injury (TBI) is challenging, with only low-quality evidence. We aimed to explore differences in neurosurgical strategies for TBI across Europe. Methods: A survey was sent to 68 centers participating in the Collaborative European Neurotrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) study. The questionnaire contained 21 questions, including the decision when to operate (or not) on traumatic acute subdural hematoma (ASDH) and intracerebral hematoma (ICH), and when to perform a decompressive craniectomy (DC) in raised intracranial pressure (ICP). Results: The survey was completed by 68 centers (100%). On average, 10 neurosurgeons work in each trauma center. In all centers, a neurosurgeon was available within 30 min. Forty percent of responders reported a thickness or volume threshold for evacuation of an ASDH. Most responders (78%) decide on a primary DC in evacuating an ASDH during the operation, when swelling is present. For ICH, 3% would perform an evacuation directly to prevent secondary deterioration and 66% only in case of clinical deterioration. Most respondents (91%) reported to consider a DC for refractory high ICP. The reported cut-off ICP for DC in refractory high ICP, however, differed: 60% uses 25 mmHg, 18% 30 mmHg, and 17% 20 mmHg. Treatment strategies varied substantially between regions, specifically for the threshold for ASDH surgery and DC for refractory raised ICP. Also within center variation was present: 31% reported variation within the hospital for inserting an ICP monitor and 43% for evacuating mass lesions. Conclusion: Despite a homogeneous organization, considerable practice variation exists of neurosurgical strategies for TBI in Europe. These results provide an incentive for comparative effectiveness research to determine elements of effective neurosurgical care