Test-Retest Reliability and Interpretation of Common Concussion Assessment Tools: Findings from the NCAA-DoD CARE Consortium

BACKGROUND: Concussion diagnosis is typically made through clinical examination and supported by performance on clinical assessment tools. Performance on commonly implemented and emerging assessment tools is known to vary between administrations, in the absence of concussion. OBJECTIVE: To evaluate the test-retest reliability of commonly implemented and emerging concussion assessment tools across a large nationally representative sample of student-athletes. METHODS: Participants (n = 4874) from the Concussion Assessment, Research, and Education Consortium completed annual baseline assessments on two or three occasions. Each assessment included measures of self-reported concussion symptoms, motor control, brief and extended neurocognitive function, reaction time, oculomotor/oculovestibular function, and quality of life. Consistency between years 1 and 2 and 1 and 3 were estimated using intraclass correlation coefficients or Kappa and effect sizes (Cohen's d). Clinical interpretation guidelines were also generated using confidence intervals to account for non-normally distributed data. RESULTS: Reliability for the self-reported concussion symptoms, motor control, and brief and extended neurocognitive assessments from year 1 to 2 ranged from 0.30 to 0.72 while effect sizes ranged from 0.01 to 0.28 (i.e., small). The reliability for these same measures ranged from 0.34 to 0.66 for the year 1-3 interval with effect sizes ranging from 0.05 to 0.42 (i.e., small to less than medium). The year 1-2 reliability for the reaction time, oculomotor/oculovestibular function, and quality-of-life measures ranged from 0.28 to 0.74 with effect sizes from 0.01 to 0.38 (i.e., small to less than medium effects). CONCLUSIONS: This investigation noted less than optimal reliability for most common and emerging concussion assessment tools. Despite this finding, their use is still necessitated by the absence of a gold standard diagnostic measure, with the ultimate goal of developing more refined and sound tools for clinical use. Clinical interpretation guidelines are provided for the clinician to apply with a degree of certainty in application

A National Study on the Effects of Concussion in Collegiate Athletes and US Military Service Academy Members: The NCAA-DoD Concussion Assessment, Research and Education (CARE) Consortium Structure and Methods

BACKGROUND: The natural history of mild traumatic brain injury (TBI) or concussion remains poorly defined and no objective biomarker of physiological recovery exists for clinical use. The National Collegiate Athletic Association (NCAA) and the US Department of Defense (DoD) established the Concussion Assessment, Research and Education (CARE) Consortium to study the natural history of clinical and neurobiological recovery after concussion in the service of improved injury prevention, safety and medical care for student-athletes and military personnel. OBJECTIVES: The objectives of this paper were to (i) describe the background and driving rationale for the CARE Consortium; (ii) outline the infrastructure of the Consortium policies, procedures, and governance; (iii) describe the longitudinal 6-month clinical and neurobiological study methodology; and (iv) characterize special considerations in the design and implementation of a multicenter trial. METHODS: Beginning Fall 2014, CARE Consortium institutions have recruited and enrolled 23,533 student-athletes and military service academy students (approximately 90% of eligible student-athletes and cadets; 64.6% male, 35.4% female). A total of 1174 concussions have been diagnosed in participating subjects, with both concussion and baseline cases deposited in the Federal Interagency Traumatic Brain Injury Research (FITBIR) database. CONCLUSIONS: Challenges have included coordinating regulatory issues across civilian and military institutions, operationalizing study procedures, neuroimaging protocol harmonization across sites and platforms, construction and maintenance of a relational database, and data quality and integrity monitoring. The NCAA-DoD CARE Consortium represents a comprehensive investigation of concussion in student-athletes and military service academy students. The richly characterized study sample and multidimensional approach provide an opportunity to advance the field of concussion science, not only among student athletes but in all populations at risk for mild TBI

School-level determinants of incidence of sports-related concussion: Findings from the CARE Consortium

OBJECTIVE: Epidemiologic research on sports-related concussion (SRC) has focused on individual risk factors, with limited research on institutional risk factors and variability in concussion rates. METHODS: This study used data from 53,822 athletes-seasons collected at 30 United States sites (26 civilian institutions and 4 military service academies), from 2014/15 to 2018/19 academic years, by the Concussion Assessment, Research, and Education Consortium. School-level risk factors included competitive division (DI, DII, DIII), school type (military/civilian) and a Sport Risk Index (SRI; Low, Medium, High). For comparability between civilian institutions and military academies, only NCAA athletes and concussions in sports games and practices were included. Random intercepts log-binomial regression was used to estimate Risk Ratios (RRs) and model variability in SRC risk. RESULTS: A total of 2,503 SRCs were observed during the study period, including 829 competition SRCs (33%) and 1,674 practice SRCs (67%). Most variability in SRC risk was at the level of athlete or team (within-school), rather than at the school-level. Specifically, across the three SRC outcomes (all [competition and practice combined], competition-only, and practice-only), within-school variability was 5 to 7 times greater than between-school variability. Three school-level risk factors (Division, School Type, and SRI) accounted for over one-third (36%) of between-school variability. SRI was the strongest school-level predictor of SRC risk (RR = 5.7; 95%CI: 4.2, 7.6 for High vs. Low). SRC risk was higher for Division I compared to Divisions II/III (RR = 1.6; 95%CI: 0.9, 2.9 for DI vs. DIII), and military academies had a moderately elevated risk of SRC (RR = 1.4; 95%CI: 0.7, 2.7). CONCLUSION: A large portion of the apparent variability between schools was attributable to structural factors (sport risk and competitive level), suggesting that there were minimal systemic differences in concussion identification between schools. While most variability is within-school, understanding school-level determinants of concussion risk may still be important in providing the implementation science context for individual-level interventions

The Relationship between Sport-Related Concussion and Sensation-Seeking

Sensation-seeking, or the need for novel and exciting experiences, is thought to play a role in sport-related concussion (SRC), yet much remains unknown regarding these relationships and, more importantly, how sensation-seeking influences SRC risk. The current study assessed sensation-seeking, sport contact level, and SRC history and incidence in a large sample of NCAA collegiate athletes. Data included a full study sample of 22,374 baseline evaluations and a sub-sample of 2037 incident SRC. Independent samples t-test, analysis of covariance, and hierarchical logistic regression were constructed to address study hypotheses. Results showed that (1) among participants without SRC, sensation-seeking scores were higher in athletes playing contact sports compared to those playing limited- or non-contact sports (p < 0.001, R2 = 0.007, η2p = 0.003); (2) in the full study sample, a one-point increase in sensation-seeking scores resulted in a 21% greater risk of prior SRC (OR = 1.212; 95% CI: 1.154–1.272), and in the incident SRC sub-sample, a 28% greater risk of prior SRC (OR = 1.278; 95% CI: 1.104–1.480); (3) a one-point increase in sensation-seeking scores resulted in a 12% greater risk of incident SRC among the full study sample; and (4) sensation-seeking did not vary as a function of incident SRC (p = 0.281, η2p = 0.000). Our findings demonstrate the potential usefulness of considering sensation-seeking in SRC management

Association of Blood Biomarkers With Acute Sport-Related Concussion in Collegiate Athletes: Findings From the NCAA and Department of Defense CARE Consortium

Importance: There is potential scientific and clinical value in validation of objective biomarkers for sport-related concussion (SRC). Objective: To investigate the association of acute-phase blood biomarker levels with SRC in collegiate athletes. Design, Setting, and Participants: This multicenter, prospective, case-control study was conducted by the National Collegiate Athletic Association (NCAA) and the US Department of Defense Concussion Assessment, Research, and Education (CARE) Consortium from February 20, 2015, to May 31, 2018, at 6 CARE Advanced Research Core sites. A total of 504 collegiate athletes with concussion, contact sport control athletes, and non-contact sport control athletes completed clinical testing and blood collection at preseason baseline, the acute postinjury period, 24 to 48 hours after injury, the point of reporting being asymptomatic, and 7 days after return to play. Data analysis was conducted from March 1 to November 30, 2019. Main Outcomes and Measures: Glial fibrillary acidic protein (GFAP), ubiquitin C-terminal hydrolase-L1 (UCH-L1), neurofilament light chain, and tau were quantified using the Quanterix Simoa multiplex assay. Clinical outcome measures included the Sport Concussion Assessment Tool-Third Edition (SCAT-3) symptom evaluation, Standardized Assessment of Concussion, Balance Error Scoring System, and Brief Symptom Inventory 18. Results: A total of 264 athletes with concussion (mean [SD] age, 19.08 [1.24] years; 211 [79.9%] male), 138 contact sport controls (mean [SD] age, 19.03 [1.27] years; 107 [77.5%] male), and 102 non-contact sport controls (mean [SD] age, 19.39 [1.25] years; 82 [80.4%] male) were included in the study. Athletes with concussion had significant elevation in GFAP (mean difference, 0.430 pg/mL; 95% CI, 0.339-0.521 pg/mL; P < .001), UCH-L1 (mean difference, 0.449 pg/mL; 95% CI, 0.167-0.732 pg/mL; P < .001), and tau levels (mean difference, 0.221 pg/mL; 95% CI, 0.046-0.396 pg/mL; P = .004) at the acute postinjury time point compared with preseason baseline. Longitudinally, a significant interaction (group × visit) was found for GFAP (F7,1507.36 = 16.18, P < .001), UCH-L1 (F7,1153.09 = 5.71, P < .001), and tau (F7,1480.55 = 6.81, P < .001); the interaction for neurofilament light chain was not significant (F7,1506.90 = 1.33, P = .23). The area under the curve for the combination of GFAP and UCH-L1 in differentiating athletes with concussion from contact sport controls at the acute postinjury period was 0.71 (95% CI, 0.64-0.78; P < .001); the acute postinjury area under the curve for all 4 biomarkers combined was 0.72 (95% CI, 0.65-0.79; P < .001). Beyond SCAT-3 symptom score, GFAP at the acute postinjury time point was associated with the classification of athletes with concussion from contact controls (β = 12.298; 95% CI, 2.776-54.481; P = .001) and non-contact sport controls (β = 5.438; 95% CI, 1.676-17.645; P = .005). Athletes with concussion with loss of consciousness or posttraumatic amnesia had significantly higher levels of GFAP than athletes with concussion with neither loss of consciousness nor posttraumatic amnesia at the acute postinjury time point (mean difference, 0.583 pg/mL; 95% CI, 0.369-0.797 pg/mL; P < .001). Conclusions and Relevance: The results suggest that blood biomarkers can be used as research tools to inform the underlying pathophysiological mechanism of concussion and provide additional support for future studies to optimize and validate biomarkers for potential clinical use in SRC

Return to play and risk of repeat concussion in collegiate football players: Comparative analysis from the NCAA Concussion Study (1999-2001) and CARE Consortium (2014-2017)

Objective We compared data from the National Collegiate Athletic Association (NCAA) Concussion Study (1999-2001) and the NCAA-Department of Defense Concussion Assessment, Research and Education (CARE) Consortium (2014-2017) to examine how clinical management, return to play (RTP) and risk of repeat concussion in collegiate football players have changed over the past 15 years. Methods We analysed data on reported duration of symptoms, symptom-free waiting period (SFWP), RTP and occurrence of within-season repeat concussion in collegiate football players with diagnosed concussion from the NCAA Study (n=184) and CARE (n=701). Results CARE athletes had significantly longer symptom duration (CARE median=5.92 days, IQR=3.02-9.98 days; NCAA median=2.00 days, IQR=1.00-4.00 days), SFWP (CARE median=6.00 days, IQR=3.49-9.00 days; NCAA median=0.98 days, IQR=0.00-4.00 days) and RTP (CARE median=12.23 days, IQR=8.04-18.92 days; NCAA median=3.00 days, IQR=1.00-8.00 days) than NCAA Study athletes (all p<0.0001). In CARE, there was only one case of repeat concussion within 10 days of initial injury (3.7% of within-season repeat concussions), whereas 92% of repeat concussions occurred within 10 days in the NCAA Study (p<0.001). The average interval between first and repeat concussion in CARE was 56.41 days, compared with 5.59 days in the NCAA Study (M difference=50.82 days; 95% CI 38.37 to 63.27; p<0.0001). Conclusion Our findings indicate that concussion in collegiate football is managed more conservatively than 15 years ago. These changes in clinical management appear to have reduced the risk of repetitive concussion during the critical period of cerebral vulnerability after sport-related concussion (SRC). These data support international guidelines recommending additional time for brain recovery before athletes RTP after SRC

Risk Factors for and Prediction of Post-Intubation Hypotension in Critically Ill Adults: A Multicenter Prospective Cohort Study

OBJECTIVE: Hypotension following endotracheal intubation in the ICU is associated with poor outcomes. There is no formal prediction tool to help estimate the onset of this hemodynamic compromise. Our objective was to derive and validate a prediction model for immediate hypotension following endotracheal intubation. METHODS: A multicenter, prospective, cohort study enrolling 934 adults who underwent endotracheal intubation across 16 medical/surgical ICUs in the United States from July 2015-January 2017 was conducted to derive and validate a prediction model for immediate hypotension following endotracheal intubation. We defined hypotension as: 1) mean arterial pressure \u3c 65 mmHg; 2) systolic blood pressure \u3c 80 mmHg and/or decrease in systolic blood pressure of 40% from baseline; 3) or the initiation or increase in any vasopressor in the 30 minutes following endotracheal intubation. RESULTS: Post-intubation hypotension developed in 344 (36.8%) patients. In the full cohort, 11 variables were independently associated with hypotension: increasing illness severity; increasing age; sepsis diagnosis; endotracheal intubation in the setting of cardiac arrest, mean arterial pressure \u3c 65 mmHg, and acute respiratory failure; diuretic use 24 hours preceding endotracheal intubation; decreasing systolic blood pressure from 130 mmHg; catecholamine and phenylephrine use immediately prior to endotracheal intubation; and use of etomidate during endotracheal intubation. A model excluding unstable patients’ pre-intubation (those receiving catecholamine vasopressors and/or who were intubated in the setting of cardiac arrest) was also developed and included the above variables with the exception of sepsis and etomidate. In the full cohort, the 11 variable model had a C-statistic of 0.75 (95% CI 0.72, 0.78). In the stable cohort, the 7 variable model C-statistic was 0.71 (95% CI 0.67, 0.75). In both cohorts, a clinical risk score was developed stratifying patients’ risk of hypotension. CONCLUSIONS: A novel multivariable risk score predicted post-intubation hypotension with accuracy in both unstable and stable critically ill patients. STUDY REGISTRATION: Clinicaltrials.gov identifier: NCT02508948 and Registered Report Identifier: RR2-10.2196/11101

Plasma Biomarker Concentrations Associated With Return to Sport Following Sport-Related Concussion in Collegiate Athletes—A Concussion Assessment, Research, and Education (CARE) Consortium Study

Importance: Identifying plasma biomarkers associated with the amount of time an athlete may need before they return to sport (RTS) following a sport-related concussion (SRC) is important because it may help to improve the health and safety of athletes. Objective: To examine whether plasma biomarkers can differentiate collegiate athletes who RTS in less than 14 days or 14 days or more following SRC. Design, Setting, and Participants: This multicenter prospective diagnostic study, conducted by the National Collegiate Athletics Association–Department of Defense Concussion Assessment, Research, and Education Consortium, included 127 male and female athletes who had sustained an SRC while enrolled at 6 Concussion Assessment, Research, and Education Consortium Advanced Research Core sites as well as 2 partial–Advanced Research Core military service academies. Data were collected between February 2015 and May 2018. Athletes with SRC completed clinical testing and blood collection at preseason (baseline), postinjury (0-21 hours), 24 to 48 hours postinjury, time of symptom resolution, and 7 days after unrestricted RTS. Main Outcomes and Measures: A total of 3 plasma biomarkers (ie, total tau protein, glial fibrillary acidic protein [GFAP], and neurofilament light chain protein [Nf-L]) were measured using an ultrasensitive single molecule array technology and were included in the final analysis. RTS was examined between athletes who took less than 14 days vs those who took 14 days or more to RTS following SRC. Linear mixed models were used to identify significant interactions between period by RTS group. Area under the receiver operating characteristic curve analyses were conducted to examine whether these plasma biomarkers could discriminate between RTS groups. Results: The 127 participants had a mean (SD) age of 18.9 (1.3) years, and 97 (76.4%) were men; 65 (51.2%) took less than 14 days to RTS, and 62 (48.8%) took 14 days or more to RTS. Linear mixed models identified significant associations for both mean (SE) plasma total tau (24-48 hours postinjury, <14 days RTS vs ≥14 days RTS: −0.65 [0.12] pg/mL vs −0.14 [0.14] pg/mL; P = .008) and GFAP (postinjury, 14 days RTS vs ≥14 days RTS: 4.72 [0.12] pg/mL vs 4.39 [0.11] pg/mL; P = .04). Total tau at the time of symptom resolution had acceptable discrimination power (area under the receiver operating characteristic curve, 0.75; 95% CI, 0.63-0.86; P < .001). We also examined a combined plasma biomarker panel that incorporated Nf-L, GFAP, and total tau at each period to discriminate RTS groups. Although the analyses did reach significance at each time period when combined, results indicated that they were poor at distinguishing the groups (area under the receiver operating characteristic curve, <0.7). Conclusions and Relevance: The findings of this study suggest that measures of total tau and GFAP may identify athletes who will require more time to RTS. However, further research is needed to improve our ability to determine recovery following an SRC.This publication was made possible with support from the Grand Alliance Concussion Assessment, Research, and Education (CARE) Consortium, funded, in part by the NCAA and the Department of Defense. The US Army Medical Research Acquisition Activity, 820 Chandler St, Ft Detrick, MD 21702, is the awarding and administering acquisition office. This work was supported by the Office of the Assistant Secretary of Defense for Health Affairs through the Psychological Health and Traumatic Brain Injury Program under award No. W81XWH-14-2-0151

Identification of patients with stable chest pain deriving minimal value from coronary computed tomography angiography:An external validation of the PROMISE minimal-risk tool

Background: The PROspective Multicenter Imaging Study for Evaluation of chest pain (PROMISE) minimal-risk tool was recently developed to identify patients with suspected stable angina at very low risk of coronary artery disease (CAD) and clinical events. We assessed the external validity of this tool within the context of the Scottish Computed Tomography of the HEART (SCOT-HEART) multicenter randomised controlled trial of patients with suspected stable angina due to coronary disease. Methods: The minimal-risk tool was applied to 1764 patients with complete imaging and follow-up data. External validity was compared with the guideline-endorsed CAD Consortium (CADC) risk score and determined through tests of model discrimination and calibration. Results: A total of 531 (30.1%, mean age 52.4 years, female 62.0%) patients were classified as minimal-risk. Compared to the remainder of the validation cohort, this group had lower estimated pre-test probability of coronary disease according to the CADC model (30.0% vs 47.0%, p &#60; 0.001). The PROMISE minimal-risk tool improved discrimination compared with the CADC model (c-statistic 0.785 vs 0.730, p &#60; 0.001) and was improved further following re-estimation of covariate coefficients (c-statistic 0.805, p &#60; 0.001). Model calibration was initially poor (χ2 197.6, Hosmer-Lemeshow [HL] p &#60; 0.001), with significant overestimation of probability of minimal risk, but improved significantly following revision of the PROMISE minimal-risk intercept and covariate coefficients (χ2 5.6, HL p = 0.692). Conclusion and relevance: Despite overestimating the probability of minimal-risk, the PROMISE minimal-risk tool outperforms the CADC model with regards to prognostic discrimination in patients with suspected stable angina, and may assist clinicians in decisions regarding non-invasive testing

Plasma phosphorylated tau181 as a biomarker of mild traumatic brain injury: findings from THINC and NCAA-DoD CARE Consortium prospective cohorts

Objective The aim of this study was to investigate phosphorylated tau (p-tau181) protein in plasma in a cohort of mild traumatic brain injury (mTBI) patients and a cohort of concussed athletes. Methods This pilot study comprised two independent cohorts. The first cohort—part of a Traumatic Head Injury Neuroimaging Classification (THINC) study—with a mean age of 46 years was composed of uninjured controls (UIC, n = 30) and mTBI patients (n = 288) recruited from the emergency department with clinical computed tomography (CT) and research magnetic resonance imaging (MRI) findings. The second cohort—with a mean age of 19 years—comprised 133 collegiate athletes with (n = 112) and without (n = 21) concussions. The participants enrolled in the second cohort were a part of a multicenter, prospective, case-control study conducted by the NCAA-DoD Concussion Assessment, Research and Education (CARE) Consortium at six CARE Advanced Research Core (ARC) sites between 2015 and 2019. Blood was collected within 48 h of injury for both cohorts. Plasma concentration (pg/ml) of p-tau181 was measured using the Single Molecule Array ultrasensitive assay. Results Concentrations of plasma p-tau181 in both cohorts were significantly elevated compared to controls within 48 h of injury, with the highest concentrations of p-tau181 within 18 h of injury, with an area under the curve (AUC) of 0.690–0.748, respectively, in distinguishing mTBI patients and concussed athletes from controls. Among the mTBI patients, the levels of plasma p-tau181 were significantly higher in patients with positive neuroimaging (either CT+/MRI+, n = 74 or CT−/MRI+, n = 89) compared to mTBI patients with negative neuroimaging (CT−/MRI−, n = 111) findings and UIC (P-values < 0.05). Conclusion These findings indicate that plasma p-tau181 concentrations likely relate to brain injury, with the highest levels in patients with neuroimaging evidence of injury. Future research is needed to replicate and validate this protein assay's performance as a possible early diagnostic biomarker for mTBI/concussions