Neuroimaging-Based Classification of PTSD Using Data-Driven Computational Approaches:A Multisite Big Data Study from the ENIGMA-PGC PTSD Consortium

BACKGROUND: Recent advances in data-driven computational approaches have been helpful in devising tools to objectively diagnose psychiatric disorders. However, current machine learning studies limited to small homogeneous samples, different methodologies, and different imaging collection protocols, limit the ability to directly compare and generalize their results. Here we aimed to classify individuals with PTSD versus controls and assess the generalizability using a large heterogeneous brain datasets from the ENIGMA-PGC PTSD Working group.METHODS: We analyzed brain MRI data from 3,477 structural-MRI; 2,495 resting state-fMRI; and 1,952 diffusion-MRI. First, we identified the brain features that best distinguish individuals with PTSD from controls using traditional machine learning methods. Second, we assessed the utility of the denoising variational autoencoder (DVAE) and evaluated its classification performance. Third, we assessed the generalizability and reproducibility of both models using leave-one-site-out cross-validation procedure for each modality.RESULTS: We found lower performance in classifying PTSD vs. controls with data from over 20 sites (60% test AUC for s-MRI, 59% for rs-fMRI and 56% for d-MRI), as compared to other studies run on single-site data. The performance increased when classifying PTSD from HC without trauma history in each modality (75% AUC). The classification performance remained intact when applying the DVAE framework, which reduced the number of features. Finally, we found that the DVAE framework achieved better generalization to unseen datasets compared with the traditional machine learning frameworks, albeit performance was slightly above chance.CONCLUSION: These results have the potential to provide a baseline classification performance for PTSD when using large scale neuroimaging datasets. Our findings show that the control group used can heavily affect classification performance. The DVAE framework provided better generalizability for the multi-site data. This may be more significant in clinical practice since the neuroimaging-based diagnostic DVAE classification models are much less site-specific, rendering them more generalizable.</p

A Comparison of Methods to Harmonize Cortical Thickness Measurements Across Scanners and Sites

Results of neuroimaging datasets aggregated from multiple sites may be biased by site-specific profiles in participants’ demographic and clinical characteristics, as well as MRI acquisition protocols and scanning platforms. We compared the impact of four different harmonization methods on results obtained from analyses of cortical thickness data: (1) linear mixed-effects model (LME) that models site-specific random intercepts (LME INT), (2) LME that models both site-specific random intercepts and age-related random slopes (LME INT+SLP), (3) ComBat, and (4) ComBat with a generalized additive model (ComBat-GAM). Our test case for comparing harmonization methods was cortical thickness data aggregated from 29 sites, which included 1,340 cases with posttraumatic stress disorder (PTSD) (6.2–81.8 years old) and 2,057 trauma-exposed controls without PTSD (6.3–85.2 years old). We found that, compared to the other data harmonization methods, data processed with ComBat-GAM was more sensitive to the detection of significant case-control differences (Χ 2(3) = 63.704, p < 0.001) as well as case-control differences in age-related cortical thinning (Χ 2(3) = 12.082, p = 0.007). Both ComBat and ComBat-GAM outperformed LME methods in detecting sex differences (Χ 2(3) = 9.114, p = 0.028) in regional cortical thickness. ComBat-GAM also led to stronger estimates of age-related declines in cortical thickness (corrected p-values < 0.001), stronger estimates of case-related cortical thickness reduction (corrected p-values < 0.001), weaker estimates of age-related declines in cortical thickness in cases than controls (corrected p-values < 0.001), stronger estimates of cortical thickness reduction in females than males (corrected p-values < 0.001), and stronger estimates of cortical thickness reduction in females relative to males in cases than controls (corrected p-values < 0.001). Our results support the use of ComBat-GAM to minimize confounds and increase statistical power when harmonizing data with non-linear effects, and the use of either ComBat or ComBat-GAM for harmonizing data with linear effects

Examining the association between posttraumatic stress disorder and disruptions in cortical networks identified using data-driven methods

Posttraumatic stress disorder (PTSD) is associated with lower cortical thickness (CT) in prefrontal, cingulate, and insular cortices in diverse trauma-affected samples. However, some studies have failed to detect differences between PTSD patients and healthy controls or reported that PTSD is associated with greater CT. Using data-driven dimensionality reduction, we sought to conduct a well-powered study to identify vulnerable networks without regard to neuroanatomic boundaries. Moreover, this approach enabled us to avoid the excessive burden of multiple comparison correction that plagues vertex-wise methods. We derived structural covariance networks (SCNs) by applying non-negative matrix factorization (NMF) to CT data from 961 PTSD patients and 1124 trauma-exposed controls without PTSD. We used regression analyses to investigate associations between CT within SCNs and PTSD diagnosis (with and without accounting for the potential confounding effect of trauma type) and symptom severity in the full sample. We performed additional regression analyses in subsets of the data to examine associations between SCNs and comorbid depression, childhood trauma severity, and alcohol abuse. NMF identified 20 unbiased SCNs, which aligned closely with functionally defined brain networks. PTSD diagnosis was most strongly associated with diminished CT in SCNs that encompassed the bilateral superior frontal cortex, motor cortex, insular cortex, orbitofrontal cortex, medial occipital cortex, anterior cingulate cortex, and posterior cingulate cortex. CT in these networks was significantly negatively correlated with PTSD symptom severity. Collectively, these findings suggest that PTSD diagnosis is associated with widespread reductions in CT, particularly within prefrontal regulatory regions and broader emotion and sensory processing cortical regions

Neuroimaging-based classification of PTSD using data-driven computational approaches: A multisite big data study from the ENIGMA-PGC PTSD consortium

Background: Recent advances in data-driven computational approaches have been helpful in devising tools to objectively diagnose psychiatric disorders. However, current machine learning studies limited to small homogeneous samples, different methodologies, and different imaging collection protocols, limit the ability to directly compare and generalize their results. Here we aimed to classify individuals with PTSD versus controls and assess the generalizability using a large heterogeneous brain datasets from the ENIGMA-PGC PTSD Working group. Methods: We analyzed brain MRI data from 3,477 structural-MRI; 2,495 resting state-fMRI; and 1,952 diffusion-MRI. First, we identified the brain features that best distinguish individuals with PTSD from controls using traditional machine learning methods. Second, we assessed the utility of the denoising variational autoencoder (DVAE) and evaluated its classification performance. Third, we assessed the generalizability and reproducibility of both models using leave-one-site-out cross-validation procedure for each modality. Results: We found lower performance in classifying PTSD vs. controls with data from over 20 sites (60 % test AUC for s-MRI, 59 % for rs-fMRI and 56 % for d-MRI), as compared to other studies run on single-site data. The performance increased when classifying PTSD from HC without trauma history in each modality (75 % AUC). The classification performance remained intact when applying the DVAE framework, which reduced the number of features. Finally, we found that the DVAE framework achieved better generalization to unseen datasets compared with the traditional machine learning frameworks, albeit performance was slightly above chance. Conclusion: These results have the potential to provide a baseline classification performance for PTSD when using large scale neuroimaging datasets. Our findings show that the control group used can heavily affect classification performance. The DVAE framework provided better generalizability for the multi-site data. This may be more significant in clinical practice since the neuroimaging-based diagnostic DVAE classification models are much less site-specific, rendering them more generalizable