Multi-Site Benchmark Classification of Major Depressive Disorder Using Machine Learning on Cortical and Subcortical Measures

Machine learning (ML) techniques have gained popularity in the neuroimaging field due to their potential for classifying neuropsychiatric disorders. However, the diagnostic predictive power of the existing algorithms has been limited by small sample sizes, lack of representativeness, data leakage, and/or overfitting. Here, we overcome these limitations with the largest multi-site sample size to date (N = 5365) to provide a generalizable ML classification benchmark of major depressive disorder (MDD) using shallow linear and non-linear models. Leveraging brain measures from standardized ENIGMA analysis pipelines in FreeSurfer, we were able to classify MDD versus healthy controls (HC) with a balanced accuracy of around 62%. But after harmonizing the data, e.g., using ComBat, the balanced accuracy dropped to approximately 52%. Accuracy results close to random chance levels were also observed in stratified groups according to age of onset, antidepressant use, number of episodes and sex. Future studies incorporating higher dimensional brain imaging/phenotype features, and/or using more advanced machine and deep learning methods may yield more encouraging prospects

DenseNet and Support Vector Machine classifications of major depressive disorder using vertex-wise cortical features

Major depressive disorder (MDD) is a complex psychiatric disorder that affects the lives of hundreds of millions of individuals around the globe. Even today, researchers debate if morphological alterations in the brain are linked to MDD, likely due to the heterogeneity of this disorder. The application of deep learning tools to neuroimaging data, capable of capturing complex non-linear patterns, has the potential to provide diagnostic and predictive biomarkers for MDD. However, previous attempts to demarcate MDD patients and healthy controls (HC) based on segmented cortical features via linear machine learning approaches have reported low accuracies. In this study, we used globally representative data from the ENIGMA-MDD working group containing an extensive sample of people with MDD (N=2,772) and HC (N=4,240), which allows a comprehensive analysis with generalizable results. Based on the hypothesis that integration of vertex-wise cortical features can improve classification performance, we evaluated the classification of a DenseNet and a Support Vector Machine (SVM), with the expectation that the former would outperform the latter. As we analyzed a multi-site sample, we additionally applied the ComBat harmonization tool to remove potential nuisance effects of site. We found that both classifiers exhibited close to chance performance (balanced accuracy DenseNet: 51%; SVM: 53%), when estimated on unseen sites. Slightly higher classification performance (balanced accuracy DenseNet: 58%; SVM: 55%) was found when the cross-validation folds contained subjects from all sites, indicating site effect. In conclusion, the integration of vertex-wise morphometric features and the use of the non-linear classifier did not lead to the differentiability between MDD and HC. Our results support the notion that MDD classification on this combination of features and classifiers is unfeasible

Multi-site benchmark classification of major depressive disorder using machine learning on cortical and subcortical measures

Machine learning (ML) techniques have gained popularity in the neuroimaging field due to their potential for classifying neuropsychiatric disorders. However, the diagnostic predictive power of the existing algorithms has been limited by small sample sizes, lack of representativeness, data leakage, and/or overfitting. Here, we overcome these limitations with the largest multi-site sample size to date (N = 5365) to provide a generalizable ML classification benchmark of major depressive disorder (MDD) using shallow linear and non-linear models. Leveraging brain measures from standardized ENIGMA analysis pipelines in FreeSurfer, we were able to classify MDD versus healthy controls (HC) with a balanced accuracy of around 62%. But after harmonizing the data, e.g., using ComBat, the balanced accuracy dropped to approximately 52%. Accuracy results close to random chance levels were also observed in stratified groups according to age of onset, antidepressant use, number of episodes and sex. Future studies incorporating higher dimensional brain imaging/phenotype features, and/or using more advanced machine and deep learning methods may yield more encouraging prospects

Personalized repetitive transcranial magnetic stimulation temporarily alters default mode network in healthy subjects

Abstract High frequency repetitive transcranial magnetic stimulation (HF-rTMS) delivered to the left dorsolateral prefrontal cortex (DLPFC) is an effective treatment option for treatment resistant depression. However, the underlying mechanisms of a full session of HF-rTMS in healthy volunteers have not yet been described. Here we investigated, with a personalized selection of DLPFC stimulation sites, the effects driven by HF-rTMS in healthy volunteers (n = 23) over the default mode network (DMN) in multiple time windows. After a complete 10 Hz rTMS (3000 pulses) session, we observe a decrease of functional connectivity between the DMN and the subgenual Anterior Cingulate Cortex (sgACC), as well as the ventral striatum (vStr). A negative correlation between the magnitude of this decrease in the right sgACC and the harm avoidance domain measure from the Temperament and Character Inventory was observed. Moreover, we identify that coupling strength of right vStr with the DMN post-stimulation was proportional to a decrease in self-reports of negative mood from the Positive and Negative Affect Schedule. This shows HF-rTMS attenuates perception of negative mood in healthy recipients in agreement with the expected effects in patients. Our study, by using a personalized selection of DLPFC stimulation sites, contributes understanding the effects of a full session of rTMS approved for clinical use in depression over related brain regions in healthy volunteers

Multi-site benchmark classification of major depressive disorder using machine learning on cortical and subcortical measures

Abstract Machine learning (ML) techniques have gained popularity in the neuroimaging field due to their potential for classifying neuropsychiatric disorders. However, the diagnostic predictive power of the existing algorithms has been limited by small sample sizes, lack of representativeness, data leakage, and/or overfitting. Here, we overcome these limitations with the largest multi-site sample size to date (N = 5365) to provide a generalizable ML classification benchmark of major depressive disorder (MDD) using shallow linear and non-linear models. Leveraging brain measures from standardized ENIGMA analysis pipelines in FreeSurfer, we were able to classify MDD versus healthy controls (HC) with a balanced accuracy of around 62%. But after harmonizing the data, e.g., using ComBat, the balanced accuracy dropped to approximately 52%. Accuracy results close to random chance levels were also observed in stratified groups according to age of onset, antidepressant use, number of episodes and sex. Future studies incorporating higher dimensional brain imaging/phenotype features, and/or using more advanced machine and deep learning methods may yield more encouraging prospects.Open-Access-Publikationsfonds 202

ENIGMA MDD: Seven Years of Global Neuroimaging Studies of Major Depression through Worldwide Data Sharing

A key objective in the field of translational psychiatry over the past few decades has been to identify the brain correlates common to individuals with major depressive disorder (MDD). Identifying measurable indicators of brain processes associated with MDD could facilitate the detection of individuals at risk, and the development of novel treatments, the monitoring of treatment effects, and predicting who might benefit most from treatments that target specific brain mechanisms. However, despite intensive neuroimaging research towards this effort, underpowered studies and a lack of reproducible findings have hindered progress. Here we discuss the work of the ENIGMA Major Depressive Disorder (MDD) Consortium, which was established to address issues of poor replication, unreliable results, and overestimation of effect sizes in previous studies. The ENIGMA MDD Consortium currently includes data from 45 MDD study cohorts from 14 countries across 6 continents. The primary aim of ENIGMA MDD is to identify structural and functional brain alterations associated with MDD that can be reliably detected and replicated across cohorts worldwide. A secondary goal is to investigate how demographic, genetic, clinical, psychological, and environmental factors affect these associations. In this review, we summarize findings of the ENIGMA-MDD disease working group to date and discuss future directions. We also highlight the challenges and benefits of large-scale data-sharing for mental health research

ENIGMA MDD: seven years of global neuroimaging studies of major depression through worldwide data sharing

A key objective in the field of translational psychiatry over the past few decades has been to identify the brain correlates of major depressive disorder (MDD). Identifying measurable indicators of brain processes associated with MDD could facilitate the detection of individuals at risk, and the development of novel treatments, the monitoring of treatment effects, and predicting who might benefit most from treatments that target specific brain mechanisms. However, despite intensive neuroimaging research towards this effort, underpowered studies and a lack of reproducible findings have hindered progress. Here, we discuss the work of the ENIGMA Major Depressive Disorder (MDD) Consortium, which was established to address issues of poor replication, unreliable results, and overestimation of effect sizes in previous studies. The ENIGMA MDD Consortium currently includes data from 45 MDD study cohorts from 14 countries across six continents. The primary aim of ENIGMA MDD is to identify structural and functional brain alterations associated with MDD that can be reliably detected and replicated across cohorts worldwide. A secondary goal is to investigate how demographic, genetic, clinical, psychological, and environmental factors affect these associations. In this review, we summarize findings of the ENIGMA MDD disease working group to date and discuss future directions. We also highlight the challenges and benefits of large-scale data sharing for mental health research

Virtual Ontogeny of Cortical Growth Preceding Mental Illness

BackgroundMorphology of the human cerebral cortex differs across psychiatric disorders, with neurobiology and developmental origins mostly undetermined. Deviations in the tangential growth of the cerebral cortex during pre/perinatal periods may be reflected in individual variations in cortical surface area later in life.MethodsInterregional profiles of group differences in surface area between cases and controls were generated using T1-weighted magnetic resonance imaging from 27,359 individuals including those with attention-deficit/hyperactivity disorder, autism spectrum disorder, bipolar disorder, major depressive disorder, schizophrenia, and high general psychopathology (through the Child Behavior Checklist). Similarity of interregional profiles of group differences in surface area and prenatal cell-specific gene expression was assessed.ResultsAcross the 11 cortical regions, group differences in cortical area for attention-deficit/hyperactivity disorder, schizophrenia, and Child Behavior Checklist were dominant in multimodal association cortices. The same interregional profiles were also associated with interregional profiles of (prenatal) gene expression specific to proliferative cells, namely radial glia and intermediate progenitor cells (greater expression, larger difference), as well as differentiated cells, namely excitatory neurons and endothelial and mural cells (greater expression, smaller difference). Finally, these cell types were implicated in known pre/perinatal risk factors for psychosis. Genes coexpressed with radial glia were enriched with genes implicated in congenital abnormalities, birth weight, hypoxia, and starvation. Genes coexpressed with endothelial and mural genes were enriched with genes associated with maternal hypertension and preterm birth.ConclusionsOur findings support a neurodevelopmental model of vulnerability to mental illness whereby prenatal risk factors acting through cell-specific processes lead to deviations from typical brain development during pregnancy

Concurrent Validity and Reliability of Suicide Risk Assessment Instruments: A Meta-Analysis of 20 Instruments Across 27 International Cohorts

Objective: A major limitation of current suicide research is the lack of power to identify robust correlates of suicidal thoughts or behavior. Variation in suicide risk assessment instruments used across cohorts may represent a limitation to pooling data in international consortia. Method: Here, we examine this issue through two approaches: (a) an extensive literature search on the reliability and concurrent validity of the most commonly used instruments and (b) by pooling data (N ∼ 6,000 participants) from cohorts from the Enhancing NeuroImaging Genetics Through Meta-Analysis (ENIGMA) Major Depressive Disorder and ENIGMA–Suicidal Thoughts and Behaviour working groups, to assess the concurrent validity of instruments currently used for assessing suicidal thoughts or behavior. Results: We observed moderate-to-high correlations between measures, consistent with the wide range (κ range: 0.15–0.97; r range: 0.21–0.94) reported in the literature. Two common multi-item instruments, the Columbia Suicide Severity Rating Scale and the Beck Scale for Suicidal Ideation were highly correlated with each other (r = 0.83). Sensitivity analyses identified sources of heterogeneity such as the time frame of the instrument and whether it relies on self-report or a clinical interview. Finally, construct-specific analyses suggest that suicide ideation items from common psychiatric questionnaires are most concordant with the suicide ideation construct of multi-item instruments. Conclusions: Our findings suggest that multi-item instruments provide valuable information on different aspects of suicidal thoughts or behavior but share a modest core factor with single suicidal ideation items. Retrospective, multisite collaborations including distinct instruments should be feasible provided they harmonize across instruments or focus on specific constructs of suicidality