Multi-site benchmark classification of major depressive disorder using machine learning on cortical and subcortical measures

Machine learning (ML) techniques have gained popularity in the neuroimaging field due to their potential for classifying neuropsychiatric disorders. However, the diagnostic predictive power of the existing algorithms has been limited by small sample sizes, lack of representativeness, data leakage, and/or overfitting. Here, we overcome these limitations with the largest multi-site sample size to date (N = 5365) to provide a generalizable ML classification benchmark of major depressive disorder (MDD) using shallow linear and non-linear models. Leveraging brain measures from standardized ENIGMA analysis pipelines in FreeSurfer, we were able to classify MDD versus healthy controls (HC) with a balanced accuracy of around 62%. But after harmonizing the data, e.g., using ComBat, the balanced accuracy dropped to approximately 52%. Accuracy results close to random chance levels were also observed in stratified groups according to age of onset, antidepressant use, number of episodes and sex. Future studies incorporating higher dimensional brain imaging/phenotype features, and/or using more advanced machine and deep learning methods may yield more encouraging prospects

ENIGMA MDD: seven years of global neuroimaging studies of major depression through worldwide data sharing

A key objective in the field of translational psychiatry over the past few decades has been to identify the brain correlates of major depressive disorder (MDD). Identifying measurable indicators of brain processes associated with MDD could facilitate the detection of individuals at risk, and the development of novel treatments, the monitoring of treatment effects, and predicting who might benefit most from treatments that target specific brain mechanisms. However, despite intensive neuroimaging research towards this effort, underpowered studies and a lack of reproducible findings have hindered progress. Here, we discuss the work of the ENIGMA Major Depressive Disorder (MDD) Consortium, which was established to address issues of poor replication, unreliable results, and overestimation of effect sizes in previous studies. The ENIGMA MDD Consortium currently includes data from 45 MDD study cohorts from 14 countries across six continents. The primary aim of ENIGMA MDD is to identify structural and functional brain alterations associated with MDD that can be reliably detected and replicated across cohorts worldwide. A secondary goal is to investigate how demographic, genetic, clinical, psychological, and environmental factors affect these associations. In this review, we summarize findings of the ENIGMA MDD disease working group to date and discuss future directions. We also highlight the challenges and benefits of large-scale data sharing for mental health research

No Alterations of Brain Structural Asymmetry in Major Depressive Disorder: An ENIGMA Consortium Analysis

OBJECTIVE: Asymmetry is a subtle but pervasive aspect of the human brain, and it may be altered in several psychiatric conditions. MRI studies have shown subtle differences of brain anatomy between people with major depressive disorder and healthy control subjects, but few studies have specifically examined brain anatomical asymmetry in relation to this disorder, and results from those studies have remained inconclusive. At the functional level, some electroencephalography studies have indicated left fronto-cortical hypoactivity and right parietal hypoactivity in depressive disorders, so aspects of lateralized anatomy may also be affected. The authors used pooled individual-level data from data sets collected around the world to investigate differences in laterality in measures of cortical thickness, cortical surface area, and subcortical volume between individuals with major depression and healthy control subjects. METHODS: The authors investigated differences in the laterality of thickness and surface area measures of 34 cerebral cortical regions in 2,256 individuals with major depression and 3,504 control subjects from 31 separate data sets, and they investigated volume asymmetries of eight subcortical structures in 2,540 individuals with major depression and 4,230 control subjects from 32 data sets. T1-weighted MRI data were processed with a single protocol using FreeSurfer and the Desikan-Killiany atlas. The large sample size provided 80% power to detect effects of the order of Cohen's d=0.1. RESULTS: The largest effect size (Cohen's d) of major depression diagnosis was 0.085 for the thickness asymmetry of the superior temporal cortex, which was not significant after adjustment for multiple testing. Asymmetry measures were not significantly associated with medication use, acute compared with remitted status, first episode compared with recurrent status, or age at onset. CONCLUSIONS: Altered brain macro-anatomical asymmetry may be of little relevance to major depression etiology in most cases

DenseNet and Support Vector Machine classifications of major depressive disorder using vertex-wise cortical features

Major depressive disorder (MDD) is a complex psychiatric disorder that affects the lives of hundreds of millions of individuals around the globe. Even today, researchers debate if morphological alterations in the brain are linked to MDD, likely due to the heterogeneity of this disorder. The application of deep learning tools to neuroimaging data, capable of capturing complex non-linear patterns, has the potential to provide diagnostic and predictive biomarkers for MDD. However, previous attempts to demarcate MDD patients and healthy controls (HC) based on segmented cortical features via linear machine learning approaches have reported low accuracies. In this study, we used globally representative data from the ENIGMA-MDD working group containing an extensive sample of people with MDD (N=2,772) and HC (N=4,240), which allows a comprehensive analysis with generalizable results. Based on the hypothesis that integration of vertex-wise cortical features can improve classification performance, we evaluated the classification of a DenseNet and a Support Vector Machine (SVM), with the expectation that the former would outperform the latter. As we analyzed a multi-site sample, we additionally applied the ComBat harmonization tool to remove potential nuisance effects of site. We found that both classifiers exhibited close to chance performance (balanced accuracy DenseNet: 51%; SVM: 53%), when estimated on unseen sites. Slightly higher classification performance (balanced accuracy DenseNet: 58%; SVM: 55%) was found when the cross-validation folds contained subjects from all sites, indicating site effect. In conclusion, the integration of vertex-wise morphometric features and the use of the non-linear classifier did not lead to the differentiability between MDD and HC. Our results support the notion that MDD classification on this combination of features and classifiers is unfeasible

Virtual Ontogeny of Cortical Growth Preceding Mental Illness

Background: Morphology of the human cerebral cortex differs across psychiatric disorders, with neurobiology and developmental origins mostly undetermined. Deviations in the tangential growth of the cerebral cortex during pre/perinatal periods may be reflected in individual variations in cortical surface area later in life. Methods: Interregional profiles of group differences in surface area between cases and controls were generated using T1-weighted magnetic resonance imaging from 27,359 individuals including those with attention-deficit/hyperactivity disorder, autism spectrum disorder, bipolar disorder, major depressive disorder, schizophrenia, and high general psychopathology (through the Child Behavior Checklist). Similarity of interregional profiles of group differences in surface area and prenatal cell-specific gene expression was assessed. Results: Across the 11 cortical regions, group differences in cortical area for attention-deficit/hyperactivity disorder, schizophrenia, and Child Behavior Checklist were dominant in multimodal association cortices. The same interregional profiles were also associated with interregional profiles of (prenatal) gene expression specific to proliferative cells, namely radial glia and intermediate progenitor cells (greater expression, larger difference), as well as differentiated cells, namely excitatory neurons and endothelial and mural cells (greater expression, smaller difference). Finally, these cell types were implicated in known pre/perinatal risk factors for psychosis. Genes coexpressed with radial glia were enriched with genes implicated in congenital abnormalities, birth weight, hypoxia, and starvation. Genes coexpressed with endothelial and mural genes were enriched with genes associated with maternal hypertension and preterm birth. Conclusions: Our findings support a neurodevelopmental model of vulnerability to mental illness whereby prenatal risk factors acting through cell-specific processes lead to deviations from typical brain development during pregnancy

Multi-site benchmark classification of major depressive disorder using machine learning on cortical and subcortical measures

Machine learning (ML) techniques have gained popularity in the neuroimaging field due to their potential for classifying neuropsychiatric disorders. However, the diagnostic predictive power of the existing algorithms has been limited by small sample sizes, lack of representativeness, data leakage, and/or overfitting. Here, we overcome these limitations with the largest multi-site sample size to date (N = 5365) to provide a generalizable ML classification benchmark of major depressive disorder (MDD) using shallow linear and non-linear models. Leveraging brain measures from standardized ENIGMA analysis pipelines in FreeSurfer, we were able to classify MDD versus healthy controls (HC) with a balanced accuracy of around 62%. But after harmonizing the data, e.g., using ComBat, the balanced accuracy dropped to approximately 52%. Accuracy results close to random chance levels were also observed in stratified groups according to age of onset, antidepressant use, number of episodes and sex. Future studies incorporating higher dimensional brain imaging/phenotype features, and/or using more advanced machine and deep learning methods may yield more encouraging prospects

Multi-site benchmark classification of major depressive disorder using machine learning on cortical and subcortical measures

Machine learning (ML) techniques have gained popularity in the neuroimaging field due to their potential for classifying neuropsychiatric disorders. However, the diagnostic predictive power of the existing algorithms has been limited by small sample sizes, lack of representativeness, data leakage, and/or overfitting. Here, we overcome these limitations with the largest multi-site sample size to date (N = 5365) to provide a generalizable ML classification benchmark of major depressive disorder (MDD) using shallow linear and non-linear models. Leveraging brain measures from standardized ENIGMA analysis pipelines in FreeSurfer, we were able to classify MDD versus healthy controls (HC) with a balanced accuracy of around 62%. But after harmonizing the data, e.g., using ComBat, the balanced accuracy dropped to approximately 52%. Accuracy results close to random chance levels were also observed in stratified groups according to age of onset, antidepressant use, number of episodes and sex. Future studies incorporating higher dimensional brain imaging/phenotype features, and/or using more advanced machine and deep learning methods may yield more encouraging prospects

Brain Correlates of Suicide Attempt in 18,925 Participants Across 18 International Cohorts.

BACKGROUND: Neuroimaging studies of suicidal behavior have so far been conducted in small samples, prone to biases and false-positive associations, yielding inconsistent results. The ENIGMA-MDD Working Group aims to address the issues of poor replicability and comparability by coordinating harmonized analyses across neuroimaging studies of major depressive disorder and related phenotypes, including suicidal behavior. METHODS: Here, we pooled data from 18 international cohorts with neuroimaging and clinical measurements in 18,925 participants (12,477 healthy control subjects and 6448 people with depression, of whom 694 had attempted suicide). We compared regional cortical thickness and surface area and measures of subcortical, lateral ventricular, and intracranial volumes between suicide attempters, clinical control subjects (nonattempters with depression), and healthy control subjects. RESULTS: We identified 25 regions of interest with statistically significant (false discovery rate < .05) differences between groups. Post hoc examinations identified neuroimaging markers associated with suicide attempt including smaller volumes of the left and right thalamus and the right pallidum and lower surface area of the left inferior parietal lobe. CONCLUSIONS: This study addresses the lack of replicability and consistency in several previously published neuroimaging studies of suicide attempt and further demonstrates the need for well-powered samples and collaborative efforts. Our results highlight the potential involvement of the thalamus, a structure viewed historically as a passive gateway in the brain, and the pallidum, a region linked to reward response and positive affect. Future functional and connectivity studies of suicidal behaviors may focus on understanding how these regions relate to the neurobiological mechanisms of suicide attempt risk