Multiple Holdouts With Stability: Improving the Generalizability of Machine Learning Analyses of Brain-Behavior Relationships.

BACKGROUND:In 2009, the National Institute of Mental Health launched the Research Domain Criteria, an attempt to move beyond diagnostic categories and ground psychiatry within neurobiological constructs that combine different levels of measures (e.g., brain imaging and behavior). Statistical methods that can integrate such multimodal data, however, are often vulnerable to overfitting, poor generalization, and difficulties in interpreting the results. METHODS:We propose an innovative machine learning framework combining multiple holdouts and a stability criterion with regularized multivariate techniques, such as sparse partial least squares and kernel canonical correlation analysis, for identifying hidden dimensions of cross-modality relationships. To illustrate the approach, we investigated structural brain-behavior associations in an extensively phenotyped developmental sample of 345 participants (312 healthy and 33 with clinical depression). The brain data consisted of whole-brain voxel-based gray matter volumes, and the behavioral data included item-level self-report questionnaires and IQ and demographic measures. RESULTS:Both sparse partial least squares and kernel canonical correlation analysis captured two hidden dimensions of brain-behavior relationships: one related to age and drinking and the other one related to depression. The applied machine learning framework indicates that these results are stable and generalize well to new data. Indeed, the identified brain-behavior associations are in agreement with previous findings in the literature concerning age, alcohol use, and depression-related changes in brain volume. CONCLUSIONS:Multivariate techniques (such as sparse partial least squares and kernel canonical correlation analysis) embedded in our novel framework are promising tools to link behavior and/or symptoms to neurobiology and thus have great potential to contribute to a biologically grounded definition of psychiatric disorders

An expanding manifold in transmodal regions characterizes adolescent reconfiguration of structural connectome organization

Funder: Canada Research Chairs; FundRef: http://dx.doi.org/10.13039/501100001804Funder: Fonds de la Recherche du Quebec – SantéFunder: Autism Research TrustFunder: Canadian Institutes of Health Research; FundRef: http://dx.doi.org/10.13039/501100000024Funder: BrainCanadaFunder: MNI-Cambridge collaborative awardAdolescence is a critical time for the continued maturation of brain networks. Here, we assessed structural connectome development in a large longitudinal sample ranging from childhood to young adulthood. By projecting high-dimensional connectomes into compact manifold spaces, we identified a marked expansion of structural connectomes, with strongest effects in transmodal regions during adolescence. Findings reflected increased within-module connectivity together with increased segregation, indicating increasing differentiation of higher-order association networks from the rest of the brain. Projection of subcortico-cortical connectivity patterns into these manifolds showed parallel alterations in pathways centered on the caudate and thalamus. Connectome findings were contextualized via spatial transcriptome association analysis, highlighting genes enriched in cortex, thalamus, and striatum. Statistical learning of cortical and subcortical manifold features at baseline and their maturational change predicted measures of intelligence at follow-up. Our findings demonstrate that connectome manifold learning can bridge the conceptual and empirical gaps between macroscale network reconfigurations, microscale processes, and cognitive outcomes in adolescent development

An expanding manifold in transmodal regions characterizes adolescent reconfiguration of structural connectome organization.

Adolescence is a critical time for the continued maturation of brain networks. Here, we assessed structural connectome development in a large longitudinal sample ranging from childhood to young adulthood. By projecting high-dimensional connectomes into compact manifold spaces, we identified a marked expansion of structural connectomes, with strongest effects in transmodal regions during adolescence. Findings reflected increased within-module connectivity together with increased segregation, indicating increasing differentiation of higher-order association networks from the rest of the brain. Projection of subcortico-cortical connectivity patterns into these manifolds showed parallel alterations in pathways centered on the caudate and thalamus. Connectome findings were contextualized via spatial transcriptome association analysis, highlighting genes enriched in cortex, thalamus, and striatum. Statistical learning of cortical and subcortical manifold features at baseline and their maturational change predicted measures of intelligence at follow-up. Our findings demonstrate that connectome manifold learning can bridge the conceptual and empirical gaps between macroscale network reconfigurations, microscale processes, and cognitive outcomes in adolescent development

Multiple Holdouts With Stability: Improving the Generalizability of Machine Learning Analyses of Brain-Behavior Relationships.

BACKGROUND:In 2009, the National Institute of Mental Health launched the Research Domain Criteria, an attempt to move beyond diagnostic categories and ground psychiatry within neurobiological constructs that combine different levels of measures (e.g., brain imaging and behavior). Statistical methods that can integrate such multimodal data, however, are often vulnerable to overfitting, poor generalization, and difficulties in interpreting the results. METHODS:We propose an innovative machine learning framework combining multiple holdouts and a stability criterion with regularized multivariate techniques, such as sparse partial least squares and kernel canonical correlation analysis, for identifying hidden dimensions of cross-modality relationships. To illustrate the approach, we investigated structural brain-behavior associations in an extensively phenotyped developmental sample of 345 participants (312 healthy and 33 with clinical depression). The brain data consisted of whole-brain voxel-based gray matter volumes, and the behavioral data included item-level self-report questionnaires and IQ and demographic measures. RESULTS:Both sparse partial least squares and kernel canonical correlation analysis captured two hidden dimensions of brain-behavior relationships: one related to age and drinking and the other one related to depression. The applied machine learning framework indicates that these results are stable and generalize well to new data. Indeed, the identified brain-behavior associations are in agreement with previous findings in the literature concerning age, alcohol use, and depression-related changes in brain volume. CONCLUSIONS:Multivariate techniques (such as sparse partial least squares and kernel canonical correlation analysis) embedded in our novel framework are promising tools to link behavior and/or symptoms to neurobiology and thus have great potential to contribute to a biologically grounded definition of psychiatric disorders