A deep residual model for characterization of 5D spatiotemporal network dynamics reveals widespread spatiodynamic changes in schizophrenia

Schizophrenia is a severe brain disorder with serious symptoms including delusions, disorganized speech, and hallucinations that can have a long-term detrimental impact on different aspects of a patient's life. It is still unclear what the main cause of schizophrenia is, but a combination of altered brain connectivity and structure may play a role. Neuroimaging data has been useful in characterizing schizophrenia, but there has been very little work focused on voxel-wise changes in multiple brain networks over time, despite evidence that functional networks exhibit complex spatiotemporal changes over time within individual subjects. Recent studies have primarily focused on static (average) features of functional data or on temporal variations between fixed networks; however, such approaches are not able to capture multiple overlapping networks which change at the voxel level. In this work, we employ a deep residual convolutional neural network (CNN) model to extract 53 different spatiotemporal networks each of which captures dynamism within various domains including subcortical, cerebellar, visual, sensori-motor, auditory, cognitive control, and default mode. We apply this approach to study spatiotemporal brain dynamism at the voxel level within multiple functional networks extracted from a large functional magnetic resonance imaging (fMRI) dataset of individuals with schizophrenia (N = 708) and controls (N = 510). Our analysis reveals widespread group level differences across multiple networks and spatiotemporal features including voxel-wise variability, magnitude, and temporal functional network connectivity in widespread regions expected to be impacted by the disorder. We compare with typical average spatial amplitude and show highly structured and neuroanatomically relevant results are missed if one does not consider the voxel-wise spatial dynamics. Importantly, our approach can summarize static, temporal dynamic, spatial dynamic, and spatiotemporal dynamics features, thus proving a powerful approach to unify and compare these various perspectives. In sum, we show the proposed approach highlights the importance of accounting for both temporal and spatial dynamism in whole brain neuroimaging data generally, shows a high-level of sensitivity to schizophrenia highlighting global but spatially unique dynamics showing group differences, and may be especially important in studies focused on the development of brain-based biomarkers

4D Dynamic Spatial Brain Networks at Rest Linked to Cognition Show Atypical Variability and Coupling in Schizophrenia

Despite increasing interest in the dynamics of functional brain networks, most studies focus on the changing relationships over time between spatially static networks or regions. Here we propose an approach to study dynamic spatial brain networks in human resting state functional magnetic resonance imaging (rsfMRI) data and evaluate the temporal changes in the volumes of these 4D networks. Our results show significant volumetric coupling (i.e., synchronized shrinkage and growth) between networks during the scan, that we refer to as dynamic spatial network connectivity (dSNC). We find that several features of such dynamic spatial brain networks are associated with cognition, with higher dynamic variability in these networks and higher volumetric coupling between network pairs positively associated with cognitive performance. We show that these networks are modulated differently in individuals with schizophrenia versus typical controls, resulting in network growth or shrinkage, as well as altered focus of activity within a network. Schizophrenia also shows lower spatial dynamical variability in several networks, and lower volumetric coupling between pairs of networks, thus upholding the role of dynamic spatial brain networks in cognitive impairment seen in schizophrenia. Our data show evidence for the importance of studying the typically overlooked voxel-wise changes within and between brain networks

A Multi-site Resting State fMRI Study on the Amplitude of Low Frequency Fluctuations in Schizophrenia

Background: This multi-site study compares resting state fMRI amplitude of low frequency fluctuations (ALFF) and fractional ALFF (fALFF) between patients with schizophrenia (SZ) and healthy controls (HC). Methods: Eyes-closed resting fMRI scans (5:38 min; n = 306, 146 SZ) were collected from 6 Siemens 3T scanners and one GE 3T scanner. Imaging data were pre-processed using an SPM pipeline. Power in the low frequency band (0.01–0.08 Hz) was calculated both for the original pre-processed data as well as for the pre-processed data after regressing out the six rigid-body motion parameters, mean white matter (WM) and cerebral spinal fluid (CSF) signals. Both original and regressed ALFF and fALFF measures were modeled with site, diagnosis, age, and diagnosis × age interactions. Results: Regressing out motion and non-gray matter signals significantly decreased fALFF throughout the brain as well as ALFF in the cortical edge, but significantly increased ALFF in subcortical regions. Regression had little effect on site, age, and diagnosis effects on ALFF, other than to reduce diagnosis effects in subcortical regions. There were significant effects of site across the brain in all the analyses, largely due to vendor differences. HC showed greater ALFF in the occipital, posterior parietal, and superior temporal lobe, while SZ showed smaller clusters of greater ALFF in the frontal and temporal/insular regions as well as in the caudate, putamen, and hippocampus. HC showed greater fALFF compared with SZ in all regions, though subcortical differences were only significant for original fALFF. Conclusions: SZ show greater eyes-closed resting state low frequency power in frontal cortex, and less power in posterior lobes than do HC; fALFF, however, is lower in SZ than HC throughout the cortex. These effects are robust to multi-site variability. Regressing out physiological noise signals significantly affects both total and fALFF measures, but does not affect the pattern of case/control differences

Dynamic Functional Connectivity Analysis Reveals Transient States of Dysconnectivity in Schizophrenia

Schizophrenia is a psychotic disorder characterized by functional dysconnectivity or abnormal integration between distant brain regions. Recent functional imaging studies have implicated large-scale thalamo-cortical connectivity as being disrupted in patients.However, observed connectivity differences in schizophrenia have been inconsistent between studies,with reports of hyperconnectivity and hypoconnectivity between the same brain regions. Using resting state eyes-closed functional imaging and independent component analysis on amulti-site data that included 151 schizophrenia patients and 163 age- and gender matched healthy controls, we decomposed the functional brain data into 100 components and identified 47 as functionally relevant intrinsic connectivity networks. We subsequently evaluated group differences in functional network connectivity, both in a static sense, computed as the pairwise Pearson correlations between the full network time courses (5.4 minutes in length), and a dynamic sense, computed using slidingwindows (44 s in length) and k-means clustering to characterize five discrete functional connectivity states. Static connectivity analysis revealed that compared to healthy controls, patients show significantly stronger connectivity, i.e., hyperconnectivity, between the thalamus and sensory networks (auditory, motor and visual), as well as reduced connectivity (hypoconnectivity) between sensory networks from all modalities. Dynamic analysis suggests that (1), on average, schizophrenia patients spendmuch less time than healthy controls in states typified by strong, large-scale connectivity, and (2), that abnormal connectivity patterns are more pronounced during these connectivity states. In particular, states exhibiting cortical–subcortical antagonism (anticorrelations) and strong positive connectivity between sensory networks are those that showthe group differences of thalamic hyperconnectivity and sensory hypoconnectivity. Group differences are weak or absent during other connectivity states. Dynamic analysis also revealed hypoconnectivity between the putamen and sensory networks during the same states of thalamic hyperconnectivity; notably, this finding cannot be observed in the static connectivity analysis. Finally, in post-hoc analyses we observed that the relationships between sub-cortical low frequency power and connectivitywith sensory networks is altered in patients, suggesting different functional interactions between sub-cortical nuclei and sensorimotor cortex during specific connectivity states. While important differences between patients with schizophrenia and healthy controls have been identified, one should interpret the results with caution given the history of medication in patients. Taken together, our results support and expand current knowledge regarding dysconnectivity in schizophrenia, and strongly advocate the use of dynamic analyses to better account for and understand functional connectivity differences

Multidimensional Frequency Domain Analysis of Full-Volume fMRI Reveals Significant Effects of Age, Gender, and Mental Illness on the Spatiotemporal Organization of Resting-State Brain Activity

Clinical research employing functional magnetic resonance imaging (fMRI) is often conducted within the connectionist paradigm, focusing on patterns of connectivity between voxels, regions of interest (ROIs) or spatially distributed functional networks. Connectivity-based analyses are concerned with pairwise correlations of the temporal activation associated with restrictions of the whole-brain hemodynamic signal to locations of a priori interest. There is a more abstract question however that such spatially granular correlation-based approaches do not elucidate: Are the broad spatiotemporal organizing principles of brains in certain populations distinguishable from those of others? Global patterns (in space and time) of hemodynamic activation are rarely scrutinized for features that might characterize complex psychiatric conditions, aging effects or gender—among other variables of potential interest to researchers. We introduce a canonical, transparent technique for characterizing the role in overall brain activation of spatially scaled periodic patterns with given temporal recurrence rates. A core feature of our technique is the spatiotemporal spectral profile (STSP), a readily interpretable 2D reduction of the native four-dimensional brain × time frequency domain that is still “big enough” to capture important group differences in globally patterned brain activation. Its power to distinguish populations of interest is demonstrated on a large balanced multi-site resting fMRI dataset with nearly equal numbers of schizophrenia patients and healthy controls. Our analysis reveals striking differences in the spatiotemporal organization of brain activity that correlate with the presence of diagnosed schizophrenia, as well as with gender and age. To the best of our knowledge, this is the first demonstration that a 4D frequency domain analysis of full volume fMRI data exposes clinically or demographically relevant differences in resting-state brain function

Multi-Model Order Spatially Constrained ICA Reveals Highly Replicable Group Differences and Consistent Predictive Results From Resting Data: A Large N fMRI Schizophrenia Study

Brain functional networks identified from resting functional magnetic resonance imaging (fMRI) data have the potential to reveal biomarkers for brain disorders, but studies of complex mental illnesses such as schizophrenia (SZ) often yield mixed results across replication studies. This is likely due in part to the complexity of the disorder, the short data acquisition time, and the limited ability of the approaches for brain imaging data mining. Therefore, the use of analytic approaches which can both capture individual variability while offering comparability across analyses is highly preferred. Fully blind data-driven approaches such as independent component analysis (ICA) are hard to compare across studies, and approaches that use fixed atlas-based regions can have limited sensitivity to individual sensitivity. By contrast, spatially constrained ICA (scICA) provides a hybrid, fully automated solution that can incorporate spatial network priors while also adapting to new subjects. However, scICA has thus far only been used with a single spatial scale (ICA dimensionality, i.e., ICA model order). In this work, we present an approach using multi-objective optimization scICA with reference algorithm (MOO-ICAR) to extract subject-specific intrinsic connectivity networks (ICNs) from fMRI data at multiple spatial scales, which also enables us to study interactions across spatial scales. We evaluate this approach using a large N (N \u3e 1,600) study of schizophrenia divided into separate validation and replication sets. A multi-scale ICN template was estimated and labeled, then used as input into scICA which was computed on an individual subject level. We then performed a subsequent analysis of multiscale functional network connectivity (msFNC) to evaluate the patient data, including group differences and classification. Results showed highly consistent group differences in msFNC in regions including cerebellum, thalamus, and motor/auditory networks. Importantly, multiple msFNC pairs linking different spatial scales were implicated. The classification model built on the msFNC features obtained up to 85% F1 score, 83% precision, and 88% recall, indicating the strength of the proposed framework in detecting group differences between schizophrenia and the control group. Finally, we evaluated the relationship of the identified patterns to positive symptoms and found consistent results across datasets. The results verified the robustness of our framework in evaluating brain functional connectivity of schizophrenia at multiple spatial scales, implicated consistent and replicable brain networks, and highlighted a promising approach for leveraging resting fMRI data for brain biomarker development

Modality-Dependent Impact of Hallucinations on Low-Frequency Fluctuations in Schizophrenia

Prior resting-state functional magnetic resonance imaging (fMRI) analyses have identified patterns of functional connectivity associated with hallucinations in schizophrenia (Sz). In this study, we performed an analysis of the mean amplitude of low-frequency fluctuations (ALFF) to compare resting state spontaneous low-frequency fluctuations in patients with Sz who report experiencing hallucinations impacting different sensory modalities. By exploring dynamics across 2 low-frequency passbands (slow-4 and slow-5), we assessed the impact of hallucination modality and frequency range on spatial ALFF variation. Drawing from a sample of Sz and healthy controls studied as part of the Functional Imaging Biomedical Informatics Research Network (FBIRN), we replicated prior findings showing that patients with Sz have decreased ALFF in the posterior brain in comparison to controls. Remarkably, we found that patients that endorsed visual hallucinations did not show this pattern of reduced ALFF in the back of the brain. These patients also had elevated ALFF in the left hippocampus in comparison to patients that endorsed auditory (but not visual) hallucinations. Moreover, left hippocampal ALFF across all the cases was related to reported hallucination severity in both the auditory and visual domains, and not overall positive symptoms. This supports the hypothesis that dynamic changes in the ALFF in the hippocampus underlie severity of hallucinations that impact different sensory modalities

Multimodel Order Independent Component Analysis: A Data-Driven Method for Evaluating Brain Functional Network Connectivity Within and Between Multiple Spatial Scales

Background: While functional connectivity is widely studied, there has been little work studying functional connectivity at different spatial scales. Likewise, the relationship of functional connectivity between spatial scales is unknown. Methods: We proposed an independent component analysis (ICA)-based approach to capture information at multiple-model orders (component numbers), and to evaluate functional network connectivity (FNC) both within and between model orders. We evaluated the approach by studying group differences in the context of a study of resting-state functional magnetic resonance imaging (rsfMRI) data collected from schizophrenia (SZ) individuals and healthy controls (HC). The predictive ability of FNC at multiple spatial scales was assessed using support vector machine-based classification. Results: In addition to consistent predictive patterns at both multiple-model orders and single-model orders, unique predictive information was seen at multiple-model orders and in the interaction between model orders. We observed that the FNC between model orders 25 and 50 maintained the highest predictive information between HC and SZ. Results highlighted the predictive ability of the somatomotor and visual domains both within and between model orders compared with other functional domains. Also, subcortical-somatomotor, temporal-somatomotor, and temporal-subcortical FNCs had relatively high weights in predicting SZ. Conclusions: In sum, multimodel order ICA provides a more comprehensive way to study FNC, produces meaningful and interesting results, which are applicable to future studies. We shared the spatial templates from this work at different model orders to provide a reference for the community, which can be leveraged in regression-based or fully automated (spatially constrained) ICA approaches. Impact statement Multimodel order independent component analysis (ICA) provides a comprehensive way to study brain functional network connectivity within and between multiple spatial scales, highlighting findings that would have been ignored in single-model order analysis. This work expands upon and adds to the relatively new literature on resting functional magnetic resonance imaging-based classification and prediction. Results highlighted the differentiating power of specific intrinsic connectivity networks on classifying brain disorders of schizophrenia patients and healthy participants, at different spatial scales. The spatial templates from this work provide a reference for the community, which can be leveraged in regression-based or fully automated ICA approaches