Geometric Convolutional Neural Network for Analyzing Surface-Based Neuroimaging Data

The conventional CNN, widely used for two-dimensional images, however, is not directly applicable to non-regular geometric surface, such as a cortical thickness. We propose Geometric CNN (gCNN) that deals with data representation over a spherical surface and renders pattern recognition in a multi-shell mesh structure. The classification accuracy for sex was significantly higher than that of SVM and image based CNN. It only uses MRI thickness data to classify gender but this method can expand to classify disease from other MRI or fMRI dataComment: 29 page

Geometric Convolutional Neural Network for Analyzing Surface-Based Neuroimaging Data.

In machine learning, one of the most popular deep learning methods is the convolutional neural network (CNN), which utilizes shared local filters and hierarchical information processing analogous to the brain's visual system. Despite its popularity in recognizing two-dimensional (2D) images, the conventional CNN is not directly applicable to semi-regular geometric mesh surfaces, on which the cerebral cortex is often represented. In order to apply the CNN to surface-based brain research, we propose a geometric CNN (gCNN) that deals with data representation on a mesh surface and renders pattern recognition in a multi-shell mesh structure. To make it compatible with the conventional CNN toolbox, the gCNN includes data sampling over the surface, and a data reshaping method for the convolution and pooling layers. We evaluated the performance of the gCNN in sex classification using cortical thickness maps of both hemispheres from the Human Connectome Project (HCP). The classification accuracy of the gCNN was significantly higher than those of a support vector machine (SVM) and a 2D CNN for thickness maps generated by a map projection. The gCNN also demonstrated position invariance of local features, which rendered reuse of its pre-trained model for applications other than that for which the model was trained without significant distortion in the final outcome. The superior performance of the gCNN is attributable to CNN properties stemming from its brain-like architecture, and its surface-based representation of cortical information. The gCNN provides much-needed access to surface-based machine learning, which can be used in both scientific investigations and clinical applications.ope

Geometric Convolutional Neural Network for Analyzing Surface-Based Neuroimaging Data

In machine learning, one of the most popular deep learning methods is the convolutional neural network (CNN), which utilizes shared local filters and hierarchical information processing analogous to the brain’s visual system. Despite its popularity in recognizing two-dimensional (2D) images, the conventional CNN is not directly applicable to semi-regular geometric mesh surfaces, on which the cerebral cortex is often represented. In order to apply the CNN to surface-based brain research, we propose a geometric CNN (gCNN) that deals with data representation on a mesh surface and renders pattern recognition in a multi-shell mesh structure. To make it compatible with the conventional CNN toolbox, the gCNN includes data sampling over the surface, and a data reshaping method for the convolution and pooling layers. We evaluated the performance of the gCNN in sex classification using cortical thickness maps of both hemispheres from the Human Connectome Project (HCP). The classification accuracy of the gCNN was significantly higher than those of a support vector machine (SVM) and a 2D CNN for thickness maps generated by a map projection. The gCNN also demonstrated position invariance of local features, which rendered reuse of its pre-trained model for applications other than that for which the model was trained without significant distortion in the final outcome. The superior performance of the gCNN is attributable to CNN properties stemming from its brain-like architecture, and its surface-based representation of cortical information. The gCNN provides much-needed access to surface-based machine learning, which can be used in both scientific investigations and clinical applications

Hippocampal representations for deep learning on Alzheimer’s disease

Deep learning offers a powerful approach for analyzing hippocampal changes in Alzheimer’s disease (AD) without relying on handcrafted features. Nevertheless, an input format needs to be selected to pass the image information to the neural network, which has wide ramifications for the analysis, but has not been evaluated yet. We compare five hippocampal representations (and their respective tailored network architectures) that span from raw images to geometric representations like meshes and point clouds. We performed a thorough evaluation for the prediction of AD diagnosis and time-to-dementia prediction with experiments on an independent test dataset. In addition, we evaluated the ease of interpretability for each representation–network pair. Our results show that choosing an appropriate representation of the hippocampus for predicting Alzheimer’s disease with deep learning is crucial, since it impacts performance and ease of interpretation

Geometric deep learning for Alzheimer's disease analysis

Alzheimer’s Disease (AD) represents between 50-70% of the cases of dementia, which translates in around 25-35 million people affected by this disease. During its development, patients suffering from AD experience an irreversible cognitive decline, which limits their autonomy on their daily lives. While many of the causes of AD are still unknown, researchers have noticed a abnormal amyloid deposition and neurofibrillary tangles that will start affecting the short-term memory of the patient, together with other cognitive functions. In fact, these pathophysiological changes start taking place even before the patient experiences the first symptoms. One of the structures that is first affected by the disease is the hippocampus. During the development of AD, this part of the brain experiences an irregular deformation that affects its capabilities of forming new memories. Therefore, many clinical work has set a focus on studying this structure and its evolution along the disease. Identifying the changes it suffers can help us understand better the causes of the patient's cognitive decline. Given the complexity that characterizes AD, identifying patterns during its development is still a cumbersome task for physicians.Thus, aiding the diagnosis and prognosis of the disease using Deep Learning methods can be highly beneficial, as seen for other medical applications. In particular, if the focus is set on single structures (e.g. the hippocampus) Geometric Deep Learning offers a set of models that are best suited for 3D shape representations. We believe these methods can help doctors identify abnormalities in the structure that can lead to AD in the future. In this work, we first study the capabilities of current Geometric Deep Learning methods in diagnosing patients suffering from AD, by only looking at the hippocampus. We start by studying one of the simplest 3d representations, point clouds. We continue by comparing this representation to other non-Euclidean representations, such as meshes, and also Euclidean ones (e.g. 3d masks). We observe that meshes are one of the optimal ways of representing 3d structures for capturing fine-grained changes, but they carry additional pre-processing steps that Euclidean representations do not require. Finally, once we have confirmed that Geometric Deep Learning, particularly mesh neural networks, can properly capture the effects of AD on the hippocampus, we expand their application to longitudinal analysis of the structure. We propose a new temporal model based on Spiral Resnet and Transformers that sets a new state-of-the-art for the task of predicting longitudinal trajectories of the hippocampus. We also evaluated the effect that imputing missing longitudinal data has on detecting subjects that are developping to AD. Our experiments show an increase of a 3% in distinguishing between converting and stable trajectories