Multi-modal deep learning from imaging genomic data for schizophrenia classification

BackgroundSchizophrenia (SZ) is a psychiatric condition that adversely affects an individual’s cognitive, emotional, and behavioral aspects. The etiology of SZ, although extensively studied, remains unclear, as multiple factors come together to contribute toward its development. There is a consistent body of evidence documenting the presence of structural and functional deviations in the brains of individuals with SZ. Moreover, the hereditary aspect of SZ is supported by the significant involvement of genomics markers. Therefore, the need to investigate SZ from a multi-modal perspective and develop approaches for improved detection arises.MethodsOur proposed method employed a deep learning framework combining features from structural magnetic resonance imaging (sMRI), functional magnetic resonance imaging (fMRI), and genetic markers such as single nucleotide polymorphism (SNP). For sMRI, we used a pre-trained DenseNet to extract the morphological features. To identify the most relevant functional connections in fMRI and SNPs linked to SZ, we applied a 1-dimensional convolutional neural network (CNN) followed by layerwise relevance propagation (LRP). Finally, we concatenated these obtained features across modalities and fed them to the extreme gradient boosting (XGBoost) tree-based classifier to classify SZ from healthy control (HC).ResultsExperimental evaluation on clinical dataset demonstrated that, compared to the outcomes obtained from each modality individually, our proposed multi-modal approach performed classification of SZ individuals from HC with an improved accuracy of 79.01%.ConclusionWe proposed a deep learning based framework that selects multi-modal (sMRI, fMRI and genetic) features efficiently and fuse them to obtain improved classification scores. Additionally, by using Explainable AI (XAI), we were able to pinpoint and validate significant functional network connections and SNPs that contributed the most toward SZ classification, providing necessary interpretation behind our findings

Biorthogonal wavelet based entropy feature extraction for identification of maize leaf diseases

Crop disease is considered as a major constraint to both food quality and production. Even in this era of precision agriculture, the lacking of compulsory infrastructure has made rapid identification of crop diseases quite hard in numerous regions around the world. In this paper, we introduced a new method based on biorthogonal wavelet transform (BWT) to identify prime maize leaf diseases. We performed biorthogonal wavelet decomposition and pixel wise morphological operation to segment the maize leaf lesion from input image. For feature extraction, by applying 2-D biorthogonal wavelet transform (BWT) at multiple levels we proposed a novel method to extract colour channel wise wavelet entropy features by investigating discriminatory potential of three different biorthogonal wavelet filters (bior3.3, bior3.5, and bior3.7). The effectiveness of our extracted features were evaluated by employing five different classifiers and obtaining 95.78% overall identification accuracy with 10-fold cross validation. All the materials related our study can be found at: https://github.com/BadhanMazumder/BiorthogonalWavelet_MaizeDiseaseDetection.git