Tensor Analysis and Fusion of Multimodal Brain Images

Current high-throughput data acquisition technologies probe dynamical systems with different imaging modalities, generating massive data sets at different spatial and temporal resolutions posing challenging problems in multimodal data fusion. A case in point is the attempt to parse out the brain structures and networks that underpin human cognitive processes by analysis of different neuroimaging modalities (functional MRI, EEG, NIRS etc.). We emphasize that the multimodal, multi-scale nature of neuroimaging data is well reflected by a multi-way (tensor) structure where the underlying processes can be summarized by a relatively small number of components or "atoms". We introduce Markov-Penrose diagrams - an integration of Bayesian DAG and tensor network notation in order to analyze these models. These diagrams not only clarify matrix and tensor EEG and fMRI time/frequency analysis and inverse problems, but also help understand multimodal fusion via Multiway Partial Least Squares and Coupled Matrix-Tensor Factorization. We show here, for the first time, that Granger causal analysis of brain networks is a tensor regression problem, thus allowing the atomic decomposition of brain networks. Analysis of EEG and fMRI recordings shows the potential of the methods and suggests their use in other scientific domains.Comment: 23 pages, 15 figures, submitted to Proceedings of the IEE

Efficient Bayesian Model Selection in PARAFAC via Stochastic Thermodynamic Integration

International audienceParallel factor analysis (PARAFAC) is one of the most popular tensor factorization models. Even though it has proven successful in diverse application fields, the performance of PARAFAC usually hinges up on the rank of the factorization, which is typically specified manually by the practitioner. In this study, we develop a novel parallel and distributed Bayesian model selection technique for rank estimation in large-scale PARAFAC models. The proposed approach integrates ideas from the emerging field of stochastic gradient Markov Chain Monte Carlo, statistical physics, and distributed stochastic optimization. As opposed to the existing methods, which are based on some heuristics, our method has a clear mathematical interpretation, and has significantly lower computational requirements, thanks to data subsampling and parallelization. We provide formal theoretical analysis on the bias induced by the proposed approach. Our experiments on synthetic and large-scale real datasets show that our method is able to find the optimal model order while being significantly faster than the state-of-the-art

Performance of modified wood in service - multi-sensor data fusion and its multi-way analysis

Recent developments in the field of electronic sensors and analytics provide new opportunity for accurate characterization of materials often based on portable and non-destructive methods. By using several complementary techniques, the material description is precise and complete. The data provided by multiple equipment, however, are often not directly comparable due to different resolution, sensitivity and/or data format. The complexity related to the data fusion step and its further interpretation often leads to not complete exploitation of the available data. This paper presents a multi-block approach used for merging experimental data collected by measurement of modified wood in service. Characterization of samples appearance (colour and gloss) is merged with spectral data that decodes information regarding chemical composition. Alternative approaches for data fusion on the low-, mid- and high-levels are introduced, discussed and confronted with the standard approach (single sensor data interpretation). Finally, the trial to analyse the data with multi-way method is presented and interpreted

Cerebral language networks and neuropsychological profile in children with frontotemporal lobe epilepsy : a multimodal neuroimaging and neuropsychological approach

Thèse de doctorat présentée en vue de l'obtention du doctorat en psychologie (Ph.D).L'enfance et l'adolescence sont des périodes uniques de la vie où les changements neuronaux favorisent l'établissement de réseaux cérébraux matures et le développement des capacités intellectuelles. Le langage est un domaine cognitif qui est, non seulement essentiel pour la communication interhumaine, mais qui contribue également au développement de nombreuse capacités et prédit de manière significative la réussite académique. Les régions cérébrales frontotemporales sont des régions clés du réseau langagier du cerveau. Il a été démontré que les neuropathologies telles que l'épilepsie des lobes frontal et temporal (ELF et ELT) interfèrent avec le développement des réseaux cérébraux du langage et provoquent des circuits cérébraux aberrants. Les patrons exacts de réorganisation des réseaux cérébraux fonctionnels ne sont toutefois, pas entièrement compris et l'association avec le profil neuropsychologique reste spéculative. Par conséquent, l'objectif principal de cette thèse est d'accroître la compréhension des altérations du réseau langagier et d'améliorer les connaissances de l'association de l'architecture du réseau et des capacités cognitives chez les enfants et les adolescents avec ELF ou ELT. La présente thèse est composée de trois articles scientifiques, les deux premiers présentant des travaux méthodologiques qui ont permis d'optimiser les méthodes appliquées dans le troisième article, l'étude empirique principale menée auprès d'enfants avec ELF et ELT. Le premier article présente le bilan neuropsychologique pédiatrique comme un outil important pour estimer les capacités cognitives et dresser un profil cognitif avec ses forces et ses faiblesses. Dans le deuxième article, l'analyse factorielle parallèle (PARAFAC) est présentée et validée comme une nouvelle technique employée pour corriger les artefacts de mouvement qui contaminent le signal hémodynamique évalué par la spectroscopie fonctionnelle proche infrarouge (fNIRS). Une meilleure qualité du signal permet une interprétation fiable de la réponse cérébrale en plis de déduire des métriques d'organisation du réseau cérébral. Le troisième article consiste en une étude empirique, où le traitement cérébral du langage, est comparé entre des enfants avec ELF et ELT, et des pairs neuroptypiques. Les schémas de connectivité fonctionnelle indiquent que le groupe de patients présente moins de connexions intra-hémisphériques dans l'hémisphère gauche et entre les hémisphères, et des connexions accrues dans l'hémisphère droit par rapport au groupe témoin. Les mesures de l'architecture du réseau révèlent en outre une efficacité de traitement local plus élevée dans l'hémisphère droit chez les enfants atteints de ELF et ELT par rapport aux enfants en bonne santé. L'architecture du réseau local de l'hémisphère gauche et la capacité intellectuelle globale dans le groupe de patients sont négativement liées, tandis que dans le groupe contrôle, aucune association de ce type n'est identifiable. Ces résultats suggèrent que la réorganisation du réseau de langage chez les enfants avec ELF ou ELT semble dans certains cas soutenir un meilleur résultat cognitif, soit lorsque l'efficacité du traitement local dans l'hémisphère gauche est diminuée. Au contraire, une plus grande efficacité de traitement local semble être une caractéristique d'un réseau de langage cérébral associé à de moins bonnes capacités cognitives. Les travaux de recherche de cette thèse de doctorat fournissent des lignes directrices pour l'utilisation de l'évaluation neuropsychologique pédiatrique, à la fois dans un contexte clinique et scientifique. L'introduction de PARAFAC pour corriger les artefacts de mouvement dans le signal fNIRS est un ajout important au pipeline de prétraitement qui permet d'augmenter la qualité du signal pour une analyse ultérieure. De futurs projets pourront s'appuyer sur cette validation initiale et étendre l'utilisation de PARAFAC pour les analyses du signal fNIRS. Sur cette base méthodologique solide, le travail empirique confirme l'incidence accrue de circuits cérébraux aberrants liés au traitement du langage chez les enfants atteints de ELF et de ELT, et soutient en outre l'efficacité du réseau local en tant que déterminant clé de l'impact de la plasticité cérébrale précoce sur les capacités cognitives. Afin de mieux comprendre les altérations du réseau en réponse aux neuropathologies et leur impact, des études avec des échantillons plus grands et de différents groupes d'âge, devraient étudier plus spécifiquement le rôle des facteurs cliniques (e.g., le type d'épilepsie, la latéralisation de l'épilepsie, le contrôle des crises, etc.) et aborder leurs influences sur le développement. À long terme, cela augmentera le pronostic des phénotypes cliniques chez les patients pédiatriques atteints de ELF et de ELT, et offrira des opportunités d'interventions précoces pour soutenir un développement typique.Childhood and adolescence are unique periods in life where neuronal changes support the establishment of mature brain networks and the development of intellectual capacities. Language is one cognitive domain that is not only an essential part of inter-human communication but also contributes to the development of other capacities and significantly influences academic achievement. Frontotemporal brain areas are key regions of the brain's language network. Neuropathologies such as frontal and temporal lobe epilepsies (FLE and TLE) have been shown to interfere with developing brain language networks and cause aberrant cerebral circuits. The exact patterns of functional brain network reorganization are not fully understood and the association with the neuropsychological profile remains speculative. Therefore, the main objective of this thesis was to increase comprehension of language network alterations and enhance the knowledge on the association of network topology and cognitive capacities in children and adolescents with FLE or TLE. This thesis consists of three scientific articles, with the first two presenting methodological work that allowed for the optimization of the methods applied in the third article, which is the main empirical study conducted on children with FLE and TLE. The first article presents the pediatric neuropsychological assessment as a valuable tool to estimate cognitive capacities and draw a cognitive profile with strengths and weaknesses. In the second article, parallel factor analysis (PARAFAC) is presented and validated as a novel technique to correct motion artifacts that contaminate the hemodynamic signal assessed with functional near-infrared spectroscopy (fNIRS). A better signal quality is the basis for a reliable interpretation of the cerebral response and derive metrics of brain network organization. The third article consists of an empirical study where cerebral language processing is compared between children with FLE and TLE, and neuroptypical peers. Patterns of functional connectivity indicate that the patient group demonstrates fewer intra-hemispheric connections in the left hemisphere and between hemispheres, and increased connections within the right hemisphere as compared to the control group. Metrics of network architecture further reveal a higher local processing efficiency within the right hemisphere in children with FLE and TLE compared to healthy peers. Local network architecture of the left hemisphere and the overall intellectual capacity in the patient group is negatively related, while in the control group no such association is identifiable. These findings suggest that language network reorganization in children with FLE or TLE in some cases seems to support a better cognitive outcome, namely when local processing efficiency in the left hemisphere is decreased. On the contrary, a higher local processing efficiency seems to be a characteristic of a brain language network that goes along with worse cognitive capacities. The research work of this doctoral thesis provides guidelines for the use of pediatric neuropsychological assessment both in a clinical and scientific context. The introduction of PARAFAC to correct motion artifact in the fNIRS signal is an important add-on to the preprocessing pipeline that allows to increase signal quality for subsequent analysis. Future projects will be able to build on this initial validation and extend PARAFAC's use for fNIRS analysis. On this solid methodological foundation, the empirical work confirms the increased incidence of aberrant brain circuits related to language processing in children with FLE and TLE, and further supports local network efficiency as a key determinant of the impact of early brain plasticity on cognitive capacities. In order to further understand network alterations in response to neuropathologies and their impact, studies with larger samples sizes and different age groups should further investigate the specific role of clinical factors (e.g., epilepsy type, epilepsy lateralization, seizure control, etc.) and address developmental influences. Ultimately, this will increase prognosis of clinical phenotypes in pediatric patients with FLE and TLE, and offer opportunities for early interventions to support a healthy development

Space-by-time non-negative matrix factorization for single-trial decoding of M/EEG activity

We develop a novel methodology for the single-trial analysis of multichannel time-varying neuroimaging signals. We introduce the space-by-time M/EEG decomposition, based on Non-negative Matrix Factorization (NMF), which describes single-trial M/EEG signals using a set of non-negative spatial and temporal components that are linearly combined with signed scalar activation coefficients. We illustrate the effectiveness of the proposed approach on an EEG dataset recorded during the performance of a visual categorization task. Our method extracts three temporal and two spatial functional components achieving a compact yet full representation of the underlying structure, which validates and summarizes succinctly results from previous studies. Furthermore, we introduce a decoding analysis that allows determining the distinct functional role of each component and relating them to experimental conditions and task parameters. In particular, we demonstrate that the presented stimulus and the task difficulty of each trial can be reliably decoded using specific combinations of components from the identified space-by-time representation. When comparing with a sliding-window linear discriminant algorithm, we show that our approach yields more robust decoding performance across participants. Overall, our findings suggest that the proposed space-by-time decomposition is a meaningful low-dimensional representation that carries the relevant information of single-trial M/EEG signals

Single-Trial Decoding of Bistable Perception Based on Sparse Nonnegative Tensor Decomposition

The study of the neuronal correlates of the spontaneous alternation in perception elicited by bistable visual stimuli is promising for understanding the mechanism of neural information processing and the neural basis of visual perception and perceptual decision-making. In this paper, we develop a sparse nonnegative tensor factorization-(NTF)-based method to extract features from the local field potential (LFP), collected from the middle temporal (MT) visual cortex in a macaque monkey, for decoding its bistable structure-from-motion (SFM) perception. We apply the feature extraction approach to the multichannel time-frequency representation of the intracortical LFP data. The advantages of the sparse NTF-based feature extraction approach lies in its capability to yield components common across the space, time, and frequency domains yet discriminative across different conditions without prior knowledge of the discriminating frequency bands and temporal windows for a specific subject. We employ the support vector machines (SVMs) classifier based on the features of the NTF components for single-trial decoding the reported perception. Our results suggest that although other bands also have certain discriminability, the gamma band feature carries the most discriminative information for bistable perception, and that imposing the sparseness constraints on the nonnegative tensor factorization improves extraction of this feature