Reference Tracts and Generative Models for Brain White Matter Tractography †

Background: Probabilistic neighborhood tractography aims to automatically segment brain white matter tracts from diffusion magnetic resonance imaging (dMRI) data in different individuals. It uses reference tracts as priors for the shape and length of the tract, and matching models that describe typical deviations from these. We evaluated new reference tracts and matching models derived from dMRI data acquired from 80 healthy volunteers, aged 25–64 years. Methods: The new reference tracts and models were tested in 50 healthy older people, aged 71.8 ± 0.4 years. The matching models were further assessed by sampling and visualizing synthetic tracts derived from them. Results: We found that data-generated reference tracts improved the success rate of automatic white matter tract segmentations. We observed an increased rate of visually acceptable tracts, and decreased variation in quantitative parameters when using this approach. Sampling from the matching models demonstrated their quality, independently of the testing data. Conclusions: We have improved the automatic segmentation of brain white matter tracts, and demonstrated that matching models can be successfully transferred to novel data. In many cases, this will bypass the need for training data and make the use of probabilistic neighborhood tractography in small testing datasets newly practicable

Generative models of the human connectome

The human connectome represents a network map of the brain's wiring diagram and the pattern into which its connections are organized is thought to play an important role in cognitive function. The generative rules that shape the topology of the human connectome remain incompletely understood. Earlier work in model organisms has suggested that wiring rules based on geometric relationships (distance) can account for many but likely not all topological features. Here we systematically explore a family of generative models of the human connectome that yield synthetic networks designed according to different wiring rules combining geometric and a broad range of topological factors. We find that a combination of geometric constraints with a homophilic attachment mechanism can create synthetic networks that closely match many topological characteristics of individual human connectomes, including features that were not included in the optimization of the generative model itself. We use these models to investigate a lifespan dataset and show that, with age, the model parameters undergo progressive changes, suggesting a rebalancing of the generative factors underlying the connectome across the lifespan.Comment: 38 pages, 5 figures + 19 supplemental figures, 1 tabl

Unsupervised deep learning of human brain diffusion magnetic resonance imaging tractography data

L'imagerie par résonance magnétique de diffusion est une technique non invasive permettant de connaître la microstructure organisationnelle des tissus biologiques. Les méthodes computationnelles qui exploitent la préférence orientationnelle de la diffusion dans des structures restreintes pour révéler les voies axonales de la matière blanche du cerveau sont appelées tractographie. Ces dernières années, diverses méthodes de tractographie ont été utilisées avec succès pour découvrir l'architecture de la matière blanche du cerveau. Pourtant, ces techniques de reconstruction souffrent d'un certain nombre de défauts dérivés d'ambiguïtés fondamentales liées à l'information orientationnelle. Cela a des conséquences dramatiques, puisque les cartes de connectivité de la matière blanche basées sur la tractographie sont dominées par des faux positifs. Ainsi, la grande proportion de voies invalides récupérées demeure un des principaux défis à résoudre par la tractographie pour obtenir une description anatomique fiable de la matière blanche. Des approches méthodologiques innovantes sont nécessaires pour aider à résoudre ces questions. Les progrès récents en termes de puissance de calcul et de disponibilité des données ont rendu possible l'application réussie des approches modernes d'apprentissage automatique à une variété de problèmes, y compris les tâches de vision par ordinateur et d'analyse d'images. Ces méthodes modélisent et trouvent les motifs sous-jacents dans les données, et permettent de faire des prédictions sur de nouvelles données. De même, elles peuvent permettre d'obtenir des représentations compactes des caractéristiques intrinsèques des données d'intérêt. Les approches modernes basées sur les données, regroupées sous la famille des méthodes d'apprentissage profond, sont adoptées pour résoudre des tâches d'analyse de données d'imagerie médicale, y compris la tractographie. Dans ce contexte, les méthodes deviennent moins dépendantes des contraintes imposées par les approches classiques utilisées en tractographie. Par conséquent, les méthodes inspirées de l'apprentissage profond conviennent au changement de paradigme requis, et peuvent ouvrir de nouvelles possibilités de modélisation, en améliorant ainsi l'état de l'art en tractographie. Dans cette thèse, un nouveau paradigme basé sur les techniques d'apprentissage de représentation est proposé pour générer et analyser des données de tractographie. En exploitant les architectures d'autoencodeurs, ce travail tente d'explorer leur capacité à trouver un code optimal pour représenter les caractéristiques des fibres de la matière blanche. Les contributions proposées exploitent ces représentations pour une variété de tâches liées à la tractographie, y compris (i) le filtrage et (ii) le regroupement efficace sur les résultats générés par d'autres méthodes, ainsi que (iii) la reconstruction proprement dite des fibres de la matière blanche en utilisant une méthode générative. Ainsi, les méthodes issues de cette thèse ont été nommées (i) FINTA (Filtering in Tractography using Autoencoders), (ii) CINTA (Clustering in Tractography using Autoencoders), et (iii) GESTA (Generative Sampling in Bundle Tractography using Autoencoders), respectivement. Les performances des méthodes proposées sont évaluées par rapport aux méthodes de l'état de l'art sur des données de diffusion synthétiques et des données de cerveaux humains chez l'adulte sain in vivo. Les résultats montrent que (i) la méthode de filtrage proposée offre une sensibilité et spécificité supérieures par rapport à d'autres méthodes de l'état de l'art; (ii) le regroupement des tractes dans des faisceaux est fait de manière consistante; et (iii) l'approche générative échantillonnant des tractes comble mieux l'espace de la matière blanche dans des régions difficiles à reconstruire. Enfin, cette thèse révèle les possibilités des autoencodeurs pour l'analyse des données des fibres de la matière blanche, et ouvre la voie à fournir des données de tractographie plus fiables.Abstract : Diffusion magnetic resonance imaging is a non-invasive technique providing insights into the organizational microstructure of biological tissues. The computational methods that exploit the orientational preference of the diffusion in restricted structures to reveal the brain's white matter axonal pathways are called tractography. In recent years, a variety of tractography methods have been successfully used to uncover the brain's white matter architecture. Yet, these reconstruction techniques suffer from a number of shortcomings derived from fundamental ambiguities inherent to the orientation information. This has dramatic consequences, since current tractography-based white matter connectivity maps are dominated by false positive connections. Thus, the large proportion of invalid pathways recovered remains one of the main challenges to be solved by tractography to obtain a reliable anatomical description of the white matter. Methodological innovative approaches are required to help solving these questions. Recent advances in computational power and data availability have made it possible to successfully apply modern machine learning approaches to a variety of problems, including computer vision and image analysis tasks. These methods model and learn the underlying patterns in the data, and allow making accurate predictions on new data. Similarly, they may enable to obtain compact representations of the intrinsic features of the data of interest. Modern data-driven approaches, grouped under the family of deep learning methods, are being adopted to solve medical imaging data analysis tasks, including tractography. In this context, the proposed methods are less dependent on the constraints imposed by current tractography approaches. Hence, deep learning-inspired methods are suit for the required paradigm shift, may open new modeling possibilities, and thus improve the state of the art in tractography. In this thesis, a new paradigm based on representation learning techniques is proposed to generate and to analyze tractography data. By harnessing autoencoder architectures, this work explores their ability to find an optimal code to represent the features of the white matter fiber pathways. The contributions exploit such representations for a variety of tractography-related tasks, including efficient (i) filtering and (ii) clustering on results generated by other methods, and (iii) the white matter pathway reconstruction itself using a generative method. The methods issued from this thesis have been named (i) FINTA (Filtering in Tractography using Autoencoders), (ii) CINTA (Clustering in Tractography using Autoencoders), and (iii) GESTA (Generative Sampling in Bundle Tractography using Autoencoders), respectively. The proposed methods' performance is assessed against current state-of-the-art methods on synthetic data and healthy adult human brain in vivo data. Results show that the (i) introduced filtering method has superior sensitivity and specificity over other state-of-the-art methods; (ii) the clustering method groups streamlines into anatomically coherent bundles with a high degree of consistency; and (iii) the generative streamline sampling technique successfully improves the white matter coverage in hard-to-track bundles. In summary, this thesis unlocks the potential of deep autoencoder-based models for white matter data analysis, and paves the way towards delivering more reliable tractography data

Adaptive microstructure-informed tractography for accurate brain connectivity analyses

Human brain has been subject of deep interest for centuries, given it's central role in controlling and directing the actions and functions of the body as response to external stimuli. The neural tissue is primarily constituted of neurons and, together with dendrites and the nerve synapses, constitute the gray matter (GM) which plays a major role in cognitive functions. The information processed in the GM travel from one region to the other of the brain along nerve cell projections, called axons. All together they constitute the white matter (WM) whose wiring organization still remains challenging to uncover. The relationship between structure organization of the brain and function has been deeply investigated on humans and animals based on the assumption that the anatomic architecture determine the network dynamics. In response to that, many different imaging techniques raised, among which diffusion-weighted magnetic resonance imaging (DW-MRI) has triggered tremendous hopes and expectations. Diffusion-weighted imaging measures both restricted and unrestricted diffusion, i.e. the degree of movement freedom of the water molecules, allowing to map the tissue fiber architecture in vivo and non-invasively. Based on DW-MRI data, tractography is able to exploit information of the local fiber orientation to recover global fiber pathways, called streamlines, that represent groups of axons. This, in turn, allows to infer the WM structural connectivity, becoming widely used in many different clinical applications as for diagnoses, virtual dissections and surgical planning. However, despite this unique and compelling ability, data acquisition still suffers from technical limitations and recent studies have highlighted the poor anatomical accuracy of the reconstructions obtained with this technique and challenged its effectiveness for studying brain connectivity. The focus of this Ph.D. project is to specifically address these limitations and to improve the anatomical accuracy of the structural connectivity estimates. To this aim, we developed a global optimization algorithm that exploits micro and macro-structure information, introducing an iterative procedure that uses the underlying tissue properties to drive the reconstruction using a semi-global approach. Then, we investigated the possibility to dynamically adapt the position of a set of candidate streamlines while embedding the anatomical prior of trajectories smoothness and adapting the configuration based on the observed data. Finally, we introduced the concept of bundle-o-graphy by implementing a method to model groups of streamlines based on the concept that axons are organized into fascicles, adapting their shape and extent based on the underlying microstructure

Tractographie adaptative basée sur la microstructure pour des analyses précises de la connectivité cérébrale

Le cerveau est un sujet de recherche depuis plusieurs décennies, puisque son rôle est central dans la compréhension du genre humain. Le cerveau est composé de neurones, où leurs dendrites et synapses se retrouvent dans la matière grise alors que les axones en constituent la matière blanche. L’information traitée dans les différentes régions de la matière grise est ensuite transmise par l’intermédiaire des axones afin d’accomplir différentes fonctions cognitives. La matière blanche forme une structure d’interconnections complexe encore dif- ficile à comprendre et à étudier. La relation entre l’architecture et la fonction du cerveau a été étudiée chez les humains ainsi que pour d’autres espèces, croyant que l’architecture des axones déterminait la dynamique du réseau fonctionnel. Dans ce même objectif, l’Imagerie par résonance (IRM) est un outil formidable qui nous permet de visualiser les tissus cérébraux de façon non-invasive. Plus partic- ulièrement, l’IRM de diffusion permet d’estimer et de séparer la diffusion libre de celle restreinte par la structure des tissus. Cette mesure de restriction peut être utilisée afin d’inférer l’orientation locale des faisceaux de matière blanche. L’algorithme de tractographie exploite cette carte d’orientation pour reconstruire plusieurs connexions de la matière blanche (nommées “streamlines”). Cette modélisation de la matière blanche permet d’estimer la connectivité cérébrale dite structurelle entre les différentes régions du cerveau. Ces résultats peuvent être employés directement pour la planification chirurgicale ou indirectement pour l’analyse ou une évaluation clinique. Malgré plusieurs de ses limitations, telles que sa variabilité et son imprécision, la tractographie reste l’unique moyen d’étudier l’architecture de la matière blanche ainsi que la connectivité cérébrale de façon non invasive. L’objectif de ce projet de doctorat est de répondre spécifiquement à ces limitations et d’améliorer la précision anatomique des estimations de connectivité structurelle. Dans ce but, nous avons développé un algorithme d’optimisation globale qui exploite les informations de micro et macrostructure, en introduisant une procédure itéra- tive qui utilise les propriétés sous-jacentes des tissus pour piloter la reconstruction en utilisant une approche semi-globale. Ensuite, nous avons étudié la possibilité d’adapter dynamiquement la position d’un ensemble de lignes de courant candidates tout en intégrant le préalable anatomique de la douceur des trajectoires et en adap- tant la configuration en fonction des données observées. Enfin, nous avons introduit le concept de bundle-o-graphy en mettant en œuvre une méthode pour modéliser des groupes de lignes de courant basées sur le concept que les axones sont organisés en fascicules, en adaptant leur forme et leur étendue en fonction de la microstructure sous-jacente.Abstract : Human brain has been subject of deep interest for centuries, given it’s central role in controlling and directing the actions and functions of the body as response to external stimuli. The neural tissue is primarily constituted of neurons and, together with dendrites and the nerve synapses, constitute the gray matter (GM) which plays a major role in cognitive functions. The information processed in the GM travel from one region to the other of the brain along nerve cell projections, called axons. All together they constitute the white matter (WM) whose wiring organization still remains challenging to uncover. The relationship between structure organization of the brain and function has been deeply investigated on humans and animals based on the assumption that the anatomic architecture determine the network dynamics. In response to that, many different imaging techniques raised, among which diffusion-weighted magnetic resonance imaging (DW-MRI) has triggered tremendous hopes and expectations. Diffusion-weighted imaging measures both restricted and unrestricted diffusion, i.e. the degree of movement freedom of the water molecules, allowing to map the tissue fiber architecture in vivo and non-invasively. Based on DW-MRI data, tractography is able to exploit information of the local fiber orien- tation to recover global fiber pathways, called streamlines, that represent groups of axons. This, in turn, allows to infer the WM structural connectivity, becoming widely used in many different clinical applications as for diagnoses, virtual dissections and surgical planning. However, despite this unique and compelling ability, data acqui- sition still suffers from technical limitations and recent studies have highlighted the poor anatomical accuracy of the reconstructions obtained with this technique and challenged its effectiveness for studying brain connectivity. The focus of this Ph.D. project is to specifically address these limitations and to improve the anatomical accuracy of the structural connectivity estimates. To this aim, we developed a global optimization algorithm that exploits micro and macro- structure information, introducing an iterative procedure that uses the underlying tissue properties to drive the reconstruction using a semi-global approach. Then, we investigated the possibility to dynamically adapt the position of a set of candidate streamlines while embedding the anatomical prior of trajectories smoothness and adapting the configuration based on the observed data. Finally, we introduced the concept of bundle-o-graphy by implementing a method to model groups of streamlines based on the concept that axons are organized into fascicles, adapting their shape and extent based on the underlying microstructure.Sommario : Il cervello umano è oggetto di profondo interesse da secoli, dato il suo ruolo centrale nel controllare e dirigere le azioni e le funzioni del corpo in risposta a stimoli esterno. Il tessuto neurale è costituito principalmente da neuroni che, insieme ai dendriti e alle sinapsi nervose, costituiscono la materia grigia (GM), la quale riveste un ruolo centrale nelle funzioni cognitive. Le informazioni processate nella GM viaggiano da una regione all’altra del cervello lungo estensioni delle cellule nervose, chiamate assoni. Tutti insieme costituiscono la materia bianca (WM) la cui organizzazione strutturale rimane tuttora sconosciuta. Il legame tra struttura e funzione del cervello sono stati studiati a fondo su esseri umani e animali partendo dal presupposto che l’architettura anatomica determini la dinamica della rete funzionale. In risposta a ciò, sono emerse diverse tecniche di imaging, tra cui la risonanza magnetica pesata per diffusione (DW-MRI) ha suscitato enormi speranze e aspettative. Questa tecnica misura la diffusione sia libera che ristretta, ovvero il grado di libertà di movimento delle molecole d’acqua, consentendo di mappare l’architettura delle fibre neuronali in vivo e in maniera non invasiva. Basata su dati DW-MRI, la trattografia è in grado di sfruttare le informazioni sull’orientamento locale delle fibre per ricostruirne i percorsi a livello globale. Questo, a sua volta, consente di estrarre la connettività strutturale della WM, utilizzata in diverse applicazioni cliniche come per diagnosi, dissezioni virtuali e pianificazione chirurgica. Tuttavia, nonostante questa capacità unica e promettente, l’acquisizione dei dati soffre ancora di limitazioni tecniche e recenti studi hanno messo in evidenza la scarsa accuratezza anatomica delle ricostruzioni ottenute con questa tecnica, mettendone in dubbio l’efficacia per lo studio della connettività cerebrale. Il focus di questo progetto di dottorato è quello di affrontare in modo specifico queste limitazioni e di migliorare l’accuratezza anatomica delle stime di connettività strutturale. A tal fine, abbiamo sviluppato un algoritmo di ottimizzazione globale che sfrutta le informazioni sia micro che macrostrutturali, introducendo una procedura iterativa che utilizza le proprietà del tessuto neuronale per guidare la ricostruzione utilizzando un approccio semi-globale. Successivamente, abbiamo studiato la possibilità di adattare dinamicamente la posizione di un insieme di streamline candidate incorporando il prior anatomico per cui devono seguire traiettorie regolari e adattando la configurazione in base ai dati osservati. Infine, abbiamo introdotto il concetto di bundle-o-graphy implementando un metodo per modellare gruppi di streamline basato sul concetto che gli assoni sono organizzati in fasci, adattando la loro forma ed estensione in base alla microstruttura sottostante

The autonomic brain: Multi-dimensional generative hierarchical modelling of the autonomic connectome.

The autonomic nervous system governs the body's multifaceted internal adaptation to diverse changes in the external environment, a role more complex than is accessible to the methods-and data scales-hitherto used to illuminate its operation. Here we apply generative graphical modelling to large-scale multimodal neuroimaging data encompassing normal and abnormal states to derive a comprehensive hierarchical representation of the autonomic brain. We demonstrate that whereas conventional structural and functional maps identify regions jointly modulated by parasympathetic and sympathetic systems, only graphical analysis discriminates between them, revealing the cardinal roles of the autonomic system to be mediated by high-level distributed interactions. We provide a novel representation of the autonomic system-a multidimensional, generative network-that renders its richness tractable within future models of its function in health and disease

Building connectomes using diffusion MRI: why, how and but

Why has diffusion MRI become a principal modality for mapping connectomes in vivo? How do different image acquisition parameters, fiber tracking algorithms and other methodological choices affect connectome estimation? What are the main factors that dictate the success and failure of connectome reconstruction? These are some of the key questions that we aim to address in this review. We provide an overview of the key methods that can be used to estimate the nodes and edges of macroscale connectomes, and we discuss open problems and inherent limitations. We argue that diffusion MRI-based connectome mapping methods are still in their infancy and caution against blind application of deep white matter tractography due to the challenges inherent to connectome reconstruction. We review a number of studies that provide evidence of useful microstructural and network properties that can be extracted in various independent and biologically-relevant contexts. Finally, we highlight some of the key deficiencies of current macroscale connectome mapping methodologies and motivate future developments