Geodesic tractography segmentation for directional medical image analysis

Acknowledgements page removed per author's request, 01/06/2014.Geodesic Tractography Segmentation is the two component approach presented in this thesis for the analysis of imagery in oriented domains, with emphasis on the application to diffusion-weighted magnetic resonance imagery (DW-MRI). The computeraided analysis of DW-MRI data presents a new set of problems and opportunities for the application of mathematical and computer vision techniques. The goal is to develop a set of tools that enable clinicians to better understand DW-MRI data and ultimately shed new light on biological processes. This thesis presents a few techniques and tools which may be used to automatically find and segment major neural fiber bundles from DW-MRI data. For each technique, we provide a brief overview of the advantages and limitations of our approach relative to other available approaches.Ph.D.Committee Chair: Tannenbaum, Allen; Committee Member: Barnes, Christopher F.; Committee Member: Niethammer, Marc; Committee Member: Shamma, Jeff; Committee Member: Vela, Patrici

Spatiotemporal mixed modeling of multi-subject task fMRI via method of moments

Estimating spatiotemporal models for multi-subject fMRI is computationally challenging. We propose a mixed model for localization studies with spatial random effects and time-series errors. We develop method-of-moment estimators that leverage population and spatial information and are scalable to massive datasets. In simulations, subject-specific estimates of activation are considerably more accurate than the standard voxel-wise general linear model. Our mixed model also allows for valid population inference. We apply our model to cortical data from motor and theory of mind tasks from the Human Connectome Project (HCP). The proposed method results in subject-specific predictions that appear smoother and less noisy than those from the popular single-subject univariate approach. In particular, the regions of motor cortex associated with a left-hand finger-tapping task appear to be more clearly delineated. Subject-specific maps of activation from task fMRI are increasingly used in pre-surgical planning for tumor removal and in locating targets for transcranial magnetic stimulation. Our findings suggest that using spatial and population information is a promising avenue for improving clinical neuroimaging

Adaptive microstructure-informed tractography for accurate brain connectivity analyses

Human brain has been subject of deep interest for centuries, given it's central role in controlling and directing the actions and functions of the body as response to external stimuli. The neural tissue is primarily constituted of neurons and, together with dendrites and the nerve synapses, constitute the gray matter (GM) which plays a major role in cognitive functions. The information processed in the GM travel from one region to the other of the brain along nerve cell projections, called axons. All together they constitute the white matter (WM) whose wiring organization still remains challenging to uncover. The relationship between structure organization of the brain and function has been deeply investigated on humans and animals based on the assumption that the anatomic architecture determine the network dynamics. In response to that, many different imaging techniques raised, among which diffusion-weighted magnetic resonance imaging (DW-MRI) has triggered tremendous hopes and expectations. Diffusion-weighted imaging measures both restricted and unrestricted diffusion, i.e. the degree of movement freedom of the water molecules, allowing to map the tissue fiber architecture in vivo and non-invasively. Based on DW-MRI data, tractography is able to exploit information of the local fiber orientation to recover global fiber pathways, called streamlines, that represent groups of axons. This, in turn, allows to infer the WM structural connectivity, becoming widely used in many different clinical applications as for diagnoses, virtual dissections and surgical planning. However, despite this unique and compelling ability, data acquisition still suffers from technical limitations and recent studies have highlighted the poor anatomical accuracy of the reconstructions obtained with this technique and challenged its effectiveness for studying brain connectivity. The focus of this Ph.D. project is to specifically address these limitations and to improve the anatomical accuracy of the structural connectivity estimates. To this aim, we developed a global optimization algorithm that exploits micro and macro-structure information, introducing an iterative procedure that uses the underlying tissue properties to drive the reconstruction using a semi-global approach. Then, we investigated the possibility to dynamically adapt the position of a set of candidate streamlines while embedding the anatomical prior of trajectories smoothness and adapting the configuration based on the observed data. Finally, we introduced the concept of bundle-o-graphy by implementing a method to model groups of streamlines based on the concept that axons are organized into fascicles, adapting their shape and extent based on the underlying microstructure

Tractographie adaptative basée sur la microstructure pour des analyses précises de la connectivité cérébrale

Le cerveau est un sujet de recherche depuis plusieurs décennies, puisque son rôle est central dans la compréhension du genre humain. Le cerveau est composé de neurones, où leurs dendrites et synapses se retrouvent dans la matière grise alors que les axones en constituent la matière blanche. L’information traitée dans les différentes régions de la matière grise est ensuite transmise par l’intermédiaire des axones afin d’accomplir différentes fonctions cognitives. La matière blanche forme une structure d’interconnections complexe encore dif- ficile à comprendre et à étudier. La relation entre l’architecture et la fonction du cerveau a été étudiée chez les humains ainsi que pour d’autres espèces, croyant que l’architecture des axones déterminait la dynamique du réseau fonctionnel. Dans ce même objectif, l’Imagerie par résonance (IRM) est un outil formidable qui nous permet de visualiser les tissus cérébraux de façon non-invasive. Plus partic- ulièrement, l’IRM de diffusion permet d’estimer et de séparer la diffusion libre de celle restreinte par la structure des tissus. Cette mesure de restriction peut être utilisée afin d’inférer l’orientation locale des faisceaux de matière blanche. L’algorithme de tractographie exploite cette carte d’orientation pour reconstruire plusieurs connexions de la matière blanche (nommées “streamlines”). Cette modélisation de la matière blanche permet d’estimer la connectivité cérébrale dite structurelle entre les différentes régions du cerveau. Ces résultats peuvent être employés directement pour la planification chirurgicale ou indirectement pour l’analyse ou une évaluation clinique. Malgré plusieurs de ses limitations, telles que sa variabilité et son imprécision, la tractographie reste l’unique moyen d’étudier l’architecture de la matière blanche ainsi que la connectivité cérébrale de façon non invasive. L’objectif de ce projet de doctorat est de répondre spécifiquement à ces limitations et d’améliorer la précision anatomique des estimations de connectivité structurelle. Dans ce but, nous avons développé un algorithme d’optimisation globale qui exploite les informations de micro et macrostructure, en introduisant une procédure itéra- tive qui utilise les propriétés sous-jacentes des tissus pour piloter la reconstruction en utilisant une approche semi-globale. Ensuite, nous avons étudié la possibilité d’adapter dynamiquement la position d’un ensemble de lignes de courant candidates tout en intégrant le préalable anatomique de la douceur des trajectoires et en adap- tant la configuration en fonction des données observées. Enfin, nous avons introduit le concept de bundle-o-graphy en mettant en œuvre une méthode pour modéliser des groupes de lignes de courant basées sur le concept que les axones sont organisés en fascicules, en adaptant leur forme et leur étendue en fonction de la microstructure sous-jacente.Abstract : Human brain has been subject of deep interest for centuries, given it’s central role in controlling and directing the actions and functions of the body as response to external stimuli. The neural tissue is primarily constituted of neurons and, together with dendrites and the nerve synapses, constitute the gray matter (GM) which plays a major role in cognitive functions. The information processed in the GM travel from one region to the other of the brain along nerve cell projections, called axons. All together they constitute the white matter (WM) whose wiring organization still remains challenging to uncover. The relationship between structure organization of the brain and function has been deeply investigated on humans and animals based on the assumption that the anatomic architecture determine the network dynamics. In response to that, many different imaging techniques raised, among which diffusion-weighted magnetic resonance imaging (DW-MRI) has triggered tremendous hopes and expectations. Diffusion-weighted imaging measures both restricted and unrestricted diffusion, i.e. the degree of movement freedom of the water molecules, allowing to map the tissue fiber architecture in vivo and non-invasively. Based on DW-MRI data, tractography is able to exploit information of the local fiber orien- tation to recover global fiber pathways, called streamlines, that represent groups of axons. This, in turn, allows to infer the WM structural connectivity, becoming widely used in many different clinical applications as for diagnoses, virtual dissections and surgical planning. However, despite this unique and compelling ability, data acqui- sition still suffers from technical limitations and recent studies have highlighted the poor anatomical accuracy of the reconstructions obtained with this technique and challenged its effectiveness for studying brain connectivity. The focus of this Ph.D. project is to specifically address these limitations and to improve the anatomical accuracy of the structural connectivity estimates. To this aim, we developed a global optimization algorithm that exploits micro and macro- structure information, introducing an iterative procedure that uses the underlying tissue properties to drive the reconstruction using a semi-global approach. Then, we investigated the possibility to dynamically adapt the position of a set of candidate streamlines while embedding the anatomical prior of trajectories smoothness and adapting the configuration based on the observed data. Finally, we introduced the concept of bundle-o-graphy by implementing a method to model groups of streamlines based on the concept that axons are organized into fascicles, adapting their shape and extent based on the underlying microstructure.Sommario : Il cervello umano è oggetto di profondo interesse da secoli, dato il suo ruolo centrale nel controllare e dirigere le azioni e le funzioni del corpo in risposta a stimoli esterno. Il tessuto neurale è costituito principalmente da neuroni che, insieme ai dendriti e alle sinapsi nervose, costituiscono la materia grigia (GM), la quale riveste un ruolo centrale nelle funzioni cognitive. Le informazioni processate nella GM viaggiano da una regione all’altra del cervello lungo estensioni delle cellule nervose, chiamate assoni. Tutti insieme costituiscono la materia bianca (WM) la cui organizzazione strutturale rimane tuttora sconosciuta. Il legame tra struttura e funzione del cervello sono stati studiati a fondo su esseri umani e animali partendo dal presupposto che l’architettura anatomica determini la dinamica della rete funzionale. In risposta a ciò, sono emerse diverse tecniche di imaging, tra cui la risonanza magnetica pesata per diffusione (DW-MRI) ha suscitato enormi speranze e aspettative. Questa tecnica misura la diffusione sia libera che ristretta, ovvero il grado di libertà di movimento delle molecole d’acqua, consentendo di mappare l’architettura delle fibre neuronali in vivo e in maniera non invasiva. Basata su dati DW-MRI, la trattografia è in grado di sfruttare le informazioni sull’orientamento locale delle fibre per ricostruirne i percorsi a livello globale. Questo, a sua volta, consente di estrarre la connettività strutturale della WM, utilizzata in diverse applicazioni cliniche come per diagnosi, dissezioni virtuali e pianificazione chirurgica. Tuttavia, nonostante questa capacità unica e promettente, l’acquisizione dei dati soffre ancora di limitazioni tecniche e recenti studi hanno messo in evidenza la scarsa accuratezza anatomica delle ricostruzioni ottenute con questa tecnica, mettendone in dubbio l’efficacia per lo studio della connettività cerebrale. Il focus di questo progetto di dottorato è quello di affrontare in modo specifico queste limitazioni e di migliorare l’accuratezza anatomica delle stime di connettività strutturale. A tal fine, abbiamo sviluppato un algoritmo di ottimizzazione globale che sfrutta le informazioni sia micro che macrostrutturali, introducendo una procedura iterativa che utilizza le proprietà del tessuto neuronale per guidare la ricostruzione utilizzando un approccio semi-globale. Successivamente, abbiamo studiato la possibilità di adattare dinamicamente la posizione di un insieme di streamline candidate incorporando il prior anatomico per cui devono seguire traiettorie regolari e adattando la configurazione in base ai dati osservati. Infine, abbiamo introdotto il concetto di bundle-o-graphy implementando un metodo per modellare gruppi di streamline basato sul concetto che gli assoni sono organizzati in fasci, adattando la loro forma ed estensione in base alla microstruttura sottostante

Distribution on Warp Maps for Alignment of Open and Closed Curves

Alignment of curve data is an integral part of their statistical analysis, and can be achieved using model- or optimization-based approaches. The parameter space is usually the set of monotone, continuous warp maps of a domain. Infinite-dimensional nature of the parameter space encourages sampling based approaches, which require a distribution on the set of warp maps. Moreover, the distribution should also enable sampling in the presence of important landmark information on the curves which constrain the warp maps. For alignment of closed and open curves in $\mathbb{R}^d, d=1,2,3$, possibly with landmark information, we provide a constructive, point-process based definition of a distribution on the set of warp maps of $[0,1]$ and the unit circle $\mathbb{S}^1$ that is (1) simple to sample from, and (2) possesses the desiderata for decomposition of the alignment problem with landmark constraints into multiple unconstrained ones. For warp maps on $[0,1]$, the distribution is related to the Dirichlet process. We demonstrate its utility by using it as a prior distribution on warp maps in a Bayesian model for alignment of two univariate curves, and as a proposal distribution in a stochastic algorithm that optimizes a suitable alignment functional for higher-dimensional curves. Several examples from simulated and real datasets are provided

Model and Appearance Based Analysis of Neuronal Morphology from Different Microscopy Imaging Modalities

The neuronal morphology analysis is key for understanding how a brain works. This process requires the neuron imaging system with single-cell resolution; however, there is no feasible system for the human brain. Fortunately, the knowledge can be inferred from the model organism, Drosophila melanogaster, to the human system. This dissertation explores the morphology analysis of Drosophila larvae at single-cell resolution in static images and image sequences, as well as multiple microscopy imaging modalities. Our contributions are on both computational methods for morphology quantification and analysis of the influence of the anatomical aspect. We develop novel model-and-appearance-based methods for morphology quantification and illustrate their significance in three neuroscience studies. Modeling of the structure and dynamics of neuronal circuits creates understanding about how connectivity patterns are formed within a motor circuit and determining whether the connectivity map of neurons can be deduced by estimations of neuronal morphology. To address this problem, we study both boundary-based and centerline-based approaches for neuron reconstruction in static volumes. Neuronal mechanisms are related to the morphology dynamics; so the patterns of neuronal morphology changes are analyzed along with other aspects. In this case, the relationship between neuronal activity and morphology dynamics is explored to analyze locomotion procedures. Our tracking method models the morphology dynamics in the calcium image sequence designed for detecting neuronal activity. It follows the local-to-global design to handle calcium imaging issues and neuronal movement characteristics. Lastly, modeling the link between structural and functional development depicts the correlation between neuron growth and protein interactions. This requires the morphology analysis of different imaging modalities. It can be solved using the part-wise volume segmentation with artificial templates, the standardized representation of neurons. Our method follows the global-to-local approach to solve both part-wise segmentation and registration across modalities. Our methods address common issues in automated morphology analysis from extracting morphological features to tracking neurons, as well as mapping neurons across imaging modalities. The quantitative analysis delivered by our techniques enables a number of new applications and visualizations for advancing the investigation of phenomena in the nervous system

Gaussian-Process-based Robot Learning from Demonstration

Endowed with higher levels of autonomy, robots are required to perform increasingly complex manipulation tasks. Learning from demonstration is arising as a promising paradigm for transferring skills to robots. It allows to implicitly learn task constraints from observing the motion executed by a human teacher, which can enable adaptive behavior. We present a novel Gaussian-Process-based learning from demonstration approach. This probabilistic representation allows to generalize over multiple demonstrations, and encode variability along the different phases of the task. In this paper, we address how Gaussian Processes can be used to effectively learn a policy from trajectories in task space. We also present a method to efficiently adapt the policy to fulfill new requirements, and to modulate the robot behavior as a function of task variability. This approach is illustrated through a real-world application using the TIAGo robot.Comment: 8 pages, 10 figure