Automatic Mesh-Based Segmentation of Multiple Organs in MR Images

La segmentation de structures anatomiques multiples dans des images de résonance magnétique (RM) est souvent requise dans des applications de génie biomédical telles que la simulation numérique, la chirurgie guidée par l’image, la planification de traitements, etc. De plus, il y a un besoin croissant pour une segmentation automatique d’organes multiples et de structures complexes à partir de cette modalité d’imagerie. Il existe plusieurs techniques de segmentation multi-objets qui ont été appliquées avec succès sur des images de tomographie axiale à rayons-X (CT). Cependant, dans le cas des images RM cette tâche est plus difficile en raison de l’inhomogénéité des intensités dans ces images et de la variabilité dans l’apparence des structures anatomiques. Par conséquent, l’état de l’art sur la segmentation multi-objets sur des images RM est beaucoup plus faible que celui sur les images CT. Parmi les travaux qui portent sur la segmentation d’images RM, les approches basées sur la segmentation de régions sont sensibles au bruit et la non uniformité de l’intensité dans les images. Les approches basées sur les contours ont de la difficulté à regrouper les informations sur les contours de sorte à produire un contour fermé cohérent. Les techniques basées sur les atlas peuvent avoir des problèmes en présence de structures complexes avec une grande variabilité anatomique. Les modèles déformables représentent une des méthodes les plus populaire pour la détection automatique de différents organes dans les images RM. Cependant, ces modèles souffrent encore d’une limitation importante qui est leur sensibilité à la position initiale et la forme du modèle. Une initialisation inappropriée peut conduire à un échec dans l’extraction des frontières des objets. D’un autre côté, le but ultime d’une segmentation automatique multi-objets dans les images RM est de produire un modèle qui peut aider à extraire les caractéristiques structurelles d’organes distincts dans les images. Les méthodes d’initialisation automatique actuelles qui utilisent différents descripteurs ne réussissent pas complètement l’extraction d’objets multiples dans les images RM. Nous avons besoin d’exploiter une information plus riche qui se trouve dans les contours des organes. Dans ce contexte les maillages adaptatifs anisotropiques semblent être une solution potentielle au problème soulevé. Les maillages adaptatifs anisotropiques construits à partir des images RM contiennent de l’information à un plus haut niveau d’abstraction représentant les éléments, d’une orientation et d’une forme donnée, qui constituent les différents organes dans l’image. Les méthodes existantes pour la construction de maillages adaptatifs sont basées sur les intensités dans l’image et possèdent une limitation pratique qui est l’alignement inadéquat des éléments du maillage en présence de contours inclinés dans l’image. Par conséquent, nous avons aussi besoin d’améliorer le processus d’adaptation de maillage pour produire une meilleure représentation de l’image basée sur un maillage.----------ABSTRACT: Segmentation of multiple anatomical structures in MR images is often required for biomedical engineering applications such as clinical simulation, image-guided surgery, treatment planning, etc. Moreover, there is a growing need for automatic segmentation of multiple organs and complex structures from this medical imaging modality. Many successful multi-object segmentation attempts were introduced for CT images. However in the case of MR images it is a more challenging task due to intensity inhomogeneity and variability of anatomy appearance. Therefore, state-of-the-art in multi-object MR segmentation is very inferior to that of CT images. In literature dealing with MR image segmentation, the region-based approaches are sensitive to noise and non-uniformity in the input image. The edge-based approaches are challenging to group the edge information into a coherent closed contour. The atlas-based techniques can be problematic for complicated structures with anatomical variability. Deformable models are among the most popular methods for automatic detection of different organs in MR images. However they still have an important limitation which is that they are sensitive to initial position and shape of the model. An unsuitable initialization may provide failure to capture the true boundaries of the objects. On the other hand, a useful aim for an automatic multi-object MR segmentation is to provide a model which promotes understanding of the structural features of the distinct objects within the MR images. The current automatic initialization methods which have used different descriptors are not completely successful in extracting multiple objects from MR images and we need to find richer information that is available from edges. In this regard, anisotropic adaptive meshes seem to be a potential solution to the aforesaid limitation. Anisotropic adaptive meshes constructed from MR images contain higher level, abstract information about the anatomical structures of the organs within the image retained as the elements shape and orientation. Existing methods for constructing adaptive meshes based on image features have a practical limitation where manifest itself in inadequate mesh elements alignment to inclined edges in the image. Therefore, we also have to enhance mesh adaptation process to provide a better mesh-based representation. In this Ph.D. project, considering the highlighted limitations we are going to present a novel method for automatic segmentation of multiple organs in MR images by incorporating mesh adaptation techniques. In our progress, first, we improve an anisotropic adaptation process for the meshes that are constructed from MR images where the mesh elements align adequately to the image content and improve mesh anisotropy along edges in all directions. Then the resulting adaptive meshes are used for initialization of multiple active models which leads to extract initial object boundaries close to the true boundaries of multiple objects simultaneously. Finally, the Vector Field Convolution method is utilized to guide curve evolution towards the object boundaries to obtain the final segmentation results and present a better performance in terms of speed and accuracy

Decoupled Deformable Model For 2D/3D Boundary Identification

The accurate detection of static object boundaries such as contours or surfaces and dynamic tunnels of moving objects via deformable models is an ongoing research topic in computer vision. Most deformable models attempt to converge towards a desired solution by minimizing the sum of internal (prior) and external (measurement) energy terms. Such an approach is elegant, but frequently mis-converges in the presence of noise or complex boundaries and typically requires careful semi-dependent parameter tuning and initialization. Furthermore, current deformable model based approaches are computationally demanding which precludes real-time use. To address these limitations, a decoupled deformable model (DDM) is developed which optimizes the two energy terms separately. Essentially, the DDM consists of a measurement update step, employing a Hidden Markov Model (HMM) and Maximum Likelihood (ML) estimator, followed by a separate prior step, which modifies the updated deformable model based on the relative strengths of the measurement uncertainty and the non-stationary prior. The non-stationary prior is generated by using a curvature guided importance sampling method to capture high curvature regions. By separating the measurement and prior steps, the algorithm is less likely to mis-converge; furthermore, the use of a non-iterative ML estimator allows the method to converge more rapidly than energy-based iterative solvers. The full functionality of the DDM is developed in three phases. First, a DDM in 2D called the decoupled active contour (DAC) is developed to accurately identify the boundary of a 2D object in the presence of noise and background clutter. To carry out this task, the DAC employs the Viterbi algorithm as a truncated ML estimator, curvature guided importance sampling as a non-stationary prior generator, and a linear Bayesian estimator to fuse the non-stationary prior with the measurements. Experimental results clearly demonstrate that the DAC is robust to noise, can capture regions of very high curvature, and exhibits limited dependence on contour initialization or parameter settings. Compared to three other published methods and across many images, the DAC is found to be faster and to offer consistently accurate boundary identification. Second, a fast decoupled active contour (FDAC) is proposed to accelerate the convergence rate and the scalability of the DAC without sacrificing the accuracy by employing computationally efficient and scalable techniques to solve the three primary steps of DAC. The computational advantage of the FDAC is demonstrated both experimentally and analytically compared to three computationally efficient methods using illustrative examples. Finally, an extension of the FDAC from 2D to 3D called a decoupled active surface (DAS) is developed to precisely identify the surface of a volumetric 3D image and the tunnel of a moving 2D object. To achieve the objectives of the DAS, the concepts of the FDAC are extended to 3D by using a specialized 3D deformable model representation scheme and a computationally and storage efficient estimation scheme. The performance of the DAS is demonstrated using several natural and synthetic volumetric images and a sequence of moving objects

Model and Appearance Based Analysis of Neuronal Morphology from Different Microscopy Imaging Modalities

The neuronal morphology analysis is key for understanding how a brain works. This process requires the neuron imaging system with single-cell resolution; however, there is no feasible system for the human brain. Fortunately, the knowledge can be inferred from the model organism, Drosophila melanogaster, to the human system. This dissertation explores the morphology analysis of Drosophila larvae at single-cell resolution in static images and image sequences, as well as multiple microscopy imaging modalities. Our contributions are on both computational methods for morphology quantification and analysis of the influence of the anatomical aspect. We develop novel model-and-appearance-based methods for morphology quantification and illustrate their significance in three neuroscience studies. Modeling of the structure and dynamics of neuronal circuits creates understanding about how connectivity patterns are formed within a motor circuit and determining whether the connectivity map of neurons can be deduced by estimations of neuronal morphology. To address this problem, we study both boundary-based and centerline-based approaches for neuron reconstruction in static volumes. Neuronal mechanisms are related to the morphology dynamics; so the patterns of neuronal morphology changes are analyzed along with other aspects. In this case, the relationship between neuronal activity and morphology dynamics is explored to analyze locomotion procedures. Our tracking method models the morphology dynamics in the calcium image sequence designed for detecting neuronal activity. It follows the local-to-global design to handle calcium imaging issues and neuronal movement characteristics. Lastly, modeling the link between structural and functional development depicts the correlation between neuron growth and protein interactions. This requires the morphology analysis of different imaging modalities. It can be solved using the part-wise volume segmentation with artificial templates, the standardized representation of neurons. Our method follows the global-to-local approach to solve both part-wise segmentation and registration across modalities. Our methods address common issues in automated morphology analysis from extracting morphological features to tracking neurons, as well as mapping neurons across imaging modalities. The quantitative analysis delivered by our techniques enables a number of new applications and visualizations for advancing the investigation of phenomena in the nervous system

Multi-resolution Active Models for Image Segmentation

Image segmentation refers to the process of subdividing an image into a set of non-overlapping regions. Image segmentation is a critical and essential step to almost all higher level image processing and pattern recognition approaches, where a good segmentation relieves higher level applications from considering irrelevant and noise data in the image. Image segmentation is also considered as the most challenging image processing step due to several reasons including spatial discontinuity of the region of interest and the absence of a universally accepted criteria for image segmentation. Among the huge number of segmentation approaches, active contour models or simply snakes receive a great attention in the literature. Where the contour/boundary of the region of interest is defined as the set of pixels at which the active contour reaches its equilibrium state. In general, two forces control the movement of the snake inside the image, internal force that prevents the snake from stretching and bending and external force that pulls the snake towards the desired object boundaries. One main limitation of active contour models is their sensitivity to image noise. Specifically, noise sensitivity leads the active contour to fail to properly converge, getting caught on spurious image features, preventing the iterative solver from taking large steps towards the final contour. Additionally, active contour initialization forms another type of limitation. Where, especially in noisy images, the active contour needs to be initialized relatively close to the object of interest, otherwise the active contour will be pulled by other non-real/spurious image features. This dissertation, aiming to improve the active model-based segmentation, introduces two models for building up the external force of the active contour. The first model builds up a scale-based-weighted gradient map from all resolutions of the undecimated wavelet transform, with preference given to coarse gradients over fine gradients. The undecimated wavelet transform, due to its near shift-invariance and the absence of down-sampling properties, produces well-localized gradient maps at all resolutions of the transform. Hence, the proposed final weighted gradient map is able to better drive the snake towards its final equilibrium state. Unlike other multiscale active contour algorithms that define a snake at each level of the hierarchy, our model defines a single snake with the external force field is simultaneously built based on gradient maps from all scales. The second model proposes the incorporation of the directional information, revealed by the dual tree complex wavelet transform (DT CWT), into the external force field of the active contour. At each resolution of the transform, a steerable set of convolution kernels is created and used for external force generation. In the proposed model, the size and the orientation of the kernels depend on the scale of the DT CWT and the local orientation statistics of each pixel. Experimental results using nature, synthetic and Optical Coherent Tomography (OCT) images reflect the superiority of the proposed models over the classical and the state-of-the-art models

Combinatorial optimisation for arterial image segmentation.

Cardiovascular disease is one of the leading causes of the mortality in the western world. Many imaging modalities have been used to diagnose cardiovascular diseases. However, each has different forms of noise and artifacts that make the medical image analysis field important and challenging. This thesis is concerned with developing fully automatic segmentation methods for cross-sectional coronary arterial imaging in particular, intra-vascular ultrasound and optical coherence tomography, by incorporating prior and tracking information without any user intervention, to effectively overcome various image artifacts and occlusions. Combinatorial optimisation methods are proposed to solve the segmentation problem in polynomial time. A node-weighted directed graph is constructed so that the vessel border delineation is considered as computing a minimum closed set. A set of complementary edge and texture features is extracted. Single and double interface segmentation methods are introduced. Novel optimisation of the boundary energy function is proposed based on a supervised classification method. Shape prior model is incorporated into the segmentation framework based on global and local information through the energy function design and graph construction. A combination of cross-sectional segmentation and longitudinal tracking is proposed using the Kalman filter and the hidden Markov model. The border is parameterised using the radial basis functions. The Kalman filter is used to adapt the inter-frame constraints between every two consecutive frames to obtain coherent temporal segmentation. An HMM-based border tracking method is also proposed in which the emission probability is derived from both the classification-based cost function and the shape prior model. The optimal sequence of the hidden states is computed using the Viterbi algorithm. Both qualitative and quantitative results on thousands of images show superior performance of the proposed methods compared to a number of state-of-the-art segmentation methods

β-CATENIN REGULATION OF ADULT SKELETAL MUSCLE PLASTICITY

Adult skeletal muscle is highly plastic and responds readily to environmental stimuli. One of the most commonly utilized methods to study skeletal muscle adaptations is immunofluorescence microscopy. By analyzing images of adult muscle cells, also known as myofibers, one can quantify changes in skeletal muscle structure and function (e.g. hypertrophy and fiber type). Skeletal muscle samples are typically cut in transverse or cross sections, and antibodies against sarcolemmal or basal lamina proteins are used to label the myofiber boundaries. The quantification of hundreds to thousands of myofibers per sample is accomplished either manually or semi-automatically using generalized pathology software, and such approaches become exceedingly tedious. In the first study, I developed MyoVision, a robust, fully automated software that is dedicated to skeletal muscle immunohistological image analysis. The software has been made freely available to muscle biologists to alleviate the burden of routine image analyses. To date, more than 60 technicians, students, postdoctoral fellows, faculty members, and others have requested this software. Using MyoVision, I was able to accurately quantify the effects of β-catenin knockout on myofiber hypertrophy. In the second study, I tested the hypothesis that myofiber hypertrophy requires β-catenin to activate c-myc transcription and promote ribosome biogenesis. Recent evidence in both mice and human suggests a close association between ribosome biogenesis and skeletal muscle hypertrophy. Using an inducible mouse model of skeletal myofiber-specific genetic knockout, I obtained evidence that β-catenin is important for myofiber hypertrophy, although its role in ribosome biogenesis appears to be dispensable for mechanical overload induced muscle growth. Instead, β-catenin may be necessary for promoting the translation of growth related genes through activation of ribosomal protein S6. Unexpectedly, we detected a novel, enhancing effect of myofiber β-catenin knockout on the resident muscle stem cells, or satellite cells. In the absence of myofiber β-catenin, satellite cells activate and proliferate earlier in response to mechanical overload. Consistent with the role of satellite cells in muscle repair, the enhanced recruitment of satellite cells led to a significantly improved regeneration response after chemical injury. The novelty of these findings resides in the fact that the genetic perturbation was extrinsic to the satellite cells, and this is even more surprising because the current literature focuses heavily on intrinsic mechanisms within satellite cells. As such, this model of myofiber β-catenin knockout may significantly contribute to better understanding of the mechanisms of satellite cell priming, with implications for regenerative medicine

3D reconstruction of coronary arteries from angiographic sequences for interventional assistance

Introduction -- Review of literature -- Research hypothesis and objectives -- Methodology -- Results and discussion -- Conclusion and future perspectives

Segmentierung von Pathologien der Aorta mit deformierbaren Modellen

Die häufigste Todesursache in Deutschland sind Erkrankungen des Herz-Kreislaufsystems. Zwei häufig auftretende Krankheiten sind Aortenaneurysmen und Aortendissektionen. Für die Diagnose und die computerunterstützte OP-Planung wird eine semantische Annotation der präoperativ akquirierten Bilddaten benötigt. Dies wird herkömmlich durch eine manuelle Segmentierung der betroffenen Strukturen erreicht. Mit Verfahren aus der medizinischen Bildverarbeitung, darunter die deformierbaren Modelle, ist es möglich diese Segmentierung weitgehend zu automatisieren. In dieser Masterarbeit wird ein Verfahren vorgestellt, das mit Hilfe von deformierbaren Modellen eine automatische Segmentierung der Aorta und Aortenpathologien in 2D-CTA-Aufnahmen ermöglicht. Hierfür wurde ein geeignetes deformierbares Modell identifiziert, welches mit üblichen Störungen von CTA-Aufnahmen zurecht kommt. Das Verfahren ist eine Kombination aus den Dual Snakes und den GVF-Snakes und wird Dual-GVF-Snakes genannt. Das Besondere an diesem Verfahren ist, dass nicht nur das Lumen der Aorta und eines Aortenaneurysmas, sondern auch die zwei Lumen einer Aortendissektion gleichzeitig segmentiert werden können. Realisiert wird dies durch eine Unterteilung der Kontur in Segmente mit unterschiedlichen Eigenschaften. Das in dieser Arbeit vorgestellte Verfahren wurde zur Segmentierung von Objekten in synthetischen und klinischen Bilder angewendet, wobei die klinischen Bilder die Aorta, ein Aortenaneurysma und verschiedene Aortendissektionen beinhalten. Zur Evaluierung wurde das Verfahren mit den GVF-Snakes und den AB-Snakes verglichen, indem der Abstand zwischen Referenzkonturen und berechneter Konturen ermittelt wurde. Ein Vorteil gegenüber GVF-Snakes ist, dass zwei Objekte segmentiert und voneinander unterschieden werden können. Im Gegensatz zu den GVF-Snakes und den AB-Snakes müssen weniger Parameter eingestellt werden und die Membran zwischen den beiden Lumen der Aortendissektion wird erkannt. Das Verfahren ist robuster gegenüber der Initialisierung und lierfert vergleichbare Ergebnisse wie das GVF-Snakes Verfahren mit gezielter Initialisierung

Biological image analysis

In biological research images are extensively used to monitor growth, dynamics and changes in biological specimen, such as cells or plants. Many of these images are used solely for observation or are manually annotated by an expert. In this dissertation we discuss several methods to automate the annotating and analysis of bio-images. Two large clusters of methods have been investigated and developed. A first set of methods focuses on the automatic delineation of relevant objects in bio-images, such as individual cells in microscopic images. Since these methods should be useful for many different applications, e.g. to detect and delineate different objects (cells, plants, leafs, ...) in different types of images (different types of microscopes, regular colour photographs, ...), the methods should be easy to adjust. Therefore we developed a methodology relying on probability theory, where all required parameters can easily be estimated by a biologist, without requiring any knowledge on the techniques used in the actual software. A second cluster of investigated techniques focuses on the analysis of shapes. By defining new features that describe shapes, we are able to automatically classify shapes, retrieve similar shapes from a database and even analyse how an object deforms through time