Weighted kernel mapping model with spring simulation based watershed transformation for level set image segmentation

The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.This paper proposes a novel active contour model called weighted kernel mapping (WKM) model along with an extended watershed transformation (EWT) method for the level set image segmentation, which is a hybrid model based on the global and local intensity information. The proposed EWT method simulates a general spring on a hill with a fountain process and a rainfall process, which can be considered as an image pre-processing step for improving the image intensity homogeneity and providing the weighted information to the level set function. The WKM model involves two new energy functionals which are used to segment the image in the low dimensional observation space and the higher dimensional feature space respectively. The energy functional in the low dimensional space is used to demonstrate that the proposed WKM model is right in theory. The energy functional in the higher dimensional space obtains the region parameters through the weighted kernel function by utilising mean shift technique. Since the region parameters can better represent the values of the evolving regions due to the better image homogeneity, the proposed method can more accurately segment various types of images. Meanwhile, by adding the weighted information, the level set elements can be updated faster and the image segmentation can be achieved with fewer iterations. Experimental results on synthetic, medical and natural images show that the proposed method can increase the accuracy of image segmentation and reduce the iterations of level set evolution for image segmentation

Multi-Surface Simplex Spine Segmentation for Spine Surgery Simulation and Planning

This research proposes to develop a knowledge-based multi-surface simplex deformable model for segmentation of healthy as well as pathological lumbar spine data. It aims to provide a more accurate and robust segmentation scheme for identification of intervertebral disc pathologies to assist with spine surgery planning. A robust technique that combines multi-surface and shape statistics-aware variants of the deformable simplex model is presented. Statistical shape variation within the dataset has been captured by application of principal component analysis and incorporated during the segmentation process to refine results. In the case where shape statistics hinder detection of the pathological region, user-assistance is allowed to disable the prior shape influence during deformation. Results have been validated against user-assisted expert segmentation

New Methods to Improve Large-Scale Microscopy Image Analysis with Prior Knowledge and Uncertainty

Multidimensional imaging techniques provide powerful ways to examine various kinds of scientific questions. The routinely produced data sets in the terabyte-range, however, can hardly be analyzed manually and require an extensive use of automated image analysis. The present work introduces a new concept for the estimation and propagation of uncertainty involved in image analysis operators and new segmentation algorithms that are suitable for terabyte-scale analyses of 3D+t microscopy images

New Methods to Improve Large-Scale Microscopy Image Analysis with Prior Knowledge and Uncertainty

Multidimensional imaging techniques provide powerful ways to examine various kinds of scientific questions. The routinely produced datasets in the terabyte-range, however, can hardly be analyzed manually and require an extensive use of automated image analysis. The present thesis introduces a new concept for the estimation and propagation of uncertainty involved in image analysis operators and new segmentation algorithms that are suitable for terabyte-scale analyses of 3D+t microscopy images.Comment: 218 pages, 58 figures, PhD thesis, Department of Mechanical Engineering, Karlsruhe Institute of Technology, published online with KITopen (License: CC BY-SA 3.0, http://dx.doi.org/10.5445/IR/1000057821

Segmentation d'images IRM du cerveau pour la construction d'un modèle anatomique destiné à la simulation bio-mécanique

Comment obtenir des données anatomiques pendant une neurochirurgie ? a été ce qui a guidé le travail développé dans le cadre de cette thèse. Les IRM sont actuellement utilisées en amont de l'opération pour fournir cette information, que ce soit pour le diagnostique ou pour définir le plan de traitement. De même, ces images pre-opératoires peuvent aussi être utilisées pendant l'opération, pour pallier la difficulté et le coût des images per-opératoires. Pour les rendre utilisables en salle d'opération, un recalage doit être effectué avec la position du patient. Cependant, le cerveau subit des déformations pendant la chirurgie, phénomène appelé Brain Shift, ce qui altère la qualité du recalage. Pour corriger cela, d'autres données per-opératoires peuvent être acquises, comme la localisation de la surface corticale, ou encore des images US localisées en 3D. Ce nouveau recalage permet de compenser ce problème, mais en partie seulement. Ainsi, des modèles mécaniques ont été développés, entre autres pour apporter des solutions à l'amélioration de ce recalage. Ils permettent ainsi d'estimer les déformations du cerveau. De nombreuses méthodes existent pour implémenter ces modèles, selon différentes lois de comportement et différents paramètres physiologiques. Dans tous les cas, cela requiert un modèle anatomique patient-spécifique. Actuellement, ce modèle est obtenu par contourage manuel, ou quelquefois semi-manuel. Le but de ce travail de thèse est donc de proposer une méthode automatique pour obtenir un modèle du cerveau adapté sur l'anatomie du patient, et utilisable pour une simulation mécanique. La méthode implémentée se base sur les modèles déformables pour segmenter les structures anatomiques les plus pertinentes dans une modélisation bio-mécanique. En effet, les membranes internes du cerveau sont intégrées: falx cerebri and tentorium cerebelli. Et bien qu'il ait été démontré que ces structures jouent un rôle primordial, peu d'études les prennent en compte. Par ailleurs, la segmentation résultante de notre travail est validée par comparaison avec des données disponibles en ligne. De plus, nous construisons un modèle 3D, dont les déformations seront simulées en utilisant une méthode de résolution par Éléments Finis. Ainsi, nous vérifions par des expériences l'importance des membranes, ainsi que celle des paramètres physiologiques.The general problem that motivates the work developed in this thesis is: how to obtain anatomical information during a neurosurgery?. Magnetic Resonance (MR) images are usually acquired before the surgery to provide anatomical information for diagnosis and planning. Also, the same images are commonly used during the surgery, because to acquire MRI images in the operating room is complex and expensive. To make these images useful inside the operating room, a registration between them and the patient's position has to be processed. The problem is that the brain suffers deformations during the surgery, in a process called brain shift, degrading the quality of registration. To correct this, intra-operative information may be used, for example, the position of the brain surface or US images localized in 3D. The new registration will compensate this problem, but only to a certain extent. Mechanical models of the brain have been developed as a solution to improve this registration. They allow to estimate brain deformation under certain boundary conditions. In the literature, there are a variety of methods for implementing these models, different equation laws used for continuum mechanic, and different reported mechanical properties of the tissues. However, a patient specific anatomical model is always required. Currently, most mechanical models obtain the associated anatomical model by manual or semi-manual segmentation. The aim of this thesis is to propose and implement an automatic method to obtain a model of the brain fitted to the patient's anatomy and suitable for mechanical modeling. The implemented method uses deformable model techniques to segment the most relevant anatomical structures for mechanical modeling. Indeed, the internal membranes of the brain are included: falx cerebri and tentorium cerebelli. Even though the importance of these structures is stated in the literature, only a few of publications include them in the model. The segmentation obtained by our method is assessed using the most used online databases. In addition, a 3D model is constructed to validate the usability of the anatomical model in a Finite Element Method (FEM). And the importance of the internal membranes and the variation of the mechanical parameters is studied.SAVOIE-SCD - Bib.électronique (730659901) / SudocGRENOBLE1/INP-Bib.électronique (384210012) / SudocGRENOBLE2/3-Bib.électronique (384219901) / SudocSudocFranceF

Deep Learning Methods for Remote Sensing

Remote sensing is a field where important physical characteristics of an area are exacted using emitted radiation generally captured by satellite cameras, sensors onboard aerial vehicles, etc. Captured data help researchers develop solutions to sense and detect various characteristics such as forest fires, flooding, changes in urban areas, crop diseases, soil moisture, etc. The recent impressive progress in artificial intelligence (AI) and deep learning has sparked innovations in technologies, algorithms, and approaches and led to results that were unachievable until recently in multiple areas, among them remote sensing. This book consists of sixteen peer-reviewed papers covering new advances in the use of AI for remote sensing

Unsupervised multi-scale change detection from SAR imagery for monitoring natural and anthropogenic disasters

Thesis (Ph.D.) University of Alaska Fairbanks, 2017Radar remote sensing can play a critical role in operational monitoring of natural and anthropogenic disasters. Despite its all-weather capabilities, and its high performance in mapping, and monitoring of change, the application of radar remote sensing in operational monitoring activities has been limited. This has largely been due to: (1) the historically high costs associated with obtaining radar data; (2) slow data processing, and delivery procedures; and (3) the limited temporal sampling that was provided by spaceborne radar-based satellites. Recent advances in the capabilities of spaceborne Synthetic Aperture Radar (SAR) sensors have developed an environment that now allows for SAR to make significant contributions to disaster monitoring. New SAR processing strategies that can take full advantage of these new sensor capabilities are currently being developed. Hence, with this PhD dissertation, I aim to: (i) investigate unsupervised change detection techniques that can reliably extract signatures from time series of SAR images, and provide the necessary flexibility for application to a variety of natural, and anthropogenic hazard situations; (ii) investigate effective methods to reduce the effects of speckle and other noise on change detection performance; (iii) automate change detection algorithms using probabilistic Bayesian inferencing; and (iv) ensure that the developed technology is applicable to current, and future SAR sensors to maximize temporal sampling of a hazardous event. This is achieved by developing new algorithms that rely on image amplitude information only, the sole image parameter that is available for every single SAR acquisition. The motivation and implementation of the change detection concept are described in detail in Chapter 3. In the same chapter, I demonstrated the technique's performance using synthetic data as well as a real-data application to map wildfire progression. I applied Radiometric Terrain Correction (RTC) to the data to increase the sampling frequency, while the developed multiscaledriven approach reliably identified changes embedded in largely stationary background scenes. With this technique, I was able to identify the extent of burn scars with high accuracy. I further applied the application of the change detection technology to oil spill mapping. The analysis highlights that the approach described in Chapter 3 can be applied to this drastically different change detection problem with only little modification. While the core of the change detection technique remained unchanged, I made modifications to the pre-processing step to enable change detection from scenes of continuously varying background. I introduced the Lipschitz regularity (LR) transformation as a technique to normalize the typically dynamic ocean surface, facilitating high performance oil spill detection independent of environmental conditions during image acquisition. For instance, I showed that LR processing reduces the sensitivity of change detection performance to variations in surface winds, which is a known limitation in oil spill detection from SAR. Finally, I applied the change detection technique to aufeis flood mapping along the Sagavanirktok River. Due to the complex nature of aufeis flooded areas, I substituted the resolution-preserving speckle filter used in Chapter 3 with curvelet filters. In addition to validating the performance of the change detection results, I also provide evidence of the wealth of information that can be extracted about aufeis flooding events once a time series of change detection information was extracted from SAR imagery. A summary of the developed change detection techniques is conducted and suggested future work is presented in Chapter 6

Image Processing and Simulation Toolboxes of Microscopy Images of Bacterial Cells

Recent advances in microscopy imaging technology have allowed the characterization of the dynamics of cellular processes at the single-cell and single-molecule level. Particularly in bacterial cell studies, and using the E. coli as a case study, these techniques have been used to detect and track internal cell structures such as the Nucleoid and the Cell Wall and fluorescently tagged molecular aggregates such as FtsZ proteins, Min system proteins, inclusion bodies and all the different types of RNA molecules. These studies have been performed with using multi-modal, multi-process, time-lapse microscopy, producing both morphological and functional images. To facilitate the finding of relationships between cellular processes, from small-scale, such as gene expression, to large-scale, such as cell division, an image processing toolbox was implemented with several automatic and/or manual features such as, cell segmentation and tracking, intra-modal and intra-modal image registration, as well as the detection, counting and characterization of several cellular components. Two segmentation algorithms of cellular component were implemented, the first one based on the Gaussian Distribution and the second based on Thresholding and morphological structuring functions. These algorithms were used to perform the segmentation of Nucleoids and to identify the different stages of FtsZ Ring formation (allied with the use of machine learning algorithms), which allowed to understand how the temperature influences the physical properties of the Nucleoid and correlated those properties with the exclusion of protein aggregates from the center of the cell. Another study used the segmentation algorithms to study how the temperature affects the formation of the FtsZ Ring. The validation of the developed image processing methods and techniques has been based on benchmark databases manually produced and curated by experts. When dealing with thousands of cells and hundreds of images, these manually generated datasets can become the biggest cost in a research project. To expedite these studies in terms of time and lower the cost of the manual labour, an image simulation was implemented to generate realistic artificial images. The proposed image simulation toolbox can generate biologically inspired objects that mimic the spatial and temporal organization of bacterial cells and their processes, such as cell growth and division and cell motility, and cell morphology (shape, size and cluster organization). The image simulation toolbox was shown to be useful in the validation of three cell tracking algorithms: Simple Nearest-Neighbour, Nearest-Neighbour with Morphology and DBSCAN cluster identification algorithm. It was shown that the Simple Nearest-Neighbour still performed with great reliability when simulating objects with small velocities, while the other algorithms performed better for higher velocities and when there were larger clusters present