Convective cold pools: characterization and soil moisture dependence

2016 Fall.Includes bibliographical references.Convective cold pools play an important role in Earth's climate system. However, a common framework does not exist for conceptually defining and objectively identifying convective cold pools in observations and models. The first part of this thesis begins with a review of the identification methods used in previous works. This is followed by an investigation of convective cold pools within a high-resolution simulation of rainforest convection simulated using the Regional Atmospheric Modeling System (RAMS), an open-source cloud-resolving model with a coupled land-surface model. Multiple variables are assessed for their potential for identifying convective cold pool boundaries, and a novel technique is developed and tested for identifying and tracking convective cold pools in numerical model simulations. This algorithm is based on surface rainfall rates and radial gradients in the density potential temperature field. The algorithm successfully identifies near-surface cold pool boundaries and is able to distinguish between connected cold pools. Once cold pools have been identified and tracked, composites of cold pool evolution are then constructed, and average cold pool properties are investigated. One novel result is the presence of moist patches that develop within the centers of cold pools where the ground has been soaked with rainwater. These moist patches help to maintain cool temperatures and prevent cold pool dissipation, which has implications for the development of subsequent convection. The second part of this thesis explores how the properties of convective cold pools are modulated by soil moisture. Three high-resolution simulations of tropical rainforest convection are performed using the RAMS, and the initial soil moisture is varied between 25% and 75% saturation. The cold pool identification algorithm developed in the first part of the thesis is used to construct composites of cold pools within each simulation, and the composites are compared. When soil moisture is decreased, stronger convective cold pools result. These stronger cold pools are also smaller because increased sensible heat fluxes in the reduced soil-moisture simulations cause the cold pools to dissipate more quickly as they expand. Finally, the rings of enhanced water vapor that have been documented in previous studies of tropical cold pools disappear when soil moisture is reduced. These results emphasize the role that land surface properties can have in modulating convective cold pool properties

Computational Methods for Segmentation of Multi-Modal Multi-Dimensional Cardiac Images

Segmentation of the heart structures helps compute the cardiac contractile function quantified via the systolic and diastolic volumes, ejection fraction, and myocardial mass, representing a reliable diagnostic value. Similarly, quantification of the myocardial mechanics throughout the cardiac cycle, analysis of the activation patterns in the heart via electrocardiography (ECG) signals, serve as good cardiac diagnosis indicators. Furthermore, high quality anatomical models of the heart can be used in planning and guidance of minimally invasive interventions under the assistance of image guidance. The most crucial step for the above mentioned applications is to segment the ventricles and myocardium from the acquired cardiac image data. Although the manual delineation of the heart structures is deemed as the gold-standard approach, it requires significant time and effort, and is highly susceptible to inter- and intra-observer variability. These limitations suggest a need for fast, robust, and accurate semi- or fully-automatic segmentation algorithms. However, the complex motion and anatomy of the heart, indistinct borders due to blood flow, the presence of trabeculations, intensity inhomogeneity, and various other imaging artifacts, makes the segmentation task challenging. In this work, we present and evaluate segmentation algorithms for multi-modal, multi-dimensional cardiac image datasets. Firstly, we segment the left ventricle (LV) blood-pool from a tri-plane 2D+time trans-esophageal (TEE) ultrasound acquisition using local phase based filtering and graph-cut technique, propagate the segmentation throughout the cardiac cycle using non-rigid registration-based motion extraction, and reconstruct the 3D LV geometry. Secondly, we segment the LV blood-pool and myocardium from an open-source 4D cardiac cine Magnetic Resonance Imaging (MRI) dataset by incorporating average atlas based shape constraint into the graph-cut framework and iterative segmentation refinement. The developed fast and robust framework is further extended to perform right ventricle (RV) blood-pool segmentation from a different open-source 4D cardiac cine MRI dataset. Next, we employ convolutional neural network based multi-task learning framework to segment the myocardium and regress its area, simultaneously, and show that segmentation based computation of the myocardial area is significantly better than that regressed directly from the network, while also being more interpretable. Finally, we impose a weak shape constraint via multi-task learning framework in a fully convolutional network and show improved segmentation performance for LV, RV and myocardium across healthy and pathological cases, as well as, in the challenging apical and basal slices in two open-source 4D cardiac cine MRI datasets. We demonstrate the accuracy and robustness of the proposed segmentation methods by comparing the obtained results against the provided gold-standard manual segmentations, as well as with other competing segmentation methods

Image processing in medicine advances for phenotype characterization, computer-assisted diagnosis and surgical planning

En esta Tesis presentamos nuestras contribuciones al estado del arte en procesamiento digital de imágenes médicas, articulando nuestra exposición en torno a los tres principales objetivos de la adquisición de imágenes en medicina: la prevención, el diagnóstico y el tratamiento de las enfermedades. La prevención de la enfermedad se puede conseguir a veces mediante una caracterización cuidadosa de los fenotipos propios de la misma. Tal caracterización a menudo se alcanza a partir de imágenes. Presentamos nuestro trabajo en caracterización del enfisema pulmonar a partir de imágenes TAC (Tomografía Axial Computerizada) de tórax en alta resolución, a través del análisis de las texturas locales de la imagen. Nos proponemos llenar el vacío existente entre la práctica clínica actual, y las sofisticadas pero costosas técnicas de caracterización de regiones texturadas, disponibles en la literatura. Lo hacemos utilizando la distribución local de intensidades como un descriptor adecuado para determinar el grado de destrucción de tejido en pulmones enfisematosos. Se presentan interesantes resultados derivados del análisis de varios cientos de imágenes para niveles variables de severidad de la enfermedad, sugiriendo tanto la validez de nuestras hipótesis, como la pertinencia de este tipo de análisis para la comprensión de la enfermedad pulmonar obstructiva crónica. El procesado de imágenes médicas también puede asistir en el diagnóstico y detección de enfermedades. Presentamos nuestras contribuciones a este campo, que consisten en técnicas de segmentación y cuantificación de imágenes dermatoscópicas de lesiones de la piel. La segmentación se obtiene mediante un novedoso algoritmo basado en contornos activos que explota al máximo el contenido cromático de las imágenes, gracias a la maximización de la discrepancia mediante comparaciones cross-bin. La cuantificación de texturas en lesiones melanocíticas se lleva a cabo utilizando un modelado de los patrones de pigmentación basado en campos aleatorios de Markov, en un esfuerzo por adoptar la tendencia emergente en dermatología: la detección de la malignidad mediante el análisis de la irregularidad de la textura. Los resultados para ambas técnicas son validados con un conjunto significativo de imágenes dermatológicas, sugiriendo líneas interesantes para la detección automática del melanoma maligno. Cuando la enfermedad ya está presente, el tratamiento digital de imágenes puede asistir en la planificación quirúrgica y la intervención guiada por imagen. La planificación terapeútica, ejemplicada por la planificación de cirugía plástica usando realidad virtual, se aborda en nuestro trabajo en segmentación de hueso/grasa/músculo en imágenes TAC. Usando un abordaje interactivo e incremental, nuestro sistema permite obtener segmentaciones precisas a partir de unos cuantos clics de ratón para una gran variedad de condiciones de adquisición y frente a anatomícas anormales. Presentamos nuestra metodología, y nuestra validación experimental profusa basada tanto en segmentaciones manuales como en valoraciones subjetivas de los usuarios, e indicamos referencias al lector que detallan los beneficios obtenidos con el uso de la plataforma de planifificación que utiliza nuestro algoritmo. Como conclusión presentamos una disertación final sobre la importancia de nuestros resultados y las líneas probables de trabajo futuro hacía el objetivo último de mejorar el cuidado de la salud mediante técnicas de tratamiento digital de imágenes médicas.In this Thesis we present our contributions to the state-of-the-art in medical image processing, articulating our exposition around the three main roles of medical imaging: disease prevention, diagnosis and treatment. Disease prevention can sometimes be achieved by proper characterization of disease phenotypes. Such characterization is often attained from the standpoint of imaging. We present our work in characterization of emphysema from highresolution computed-tomography images via quanti_cation of local texture. We propose to _ll the gap between current clinical practice and sophisticated texture approaches by the use of local intensity distributions as an adequate descriptor for the degree of tissue destruction in the emphysematous lung. Interesting results are presented from the analysis of several hundred datasets of lung CT for varying disease severity, suggesting both the correctness of our hypotheses and the pertinence of _ne emphysema quanti_cation for understanding of chronic obstructive pulmonary disease. Medical image processing can also assist in the diagnosis and detection of disease. We introduce our contributions to this_eld, consisting of segmentation and quanti_cation techniques in application to dermatoscopy images of skin lesions. Segmentation is achieved via a novel active contour algorithm that fully exploits the color content of the images, via cross-bin histogram dissimilarity maximization. Texture quanti_cation in the context of melanocytic lesions is performed using modelization of the pigmentation patterns via Markov random elds, in an e_ort to embrace the emerging trend in dermatology: malignancy assessment based on texture irregularity analysis. Experimental results for both, the segmentation and quanti_cation proposed techniques, will be validated on a signi_cant set of dermatoscopy images, suggesting interesting pathways towards automatic detection and diagnosis of malignant melanoma. Once disease has occurred, image processing can assist in therapeutical planning and image-guided intervention. Therapeutical planning, exempli_ed by virtual reality surgical planning, is tackled by our work in segmentation of bone/fat/muscle in CT images for plastic surgery planning. Using an interactive, incremental approach, our system is able to provide accurate segmentations based on a couple of mouse-clicks for a wide variety of imaging conditions and abnormal anatomies. We present our methodology, and provide profuse experimental validation based on manual segmentations and subjective assessment, and refer the reader to related work reporting on the clinical bene_ts obtained using the virtual reality platform hosting our algorithm. As a conclusion we present a _nal dissertation on the signi_cance of our results and the probable lines of future work towards fully bene_tting healthcare using medical image processing

An empirical evaluation of nuclei segmentation from H&E images in a real application scenario

Cell nuclei segmentation is a challenging task, especially in real applications, when the target images significantly differ between them. This task is also challenging for methods based on convolutional neural networks (CNNs), which have recently boosted the performance of cell nuclei segmentation systems. However, when training data are scarce or not representative of deployment scenarios, they may suffer from overfitting to a different extent, and may hardly generalise to images that differ from the ones used for training. In this work, we focus on real-world, challenging application scenarios when no annotated images from a given dataset are available, or when few images (even unlabelled) of the same domain are available to perform domain adaptation. To simulate this scenario, we performed extensive cross-dataset experiments on several CNN-based state-of-the-art cell nuclei segmentation methods. Our results show that some of the existing CNN-based approaches are capable of generalising to target images which resemble the ones used for training. In contrast, their effectiveness considerably degrades when target and source significantly differ in colours and scale

Méthodes multi-organes rapides avec a priori de forme pour la localisation et la segmentation en imagerie médicale 3D

With the ubiquity of imaging in medical applications (diagnostic, treatment follow-up, surgery planning. . . ), image processing algorithms have become of primary importance. Algorithms help clinicians extract critical information more quickly and more reliably from increasingly large and complex acquisitions. In this context, anatomy localization and segmentation is a crucial component in modern clinical workflows. Due to particularly high requirements in terms of robustness, accuracy and speed, designing such tools remains a challengingtask.In this work, we propose a complete pipeline for the segmentation of multiple organs in medical images. The method is generic, it can be applied to varying numbers of organs, on different imaging modalities. Our approach consists of three components: (i) an automatic localization algorithm, (ii) an automatic segmentation algorithm, (iii) a framework for interactive corrections. We present these components as a coherent processing chain, although each block could easily be used independently of the others. To fulfill clinical requirements, we focus on robust and efficient solutions. Our anatomy localization method is based on a cascade of Random Regression Forests (Cuingnet et al., 2012). One key originality of our work is the use of shape priors for each organ (thanks to probabilistic atlases). Combined with the evaluation of the trained regression forests, they result in shape-consistent confidence maps for each organ instead of simple bounding boxes. Our segmentation method extends the implicit template deformation framework of Mory et al. (2012) to multiple organs. The proposed formulation builds on the versatility of the original approach and introduces new non-overlapping constraintsand contrast-invariant forces. This makes our approach a fully automatic, robust and efficient method for the coherent segmentation of multiple structures. In the case of imperfect segmentation results, it is crucial to enable clinicians to correct them easily. We show that our automatic segmentation framework can be extended with simple user-driven constraints to allow for intuitive interactive corrections. We believe that this final component is key towards the applicability of our pipeline in actual clinical routine.Each of our algorithmic components has been evaluated on large clinical databases. We illustrate their use on CT, MRI and US data and present a user study gathering the feedback of medical imaging experts. The results demonstrate the interest in our method and its potential for clinical use.Avec l’utilisation de plus en plus répandue de l’imagerie dans la pratique médicale (diagnostic, suivi, planification d’intervention, etc.), le développement d’algorithmes d’analyse d’images est devenu primordial. Ces algorithmes permettent aux cliniciens d’analyser et d’interpréter plus facilement et plus rapidement des données de plus en plus complexes. Dans ce contexte, la localisation et la segmentation de structures anatomiques sont devenues des composants critiques dans les processus cliniques modernes. La conception de tels outils pour répondre aux exigences de robustesse, précision et rapidité demeure cependant un réel défi technique.Ce travail propose une méthode complète pour la segmentation de plusieurs organes dans des images médicales. Cette méthode, générique et pouvant être appliquée à un nombre varié de structures et dans différentes modalités d’imagerie, est constituée de trois composants : (i) un algorithme de localisation automatique, (ii) un algorithme de segmentation, (iii) un outil de correction interactive. Ces différentes parties peuvent s’enchaîner aisément pour former un outil complet et cohérent, mais peuvent aussi bien être utilisées indépendemment. L’accent a été mis sur des méthodes robustes et efficaces afin de répondre aux exigences cliniques. Notre méthode de localisation s’appuie sur une cascade de régression par forêts aléatoires (Cuingnet et al., 2012). Elle introduit l’utilisation d’informations a priori de forme, spécifiques à chaque organe (grâce à des atlas probabilistes) pour des résultats plus cohérents avec la réalité anatomique. Notre méthode de segmentation étend la méthode de segmentation par modèle implicite (Mory et al., 2012) à plusieurs modèles. La formulation proposée permet d’obtenir des déformations cohérentes, notamment en introduisant des contraintes de non recouvrement entre les modèles déformés. En s’appuyant sur des forces images polyvalentes, l’approche proposée se montre robuste et performante pour la segmentation de multiples structures. Toute méthode automatique n’est cependant jamais parfaite. Afin que le clinicien garde la main sur le résultat final, nous proposons d’enrichir la formulation précédente avec des contraintes fournies par l’utilisateur. Une optimisation localisée permet d’obtenir un outil facile à utiliser et au comportement intuitif. Ce dernier composant est crucial pour que notre outil soit réellement utilisable en pratique. Chacun de ces trois composants a été évalué sur plusieurs grandes bases de données cliniques (en tomodensitométrie, imagerie par résonance magnétique et ultrasons). Une étude avec des utilisateurs nous a aussi permis de recueillir des retours positifs de plusieurs experts en imagerie médicale. Les différents résultats présentés dans ce manuscrit montrent l’intérêt de notre méthode et son potentiel pour une utilisation clinique

Geodesic Active Fields:A Geometric Framework for Image Registration

Image registration is the concept of mapping homologous points in a pair of images. In other words, one is looking for an underlying deformation field that matches one image to a target image. The spectrum of applications of image registration is extremely large: It ranges from bio-medical imaging and computer vision, to remote sensing or geographic information systems, and even involves consumer electronics. Mathematically, image registration is an inverse problem that is ill-posed, which means that the exact solution might not exist or not be unique. In order to render the problem tractable, it is usual to write the problem as an energy minimization, and to introduce additional regularity constraints on the unknown data. In the case of image registration, one often minimizes an image mismatch energy, and adds an additive penalty on the deformation field regularity as smoothness prior. Here, we focus on the registration of the human cerebral cortex. Precise cortical registration is required, for example, in statistical group studies in functional MR imaging, or in the analysis of brain connectivity. In particular, we work with spherical inflations of the extracted hemispherical surface and associated features, such as cortical mean curvature. Spatial mapping between cortical surfaces can then be achieved by registering the respective spherical feature maps. Despite the simplified spherical geometry, inter-subject registration remains a challenging task, mainly due to the complexity and inter-subject variability of the involved brain structures. In this thesis, we therefore present a registration scheme, which takes the peculiarities of the spherical feature maps into particular consideration. First, we realize that we need an appropriate hierarchical representation, so as to coarsely align based on the important structures with greater inter-subject stability, before taking smaller and more variable details into account. Based on arguments from brain morphogenesis, we propose an anisotropic scale-space of mean-curvature maps, built around the Beltrami framework. Second, inspired by concepts from vision-related elements of psycho-physical Gestalt theory, we hypothesize that anisotropic Beltrami regularization better suits the requirements of image registration regularization, compared to traditional Gaussian filtering. Different objects in an image should be allowed to move separately, and regularization should be limited to within the individual Gestalts. We render the regularization feature-preserving by limiting diffusion across edges in the deformation field, which is in clear contrast to the indifferent linear smoothing. We do so by embedding the deformation field as a manifold in higher-dimensional space, and minimize the associated Beltrami energy which represents the hyperarea of this embedded manifold as measure of deformation field regularity. Further, instead of simply adding this regularity penalty to the image mismatch in lieu of the standard penalty, we propose to incorporate the local image mismatch as weighting function into the Beltrami energy. The image registration problem is thus reformulated as a weighted minimal surface problem. This approach has several appealing aspects, including (1) invariance to re-parametrization and ability to work with images defined on non-flat, Riemannian domains (e.g., curved surfaces, scalespaces), and (2) intrinsic modulation of the local regularization strength as a function of the local image mismatch and/or noise level. On a side note, we show that the proposed scheme can easily keep up with recent trends in image registration towards using diffeomorphic and inverse consistent deformation models. The proposed registration scheme, called Geodesic Active Fields (GAF), is non-linear and non-convex. Therefore we propose an efficient optimization scheme, based on splitting. Data-mismatch and deformation field regularity are optimized over two different deformation fields, which are constrained to be equal. The constraint is addressed using an augmented Lagrangian scheme, and the resulting optimization problem is solved efficiently using alternate minimization of simpler sub-problems. In particular, we show that the proposed method can easily compete with state-of-the-art registration methods, such as Demons. Finally, we provide an implementation of the fast GAF method on the sphere, so as to register the triangulated cortical feature maps. We build an automatic parcellation algorithm for the human cerebral cortex, which combines the delineations available on a set of atlas brains in a Bayesian approach, so as to automatically delineate the corresponding regions on a subject brain given its feature map. In a leave-one-out cross-validation study on 39 brain surfaces with 35 manually delineated gyral regions, we show that the pairwise subject-atlas registration with the proposed spherical registration scheme significantly improves the individual alignment of cortical labels between subject and atlas brains, and, consequently, that the estimated automatic parcellations after label fusion are of better quality

A Methodology for Extracting Human Bodies from Still Images

Monitoring and surveillance of humans is one of the most prominent applications of today and it is expected to be part of many future aspects of our life, for safety reasons, assisted living and many others. Many efforts have been made towards automatic and robust solutions, but the general problem is very challenging and remains still open. In this PhD dissertation we examine the problem from many perspectives. First, we study the performance of a hardware architecture designed for large-scale surveillance systems. Then, we focus on the general problem of human activity recognition, present an extensive survey of methodologies that deal with this subject and propose a maturity metric to evaluate them. One of the numerous and most popular algorithms for image processing found in the field is image segmentation and we propose a blind metric to evaluate their results regarding the activity at local regions. Finally, we propose a fully automatic system for segmenting and extracting human bodies from challenging single images, which is the main contribution of the dissertation. Our methodology is a novel bottom-up approach relying mostly on anthropometric constraints and is facilitated by our research in the fields of face, skin and hands detection. Experimental results and comparison with state-of-the-art methodologies demonstrate the success of our approach

Synergizing human-machine intelligence: Visualizing, labeling, and mining the electronic health record

We live in a world where data surround us in every aspect of our lives. The key challenge for humans and machines is how we can make better use of such data. Imagine what would happen if you were to have intelligent machines that could give you insight into the data. Insight that will enable you to better 1) reason about, 2) learn, and 3) understand the underlying phenomena that produced the data. The possibilities of combined human-machine intelligence are endless and will impact our lives in ways we can not even imagine today. Synergistic human-machine intelligence aims to facilitate the analytical reasoning and inference process of humans by creating machines that maximize a human's ability to 1) reason about, 2) learn, and 3) understand large, complex, and heterogeneous data. Combined human-machine intelligence is a powerful symbiosis of mutual benefit, in which we depend on the computational capabilities of the machine for the tasks we are not good at, and the machine requires human intervention for the tasks it performs poorly on. This relationship provides a compelling alternative to either approach in isolation for solving today's and tomorrow's arising data challenges. In his regard, this dissertation proposes a diverse analytical framework that leverages synergistic human-machine intelligence to maximize a human's ability to better 1) reason about, 2) learn, and 3) understand different biomedical imaging and healthcare data present in the patient's electronic health record (EHR). Correspondingly, we approach the data analyses problem from the 1) visualization, 2) labeling, and 3) mining perspective and demonstrate the efficacy of our analytics on specific application scenarios and various data domains. In the first part of this dissertation we explore the question how we can build intelligent imaging analytics that are commensurate with human capabilities and constraints, specifically for optimizing data visualization and automated labeling workflows. Our journey starts with heuristic rule-based analytical models that are derived from task-specific human knowledge. From this experience, we move on to data-driven analytics, where we adapt and combine the intelligence of the model based on prior information provided by the human and synthetic knowledge learned from partial data observations. Within this realm, we propose a novel Bayesian transductive Markov random field model that requires minimal human intervention and is able to cope with scarce label information to learn and infer object shapes in complex spatial, multimodal, spatio-temporal, and longitudinal data. We then study the question how machines can learn discriminative object representations from dense human provided label information by investigating learning and inference mechanisms that make use of deep learning architectures. The developed analytics can aid visualization and labeling tasks, which enables the interpretation and quantification of clinically relevant image information. The second part explores the question how we can build data-driven analytics for exploratory analysis in longitudinal event data that are commensurate with human capabilities and constraints. We propose human-intuitive analytics that enable the representation and discovery of interpretable event patterns to ease knowledge absorption and comprehension of the employed analytics model and the underlying data. We propose a novel doubly-constrained convolutional sparse-coding framework that learns interpretable and shift-invariant latent temporal event patterns. We apply the model to mine complex event data in EHRs. By mapping the event space to heterogeneous patient encounters in the EHR we explore the linkage between healthcare resource utilization (HRU) in relation to disease severity. This linkage may help to better understand how disease specific co-morbidities and their clinical attributes incur different HRU patterns. Such insight helps to characterize the patient's care history, which then enables the comparison against clinical practice guidelines, the discovery of prevailing practices based on common HRU group patterns, and the identification of outliers that might indicate poor patient management

Remote Sensing of the Oceans

This book covers different topics in the framework of remote sensing of the oceans. Latest research advancements and brand-new studies are presented that address the exploitation of remote sensing instruments and simulation tools to improve the understanding of ocean processes and enable cutting-edge applications with the aim of preserving the ocean environment and supporting the blue economy. Hence, this book provides a reference framework for state-of-the-art remote sensing methods that deal with the generation of added-value products and the geophysical information retrieval in related fields, including: Oil spill detection and discrimination; Analysis of tropical cyclones and sea echoes; Shoreline and aquaculture area extraction; Monitoring coastal marine litter and moving vessels; Processing of SAR, HF radar and UAV measurements