Two and three dimensional segmentation of multimodal imagery

The role of segmentation in the realms of image understanding/analysis, computer vision, pattern recognition, remote sensing and medical imaging in recent years has been significantly augmented due to accelerated scientific advances made in the acquisition of image data. This low-level analysis protocol is critical to numerous applications, with the primary goal of expediting and improving the effectiveness of subsequent high-level operations by providing a condensed and pertinent representation of image information. In this research, we propose a novel unsupervised segmentation framework for facilitating meaningful segregation of 2-D/3-D image data across multiple modalities (color, remote-sensing and biomedical imaging) into non-overlapping partitions using several spatial-spectral attributes. Initially, our framework exploits the information obtained from detecting edges inherent in the data. To this effect, by using a vector gradient detection technique, pixels without edges are grouped and individually labeled to partition some initial portion of the input image content. Pixels that contain higher gradient densities are included by the dynamic generation of segments as the algorithm progresses to generate an initial region map. Subsequently, texture modeling is performed and the obtained gradient, texture and intensity information along with the aforementioned initial partition map are used to perform a multivariate refinement procedure, to fuse groups with similar characteristics yielding the final output segmentation. Experimental results obtained in comparison to published/state-of the-art segmentation techniques for color as well as multi/hyperspectral imagery, demonstrate the advantages of the proposed method. Furthermore, for the purpose of achieving improved computational efficiency we propose an extension of the aforestated methodology in a multi-resolution framework, demonstrated on color images. Finally, this research also encompasses a 3-D extension of the aforementioned algorithm demonstrated on medical (Magnetic Resonance Imaging / Computed Tomography) volumes

Aplicação de uma métrica de similaridade não linear em algoritmos de segmentação

Dissertação (mestrado) - Universidade Federal de Santa Catarina, Centro Tecnológico, Programa de Pós-Graduação em Ciência da Computação, 2015.Um dos principais processos utilizados no campo de processamento digital de imagens é a segmentação, processo no qual a imagem é separada em seus elementos ou partes constituintes. Na literatura, existem diferentes e bem conhecidos métodos usados para segmentação, tais como clusterização, limiarização, segmentação com redes neurais e segmentação por crescimento de regiões . No intuito de melhorar de melhorar o desempenho dos algoritmos de segmentação, um estudo sobre o efeito da aplicação de uma métrica não linear em algoritmos de segmentação foi realizado neste trabalho. Foram selecionados três algoritmos de segmentação (Mumford-Shah, Color Structure Code e Felzenszwalb and Huttenlocher) provenientes do método de crescimento de regiões e nestes se alterou a parte de análise de similaridade utilizando para tal uma métrica não linear. A métrica não linear utilizada, denominada Polinomial Mahalanobis, é uma variação da distância de Mahalanobis utilizada para medir a distância estatística entre distribuições. Uma avaliação qualitativa e uma análise empírica foram realizadas neste trabalho para comparar os resultados obtidos em termos de eficácia. Os resultados desta comparação, apresentados neste estudo, apontam uma melhoria nos resultados de segmentação obtidos pela abordagem proposta. Em termos de eficiência, foram analisados os tempos de execução dos algoritmos com e sem o aprimoramento e os resultados desta análise mostraram um aumento do tempo de execução dos algoritmos com abordagem proposta.Abstract : One of the main procedures used on digital image processing is segmentation,where the image is split into its constituent parts or objects. In the literature,there are different well-known methods used for segmentation, suchas clustering, thresholding, segmentation using neural network and segmentationusing region growing. Aiming to improve the performance of the segmentationalgorithms, a study off the effect of the application of a non-linearmetric on segmentation algorithms was performed in this work. Three segmentationalgorithms were chosen (Mumford-Shah, Color Structure Code,Felzenszwalb and Huttenlocher) originating from region growing techniques,and on those the similarity metric was enhanced with a non-linear metric.The non-linear metric used, known as Polynomial Mahalanobis, is a variationfrom the statistical Mahalanobis distance used for measure the distancebetween distributions. A qualitative evaluation and empirical analysis wasperformed in this work to compare the obtained results in terms of efficacy.The results from these comparison, presented in this study, indicate an improvementon the segmentation result obtained by the proposed approach. Interms of efficiency, the execution time of the algorithms with and without theproposed improvement were analyzed and the result of this analysis showedan increase of the execution time for the algorithms with the proposed approach

Analyse d'image visibles et proche infrarouges : contributions à l'évaluation non-destructive du persillage dans la viande du boeuf

Le persillage (gras intramusculaire) dans la viande de boeuf est l'un des critères les plus importants pour l'évaluation de la qualité, notamment sa jutosité, dans les systèmes de classification de la viande. Le processus chimique, méthode destructive, est l'unique moyen officiellement utilisé pour évaluer la proportion du persillage dans la viande. C'est une méthode destructive, complexe et qui n'offre aucune information sur la distribution du persillage dans la viande. Cette thèse porte sur le développement d'une méthode originale destinée à l'évaluation non-destructive de la proportion volumétrique du persillage dans la viande du boeuf. Cette nouvelle méthode, qui pourrait être intégrée dans un système de vision artificielle (machine vision), est une première expérience pour ce genre d'application. À notre meilleure connaissance, aucune méthode semblable n'a été élaborée. De ces travaux de doctorat quatre contributions sont identifiées: la technique proposée, deux méthodes de segmentation d'images et une méthode non-destructive pour estimer la proportion volumétrique du persillage. La technique proposée permet d'avoir deux types d'images : une visible qui illustre la surface de la viande et une proche infrarouge qui est la projection orthogonale de l'échantillon de la viande (3D) en une image d'ombre (2D). Compte tenu de la complexité d'analyse des images, nous avons développé une méthode efficace de segmentation permettant d'identifier les régions homogènes les plus (ou les moins) claires dans une image à niveaux de gris. Cette méthode, qui est relativement générale, est basée sur un modèle mathématique permettant d'évaluer l'homogénéité des régions, qui lui-même a été introduit dans cette thèse. La généralisation de cette méthode pour la segmentation du persillage a démontré des résultats satisfaisants face aux objectifs attendus. Étant donné, que la forme volumétrique du persillage est aléatoire et que celle-ci dépend de la façon dont le persillage est déposé entre les fibres musculaires, ce qui est imprévisible, nous avons combiné les résultats de la segmentation de deux types d'images pour estimer le volume du persillage. L'intégration de l'ensemble des approches précédentes nous a permis de développer une nouvelle méthode non-destructive pour estimer la proportion volumétrique du persillage. Les résultats obtenus par la méthode proposée (non-destructive) ont été comparés aux résultats obtenus par une méthode chimique (destructive) comme étant la vérité-terrain (gold standard). Les résultats expérimentaux confirment les propriétés attendues de la méthode proposée et ils illustrent la qualité des résultats obtenus