Vision Goes Symbolic Without Loss of Information Within the Preattentive Vision Phase: The Need to Shift the Learning Paradigm from Machine-Learning (from Examples) to Machine-Teaching (by Rules) at the First Stage of a Two-Stage Hybrid Remote... Part I

Life sciences: general issue

Two and three dimensional segmentation of multimodal imagery

The role of segmentation in the realms of image understanding/analysis, computer vision, pattern recognition, remote sensing and medical imaging in recent years has been significantly augmented due to accelerated scientific advances made in the acquisition of image data. This low-level analysis protocol is critical to numerous applications, with the primary goal of expediting and improving the effectiveness of subsequent high-level operations by providing a condensed and pertinent representation of image information. In this research, we propose a novel unsupervised segmentation framework for facilitating meaningful segregation of 2-D/3-D image data across multiple modalities (color, remote-sensing and biomedical imaging) into non-overlapping partitions using several spatial-spectral attributes. Initially, our framework exploits the information obtained from detecting edges inherent in the data. To this effect, by using a vector gradient detection technique, pixels without edges are grouped and individually labeled to partition some initial portion of the input image content. Pixels that contain higher gradient densities are included by the dynamic generation of segments as the algorithm progresses to generate an initial region map. Subsequently, texture modeling is performed and the obtained gradient, texture and intensity information along with the aforementioned initial partition map are used to perform a multivariate refinement procedure, to fuse groups with similar characteristics yielding the final output segmentation. Experimental results obtained in comparison to published/state-of the-art segmentation techniques for color as well as multi/hyperspectral imagery, demonstrate the advantages of the proposed method. Furthermore, for the purpose of achieving improved computational efficiency we propose an extension of the aforestated methodology in a multi-resolution framework, demonstrated on color images. Finally, this research also encompasses a 3-D extension of the aforementioned algorithm demonstrated on medical (Magnetic Resonance Imaging / Computed Tomography) volumes

Wetland Habitat Studies using various Classification Techniques on Multi-Spectral Landsat Imagery: Case study: Tram chim National Park, Dong Thap Vietnam

Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial TechnologiesWetland is one of the most valuable ecological systems in nature. Wetland habitat is a set of comprehensive information of wetland distribution, wetland habitat types are essential to wetland management programs. Maps of wetland should provide sufficient detail, retain an appropriate scale and be useful for further mapping and inventory work (Queensland wetland framework). Remotely sensed image classification techniques are useful to detect vegetation patterns and species combination in the inaccessible regions. Automated classification procedures are conducted to save the time of the research. The purpose of the research was to develop a hierarchical classification approach that effectively integrate ancillary information into the classification process and combines ISODATA (iterative self-organizing data analysis techniques algorithm) clustering, Maximum likelihood and rule-based classifier. The main goal was to find out the best possible combination or sequence of classifiers for typically classifying wetland habitat types yields higher accuracy than the existing classified wetland map from Landsat ETM data. Three classification schemes were introduced to delineate the wetland habitat types in the idea of comparison among the methods. The results showed the low accuracy of different classification schemes revealing the fact that image classification is still on the way toward a fine proper procedure to get high accuracy result with limited effort to make the investigation on sites. Even though the motivation of the research was to apply an appropriate procedure with acceptable accuracy of classified map image, the results did not achieve a higher accuracy on knowledge-based classification method as it was expected. The possible reasons are the limitation of the image resolution, the ground truth data requirements, and the difficulties of building the rules based on the spectral characteristics of the objects which contain high mix of spectral similarities

Unsupervised methods of classifying remotely sensed imges using Kohonen self-organizing maps

Orientadores: Marcio Luiz de Andrade Netto, Jose Alfredo Ferreira CostaAcompanha Anexo A: Midia com informações adicionais em CD-RTese (doutorado) - Universidade Estadual de Campinas, Faculdade de Engenharia Eletrica e de ComputaçãoResumo: Esta tese propõe novas metodologias de classificação não-supervisionada de imagens de sensoriamento remoto que particularmente exploram as características e propriedades do Mapa Auto-organizável de Kohonen (SOM - Self-Organizing Map). O ponto chave dos métodos de classificação propostos é realizar a análise de agrupamentos das imagens através do mapeamento produzido pelo SOM, ao invés de trabalhar diretamente com os padrões originais das cenas. Tal estratégia reduz significativamente a complexidade da análise dos dados, tornando possível a utilização de técnicas normalmente consideradas computacionalmente inviáveis para o processamento de imagens de sensoriamento remoto, como métodos de agrupamentos hierárquicos e índices de validação de agrupamentos. Diferentemente de outras abordagens, nas quais o SOM é utilizado como ferramenta de auxílio visual para a detecção de agrupamentos, nos métodos de classificação propostos, mecanismos para analisar de maneira automática o arranjo de neurônios de um SOM treinado são aplicados e aprimorados com o objetivo de encontrar as melhores partições para os conjuntos de dados das imagens. Baseando-se nas propriedades estatísticas do SOM, modificações nos cálculos de índices de validação agrupamentos são propostas com o objetivo de reduzir o custo computacional do processo de classificação das imagens. Técnicas de análise de textura em imagens são aplicadas para avaliar e filtrar amostras de treinamento e/ou protótipos do SOM que correspondem a regiões de transição entre classes de cobertura terrestre. Informações espaciais a respeito dos protótipos do SOM, além das informações de distância multiespectral, também são aplicadas em critérios de fusão de agrupamentos procurando facilitar a discriminação de classes de cobertura terrestre que apresentam alto grau de similaridade espectral. Resultados experimentais mostram que os métodos de classificação propostos apresentam vantagens significativas em relação às técnicas de classificação não-supervisionada mais freqüentemente utilizadas na área de sensoriamento remoto.Abstract: This thesis proposes new methods of unsupervised classification for remotely sensed images which particularly exploit the characteristics and properties of the Kohonen Self-Organizing Map (SOM). The key point is to execute the clustering process through a set of prototypes of SOM instead of analyzing directly the original patterns of the image. This strategy significantly reduces the complexity of data analysis, making it possible to use techniques that have not usually been considered computationally viable for processing remotely sensed images, such as hierarchical clustering methods and cluster validation indices. Unlike other approaches in which SOM is used as a visual tool for detection of clusters, the proposed classification methods automatically analyze the neurons grid of a trained SOM in order to find better partitions for data sets of images. Based on the statistical properties of the SOM, clustering validation indices calculated in a modified manner are proposed with the aim of reducing the computational cost of the classification process of images. Image texture analysis techniques are applied to evaluate and filter training samples and/or prototypes of the SOM that correspond to transition regions between land cover classes. Spatial information about the prototypes of the SOM, in addition to multiespectral distance information, are also incorporated in criteria for merging clusters with aim to facilitate the discrimination of land cover classes which have high spectral similarity. Experimental results show that the proposed classification methods present significant advantages when compared to unsupervised classification techniques frequently used in remote sensing.DoutoradoEngenharia de ComputaçãoDoutor em Engenharia Elétric

Segmentação de mapas auto-organizáveis com espaço de saída 3-D

The self-organizing map (SOM) has been widely used as a software tool for visualization of high-dimensional data. Important SOM features include information compression while trying to preserve topological and metric relationship of the primary data items. Similar data in the input space would be mapped to the same neuron or in a nearby unit. The clustering properties of a trained SOM 2-D can be visualized by the U-matrix, which is a neuron's neighborhood distance based image. This assumption of topological preservation is not true for many SOM mappings involving dimension reduction. With the automation of cluster detection in SOM network higher output dimensions can be used in problems involving discovery of classes in multidimensional data. Results of topological errors are shown in a simple 2-D clustering in a 1-D output grid SOM. This paper presents the U-array as an extension of the U-matrix for 3-D output grids. The advantage of the method relies in working with higher dimensions in the output space, which can lead to a better topological preservation in data analysis. Examples of automatic class discovery using U-arrays are also presented.O mapa de Kohonen (SOM) tem sido utilizado como ferramenta para visualização de dados de elevada dimensionalidade. Características importantes da rede SOM incluem a compressão de informação e a tentativa de manutenção da topologia dos dados. Dados similares no espaço de entrada deveriam ser mapeados no mesmo neurônio, ou em neurônios vizinhos. Uma das ferramentas de visualização de um mapa 2-D treinado é U-matrix, que apresenta as relações de distância de pesos entre neurônios vizinhos do espaço de saída. A suposição de preservação topológica não é verdade em muitos problemas envolvendo redução de dimensionalidade. Com a automação da detecção de agrupamentos na rede SOM espaços de saída maiores podem ser utilizados em problemas envolvendo a descoberta de classes em dados multidimensionais. Mostra-se a ocorrência de erros topológicos em um exemplo simples de agrupamentos de dados 2-D em um mapa com saída 1-D. Este artigo apresenta uma extensão da U-matrix, o U-array, para espaços de saída maior que 2-D e sua aplicação em conjunto com o algoritmo SL-SOM, que possibilita a detecção do número e o geometria das classes em mapas treinados. Todo o processo é não-supervisionado. A vantagem de trabalhar com dimensões mais elevadas no espaço de saída é a melhor preservação da topologia em problemas de análise automática de dados. Apresenta-se um exemplo de uso de descoberta de classes de dados não linearmente separáveis.15016

An Evolutionary Approach to Adaptive Image Analysis for Retrieving and Long-term Monitoring Historical Land Use from Spatiotemporally Heterogeneous Map Sources

Land use changes have become a major contributor to the anthropogenic global change. The ongoing dispersion and concentration of the human species, being at their orders unprecedented, have indisputably altered Earth’s surface and atmosphere. The effects are so salient and irreversible that a new geological epoch, following the interglacial Holocene, has been announced: the Anthropocene. While its onset is by some scholars dated back to the Neolithic revolution, it is commonly referred to the late 18th century. The rapid development since the industrial revolution and its implications gave rise to an increasing awareness of the extensive anthropogenic land change and led to an urgent need for sustainable strategies for land use and land management. By preserving of landscape and settlement patterns at discrete points in time, archival geospatial data sources such as remote sensing imagery and historical geotopographic maps, in particular, could give evidence of the dynamic land use change during this crucial period. In this context, this thesis set out to explore the potentials of retrospective geoinformation for monitoring, communicating, modeling and eventually understanding the complex and gradually evolving processes of land cover and land use change. Currently, large amounts of geospatial data sources such as archival maps are being worldwide made online accessible by libraries and national mapping agencies. Despite their abundance and relevance, the usage of historical land use and land cover information in research is still often hindered by the laborious visual interpretation, limiting the temporal and spatial coverage of studies. Thus, the core of the thesis is dedicated to the computational acquisition of geoinformation from archival map sources by means of digital image analysis. Based on a comprehensive review of literature as well as the data and proposed algorithms, two major challenges for long-term retrospective information acquisition and change detection were identified: first, the diversity of geographical entity representations over space and time, and second, the uncertainty inherent to both the data source itself and its utilization for land change detection. To address the former challenge, image segmentation is considered a global non-linear optimization problem. The segmentation methods and parameters are adjusted using a metaheuristic, evolutionary approach. For preserving adaptability in high level image analysis, a hybrid model- and data-driven strategy, combining a knowledge-based and a neural net classifier, is recommended. To address the second challenge, a probabilistic object- and field-based change detection approach for modeling the positional, thematic, and temporal uncertainty adherent to both data and processing, is developed. Experimental results indicate the suitability of the methodology in support of land change monitoring. In conclusion, potentials of application and directions for further research are given