Innovative applications of associative morphological memories for image processing and pattern recognition

Morphological Associative Memories have been proposed for some image denoising applications. They can be applied to other less restricted domains, like image retrieval and hyper spectral image unsupervised segmentation. In this paper we present these applications. In both cases the key idea is that Autoassociative Morphological Memories selective sensitivity to erosive and dilative noise can be applied to detect the morphological independence between patterns. Linear unmixing based on the sets of morphological independent patterns define a feature extraction process that is the basis for the image processing applications. We discuss some experimental results on the fish shape data base and on a synthetic hyperspectral image, including the comparison with other linear feature extraction algorithms (ICA and CCA)

Contributions to the analysis and segmentation of remote sensing hyperspectral images

142 p.This PhD Thesis deals with the segmentation of hyperspectral images from the point of view of Lattice Computing. We have introduced the application of Associative Morphological Memories as a tool to detect strong lattice independence, which has been proven equivalent to affine independence. Therefore, sets of strong lattice independent vectors found using our algorithms correspond to the vertices of convex sets that cover most of the data. Unmixing the data relative to these endmembers provides a collection of abundance images which can be assumed either as unsupervised segmentations of the images or as features extracted from the hyperspectral image pixels. Besides, we have applied this feature extraction to propose a content based image retrieval approach based on the image spectral characterization provided by the endmembers. Finally, we extended our ideas to the proposal of Morphological Cellular Automata whose dynamics are guided by the morphological/lattice independence properties of the image pixels. Our works have also explored the applicability of Evolution Strategies to the endmember induction from the hyperspectral image data

Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches

Imaging spectrometers measure electromagnetic energy scattered in their instantaneous field view in hundreds or thousands of spectral channels with higher spectral resolution than multispectral cameras. Imaging spectrometers are therefore often referred to as hyperspectral cameras (HSCs). Higher spectral resolution enables material identification via spectroscopic analysis, which facilitates countless applications that require identifying materials in scenarios unsuitable for classical spectroscopic analysis. Due to low spatial resolution of HSCs, microscopic material mixing, and multiple scattering, spectra measured by HSCs are mixtures of spectra of materials in a scene. Thus, accurate estimation requires unmixing. Pixels are assumed to be mixtures of a few materials, called endmembers. Unmixing involves estimating all or some of: the number of endmembers, their spectral signatures, and their abundances at each pixel. Unmixing is a challenging, ill-posed inverse problem because of model inaccuracies, observation noise, environmental conditions, endmember variability, and data set size. Researchers have devised and investigated many models searching for robust, stable, tractable, and accurate unmixing algorithms. This paper presents an overview of unmixing methods from the time of Keshava and Mustard's unmixing tutorial [1] to the present. Mixing models are first discussed. Signal-subspace, geometrical, statistical, sparsity-based, and spatial-contextual unmixing algorithms are described. Mathematical problems and potential solutions are described. Algorithm characteristics are illustrated experimentally.Comment: This work has been accepted for publication in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensin

Ordem supervisionada baseada em valores fuzzy para morfologia matemática multivalorada

Orientador: Marcos Eduardo Ribeiro do Valle MesquitaDissertação (mestrado) - Universidade Estadual de Campinas, Instituto de Matemática Estatística e Computação CientíficaResumo: Morfologia Matemática foi concebida como uma ferramenta para a análise e processamento de imagens binárias e foi subsequentemente generalizada para o uso em imagens em tons de cinza e imagens multivaloradas. Reticulados completos, que são conjuntos parcialmente ordenados em que todo subconjunto tem extremos bem definidos, servem como a base matemática para uma definição geral de morfologia matemática. Em contraste a imagens em tons de cinza, imagens multivaloradas não possuem uma ordem não-ambígua. Essa dissertação trata das chamadas ordens reduzidas para imagens multivaloradas. Ordens reduzidas são definidas por meio de uma relação binária que ordena os elementos de acordo com uma função h do conjunto de valores em um reticulado completo. Ordens reduzidas podem ser classificadas em ordens não-supervisionadas e ordens supervisionadas. Numa ordem supervisionada, o função de ordenação h depende de conjuntos de treinamento de valores de foreground e de background. Nesta dissertação, estudamos ordens supervisionadas da literatura. Também propomos uma ordem supervisionada baseada em valores fuzzy. Valores fuzzy generalizam cores fuzzy - conjuntos fuzzy que modelam o modo que humanos percebem as cores - para imagens multivaloradas. Em particular, revemos como construir o mapa de ordenação baseado em conjuntos fuzzy para o foreground e para o background. Também introduzimos uma função de pertinência baseada numa estrutura neuro-fuzzy e generalizamos a função de pertinência baseada no diagrama de Voronoi. Por fim, as ordens supervisionadas são avaliadas num experimento de segmentação de imagens hiperespectrais baseado num perfil morfológico modificadoAbstract: Mathematical morphology has been conceived initially as a tool for the analysis and processing of binary images and has been later generalized to grayscale and multivalued images. Complete lattices, which are partially ordered sets in whose every subset has well defined extrema, serve as the mathematical background for a general definition of mathematical morphology. In contrast to gray-scale images, however, there is no unambiguous ordering for multivalued images. This dissertation addresses the so-called reduced orderings for multi-valued images. Reduced orderings are defined by means of a binary relation which ranks elements according to a mapping h from the value set into a complete lattice. Reduced orderings can be classified as unsupervised and supervised ordering. In a supervised ordering, the mapping h depends on training sets of foreground and background values. In this dissertation, we study some relevant supervised orderings from the literature. We also propose a supervised ordering based on fuzzy values. Fuzzy values are a generalization of fuzzy colors - fuzzy sets that model how humans perceive colors - to multivalued images other than color images. In particular, we review how to construct the fuzzy ordering mapping based on fuzzy sets that model the foreground and the background. Also, we introduce a membership function based on a neuro-fuzzy framework and generalize the membership function based on Voronoi diagrams. The supervised orderings are evaluated in an experiment of hyperspectral image segmentation based on a modified morphological profileMestradoMatematica AplicadaMestre em Matemática Aplicada131635/2018-2CNP

A Novel Densenet-324 Densely Connected Convolution Neural Network for Medical Crop Classification using Remote Sensing Hyperspectral Satellite Images

In the past few decades, importance of the medicinal Crops is extending to a large extent due to its benefits in treating life-threatening diseases. Medicinal Crop has excellent medicinal properties on its roots, stem, and leaves to prevent human and animal health. Particularly detection and identification of the Crop classes are effectively carried out using hyperspectral images as discrimination of the target feature or objects is simple and it contains rich information containing the spatial and temporal details of underlying the land cover. However, Crop classification using machine learning architectures concerning spectral characteristics obtained on the anatomical features and morphological features. Extracted features towards classification lead to several challenges such as large spatial and temporal variability and spectral signatures similarity between different objects. A further hyperspectral image poses several difficulties with changes in illumination, environment, and atmospheric aspects. To tackle those non-trivial challenges, DenseNet-324 Densely Connected convolution neural network architecture has been designed in this work to discriminate the crop and medical Crop effectively in the interested areas.  Initially, the Hyperspectral image is pre-processed against a large number of noises through the employment of the noise removal technique and bad line replacement techniques. Pre-processed image is explored to image segmentation using the global thresholding method to segment it into various regions based on spatial pieces of information on grouping the neighboring similar pixels intensity or textures. Further regions of the image are processed using principle component analysis to extract spectral features of the image. That extracted feature is employed to ant colony optimization technique to obtain the optimal features. Computed optimal features are classified using Convolution Neural Network with a hyper parameter setup. The convolution Layer of the CNN architecture process spatial, temporal, and spectral feature and generates the feature map in various context, generated feature map is max pooled in the pooling layer and classified into crops and medicinal Crop in the SoftMax layer. Experimental analysis of the proposed architecture is carried out on the Indiana Pines dataset using cross-fold validation to analyze the representation ability to discriminate the features with large variance between the different classes. From the results, it is confirmed that the proposed architecture exhibits higher performance in classification accuracy of 98.43% in classifying the Crop species compared with conventional approaches.&nbsp

PCE: Piece-wise Convex Endmember Detection

DOI: 10.1109/TGRS.2010.2041062 This item also falls under IEEE copyright. "© 2010 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works."A new hyperspectral endmember detection method that represents endmembers as distributions, autonomously partitions the input data set into several convex regions, and simultaneously determines endmember distributions and proportion values for each convex region is presented. Spectral unmixing methods that treat endmembers as distributions or hyperspectral images as piece-wise convex data sets have not been previously developed

Complete lattice projection autoassociative memories

Orientador: Marcos Eduardo Ribeiro do Valle MesquitaTese (doutorado) - Universidade Estadual de Campinas, Instituto de Matemática Estatística e Computação CientíficaResumo: A capacidade do cérebro humano de armazenar e recordar informações por associação tem inspirado o desenvolvimento de modelos matemáticos referidos na literatura como memórias associativas. Em primeiro lugar, esta tese apresenta um conjunto de memórias autoassociativas (AMs) que pertecem à ampla classe das memórias morfológicas autoassociativas (AMMs). Especificamente, as memórias morfológicas autoassociativas de projeção max-plus e min-plus (max-plus e min-plus PAMMs), bem como suas composições, são introduzidas nesta tese. Tais modelos podem ser vistos como versões não distribuídas das AMMs propostas por Ritter e Sussner. Em suma, a max-plus PAMM produz a maior combinação max-plus das memórias fundamentais que é menor ou igual ao padrão de entrada. Dualmente, a min-plus PAMM projeta o padrão de entrada no conjunto de todas combinações min-plus. Em segundo, no contexto da teoria dos conjuntos fuzzy, esta tese propõe novas memórias autoassociativas fuzzy, referidas como classe das max-C e min-D FPAMMs. Uma FPAMM representa uma rede neural morfológica fuzzy com uma camada oculta de neurônios que é concebida para o armazenamento e recordação de conjuntos fuzzy ou vetores num hipercubo. Experimentos computacionais relacionados à classificação de padrões e reconhecimento de faces indicam possíveis aplicações dos novos modelos acima mencionadosAbstract: The human brain¿s ability to store and recall information by association has inspired the development various mathematical models referred to in the literature as associative memories. Firstly, this thesis presents a set of autoassociative memories (AMs) that belong to the broad class of autoassociative morphological memories (AMMs). Specifically, the max-plus and min-plus projection autoassociative morphological memories (max-plus and min-plus PAMMs), as well as their compositions, are introduced in this thesis. These models are non-distributed versions of the AMM models developed by Ritter and Sussner. Briefly, the max-plus PAMM yields the largest max-plus combination of the stored vectors which is less than or equal to the input pattern. Dually, the min-plus PAMM projects the input pattern into the set of all min-plus combinations. In second, in the context of fuzzy set theory, this thesis proposes new fuzzy autoassociative memories mentioned as class of the max-C and min-D FPAMMs. A FPAMM represents a fuzzy morphological neural network with a hidden layer of neurons that is designed for the storage and retrieval of fuzzy sets or vectors on a hypercube. Computational experiments concerning pattern classification and face recognition indicate possible applications of the aforementioned new AM modelsDoutoradoMatematica AplicadaDoutor em Matemática AplicadaCAPE

Neural-genetic approach for patterns recall : case of study : gesture recognition in intelligent environments

Orientador: José Raimundo de OliveiraDissertação (mestrado) - Universidade Estadual de Campinas, Faculdade de Engenharia Elétrica e de ComputaçãoResumo: Esta tese apresenta uma nova e efetiva abordagem neuro-genética denominada MAAM-GA constituída por um algoritmo genético e uma rede neural associativa morfológica para a solução de problemas de reconhecimento de padrões. Especificamente, uma rede neural associativa morfológica é combinada com um algoritmo genético que é utilizado na construção da rede neural com a finalidade de aumentar a eficiência e robustez no reconhecimento de padrões. Um estudo detalhado do desempenho da abordagem é apresentado, utilizando imagens em níveis de cinza como padrões. Resultados numéricos e visuais da recuperação dos padrões são apresentados e o desempenho alcançado é comparado com outros modelos neurais associativos morfológicos relevantes para padrões de valor real, mostrando a eficiência e a robustez da abordagem proposta na recordação de imagens em níveis de cinza. Esta abordagem faz parte do desenvolvimento dos sistemas inteligentes que impulsionam o avanço de outras áreas. Pensando em uma potencial aplicação, a proposta neuro-genética é utilizada para resolver o problema de reconhecimento de gestos da mão. O reconhecimento de gestos é um caminho natural de interação humano-computador, e considerando a diversidade e a diferença manifestada pelo ser humano, para muitas pessoas que possuem deficiência física e sensorial, os gestos da mão são o meio principal de comunicação. Várias tecnologias têm sido propostas para trazer benefícios às pessoas com limitações de comunicação. Os ambientes inteligentes surgiram com o principal propósito de melhorar a qualidade de vida do ser humano baseados em ferramentas computacionais, facilitando o desenvolvimento de processos e ações de nosso cotidiano. O reconhecimento de gestos da mão é uma função do ambiente inteligente. Assim, para pessoas portadoras de deficiências físicas que limitem a sua comunicação oral, o reconhecimento de gestos em um ambiente inteligente poderá lhes trazer múltiplos benefícios na comunicação, interação e acessibilidade, permitindo a sua integração com o ambiente. Embora preocupados com pessoas portadoras de deficiências físicas, o sistema de reconhecimento de gestos da mão como parte de um ambiente inteligente destina-se, sobretudo a beneficiar todo e qualquer cidadão que dele tenha acesso. Assim, nesta tese é apresentado um estudo de um sistema de reconhecimento de gestos da mão baseado em visão artificial capaz de reconhecer gestos estáticos específicos da mão. Este sistema foi dividido em três módulos, módulo de detecção e segmentação, módulo de extração de características e o módulo de identificação e reconhecimento propriamente dito que utiliza a abordagem neuro-genética proposta. Métodos utilizados no pré-processamento das imagens para segmentação e caracterização também são apresentados. Resultados alcançados com a abordagem proposta são muito incentivadores e sugerem que a proposta possa ser considerada como uma ferramenta eficiente e robusta para recuperação e identificação a ser usada em diversas aplicações relacionadas à interface natural humano-computador. O ótimo desempenho do sistema é um passo para continuar na busca de novas tecnologias para criar um ambiente inteligente que dê suporte às necessidades de pessoas com deficiência visual, auditiva ou motora lhes dando certo nível de autonomia, capacidade de controle do entorno e de comunicaçãoAbstract: This thesis presents an innovative approach to solving problems of pattern recognition using a neural-genetic combination. Specifically, a morphological associative neural network is combined with a genetic algorithm that is used in the construction of the neural network for increasing the efficiency and robustness of pattern recall. A detailed study about the performance of the approach is presented, using grayscale images as patterns. Numerical and visual results are presented and the performance achieved is compared with other morphological associative neural models showing its effectiveness and robustness in the grayscale images recall. Thinking about a potential application, the proposed approach is used to solve the problem of hand gestures recognition. The hand gestures recognition is a natural way of human-computer interaction and considering the diversity and difference manifested by the human, for many people who have physical and sensory disabilities, the hand gestures is the primary means of communication. Several technologies have been proposed to bring benefits to people with limited communication. The intelligent environments emerged with the main purpose of improving the quality of human life based in computational tools facilitating the development of processes and actions of everyday life. The hand gestures recognition is a function of intelligent environments. So, for people with physical disabilities that limit their oral communication gesture recognition in an intelligent environment can take many benefits in communication, interaction and accessibility allowing its integration with the environment. Although concerned about people with disabilities, the hand gestures recognition system is mainly intended to benefit every people who has access to the environment. Thus, this thesis presents a study of a hand gestures recognition system. The system is able to recognize static hand gestures using the proposed Neural-Genetic Approach. Methods used in the image preprocessing and characterization are also presented. Results achieved with the proposed approach are very encouraging and suggest that the proposal can be considered as an efficient and robust tool for recovery and identification to be used in various applications related to natural human-computer interface. The optimal system performance is a big step to continue the search for new technologies to create an intelligent environment that supports the needs of people with visual, hearing or motor disabilityMestradoEngenharia de ComputaçãoDoutor em Engenharia Elétric