Um arcabouço para seleção e fusão de classificadores de padrão

Orientadores: Ricardo da Silva Torres, Anderson RochaTese (doutorado) - Universidade Estadual de Campinas, Instituto de ComputaçãoResumo: O crescente aumento de dados visuais, seja pelo uso de inúmeras câmeras de vídeo monitoramento disponíveis ou pela popularização de dispositivos móveis que permitem pessoas criar, editar e compartilhar suas próprias imagens/vídeos, tem contribuído enormemente para a chamada ''big data revolution". Esta grande quantidade de dados visuais dá origem a uma caixa de Pandora de novos problemas de classificação visuais nunca antes imaginados. Tarefas de classificação de imagens e vídeos foram inseridos em diferentes e complexas aplicações e o uso de soluções baseadas em aprendizagem de máquina tornou-se mais popular para diversas aplicações. Entretanto, por outro lado, não existe uma ''bala de prata" que resolva todos os problemas, ou seja, não é possível caracterizar todas as imagens de diferentes domínios com o mesmo método de descrição e nem utilizar o mesmo método de aprendizagem para alcançar bons resultados em qualquer tipo de aplicação. Nesta tese, propomos um arcabouço para seleção e fusão de classificadores. Nosso método busca combinar métodos de caracterização de imagem e aprendizagem por meio de uma abordagem meta-aprendizagem que avalia quais métodos contribuem melhor para solução de um determinado problema. O arcabouço utiliza três diferentes estratégias de seleção de classificadores para apontar o menos correlacionados e eficazes, por meio de análises de medidas de diversidade. Os experimentos mostram que as abordagens propostas produzem resultados comparáveis aos famosos métodos da literatura para diferentes aplicações, utilizando menos classificadores e não sofrendo com problemas que afetam outras técnicas como a maldição da dimensionalidade e normalização. Além disso, a nossa abordagem é capaz de alcançar resultados eficazes de classificação usando conjuntos de treinamento muito reduzidosAbstract: The frequent growth of visual data, either by countless available monitoring video cameras or the popularization of mobile devices that allow each person to create, edit, and share their own images and videos have contributed enormously to the so called ''big-data revolution''. This shear amount of visual data gives rise to a Pandora box of new visual classification problems never imagined before. Image and video classification tasks have been inserted in different and complex applications and the use of machine learning-based solutions has become the most popular approach to several applications. Notwithstanding, there is no silver bullet that solves all the problems, i.e., it is not possible to characterize all images of different domains with the same description method nor is it possible to use the same learning method to achieve good results in any kind of application. In this thesis, we aim at proposing a framework for classifier selection and fusion. Our method seeks to combine image characterization and learning methods by means of a meta-learning approach responsible for assessing which methods contribute more towards the solution of a given problem. The framework uses three different strategies of classifier selection which pinpoints the less correlated, yet effective, classifiers through a series of diversity measure analysis. The experiments show that the proposed approaches yield comparable results to well-known algorithms from the literature on many different applications but using less learning and description methods as well as not incurring in the curse of dimensionality and normalization problems common to some fusion techniques. Furthermore, our approach is able to achieve effective classification results using very reduced training setsDoutoradoCiência da ComputaçãoDoutor em Ciência da Computaçã

Exploiting Deep Features for Remote Sensing Image Retrieval: A Systematic Investigation

Remote sensing (RS) image retrieval is of great significant for geological information mining. Over the past two decades, a large amount of research on this task has been carried out, which mainly focuses on the following three core issues: feature extraction, similarity metric and relevance feedback. Due to the complexity and multiformity of ground objects in high-resolution remote sensing (HRRS) images, there is still room for improvement in the current retrieval approaches. In this paper, we analyze the three core issues of RS image retrieval and provide a comprehensive review on existing methods. Furthermore, for the goal to advance the state-of-the-art in HRRS image retrieval, we focus on the feature extraction issue and delve how to use powerful deep representations to address this task. We conduct systematic investigation on evaluating correlative factors that may affect the performance of deep features. By optimizing each factor, we acquire remarkable retrieval results on publicly available HRRS datasets. Finally, we explain the experimental phenomenon in detail and draw conclusions according to our analysis. Our work can serve as a guiding role for the research of content-based RS image retrieval

Unsupervised Band Selection in Hyperspectral Images using Autoencoder

International audienceHyperspectral images provide fine details of the observed scene from the exploitation of contiguous spectral bands. However, the high dimensionality of hyperspectral images causes a heavy burden on processing. Therefore, a common practice that has been largely adopted is the selection of bands before processing. Thus, in this work, a new unsupervised approach for band selection based on autoencoders is proposed. During the training phase of the autoencoder, the input data samples have some of their features turned to zero, through a masking noise transform. The subsequent reconstruction error is assigned to the indices with masking noise. The bigger the error, the greater the importance of the masked features. The errors are then summed up during the whole training phase. At the end, the bands corresponding to the biggest indices are selected. A comparison with four other band selection approaches reveals that the proposed method yields better results in some specific cases and similar results in other situations

Quantitative Spatial Upscaling of Categorical Data in the Context of Landscape Ecology: A New Scaling Algorithm

Spatially explicit ecological models rely on spatially exhaustive data layers that have scales appropriate to the ecological processes of interest. Such data layers are often categorical raster maps derived from high-resolution, remotely sensed data that must be scaled to a lower spatial resolution to make them compatible with the scale of ecological analysis. Statistical functions commonly used to aggregate categorical data are majority-, nearest-neighbor- and random-rule. For heterogeneous landscapes and large scaling factors, however, use of these functions results in two critical issues: (1) ignoring large portions of information present in the high-resolution grid cells leads to high and uncontrolled loss of information in the scaled dataset; and (2) maintaining classes from the high-resolution dataset at the lower spatial resolution assumes validity of the classification scheme at the low-resolution scale, failing to represent recurring mixes of heterogeneous classes present in the low-resolution grid cells. The proposed new scaling algorithm resolves these issues, aggregating categorical data while simultaneously controlling for information loss by generating a non-hierarchical, representative, classification system valid at the aggregated scale. Implementing scaling parameters, that control class-label precision effectively reduced information loss of scaled landscapes as class-label precision increased. In a neutral-landscape simulation study, the algorithm consistently preserved information at a significantly higher level than the other commonly used algorithms. When applied to maps of real landscapes, the same increase in information retention was observed, and the scaled classes were detectable from lower-resolution, remotely sensed, multi-spectral reflectance data with high accuracy. The framework developed in this research facilitates scaling-parameter selection to address trade-offs among information retention, label fidelity, and spectral detectability of scaled classes. When generating high spatial resolution land-cover maps, quantifying effects of sampling intensity, feature-space dimensionality and classifier method on overall accuracy, confidence estimates, and classifier efficiency allowed optimization of the mapping method. Increase in sampling intensity boosted accuracies in a reasonably predictable fashion. However, adding a second image acquired when ground conditions and vegetation phenology differed from those of the first image had a much greater impact, increasing classification accuracy even at low sampling intensities, to levels not reached with a single season image

Consulting Services to Determine the Effectiveness of Vegetation Classification Using WorldView 2 Satellite Data for the Greater Everglades

The purpose of this project was to evaluate the use of remote sensing 1) to detect and map Everglades wetland plant communities at different scales; and 2) to compare map products delineated and resampled at various scales with the intent to quantify and describe the quantitative and qualitative differences between such products. We evaluated data provided by Digital Globe’s WorldView 2 (WV2) sensor with a spatial resolution of 2m and data from Landsat’s Thematic and Enhanced Thematic Mapper (TM and ETM+) sensors with a spatial resolution of 30m. We were also interested in the comparability and scalability of products derived from these data sources. The adequacy of each data set to map wetland plant communities was evaluated utilizing two metrics: 1) model-based accuracy estimates of the classification procedures; and 2) design-based post-classification accuracy estimates of derived maps

Basic research planning in mathematical pattern recognition and image analysis

Fundamental problems encountered while attempting to develop automated techniques for applications of remote sensing are discussed under the following categories: (1) geometric and radiometric preprocessing; (2) spatial, spectral, temporal, syntactic, and ancillary digital image representation; (3) image partitioning, proportion estimation, and error models in object scene interference; (4) parallel processing and image data structures; and (5) continuing studies in polarization; computer architectures and parallel processing; and the applicability of "expert systems" to interactive analysis