Object Detection in High Resolution Aerial Images and Hyperspectral Remote Sensing Images

With rapid developments in satellite and sensor technologies, there has been a dramatic increase in the availability of remotely sensed images. However, the exploration of these images still involves a tremendous amount of human interventions, which are tedious, time-consuming, and inefficient. To help imaging experts gain a complete understanding of the images and locate the objects of interest in a more accurate and efficient way, there is always an urgent need for developing automatic detection algorithms. In this work, we delve into the object detection problems in remote sensing applications, exploring the detection algorithms for both hyperspectral images (HSIs) and high resolution aerial images. In the first part, we focus on the subpixel target detection problem in HSIs with low spatial resolutions, where the objects of interest are much smaller than the image pixel spatial resolution. To this end, we explore the detection frameworks that integrate image segmentation techniques in designing the matched filters (MFs). In particular, we propose a novel image segmentation algorithm to identify the spatial-spectral coherent image regions, from which the background statistics were estimated for deriving the MFs. Extensive experimental studies were carried out to demonstrate the advantages of the proposed subpixel target detection framework. Our studies show the superiority of the approach when comparing to state-of-the-art methods. The second part of the thesis explores the object based image analysis (OBIA) framework for geospatial object detection in high resolution aerial images. Specifically, we generate a tree representation of the aerial images from the output of hierarchical image segmentation algorithms and reformulate the object detection problem into a tree matching task. We then proposed two tree-matching algorithms for the object detection framework. We demonstrate the efficiency and effectiveness of the proposed tree-matching based object detection framework. In the third part, we study object detection in high resolution aerial images from a machine learning perspective. We investigate both traditional machine learning based framework and end-to-end convolutional neural network (CNN) based approach for various object detection tasks. In the traditional detection framework, we propose to apply the Gaussian process classifier (GPC) to train an object detector and demonstrate the advantages of the probabilistic classification algorithm. In the CNN based approach, we proposed a novel scale transfer module that generates enhanced feature maps for object detection. Our results show the efficiency and competitiveness of the proposed algorithms when compared to state-of-the-art counterparts

Hyperspectral Band Selection for Lithologic Discrimination and Geological Mapping

Classification techniques applied to hyperspectral images are very useful for lithologic discrimination and geological mapping. Classifiers are often applied either to all spectral channels or only to absorption spectral channels. However, it is difficult to obtain different lithology information using specific absorption regions from the narrow bandwidth and contiguous spectral channels due to spectral variability among rocks. In this article, we propose a band selection (BS) method for hyperspectral lithologic discrimination, in which the lithological superpixels are first gathered. A spectral bands selection criterion is learned by measuring the homogeneity and the variation of the lithological superpixels, and lithologic discriminating bands are identified by an efficient clustering algorithm based on affinity propagation. In this article, two geologic test sites, i.e., the Airborne Visible/Infrared Imaging Spectrometer data of the Cuprite, Nevada, USA, including 11 lithologic units (9 types of rocks) and the Hyperion data of Junggar, China, with 5 lithologic units, are chosen for validation. The performance of the proposed BS method is compared with those of using all the bands, specific absorption spectral channels, and two literature BS techniques. Experimental results show that the proposed method improves mapping accuracy by selecting fewer bands with higher lithologic discrimination capability than the other considered methods

Anomaly detection for replacement model in hyperspectral imaging

In this paper we consider Anomaly Detection in the hyperspectral context, and we extend the popular RX detector, initially designed under the standard additive model, to the replacement model case. Indeed, in this more realistic framework, the target, if present, is supposed to replace a part of the background. We show how to estimate this background power variation to improve the standard RX scheme. The obtained Replacement RX (RRX) is shown to be closed-form and outperforms the standard RX on a real data benchmark experiment

One-step Generalized Likelihood Ratio Test for Subpixel Target Detection in Hyperspectral Imaging

Abstract—One of the main objectives of hyperspectral image processing is to detect a given target among an unknown background. The standard data to conduct such a detection is a reflectance map, where the spectral signatures of each pixel’s components, known as endmembers, are associated with their abundances in the pixel. Due to the low spatial resolution of most hyperspectral sensors, such a target occupies a fraction of the pixel. A widely used model in case of subpixel targets is the replacement model. Among the vast number of possible detectors, algorithms matched to the replacement model are quite rare. One of the few examples is the Finite Target Matched Filter, which is an adjustment of the well-known Matched Filter. In this paper, we derive the exact Generalized Likelihood Ratio Test for this model. This new detector can be used both with a local covariance estimation window or a global one. It is shown to outperform the standard target detectors on real data, especially for small covariance estimation windows

Graph-based Data Modeling and Analysis for Data Fusion in Remote Sensing

Hyperspectral imaging provides the capability of increased sensitivity and discrimination over traditional imaging methods by combining standard digital imaging with spectroscopic methods. For each individual pixel in a hyperspectral image (HSI), a continuous spectrum is sampled as the spectral reflectance/radiance signature to facilitate identification of ground cover and surface material. The abundant spectrum knowledge allows all available information from the data to be mined. The superior qualities within hyperspectral imaging allow wide applications such as mineral exploration, agriculture monitoring, and ecological surveillance, etc. The processing of massive high-dimensional HSI datasets is a challenge since many data processing techniques have a computational complexity that grows exponentially with the dimension. Besides, a HSI dataset may contain a limited number of degrees of freedom due to the high correlations between data points and among the spectra. On the other hand, merely taking advantage of the sampled spectrum of individual HSI data point may produce inaccurate results due to the mixed nature of raw HSI data, such as mixed pixels, optical interferences and etc. Fusion strategies are widely adopted in data processing to achieve better performance, especially in the field of classification and clustering. There are mainly three types of fusion strategies, namely low-level data fusion, intermediate-level feature fusion, and high-level decision fusion. Low-level data fusion combines multi-source data that is expected to be complementary or cooperative. Intermediate-level feature fusion aims at selection and combination of features to remove redundant information. Decision level fusion exploits a set of classifiers to provide more accurate results. The fusion strategies have wide applications including HSI data processing. With the fast development of multiple remote sensing modalities, e.g. Very High Resolution (VHR) optical sensors, LiDAR, etc., fusion of multi-source data can in principal produce more detailed information than each single source. On the other hand, besides the abundant spectral information contained in HSI data, features such as texture and shape may be employed to represent data points from a spatial perspective. Furthermore, feature fusion also includes the strategy of removing redundant and noisy features in the dataset. One of the major problems in machine learning and pattern recognition is to develop appropriate representations for complex nonlinear data. In HSI processing, a particular data point is usually described as a vector with coordinates corresponding to the intensities measured in the spectral bands. This vector representation permits the application of linear and nonlinear transformations with linear algebra to find an alternative representation of the data. More generally, HSI is multi-dimensional in nature and the vector representation may lose the contextual correlations. Tensor representation provides a more sophisticated modeling technique and a higher-order generalization to linear subspace analysis. In graph theory, data points can be generalized as nodes with connectivities measured from the proximity of a local neighborhood. The graph-based framework efficiently characterizes the relationships among the data and allows for convenient mathematical manipulation in many applications, such as data clustering, feature extraction, feature selection and data alignment. In this thesis, graph-based approaches applied in the field of multi-source feature and data fusion in remote sensing area are explored. We will mainly investigate the fusion of spatial, spectral and LiDAR information with linear and multilinear algebra under graph-based framework for data clustering and classification problems

Very High Resolution (VHR) Satellite Imagery: Processing and Applications

Recently, growing interest in the use of remote sensing imagery has appeared to provide synoptic maps of water quality parameters in coastal and inner water ecosystems;, monitoring of complex land ecosystems for biodiversity conservation; precision agriculture for the management of soils, crops, and pests; urban planning; disaster monitoring, etc. However, for these maps to achieve their full potential, it is important to engage in periodic monitoring and analysis of multi-temporal changes. In this context, very high resolution (VHR) satellite-based optical, infrared, and radar imaging instruments provide reliable information to implement spatially-based conservation actions. Moreover, they enable observations of parameters of our environment at greater broader spatial and finer temporal scales than those allowed through field observation alone. In this sense, recent very high resolution satellite technologies and image processing algorithms present the opportunity to develop quantitative techniques that have the potential to improve upon traditional techniques in terms of cost, mapping fidelity, and objectivity. Typical applications include multi-temporal classification, recognition and tracking of specific patterns, multisensor data fusion, analysis of land/marine ecosystem processes and environment monitoring, etc. This book aims to collect new developments, methodologies, and applications of very high resolution satellite data for remote sensing. The works selected provide to the research community the most recent advances on all aspects of VHR satellite remote sensing

Analyse hiérarchique d'images multimodales

There is a growing interest in the development of adapted processing tools for multimodal images (several images acquired over the same scene with different characteristics). Allowing a more complete description of the scene, multimodal images are of interest in various image processing fields, but their optimal handling and exploitation raise several issues. This thesis extends hierarchical representations, a powerful tool for classical image analysis and processing, to multimodal images in order to better exploit the additional information brought by the multimodality and improve classical image processing techniques. %when applied to real applications. This thesis focuses on three different multimodalities frequently encountered in the remote sensing field. We first investigate the spectral-spatial information of hyperspectral images. Based on an adapted construction and processing of the hierarchical representation, we derive a segmentation which is optimal with respect to the spectral unmixing operation. We then focus on the temporal multimodality and sequences of hyperspectral images. Using the hierarchical representation of the frames in the sequence, we propose a new method to achieve object tracking and apply it to chemical gas plume tracking in thermal infrared hyperspectral video sequences. Finally, we study the sensorial multimodality, being images acquired with different sensors. Relying on the concept of braids of partitions, we propose a novel methodology of image segmentation, based on an energetic minimization framework.Il y a un intérêt grandissant pour le développement d’outils de traitements adaptés aux images multimodales (plusieurs images de la même scène acquises avec différentes caractéristiques). Permettant une représentation plus complète de la scène, ces images multimodales ont de l'intérêt dans plusieurs domaines du traitement d'images, mais les exploiter et les manipuler de manière optimale soulève plusieurs questions. Cette thèse étend les représentations hiérarchiques, outil puissant pour le traitement et l’analyse d’images classiques, aux images multimodales afin de mieux exploiter l’information additionnelle apportée par la multimodalité et améliorer les techniques classiques de traitement d’images. Cette thèse se concentre sur trois différentes multimodalités fréquemment rencontrées dans le domaine de la télédétection. Nous examinons premièrement l’information spectrale-spatiale des images hyperspectrales. Une construction et un traitement adaptés de la représentation hiérarchique nous permettent de produire une carte de segmentation de l'image optimale vis-à-vis de l'opération de démélange spectrale. Nous nous concentrons ensuite sur la multimodalité temporelle, traitant des séquences d’images hyperspectrales. En utilisant les représentations hiérarchiques des différentes images de la séquence, nous proposons une nouvelle méthode pour effectuer du suivi d’objet et l’appliquons au suivi de nuages de gaz chimique dans des séquences d’images hyperspectrales dans le domaine thermique infrarouge. Finalement, nous étudions la multimodalité sensorielle, c’est-à-dire les images acquises par différents capteurs. Nous appuyant sur le concept des tresses de partitions, nous proposons une nouvelle méthodologie de segmentation se basant sur un cadre de minimisation d’énergie

Teledetección. Nuevas plataformas y sensores aplicados a la gestión del agua, la agricultura y el medio ambiente

Este libro recoge las comunicaciones presentadas al XVII Congreso de la Asociación Española de Teledetección (AET), celebrado del 3 al 7 de octubre de 2017 en el auditorio y palacio de congresos de Murcia y organizado por el Grupo de Sistemas de Información Geográfica y Teledetección del Instituto Murciano de Investigación y Desarrollo Agrario y Alimentario (IMIDA),con el soporte de la AET,el Instituto Geográfico Nacional (IGN), las universidades politécnicas de Cartagena y Valencia, la Confederación Hidrográfica del Segura, el ayuntamiento de Murcia,las empresas Gade Eventos y Geodim y la Universidad Católica de San Antonio El lema elegido para el Congreso ha sido "Nuevas plataformas y sensores de teledetección" aplicados a la gestión del agua,la agricultura y el medio ambiente, con la intención de promover el encuentro entre las comunidades académicas, científicas e industriales en el área de la teledetección, destacando las nuevas plataformas de bajo coste y los logros conseguidos en la generación y difusión de productos útiles para la sociedadRuiz Fernández, LÁ.; Estornell Cremades, J.; Erena Arrabal, M. (2017). Teledetección. Nuevas plataformas y sensores aplicados a la gestión del agua, la agricultura y el medio ambiente. Editorial Universitat Politècnica de València. http://hdl.handle.net/10251/90688EDITORIA