Spectral image utility for target detection applications

In a wide range of applications, images convey useful information about scenes. The “utility” of an image is defined with reference to the specific task that an observer seeks to accomplish, and differs from the “fidelity” of the image, which seeks to capture the ability of the image to represent the true nature of the scene. In remote sensing of the earth, various means of characterizing the utility of satellite and airborne imagery have evolved over the years. Recent advances in the imaging modality of spectral imaging have enabled synoptic views of the earth at many finely sampled wavelengths over a broad spectral band. These advances challenge the ability of traditional earth observation image utility metrics to describe the rich information content of spectral images. Traditional approaches to image utility that are based on overhead panchromatic image interpretability by a human observer are not applicable to spectral imagery, which requires automated processing. This research establishes the context for spectral image utility by reviewing traditional approaches and current methods for describing spectral image utility. It proposes a new approach to assessing and predicting spectral image utility for the specific application of target detection. We develop a novel approach to assessing the utility of any spectral image using the target-implant method. This method is not limited by the requirements of traditional target detection performance assessment, which need ground truth and an adequate number of target pixels in the scene. The flexibility of this approach is demonstrated by assessing the utility of a wide range of real and simulated spectral imagery over a variety ii of target detection scenarios. The assessed image utility may be summarized to any desired level of specificity based on the image analysis requirements. We also present an approach to predicting spectral image utility that derives statistical parameters directly from an image and uses them to model target detection algorithm output. The image-derived predicted utility is directly comparable to the assessed utility and the accuracy of prediction is shown to improve with statistical models that capture the non-Gaussian behavior of real spectral image target detection algorithm outputs. The sensitivity of the proposed spectral image utility metric to various image chain parameters is examined in detail, revealing characteristics, requirements, and limitations that provide insight into the relative importance of parameters in the image utility. The results of these investigations lead to a better understanding of spectral image information vis-à-vis target detection performance that will hopefully prove useful to the spectral imagery analysis community and represent a step towards quantifying the ability of a spectral image to satisfy information exploitation requirements

Improving Hyperspectral Subpixel Target Detection Using Hybrid Detection Space

A Hyper-Spectral Image (HSI) has high spectral and low spatial resolution. As a result, most targets exist as subpixels, which pose challenges in target detection. Moreover, limitation of target and background samples always hinders the target detection performance. In this thesis, a hybrid method for subpixel target detection of an HSI using minimal prior knowledge is developed. The Matched Filter (MF) and Adaptive Cosine Estimator (ACE) are two popular algorithms in HSI target detection. They have different advantages in differentiating target from background. In the proposed method, the scores of MF and ACE algorithms are used to construct a hybrid detection space. First, some high abundance target spectra are randomly picked from the scene to perform initial detection to determine the target and background subsets. Then, the reference target spectrum and background covariance matrix are improved iteratively, using the hybrid detection space. As the iterations continue, the reference target spectrum gets closer and closer to the central line that connects the centers of target and background and resulting in noticeable improvement in target detection. Two synthetic datasets and two real datasets are used in the experiments. The results are evaluated based on the mean detection rate, Receiver Operating Characteristic (ROC) curve and observation of the detection results. Compared to traditional MF and ACE algorithms with Reed-Xiaoli Detector (RXD) background covariance matrix estimation, the new method shows much better performance on all four datasets. This method can be applied in environmental monitoring, mineral detection, as well as oceanography and forestry reconnaissance to search for extremely small target distribution in a large scene

Multiclass Object Detection with Single Query in Hyperspectral Imagery Using Class-Associative Spectral Fringe-Adjusted Joint Transform Correlation

We present a deterministic object detection algorithm capable of detecting multiclass objects in hyperspectral imagery (HSI) without any training or preprocessing. The proposed method, which is named class-associative spectral fringe-adjusted joint transform correlation (CSFJTC), is based on joint transform correlation (JTC) between object and nonobject spectral signatures to search for a similar match, which only requires one query (training-free) from the object\u27s spectral signature. Our method utilizes class-associative filtering, modified Fourier plane image subtraction, and fringe-adjusted JTC techniques in spectral correlation domain to perform the object detection task. The output of CSFJTC yields a pair of sharp correlation peaks for a matched target and negligible or no correlation peaks for a mismatch. Experimental results, in terms of receiver operating characteristic (ROC) curves and area-under-ROC (AUROC), on three popular real-world hyperspectral data sets demonstrate the superiority of the proposed CSFJTC technique over other well-known hyperspectral object detection approaches

Hyperspectral Sensors as a Management Tool to Prevent the Invasion of the Exotic Cordgrass Spartina densiflora in the Doñana Wetlands

We test the use of hyperspectral sensors for the early detection of the invasive dense-flowered cordgrass (Spartina densiflora Brongn.) in the Guadalquivir River marshes, Southwestern Spain. We flew in tandem a CASI-1500 (368–1052 nm) and an AHS (430–13,000 nm) airborne sensors in an area with presence of S. densiflora. We simplified the processing of hyperspectral data (no atmospheric correction and no data-reduction techniques) to test if these treatments were necessary for accurate S. densiflora detection in the area. We tested several statistical signal detection algorithms implemented in ENVI software as spectral target detection techniques (matched filtering, constrained energy minimization, orthogonal subspace projection, target-constrained interference minimized filter, and adaptive coherence estimator) and compared them to the well-known spectral angle mapper, using spectra extracted from ground-truth locations in the images. The target S. densiflora was easy to detect in the marshes by all algorithms in images of both sensors. The best methods (adaptive coherence estimator and target-constrained interference minimized filter) on the best sensor (AHS) produced 100% discrimination (Kappa = 1, AUC = 1) at the study site and only some decline in performance when extrapolated to a new nearby area. AHS outperformed CASI in spite of having a coarser spatial resolution (4-m vs. 1-m) and lower spectral resolution in the visible and near-infrared range, but had a better signal to noise ratio. The larger spectral range of AHS in the short-wave and thermal infrared was of no particular advantage. Our conclusions are that it is possible to use hyperspectral sensors to map the early spread S. densiflora in the Guadalquivir River marshes. AHS is the most suitable airborne hyperspectral sensor for this task and the signal processing techniques target-constrained interference minimized filter (TCIMF) and adaptive coherence estimator (ACE) are the best performing target detection techniques that can be employed operationally with a simplified processing of hyperspectral images.This study has been funded by the Spanish Ministry of Science and Innovation through the research projects HYDRA (No. CGL2006-02247/BOS) and HYDRA2 (CGL2009-09801/BOS), by the National Parks Authority (Organismo Autonomo de Parques Nacionales) of the Spanish Ministry of Environment to project OAPN 042/2007, and by funding from the European Union (EU) Horizon 2020 research and innovation program under grant agreement No. 641762 to ECOPOTENTIAL project. The Espacio Natural de Doñana provided permits for field work in protected areas with restricted access. We are grateful to the Instituto Nacional de Técnica Aeroespacial (INTA), Spain, for performing the airborne campaign and the geometric correction of the images. J.B. has to acknowledge a sabbatical stay at Pye Laboratory of the Commonwealth Scientific and Research Organization (CSIRO) Marine and Atmospheric Sciences, Australia, and at the Climate Change Cluster (C3) of the University of Technology Sydney, Australia, funded by the Spanish Ministry of Education, during data analysis and writing of this paper. This publication is a contribution from CEIMAR and also a contribution from CEICAMBIO. We acknowledge support by the CSIC Open Access Publication Initiative through its Unit of Information Resources for Research (URICI

Hyperspectral Analysis of Oil and Oil-Impacted Soils for Remote Sensing Purposes

While conventional multispectral sensors record the radiometric signal only at a handful of wavelengths, hyperspectral sensors measure the reflected solar signal at hundreds contiguous and narrow wavelength bands, spanning from the visible to the infrared. Hyperspectral images provide ample spectral information to identify and distinguish between spectrally similar (but unique) materials, providing the ability to make proper distinctions among materials with only subtle signature differences. Hyperspectral images show hence potentiality for proper discrimination between oil slicks and other natural phenomena (look-alike); and even for proper distinctions between oil types. Additionally they can give indications on oil volume. At present, many airborne hyperspectral sensors are available to collect data, but only two civil spaceborn hyperspectral sensors exist as technology demonstrator: the Hyperion sensor on NASA’s EO-1 satellite and the CHRIS sensor on the European Space Agency’s PROBA satellite. Consequently, the concrete opportunity to use spaceborn hyperspectral remote sensing for operational oil spill monitoring is yet not available. Nevertheless, it is clear that the future of satellite hyperspectral remote sensing of oil pollution in the marine/coastal environment is very promising. In order to correctly interpret the hyperspectral data, the retrieved spectral signatures must be correlated to specific materials. Therefore specific spectral libraries, containing the spectral signature of the materials to be detected, must be built up. This requires that highly accurate reflected light measurements of samples of the investigated material must be performed in the lab or in the field. Accurate measurements of the spectral reflectance of several samples of oil-contaminated soils have been performed in the laboratory, in the 400-2500 nm wavelength range. Samples of the oils spilt from the Erika and the Prestige tankers during the major accidents of 1999 and 2002 were also collected and analyzed in the same spectral range, using a portable spectrophotometer. All measurements showed the typical absorption features of hydrocarbon-bearing substances: the two absorption peaks centered at 1732 and 2310 nm.JRC.G.3-Agricultur

Detecting anomalies in remotely sensed hyperspectral signatures via wavelet transforms

An automated subpixel target detection system has been designed and tested for use with remotely sensed hyperspectral images. A database of hyperspectral signatures was created to test the system using a variety of Gaussian shaped targets. The signal-to-noise ratio of the targets varied from -95dB to -50dB. The system utilizes a wavelet-based method (discrete wavelet transform) to extract an energy feature vector from each input pixel signature. The dimensionality of the feature vector is reduced to a one-dimensional feature scalar through the process of linear discriminant analysis. Signature classification is determined by nearest mean criterion that is used to assign each input signature to one of two classes, no target present or target present. Classification accuracy ranged from nearly 60% with target SNR at -95dB without any a priori knowledge of the target, to 100% with target SNR at -50dB and a priori knowledge about the location of the target within the spectral bands of the signature

Hyperspectral Imaging for Landmine Detection

This PhD thesis aims at investigating the possibility to detect landmines using hyperspectral imaging. Using this technology, we are able to acquire at each pixel of the image spectral data in hundreds of wavelengths. So, at each pixel we obtain a reflectance spectrum that is used as fingerprint to identify the materials in each pixel, and mainly in our project help us to detect the presence of landmines. The proposed process works as follows: a preconfigured drone (hexarotor or octorotor) will carry the hyperspectral camera. This programmed drone is responsible of flying over the contaminated area in order to take images from a safe distance. Various image processing techniques will be used to treat the image in order to isolate the landmine from the surrounding. Once the presence of a mine or explosives is suspected, an alarm signal is sent to the base station giving information about the type of the mine, its location and the clear path that could be taken by the mine removal team in order to disarm the mine. This technology has advantages over the actually used techniques: • It is safer because it limits the need of humans in the searching process and gives the opportunity to the demining team to detect the mines while they are in a safe region. • It is faster. A larger area could be cleared in a single day by comparison with demining techniques • This technique can be used to detect at the same time objects other than mines such oil or minerals. First, a presentation of the problem of landmines that is expanding worldwide referring to some statistics from the UN organizations is provided. In addition, a brief presentation of different types of landmines is shown. Unfortunately, new landmines are well camouflaged and are mainly made of plastic in order to make their detection using metal detectors harder. A summary of all landmine detection techniques is shown to give an idea about the advantages and disadvantages of each technique. In this work, we give an overview of different projects that worked on the detection of landmines using hyperspectral imaging. We will show the main results achieved in this field and future work to be done in order to make this technology effective. Moreover, we worked on different target detection algorithms in order to achieve high probability of detection with low false alarm rate. We tested different statistical and linear unmixing based methods. In addition, we introduced the use of radial basis function neural networks in order to detect landmines at subpixel level. A comparative study between different detection methods will be shown in the thesis. A study of the effect of dimensionality reduction using principal component analysis prior to classification is also provided. The study shows the dependency between the two steps (feature extraction and target detection). The selection of target detection algorithm will define if feature extraction in previous phase is necessary. A field experiment has been done in order to study how the spectral signature of landmine will change depending on the environment in which the mine is planted. For this, we acquired the spectral signature of 6 types of landmines in different conditions: in Lab where specific source of light is used; in field where mines are covered by grass; and when mines are buried in soil. The results of this experiment are very interesting. The signature of two types of landmines are used in the simulations. They are a database necessary for supervised detection of landmines. Also we extracted some spectral characteristics of landmines that would help us to distinguish mines from background

Satellite remote sensing for hydrothermal alteration minerals mapping of subtle geothermal system in unexplored aseismic environment

Mapping prospective geothermal (GT) resources and monitoring associated surface manifestations can be challenging and prohibitively expensive in subtle systems especially when using conventional survey methods. Remote sensing offers a synoptic and costeffective capability for identification of GT systems. The objective of this research is to refine and develop methods of identifying unconventional GT systems by evaluating the applicability of the ASTER, Landsat 8 and Hyperion satellite data for mapping hydrothermal alteration indicator minerals as proxy for detecting subtle GT targets in unexplored aseismic settings. The study area is Yankari Park in North Eastern Nigeria, characterized by the thermal springs; Wikki, Mawulgo, Gwana and Dimmil. Spectral Angle Mapper (SAM), Linear spectral Unmixing (LSU) and Mixture Tuned Matched Filtering (MTMF) were comparatively evaluated by using image derived spectra and corresponding library spectra for mapping pixel abundance of GT indicator minerals in a novel and efficient manner. The results indicated that employing image derived spectra from field validated and laboratory verified regions of interest as reference, gives more accurate results than using library spectra around known alteration zones remotely detectable on the imagery. The MTMF provided high performance subpixel target detection with an accuracy of 50-100% and 70-100% subpixel abundance for argillicphyllic- silicic and propylitic alteration mineral assemblages respectively, as compared to less than 10% for the same endmembers when using library spectra. The MTMF is thus best suited for mapping alterations associated with subtle GT systems than the less selective LSU. The per-pixel SAM was unsuitable for target detection of alteration indicators of interest with poor overall accuracy of 33.81% and 0.24 Kappa coefficient at 0.02 radian angle. Results of mapping thermally anomalous pixels do not conform to known locations of the thermal springs signifying the limitations of the current thermal sensors in mapping low temperature GT systems even at 60m spatial resolution. However, examining the spatial correlation of the anomaly areas with the major geologic structure systems from geological map of the study area indicates a close affinity between them and with previously reported thermal gradients within heat insulating sedimentary formations. This study establishes the integrative applicability of Multispectral and Hyperspectral data for mapping subtle GT targets in unexplored regions using in-situ validated alteration mineral mapping and thermal anomaly detection. This has significant implication for the GT green energy industry as the developed methods and GT prospect map could aid the prefeasibility stage narrowing of targets for in-depth geophysical, geochemical, geothermometric and related surveys