Contextual Detection of Anomalies in Hyperspectral Images

The majority of anomaly detectors in Hyperspectral Imaging use only the statistical aspects of the spectral readings in the image. These detectors fail to use the spatial context that is contained in the images. The use of this information can yield detectors that out perform their spatially myopic counterparts. To demonstrate this, we will use an independent component analysis based detector, autonomous global anomaly detector (AutoGAD), developed at AFIT augmented to account for the spatial context of the detected anomalies. Through the use of segmentation algorithms, the anomalies identified are formed into regions. The size and shape of these regions are then used to decide if the region is anomalous or not. A Bayesian Belief Network structure is used to update a posterior probability of the region being anomalous

Object Detection in High Resolution Aerial Images and Hyperspectral Remote Sensing Images

With rapid developments in satellite and sensor technologies, there has been a dramatic increase in the availability of remotely sensed images. However, the exploration of these images still involves a tremendous amount of human interventions, which are tedious, time-consuming, and inefficient. To help imaging experts gain a complete understanding of the images and locate the objects of interest in a more accurate and efficient way, there is always an urgent need for developing automatic detection algorithms. In this work, we delve into the object detection problems in remote sensing applications, exploring the detection algorithms for both hyperspectral images (HSIs) and high resolution aerial images. In the first part, we focus on the subpixel target detection problem in HSIs with low spatial resolutions, where the objects of interest are much smaller than the image pixel spatial resolution. To this end, we explore the detection frameworks that integrate image segmentation techniques in designing the matched filters (MFs). In particular, we propose a novel image segmentation algorithm to identify the spatial-spectral coherent image regions, from which the background statistics were estimated for deriving the MFs. Extensive experimental studies were carried out to demonstrate the advantages of the proposed subpixel target detection framework. Our studies show the superiority of the approach when comparing to state-of-the-art methods. The second part of the thesis explores the object based image analysis (OBIA) framework for geospatial object detection in high resolution aerial images. Specifically, we generate a tree representation of the aerial images from the output of hierarchical image segmentation algorithms and reformulate the object detection problem into a tree matching task. We then proposed two tree-matching algorithms for the object detection framework. We demonstrate the efficiency and effectiveness of the proposed tree-matching based object detection framework. In the third part, we study object detection in high resolution aerial images from a machine learning perspective. We investigate both traditional machine learning based framework and end-to-end convolutional neural network (CNN) based approach for various object detection tasks. In the traditional detection framework, we propose to apply the Gaussian process classifier (GPC) to train an object detector and demonstrate the advantages of the probabilistic classification algorithm. In the CNN based approach, we proposed a novel scale transfer module that generates enhanced feature maps for object detection. Our results show the efficiency and competitiveness of the proposed algorithms when compared to state-of-the-art counterparts

Matched Filter Stochastic Background Characterization for Hyperspectral Target Detection

Algorithms exploiting hyperspectral imagery for target detection have continually evolved to provide improved detection results. Adaptive matched filters can be used to locate spectral targets by modeling scene background as either structured (geometric) with a set of endmembers (basis vectors) or as unstructured (stochastic) with a covariance or correlation matrix. These matrices are often calculated using all available pixels in a data set. In unstructured background research, various techniques for improving upon scene-wide methods have been developed, each involving either the removal of target signatures from the background model or the segmentation of image data into spatial or spectral subsets. Each of these methods increase the detection signal-to-background ratio (SBR) and the multivariate normality (MVN) of the data from which background statistics are calculated, thus increasing separation between target and non-target species in the detection statistic and ultimately improving thresholded target detection results. Such techniques for improved background characterization are widely practiced but not well documented or compared. This paper provides a review and comparison of methods in target exclusion, spatial subsetting and spectral pre-clustering, and introduces a new technique which combines these methods. The analysis provides insight into the merit of employing unstructured background characterization techniques, as well as limitations for their practical application

Anomaly detection for replacement model in hyperspectral imaging

In this paper we consider Anomaly Detection in the hyperspectral context, and we extend the popular RX detector, initially designed under the standard additive model, to the replacement model case. Indeed, in this more realistic framework, the target, if present, is supposed to replace a part of the background. We show how to estimate this background power variation to improve the standard RX scheme. The obtained Replacement RX (RRX) is shown to be closed-form and outperforms the standard RX on a real data benchmark experiment

Multispectral and Hyperspectral Remote Sensing Data for Mineral Exploration and Environmental Monitoring of Mined Areas

In recent decades, remote sensing technology has been incorporated in numerous mineral exploration projects in metallogenic provinces around the world. Multispectral and hyperspectral sensors play a significant role in affording unique data for mineral exploration and environmental hazard monitoring. This book covers the advances of remote sensing data processing algorithms in mineral exploration, and the technology can be used in monitoring and decision-making in relation to environmental mining hazard. This book presents state-of-the-art approaches on recent remote sensing and GIS-based mineral prospectivity modeling, offering excellent information to professional earth scientists, researchers, mineral exploration communities and mining companies

Levee Slide Detection using Synthetic Aperture Radar Magnitude and Phase

The objectives of this research are to support the development of state-of-the-art methods using remotely sensed data to detect slides or anomalies in an efficient and cost-effective manner based on the use of SAR technology. Slough or slump slides are slope failures along a levee, which leave areas of the levee vulnerable to seepage and failure during high water events. This work investigates the facility of detecting the slough slides on an earthen levee with different types of polarimetric Synthetic Aperture Radar (polSAR) imagery. The source SAR imagery is fully quad-polarimetric L-band data from the NASA Jet Propulsion Laboratory’s (JPL’s) Uninhabited Aerial Vehicle Synthetic Aperture Radar (UAVSAR). The study area encompasses a portion of the levees of the lower Mississippi river, located in Mississippi, United States. The obtained classification results reveal that the polSAR data unsupervised classification with features extraction produces more appropriate results than the unsupervised classification with no features extraction. Obviously, supervised classification methods provide better classification results compared to the unsupervised methods. The anomaly identification is good with these results and was improved with the use of a majority filter. The classification accuracy is further improved with a morphology filter. The classification accuracy is significantly improved with the use of GLCM features. The classification results obtained for all three cases (magnitude, phase, and complex data), with classification accuracies for the complex data being higher, indicate that the use of synthetic aperture radar in combination with remote sensing imagery can effectively detect anomalies or slides on an earthen levee. For all the three samples it consistently shows that the accuracies for the complex data are higher when compared to those from the magnitude and phase data alone. The tests comparing complex data features to magnitude and phase data alone, and full complex data, and use of post-processing filter, all had very high accuracy. Hence we included more test samples to validate and distinguish results

NASA's surface biology and geology designated observable: A perspective on surface imaging algorithms

The 2017–2027 National Academies' Decadal Survey, Thriving on Our Changing Planet, recommended Surface Biology and Geology (SBG) as a “Designated Targeted Observable” (DO). The SBG DO is based on the need for capabilities to acquire global, high spatial resolution, visible to shortwave infrared (VSWIR; 380–2500 nm; ~30 m pixel resolution) hyperspectral (imaging spectroscopy) and multispectral midwave and thermal infrared (MWIR: 3–5 μm; TIR: 8–12 μm; ~60 m pixel resolution) measurements with sub-monthly temporal revisits over terrestrial, freshwater, and coastal marine habitats. To address the various mission design needs, an SBG Algorithms Working Group of multidisciplinary researchers has been formed to review and evaluate the algorithms applicable to the SBG DO across a wide range of Earth science disciplines, including terrestrial and aquatic ecology, atmospheric science, geology, and hydrology. Here, we summarize current state-of-the-practice VSWIR and TIR algorithms that use airborne or orbital spectral imaging observations to address the SBG DO priorities identified by the Decadal Survey: (i) terrestrial vegetation physiology, functional traits, and health; (ii) inland and coastal aquatic ecosystems physiology, functional traits, and health; (iii) snow and ice accumulation, melting, and albedo; (iv) active surface composition (eruptions, landslides, evolving landscapes, hazard risks); (v) effects of changing land use on surface energy, water, momentum, and carbon fluxes; and (vi) managing agriculture, natural habitats, water use/quality, and urban development. We review existing algorithms in the following categories: snow/ice, aquatic environments, geology, and terrestrial vegetation, and summarize the community-state-of-practice in each category. This effort synthesizes the findings of more than 130 scientists