Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches

Imaging spectrometers measure electromagnetic energy scattered in their instantaneous field view in hundreds or thousands of spectral channels with higher spectral resolution than multispectral cameras. Imaging spectrometers are therefore often referred to as hyperspectral cameras (HSCs). Higher spectral resolution enables material identification via spectroscopic analysis, which facilitates countless applications that require identifying materials in scenarios unsuitable for classical spectroscopic analysis. Due to low spatial resolution of HSCs, microscopic material mixing, and multiple scattering, spectra measured by HSCs are mixtures of spectra of materials in a scene. Thus, accurate estimation requires unmixing. Pixels are assumed to be mixtures of a few materials, called endmembers. Unmixing involves estimating all or some of: the number of endmembers, their spectral signatures, and their abundances at each pixel. Unmixing is a challenging, ill-posed inverse problem because of model inaccuracies, observation noise, environmental conditions, endmember variability, and data set size. Researchers have devised and investigated many models searching for robust, stable, tractable, and accurate unmixing algorithms. This paper presents an overview of unmixing methods from the time of Keshava and Mustard's unmixing tutorial [1] to the present. Mixing models are first discussed. Signal-subspace, geometrical, statistical, sparsity-based, and spatial-contextual unmixing algorithms are described. Mathematical problems and potential solutions are described. Algorithm characteristics are illustrated experimentally.Comment: This work has been accepted for publication in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensin

The role of multispectral image transformations in change detection

In recent decades, remote sensing techniques have been applied as a powerful tool to provide temporal variation of Earth related phenomena. To understand the impact of climate change and human activities on Earth water resources, monitoring the variation of water storage over a long period is a primary issue. On the other hand, this variation is fundamental to estimate the hydroelectric power generation variation and fresh water recreation. Among the spaceborne sensors, optical and SAR satellite imagery provide the opportunity to monitor the spatial change in coastline, which can serve as a way to determine the water extent repeatedly in an appropriate time interval. While water absorbs nearly all the sunlight in near-infrared wavelength, the water bodies appear very dark at this band in an optical image. So applying a threshold on the image histogram is a common way to build the water mask. Despite its straightforward procedure, precise distinctions among water bodies may not be possible in some regions or seasons because of the complicated relationship between water and land and also because of the effect of vegetation. As well as thresholding, other change detection method are widely used to monitor the extent of water bodies. Multispectral transformation analyses like PCA and CCA are able to highlight the important information about the change in all spectral bands and also to reduce the dimension of data. In this way, their potential to improve the quality of satellite images and also reduce the noise level must be assessed. In this thesis, we have two general objectives. First improving the quality of the multispectral image applying PCA on spectral bands and then reconstructing the image using just a certain number of PCs. Number of the PCs and the selecting strategy appropriate PCs are the main challenge of this procedure. Highlighting the change between two multispectral images applying transformation like PCA and CCA is the other objective. Interpreting the transformed images are not straightforward and in most cases, comparing with the original images could be a solution. We examine different scenarios to examine the performance of the spectral transformations in change detection

Improved Time Series Land Cover Classification by Missing-Observation-Adaptive Nonlinear Dimensionality Reduction

Dimensionality reduction (DR) is a widely used technique to address the curse of dimensionality when high-dimensional remotely sensed data, such as multi-temporal or hyperspectral imagery, are analyzed. Nonlinear DR algorithms, also referred to as manifold learning algorithms, have been successfully applied to hyperspectral data and provide improved performance compared with linear DR algorithms. However, DR algorithms cannot handle missing data that are common in multi-temporal imagery. In this paper, the Laplacian Eigenmaps (LE) nonlinear DR algorithm was refined for application to multi-temporal satellite data with large proportions of missing data. Refined LE algorithms were applied to 52-week Landsat time series for three study areas in Texas, Kansas and South Dakota that have different amounts of missing data and land cover complexity. A series of random forest classifications were conducted on the refined LE DR bands using varying proportions of training data provided by the United States Department of Agriculture (USDA) National Agricultural Statistics Service (NASS) Cropland Data Layer (CDL); these classification results were compared with conventional metrics-based random forest classifications. Experimental results show that compared with the metrics approach, higher per-class and overall classification accuracies were obtained using the refined LE DR bands of multispectral reflectance time series, and the number of training samples required to achieve a given degree of classification accuracy was also reduced. The approach of applying the refined LE to multispectral reflectance time series is promising in that it is automated and provides dimensionality-reduced data with desirable classification properties. The implications of this research and possibilities for future algorithm development and application are discussed

Bayesian Fusion of Multi-Band Images

International audienceThis paper presents a Bayesian fusion technique for remotely sensed multi-band images. The observed images are related to the high spectral and high spatial resolution image to be recovered through physical degradations, e.g., spatial and spectral blurring and/or subsampling defined by the sensor characteristics. The fusion problem is formulated within a Bayesian estimation framework. An appropriate prior distribution exploiting geometrical considerations is introduced. To compute the Bayesian estimator of the scene of interest from its posterior distribution, a Markov chain Monte Carlo algorithm is designed to generate samples asymptotically distributed according to the target distribution. To efficiently sample from this high-dimension distribution, a Hamiltonian Monte Carlo step is introduced within a Gibbs sampling strategy. The efficiency of the proposed fusion method is evaluated with respect to several state-of-the-art fusion techniques

Detection of land cover changes in El Rawashda forest, Sudan: A systematic comparison: Detection of land cover changes in El Rawashda forest, Sudan: A systematic comparison

The primary objective of this research was to evaluate the potential for monitoring forest change using Landsat ETM and Aster data. This was accomplished by performing eight change detection algorithms: pixel post-classification comparison (PCC), image differencing Normalized Difference Vegetation Index (NDVI), Soil-Adjusted Vegetation Index (SAVI), Transformed Difference Vegetation Index (TDVI), principal component analysis (PCA), multivariate alteration detection (MAD), change vector analysis (CVA) and tasseled cap analysis (TCA). Methods, Post-Classification Comparison and vegetation indices are straightforward techniques and easy to apply. In this study the simplified classification with only 4 forest classes namely close forest, open forest, bare land and grass land was used The overall classification accuracy obtained were 88.4%, 91.9% and 92.1% for the years 2000, 2003 and 2006 respectively. The Tasseled Cap green layer (GTC) composite of the three images was proposed to detect the change in vegetation of the study area. We found that the RBG-TCG worked better than RGBNDVI. For instance, the RBG-TCG detected some areas of changes that RGB-NDVI failed to detect them, moreover RBG-TCG displayed different changed areas with more strong colours. Change vector analysis (CVA) based on Tasseled Cap transformation (TCT) was also applied for detecting and characterizing land cover change. The results support the CVA approach to change detection. The calculated date to date change vectors contained useful information, both in their magnitude and their direction. A powerful tool for time series analysis is the principal components analysis (PCA). This method was tested for change detection in the study area by two ways: Multitemporal PCA and Selective PCA. Both methods found to offer the potential for monitoring forest change detection. A recently proposed approach, the multivariate alteration detection (MAD), in combination with a posterior maximum autocorrelation factor transformation (MAF) was used to demonstrate visualization of vegetation changes in the study area. The MAD transformation provides a way of combining different data types that found to be useful in change detection. Accuracy assessment is an important final step addressed in the study to evaluate the different change detection techniques. A quantitative accuracy assessment at level of change/no change pixels was performed to determine the threshold value with the highest accuracy. Among the various accuracy assessment methods presented the highest accuracy was obtained using the post-classification comparison based on supervised classification of each two time periods (2000 -2003 and 2003-2006), which were 90.6% and 87% consequently

LANDSAT-D investigations in snow hydrology

Work undertaken during the contract and its results are described. Many of the results from this investigation are available in journal or conference proceedings literature - published, accepted for publication, or submitted for publication. For these the reference and the abstract are given. Those results that have not yet been submitted separately for publication are described in detail. Accomplishments during the contract period are summarized as follows: (1) analysis of the snow reflectance characteristics of the LANDSAT Thematic Mapper, including spectral suitability, dynamic range, and spectral resolution; (2) development of a variety of atmospheric models for use with LANDSAT Thematic Mapper data. These include a simple but fast two-stream approximation for inhomogeneous atmospheres over irregular surfaces, and a doubling model for calculation of the angular distribution of spectral radiance at any level in an plane-parallel atmosphere; (3) incorporation of digital elevation data into the atmospheric models and into the analysis of the satellite data; and (4) textural analysis of the spatial distribution of snow cover

Navigating the roadblocks to spectral color reproduction: data-efficient multi-channel imaging and spectral color management

Commercialization of spectral imaging for color reproduction will require the identification and traversal of roadblocks to its success. Among the drawbacks associated with spectral reproduction is a tremendous increase in data capture bandwidth and processing throughput. Methods are proposed for attenuating these increases with data-efficient methods based on adaptive multi-channel visible-spectrum capture and with low-dimensional approaches to spectral color management. First, concepts of adaptive spectral capture are explored. Current spectral imaging approaches require tens of camera channels although previous research has shown that five to nine channels can be sufficient for scenes limited to pre-characterized spectra. New camera systems are proposed and evaluated that incorporate adaptive features reducing capture demands to a similar few channels with the advantage that a priori information about expected scenes is not needed at the time of system design. Second, proposals are made to address problems arising from the significant increase in dimensionality within the image processing stage of a spectral image workflow. An Interim Connection Space (ICS) is proposed as a reduced dimensionality bottleneck in the processing workflow allowing support of spectral color management. In combination these investigations into data-efficient approaches improve two critical points in the spectral reproduction workflow: capture and processing. The progress reported here should help the color reproduction community appreciate that the route to data-efficient multi-channel visible spectrum imaging is passable and can be considered for many imaging modalities

Living up to the hype of hyperspectral aquatic remote sensing: science, resources and outlook

Intensifying pressure on global aquatic resources and services due to population growth and climate change is inspiring new surveying technologies to provide science-based information in support of management and policy strategies. One area of rapid development is hyperspectral remote sensing: imaging across the full spectrum of visible and infrared light. Hyperspectral imagery contains more environmentally meaningful information than panchromatic or multispectral imagery and is poised to provide new applications relevant to society, including assessments of aquatic biodiversity, habitats, water quality, and natural and anthropogenic hazards. To aid in these advances, we provide resources relevant to hyperspectral remote sensing in terms of providing the latest reviews, databases, and software available for practitioners in the field. We highlight recent advances in sensor design, modes of deployment, and image analysis techniques that are becoming more widely available to environmental researchers and resource managers alike. Systems recently deployed on space- and airborne platforms are presented, as well as future missions and advances in unoccupied aerial systems (UAS) and autonomous in-water survey methods. These systems will greatly enhance the ability to collect interdisciplinary observations on-demand and in previously inaccessible environments. Looking forward, advances in sensor miniaturization are discussed alongside the incorporation of citizen science, moving toward open and FAIR (findable, accessible, interoperable, and reusable) data. Advances in machine learning and cloud computing allow for exploitation of the full electromagnetic spectrum, and better bridging across the larger scientific community that also includes biogeochemical modelers and climate scientists. These advances will place sophisticated remote sensing capabilities into the hands of individual users and provide on-demand imagery tailored to research and management requirements, as well as provide critical input to marine and climate forecasting systems. The next decade of hyperspectral aquatic remote sensing is on the cusp of revolutionizing the way we assess and monitor aquatic environments and detect changes relevant to global communities

Detection of land cover changes in El Rawashda forest, Sudan: A systematic comparison: Detection of land cover changes in El Rawashda forest, Sudan: A systematic comparison

The primary objective of this research was to evaluate the potential for monitoring forest change using Landsat ETM and Aster data. This was accomplished by performing eight change detection algorithms: pixel post-classification comparison (PCC), image differencing Normalized Difference Vegetation Index (NDVI), Soil-Adjusted Vegetation Index (SAVI), Transformed Difference Vegetation Index (TDVI), principal component analysis (PCA), multivariate alteration detection (MAD), change vector analysis (CVA) and tasseled cap analysis (TCA). Methods, Post-Classification Comparison and vegetation indices are straightforward techniques and easy to apply. In this study the simplified classification with only 4 forest classes namely close forest, open forest, bare land and grass land was used The overall classification accuracy obtained were 88.4%, 91.9% and 92.1% for the years 2000, 2003 and 2006 respectively. The Tasseled Cap green layer (GTC) composite of the three images was proposed to detect the change in vegetation of the study area. We found that the RBG-TCG worked better than RGBNDVI. For instance, the RBG-TCG detected some areas of changes that RGB-NDVI failed to detect them, moreover RBG-TCG displayed different changed areas with more strong colours. Change vector analysis (CVA) based on Tasseled Cap transformation (TCT) was also applied for detecting and characterizing land cover change. The results support the CVA approach to change detection. The calculated date to date change vectors contained useful information, both in their magnitude and their direction. A powerful tool for time series analysis is the principal components analysis (PCA). This method was tested for change detection in the study area by two ways: Multitemporal PCA and Selective PCA. Both methods found to offer the potential for monitoring forest change detection. A recently proposed approach, the multivariate alteration detection (MAD), in combination with a posterior maximum autocorrelation factor transformation (MAF) was used to demonstrate visualization of vegetation changes in the study area. The MAD transformation provides a way of combining different data types that found to be useful in change detection. Accuracy assessment is an important final step addressed in the study to evaluate the different change detection techniques. A quantitative accuracy assessment at level of change/no change pixels was performed to determine the threshold value with the highest accuracy. Among the various accuracy assessment methods presented the highest accuracy was obtained using the post-classification comparison based on supervised classification of each two time periods (2000 -2003 and 2003-2006), which were 90.6% and 87% consequently