Nonlinear unmixing of hyperspectral images: Models and algorithms

When considering the problem of unmixing hyperspectral images, most of the literature in the geoscience and image processing areas relies on the widely used linear mixing model (LMM). However, the LMM may be not valid, and other nonlinear models need to be considered, for instance, when there are multiscattering effects or intimate interactions. Consequently, over the last few years, several significant contributions have been proposed to overcome the limitations inherent in the LMM. In this article, we present an overview of recent advances in nonlinear unmixing modeling

Graph Construction for Hyperspectral Data Unmixing

This chapter presents graph construction for hyperspectral data and associated unmixing methods based on graph regularization. Graph is a ubiquitous mathematical tool for modeling relations between objects under study. In the context of hyperspectral image analysis, constructing graphs can be useful to relate pixels in order to perform corporative analysis instead of analyzing each pixel individually. In this chapter, we review fundamental elements of graphs and present different ways to construct graphs in both spatial and spectral senses for hyperspectral images. By incorporating a graph regularization, we then formulate a general hyperspectral unmixing problem that can be important for applications such as remote sensing and environment monitoring. Alternating direction method of multipliers (ADMM) is also presented as a generic tool for solving the formulated unmixing problems. Experiments validate the proposed scheme with both synthetic data and real remote sensing data

Tensor-based Hyperspectral Image Processing Methodology and its Applications in Impervious Surface and Land Cover Mapping

The emergence of hyperspectral imaging provides a new perspective for Earth observation, in addition to previously available orthophoto and multispectral imagery. This thesis focused on both the new data and new methodology in the field of hyperspectral imaging. First, the application of the future hyperspectral satellite EnMAP in impervious surface area (ISA) mapping was studied. During the search for the appropriate ISA mapping procedure for the new data, the subpixel classification based on nonnegative matrix factorization (NMF) achieved the best success. The simulated EnMAP image shows great potential in urban ISA mapping with over 85% accuracy. Unfortunately, the NMF based on the linear algebra only considers the spectral information and neglects the spatial information in the original image. The recent wide interest of applying the multilinear algebra in computer vision sheds light on this problem and raised the idea of nonnegative tensor factorization (NTF). This thesis found that the NTF has more advantages over the NMF when work with medium- rather than the high-spatial-resolution hyperspectral image. Furthermore, this thesis proposed to equip the NTF-based subpixel classification methods with the variations adopted from the NMF. By adopting the variations from the NMF, the urban ISA mapping results from the NTF were improved by ~2%. Lastly, the problem known as the curse of dimensionality is an obstacle in hyperspectral image applications. The majority of current dimension reduction (DR) methods are restricted to using only the spectral information, when the spatial information is neglected. To overcome this defect, two spectral-spatial methods: patch-based and tensor-patch-based, were thoroughly studied and compared in this thesis. To date, the popularity of the two solutions remains in computer vision studies and their applications in hyperspectral DR are limited. The patch-based and tensor-patch-based variations greatly improved the quality of dimension-reduced hyperspectral images, which then improved the land cover mapping results from them. In addition, this thesis proposed to use an improved method to produce an important intermediate result in the patch-based and tensor-patch-based DR process, which further improved the land cover mapping results

Characterizing Spatiotemporal Patterns of White Mold in Soybean across South Dakota Using Remote Sensing

Soybean is among the most important crops, cultivated primarily for beans, which are used for food, feed, and biofuel. According to FAO, the United States was the biggest soybeans producer in 2016. The main soybean producing regions in the United States are the Corn Belt and the lower Mississippi Valley. Despite its importance, soybean production is reduced by several diseases, among which Sclerotinia stem rot, also known as white mold, a fungal disease that is caused by the fungus Sclerotinia sclerotiorum is among the top 10 soybean diseases. The disease may attack several plants and considerably reduce yield. According to previous reports, environmental conditions corresponding to high yield potential are most conducive for white mold development. These conditions include cool temperature (12-24 °C), continued wet and moist conditions (70-120 h) generally resulting from rain, but the disease development requires the presence of a susceptible soybean variety. To better understand white mold development in the field, there is a need to investigate its spatiotemoral characteristics and provide accurate estimates of the damages that white mold may cause. Current and accurate data about white mold are scarce, especially at county or larger scale. Studies that explored the characteristics of white mold were generally field oriented and local in scale, and when the spectral characteristics were investigated, the authors used spectroradiometers that are not accessible to farmers and to the general public and are mostly used for experimental modeling. This study employed free remote sensing Landsat 8 images to quantify white mold in South Dakota. Images acquired in May and July were used to map the land cover and extract the soybean mask, while an image acquired in August was used to map and quantify white mold using the random forest algorithm. The land cover map was produced with an overall accuracy of 95% while white mold was mapped with an overall accuracy of 99%. White mold area estimates were respectively 132 km2, 88 km2, and 190 km2, representing 31%, 22% and 29% of the total soybean area for Marshall, Codington and Day counties. This study also explored the spatial characteristics of white mold in soybean fields and its impact on yield. The yield distribution exhibited a significant positive spatial autocorrelation (Moran’s I = 0.38, p-value \u3c 0.001 for Moody field, Moran’s I = 0.45, p-value \u3c 0.001, for Marshall field) as an evidence of clustering. Significant clusters could be observed in white mold areas (low-low clusters) or in healthy soybeans (high-high clusters). The yield loss caused by the worst white mold was estimated at 36% and 56% respectively for the Moody and the Marshall fields, with the most accurate loss estimation occurring between late August and early September. Finally, this study modeled the temporal evolution of white mold using a logistic regression analysis in which the white mold was modeled as a function of the NDVI. The model was successful, but further improved by the inclusion of the Day of the Year (DOY). The respective areas under the curves (AUC) were 0.95 for NDVI and 0.99 for NDVI+DOY models. A comparison of the NDVI temporal change between different sites showed that white mold temporal development was affected by the site location, which could be influenced by many local parameters such as the soil properties, the local elevation, management practices, or weather parameters. This study showed the importance of freely available remotely sensed satellite images in the estimation of crop disease areas and in the characterization of the spatial and temporal patterns of crop disease; this could help in timely disease damage assessment

Hyperspectral Observations for Atmospheric Remote Sensing: Instrumentation, Atmospheric Correction, and Spectral Unmixing

Hyperspectral instruments expand the spectral dimension of remote sensing measurements by collecting data in hundreds of contiguous wavelength channels. Spectrally resolved measurements can be used to derive science products for a diverse range of fields such as atmospheric science, geology, oceanography, ecology, climate monitoring, and agricultural science, to name a few. The spectral information collected by hyperspectral instruments enables more accurate retrievals of physical properties and detection of temporal changes. These advantages have led to an increasing number of active and planned hyperspectral instruments. This thesis describes methods for attributing hyperspectral radiation observations to physical sources.We developed, validated and characterized improvements to a hyperspectral instrument, the Solar Spectral Irradiance Monitor (SSIM), built at the University of Colorado Boulder’s Laboratory for Atmospheric and Space Physics. Contributions include the characterization of the optics’ angular response, testing of an optics stabilizing platform and the development and testing of a spectrometer thermal control system. This instrument was then deployed on an aircraft for a field study with the National Ecological Observatory Network (NEON). SSIM measurements of upwelling and downwelling irradiance were used in conjunction with NEON’s Imaging Spectrometer to enable atmospheric correction of imagery collected below cloud layers.We developed a numerical spectral unmixing algorithm, Informed Non-Negative Matrix Factorization (INMF), to separate contributions to hyperspectral imagery from distinct physical sources such as surface reflectance, atmospheric absorption, molecular scattering, and aerosol scattering. INMF was tailored for hyperspectral applications by introducing algorithmic constraints based on the physics of radiative transfer. INMF was tested using imagery collected by the Hyperspectral Imager for the Coastal Ocean (HICO). To validate the method INMF results were compared to model-based atmospheric correction results. We demonstrate possible applications of INMF by presenting the retrieval of two physical properties, aerosol attributed radiance and seafloor depth. The retrievals were evaluated by comparing INMF output to independent retrievals of aerosol properties from the Moderate Resolution Imaging Spectroradiometer (MODIS) and in-situ seafloor depth measurements from the U.S. Coastal Relief Model. In these comparisons INMF shows promise for retrieving both physical properties, and may be improved with physics-based constraints on the seafloor and aerosol source spectra

Automatic nuclei segmentation in H&E stained breast cancer histopathology images

The introduction of fast digital slide scanners that provide whole slide images has led to a revival of interest in image analysis applications in pathology. Segmentation of cells and nuclei is an important first step towards automatic analysis of digitized microscopy images. We therefore developed an automated nuclei segmentation method that works with hematoxylin and eosin (H&E) stained breast cancer histopathology images, which represent regions of whole digital slides. The procedure can be divided into four main steps: 1) pre-processing with color unmixing and morphological operators, 2) marker-controlled watershed segmentation at multiple scales and with different markers, 3) post-processing for rejection of false regions and 4) merging of the results from multiple scales. The procedure was developed on a set of 21 breast cancer cases (subset A) and tested on a separate validation set of 18 cases (subset B). The evaluation was done in terms of both detection accuracy (sensitivity and positive predictive value) and segmentation accuracy (Dice coefficient). The mean estimated sensitivity for subset A was 0.875 (±0.092) and for subset B 0.853 (±0.077). The mean estimated positive predictive value was 0.904 (±0.075) and 0.886 (±0.069) for subsets A and B, respectively. For both subsets, the distribution of the Dice coefficients had a high peak around 0.9, with the vast majority of segmentations having values larger than 0.8. © 2013 Veta et al

Spectra of a shallow sea-unmixing for class identification and monitoring of coastal waters

Ocean colour-based monitoring of water masses is a promising alternative to monitoring concentrations in heterogeneous coastal seas. Fuzzy methods, such as spectral unmixing, are especially well suited for recognition of water masses from their remote sensing reflectances. However, such models have not yet been applied for water classification and monitoring. In this study, a fully constrained endmember model with simulated endmembers was developed for water class identification in the shallow Wadden Sea and adjacent German Bight. Its performance was examined on in situ measured reflectances and on MERIS satellite data. Water classification by means of unmixing reflectance spectra proved to be successful. When the endmember model was applied to MERIS data, it was able to visualise well-known spatial, tidal, seasonal, and wind-related variations in optical properties in the heterogeneous Wadden Sea. Analyses show that the method is insensitive to small changes in endmembers. Therefore, it can be applied in similar coastal areas. For use in open ocean situations or coastal or inland waters with other specific inherent optical properties, re-simulation of the endmember spectra with local optical properties is required. However, such an adaptation requires only a limited number of local in situ measurements

A Geostatistical Filter for Remote Sensing Image Enhancement

In this paper, a new method was investigated to enhance remote sensing images by alleviating the point spread function (PSF) effect. The PSF effect exists ubiquitously in remotely sensed imagery. As a result, image quality is greatly affected, and this imposes a fundamental limit on the amount of information captured in remotely sensed images. A geostatistical filter was proposed to enhance image quality based on a downscaling-then-upscaling scheme. The difference between this method and previous methods is that the PSF is represented by breaking the pixel down into a series of sub-pixels, facilitating downscaling using the PSF and then upscaling using a square-wave response. Thus, the sub-pixels allow disaggregation as an attempt to remove the PSF effect. Experimental results on simulated and real data sets both suggest that the proposed filter can enhance the original images by reducing the PSF effect and quantify the extent to which this is possible. The predictions using the new method outperform the original coarse PSF-contaminated imagery as well as a benchmark method. The proposed method represents a new solution to compensate for the limitations introduced by remote sensors (i.e., hardware) using computer techniques (i.e., software). The method has widespread application value, particularly for applications based on remote sensing image analysis

Endmember-Guided Unmixing Network (EGU-Net): A General Deep Learning Framework for Self-Supervised Hyperspectral Unmixing

Over the past decades, enormous efforts have been made to improve the performance of linear or nonlinear mixing models for hyperspectral unmixing (HU), yet their ability to simultaneously generalize various spectral variabilities (SVs) and extract physically meaningful endmembers still remains limited due to the poor ability in data fitting and reconstruction and the sensitivity to various SVs. Inspired by the powerful learning ability of deep learning (DL), we attempt to develop a general DL approach for HU, by fully considering the properties of endmembers extracted from the hyperspectral imagery, called endmember-guided unmixing network (EGU-Net). Beyond the alone autoencoder-like architecture, EGU-Net is a two-stream Siamese deep network, which learns an additional network from the pure or nearly pure endmembers to correct the weights of another unmixing network by sharing network parameters and adding spectrally meaningful constraints (e.g., nonnegativity and sum-to-one) toward a more accurate and interpretable unmixing solution. Furthermore, the resulting general framework is not only limited to pixelwise spectral unmixing but also applicable to spatial information modeling with convolutional operators for spatial–spectral unmixing. Experimental results conducted on three different datasets with the ground truth of abundance maps corresponding to each material demonstrate the effectiveness and superiority of the EGU-Net over state-of-the-art unmixing algorithms. The codes will be available from the website: https://github.com/danfenghong/IEEE_TNNLS_EGU-Net