Spectral Unmixing with Multiple Dictionaries

Spectral unmixing aims at recovering the spectral signatures of materials, called endmembers, mixed in a hyperspectral or multispectral image, along with their abundances. A typical assumption is that the image contains one pure pixel per endmember, in which case spectral unmixing reduces to identifying these pixels. Many fully automated methods have been proposed in recent years, but little work has been done to allow users to select areas where pure pixels are present manually or using a segmentation algorithm. Additionally, in a non-blind approach, several spectral libraries may be available rather than a single one, with a fixed number (or an upper or lower bound) of endmembers to chose from each. In this paper, we propose a multiple-dictionary constrained low-rank matrix approximation model that address these two problems. We propose an algorithm to compute this model, dubbed M2PALS, and its performance is discussed on both synthetic and real hyperspectral images

Multiple Endmember Spectral Mixture Analysis (MESMA) Applied to the Study of Habitat Diversity in the Fine-Grained Landscapes of the Cantabrian Mountains

P. 1-19 ArtículoHeterogeneous and patchy landscapes where vegetation and abiotic factors vary at small spatial scale (fine-grained landscapes) represent a challenge for habitat diversity mapping using remote sensing imagery. In this context, techniques of spectral mixture analysis may have an advantage over traditional methods of land cover classification because they allow to decompose the spectral signature of a mixed pixel into several endmembers and their respective abundances. In this work, we present the application of Multiple Endmember Spectral Mixture Analysis (MESMA) to quantify habitat diversity and assess the compositional turnover at different spatial scales in the fine-grained landscapes of the Cantabrian Mountains (northwestern Iberian Peninsula). A Landsat-8 OLI scene and high-resolution orthophotographs (25 cm) were used to build a region-specific spectral library of the main types of habitats in this region (arboreal vegetation; shrubby vegetation; herbaceous vegetation; rocks–soil and water bodies). We optimized the spectral library with the Iterative Endmember Selection (IES) method and we applied MESMA to unmix the Landsat scene into five fraction images representing the five defined habitats (root mean square error, RMSE 0.025 in 99.45% of the pixels). The fraction images were validated by linear regressions using 250 reference plots from the orthophotographs and then used to calculate habitat diversity at the pixel ( -diversity: 30 30 m), landscape (-diversity: 1 1 km) and regional ("-diversity: 110 33 km) scales and thecompositional turnover ( - and -diversity) according to Simpson’s diversity index. Richness and evenness were also computed. Results showed that fraction images were highly related to reference data (R2 0.73 and RMSE 0.18). In general, our findings indicated that habitat diversity was highly dependent on the spatial scale, with values for the Simpson index ranging from 0.20 0.22 for -diversity to 0.60 0.09 for -diversity and 0.72 0.11 for "-diversity. Accordingly, we found -diversity to be higher than -diversity. This work contributes to advance in the estimation of ecological diversity in complex landscapes, showing the potential of MESMA to quantify habitat diversity in a comprehensive way using Landsat imageryS

Mapping Impervious Surface Using Phenology-Integrated and Fisher Transformed Linear Spectral Mixture Analysis

The impervious surface area (ISA) is a key indicator of urbanization, which brings out serious adverse environmental and ecological consequences. The ISA is often estimated from remotely sensed data via spectral mixture analysis (SMA). However, accurate extraction of ISA using SMA is compromised by two major factors, endmember spectral variability and plant phenology. This study developed a novel approach that incorporates phenology with Fisher transformation into a conventional linear spectral mixture analysis (PF-LSMA) to address these challenges. Four endmembers, high albedo, low albedo, evergreen vegetation, and seasonally exposed soil (H-L-EV-SS) were identified for PF-LSMA, considering the phenological characteristic of Shanghai. Our study demonstrated that the PF-LSMA effectively reduced the within-endmember spectral signature variation and accounted for the endmember phenology effects, and thus well-discriminated impervious surface from seasonally exposed soil, enhancing the accuracy of ISA extraction. The ISA fraction map produced by PF-LSMA (RMSE = 0.1112) outperforms the single-date image Fisher transformed unmixing method (F-LSMA) (RMSE = 0.1327) and the other existing major global ISA products. The PF-LSMA was implemented on the Google Earth Engine platform and thus can be easily adapted to extract ISA in other places with similar climate conditions.Peer Reviewe

Improved boreal vegetation mapping using imaging spectroscopy to aid wildfire management, Interior Alaska

Thesis (Ph.D.) University of Alaska Fairbanks, 2023Wildfires are a natural and essential part of Alaska ecosystems, but excessive wildfires pose a risk to the ecosystem's health and diversity, as well as to human life and property. To manage wildfires effectively, vegetation/fuel maps play a critical role in identifying high-risk areas and allocating resources for prevention, suppression, and recovery efforts. Furthermore, vegetation/fuel maps are an important input for fire behavior models, along with weather and topography data. By predicting fire behavior, such as spread rate, intensity, and direction, fuel models allow fire managers to make informed decisions about wildfire suppression, management, and prevention. Traditionally used vegetation/fuel maps in Alaska are inadequate due to a lack of detailed information since they are primarily generated using coarser resolution (30m) multispectral data. Hyperspectral remote sensing offers an efficient approach for better characterization of forest vegetation due to the narrow bandwidth and finer spatial resolution. However, the high cost associated with data acquisition remains a significant challenge to the widespread application of hyperspectral data. The aim of this research is to create accurate and detailed vegetation maps and upscale them for the boreal region of Alaska. The study involves hyperspectral data simulation using Airborne Visible InfraRed Imaging Spectrometer - Next Generation (AVIRIS-NG) data and publicly available Sentinel-2 multispectral data, ground spectra convolved to Sentinel-2 and AVIRIS-NG using the spectral response function of each sensor. Simulated data captured the minute details found in the real AVIRIS-NG data and were classified to map vegetation. Using the ground data from Bonanza Creek Long-Term Ecological Research sites, we compared the new maps with the two existing map products (the LANDFIRE's Existing Vegetation Type (EVT) and Alaska Vegetation and Wetland Composite). The maps generated using simulated data showed an improvement of 33% in accuracy and are more detailed than existing map products. In addition to fuel maps, we performed sub-pixel level mapping to generate a needleleaf fraction map, which serves fire management needs since needleleaf species are highly flammable. However, validating the sub-pixel product was challenging. To overcome this, we devised a novel validation method incorporating high-resolution airborne hyperspectral data (1m) and ground data. The study addresses the limitations of traditional fuel/vegetation maps by providing a more detailed and accurate representation of vegetation/fuel in Alaska. The methods and findings advance fuel and vegetation mapping research in Alaska and offer a novel pathway to generate detailed fuel maps for boreal Alaska to aid wildfire management.Alaska Established Program to Stimulate Competitive Research (EPSCoR), AmericaView, and the College of Natural Science and Mathematics, National Science Foundation award OIA-1757348, State of Alaska and the U.S. Geological Survey Grant/Cooperative Agreement No. G18AP0007

Mapping Impervious Surface Using Phenology-Integrated and Fisher Transformed Linear Spectral Mixture Analysis

The impervious surface area (ISA) is a key indicator of urbanization, which brings out serious adverse environmental and ecological consequences. The ISA is often estimated from remotely sensed data via spectral mixture analysis (SMA). However, accurate extraction of ISA using SMA is compromised by two major factors, endmember spectral variability and plant phenology. This study developed a novel approach that incorporates phenology with Fisher transformation into a conventional linear spectral mixture analysis (PF-LSMA) to address these challenges. Four endmembers, high albedo, low albedo, evergreen vegetation, and seasonally exposed soil (H-L-EV-SS) were identified for PF-LSMA, considering the phenological characteristic of Shanghai. Our study demonstrated that the PF-LSMA effectively reduced the within-endmember spectral signature variation and accounted for the endmember phenology effects, and thus well-discriminated impervious surface from seasonally exposed soil, enhancing the accuracy of ISA extraction. The ISA fraction map produced by PF-LSMA (RMSE = 0.1112) outperforms the single-date image Fisher transformed unmixing method (F-LSMA) (RMSE = 0.1327) and the other existing major global ISA products. The PF-LSMA was implemented on the Google Earth Engine platform and thus can be easily adapted to extract ISA in other places with similar climate conditions

Mapping urban surface materials with imaging spectroscopy data on different spatial scales

This work focuses on the development of methods for mapping urban surface materials by means of imaging spectroscopy data with different spatial resolution. General findings from this work represent a sensor- and site-independent framework for the automated extraction of spectrally pure pixels using an urban image spectral library while coping with its potential incompleteness. The extraction of spectrally pure pixels serves as a basic prerequisite for the subsequent use of image analysis methods to obtain detailed urban surface material maps. These material maps enabled the determination of gradual material transitions that were finally related to complex spectral mixtures resulting from 30 m spatial resolution imaging spectroscopy data to analyse typical material compositions within certain administrative units. The findings demonstrate the great potential of using upcoming spaceborne imaging spectroscopy data for a regular area-wide mapping of surface materials in urban areas. Im Fokus dieser Arbeit stand die Entwicklung von Methoden zur Kartierung urbaner Oberflächenmaterialien mittels abbildender Spektroskopiedaten unterschiedlicher räumlicher Auflösung. Das vorgestellte Konzept zur automatisierten sensor- und ortsunabhängigen Extraktion spektral reiner Pixel aus flugzeuggetragenen Fernerkundungsdaten berücksichtigt dabei die mögliche Unvollständigkeit einer urbanen Bildspektralbibliothek. Die Extraktion spektral reiner Pixel dient als Grundvoraussetzung für den späteren Einsatz von Bildanalyseverfahren zur Gewinnung detaillierter Kartierungen urbaner Oberflächenmaterialien. Aus diesen sind Materialgradienten ableitbar, die mit den komplexen Spektralmischungen aus Hyperspektraldaten mit 30 m räumlicher Auflösung in Verbindung gebracht wurden. Die Analyse typischer Materialzusammensetzungen innerhalb städtischer Verwaltungseinheiten zeigt das enorme Potential zukünftiger Hyperspektralsatelliten für die Erfassung des Materialvorkommens von Städten

Endmember learning with k-means through SCD model in hyperspectral scene reconstructions

This paper proposes a simple yet effective method for improving the efficiency of sparse coding dictionary learning (DL) with an implication of enhancing the ultimate usefulness of compressive sensing (CS) technology for practical applications, such as in hyperspectral imaging (HSI) scene reconstruction. CS is the technique which allows sparse signals to be decomposed into a sparse representation “a” of a dictionary Du" role="presentation" style="max-height: none; display: inline; line-height: normal; word-spacing: normal; overflow-wrap: normal; white-space: nowrap; float: none; direction: ltr; max-width: none; min-width: 0px; min-height: 0px; border-width: 0px; border-style: initial; position: relative;">Du . The goodness of the learnt dictionary has direct impacts on the quality of the end results, e.g., in the HSI scene reconstructions. This paper proposes the construction of a concise and comprehensive dictionary by using the cluster centres of the input dataset, and then a greedy approach is adopted to learn all elements within this dictionary. The proposed method consists of an unsupervised clustering algorithm (K-Means), and it is then coupled with an advanced sparse coding dictionary (SCD) method such as the basis pursuit algorithm (orthogonal matching pursuit, OMP) for the dictionary learning. The effectiveness of the proposed K-Means Sparse Coding Dictionary (KMSCD) is illustrated through the reconstructions of several publicly available HSI scenes. The results have shown that the proposed KMSCD achieves ~40% greater accuracy, 5 times faster convergence and is twice as robust as that of the classic Spare Coding Dictionary (C-SCD) method that adopts random sampling of data for the dictionary learning. Over the five data sets that have been employed in this study, it is seen that the proposed KMSCD is capable of reconstructing these scenes with mean accuracies of approximately 20–500% better than all competing algorithms adopted in this work. Furthermore, the reconstruction efficiency of trace materials in the scene has been assessed: it is shown that the KMSCD is capable of recovering ~12% better than that of the C-SCD. These results suggest that the proposed DL using a simple clustering method for the construction of the dictionary has been shown to enhance the scene reconstruction substantially. When the proposed KMSCD is incorporated with the Fast non-negative orthogonal matching pursuit (FNNOMP) to constrain the maximum number of materials to coexist in a pixel to four, experiments have shown that it achieves approximately ten times better than that constrained by using the widely employed TMM algorithm. This may suggest that the proposed DL method using KMSCD and together with the FNNOMP will be more suitable to be the material allocation module of HSI scene simulators like the CameoSim packag

Imaging spectrometry-derived estimates of regional ecosystem composition for the Sierra Nevada, California

The composition of the plant canopy is a key attribute of terrestrial ecosystems, influencing the fluxes of carbon, water, and energy between the land surface and the atmosphere. Terrestrial ecosystem and biosphere models, which are used to predict how ecosystems are expected to respond to changes in climate, atmospheric CO2, and land-use change, require accurate representations of plant canopy composition at large spatial scales. The ability to accurately specify plant canopy composition is important because it determines the physiological and ecological properties of plants (such as leaf photosynthetic capacity, patterns of plant carbon allocation and tissue turnover, and the resulting dynamics of plant demography) that govern the biophysical and biogeochemical functioning of ecosystems. Traditionally, plant canopy composition has been represented in a coarse-grained manner within terrestrial biosphere models, with ecosystems being comprised of a single plant functional type (PFT). However, models are increasingly seeking to represent fine-scale spatial variation in plant functional diversity. In this study, we show how imaging spectrometry measurements can provide spatially-comprehensive estimates of within-biome heterogeneity in PFT composition across a functionally diverse and topographically heterogeneous ~710 km2 area in the Southern Sierra Mountains of California. AVIRIS (Airborne Visible Infrared Imaging Spectrometer) data at 18 m resolution from the recent HyspIRI Preparatory Mission (Hyperspectral InfraRed Imager) were used to estimate the sub-pixel fractions of seven PFTs represented in the ED2 terrestrial biosphere model: Shrub, Oak, Western Hardwood, Western Pine, Cedar/Fir, and High-elevation Pine, plus a Grass/NPV (Non-Photosynthetic Vegetation) fraction using Multiple Endmember Spectral Mixture Analysis (MESMA). ED2 is an individual-based terrestrial biosphere model capable of representing fine-scale sub-pixel ecosystem heterogeneity. Our results show that this methodology captures important elevation-related shifts in canopy composition that occur within the study area that are not resolved by existing multi-spectral land-cover products. These estimates modestly improved when the putative PFT endmembers considered in the mixture analysis were constrained using available geospatial data about the presence and absence of the PFTs in particular areas: the average RMSEs (root-mean-square errors) with the geospatially-constrained versus conventional method were 11.3% and 11.9% respectively, with larger reductions in the bias (i.e. mean error) in the abundances of Oak, Cedar/Fir, and Western Hardwood PFTs (ranging from 2.0% to 7.8%). At the hectare scale around four flux towers in the Southern Sierra Mountains, the overall composition improved from an RMSE of 18.2% (5.0-24.2% for individual PFTs) to RMSE 9.5% (3.3-13.2% for individual PFTs). Downgrading AVIRIS to 30 m resolution resulted in a reduction in accuracy of the constrained method to an RMSE of 12.7% (0-23.7%) with < 1% change in bias for all tree and shrub PFTs. Our results demonstrate that imaging spectrometry measurements from planned satellite missions such as HyspIRI, EnMAP (Environmental Mapping and Analysis Program), and HISUI (Hyper-spectral Imager SUIte) can provide important and much-needed information about fine-scale heterogeneity in the composition of plant canopies for constraining and improving terrestrial ecosystem and biosphere model simulations of regional- and global-scale vegetation dynamics and function