A stable and accurate wavelet-based method for noise reduction from hyperspectral vegetation spectrum

Hyperspectral vegetation spectrum is normally contaminated with noise and the presence of noise affects the results of vegetation studies, such as species discrimination and classification, disease detection, stress assessment and the estimation of vegetation’s biophysical and biochemical characteristics. Additionally, hyperspectral signals are usually studied using the derivative analysis method that is very sensitive to noise in the data. This study investigates denoising of the hyperspectral vegetation spectrum using different wavelet-based methods. A test signal and several real-world vegetation spectra are denoised using four wavelet methods: traditional discrete wavelet transform (DWT); stationary wavelet transform (SWT); lifting wavelet transform (LWT); and a combination of SWT and LWT, which in this paper is called stationary lifting wavelet transform (SLWT). SLWT incorporates the advantages of both SWT and LWT methods, including a translation invariance property and a fast simple algorithm. Experimental results show that SLWT highly outperforms other wavelet-based methods in terms of accuracy and visual quality. Furthermore, this research reveals the following novel results: SLWT 1) for different levels of decomposition of the wavelet transform gives similar results and its denoising results is independent to the selection of decomposition level; 2) generates stable statistical results; 3) can make use of mother wavelets with small filter size (i.e., low-order mother wavelets) that are suitable for preserving subtle features in vegetation spectrum; and 4) its denoising results do not depend on the selection of the mother wavelet when applying low-order mother wavelets

Noise-Resistant Spectral Features for Retrieving Foliar Chemical Parameters

Foliar chemical constituents are important indicators for understanding vegetation growing status and ecosystem functionality. Provided the noncontact and nondestructive traits, the hyperspectral analysis is a superior and efficient method for deriving these parameters. In practice, thespectral noise issue significantly impacts the performance of the hyperspectral retrieving system. To systematically investigate this issue, by introducing varying levels of noise to spectral signals, an assessment on noiseresistant capability of spectral features and models for retrieving concentrations of chlorophyll, carotenoids, and leaf water content was conducted. Given the continuous waveletanalysis (CWA) showed superior performance in extracting critical information associating plants biophysical and biochemical status in recent years, both wavelet features (WFs) and some conventional features (CFs) were chosen for the test. Two datasets including a leaf optical properties experiment dataset (n = 330), and a corn leaf spectral experiment dataset (n = 213) were used for analysis and modeling. The results suggested that the WFs had stronger correlations with all leaf chemical parameters than the CFs. According to an evaluation by decay rate of retrieving error that indicates noise-resistant capability, both WFs and CFs exhibited strong resistance to spectral noise. Particularly for WFs, the noise-resistant capability is relevant to the scale of the features. Based on the identified spectral features, both univariate and multivariate retrieving models were established and achieved satisfactory accuracies. Synthesizing the retrieving accuracy, noise resistivity, and model’s complexity, the optimal univariate WF-models were recommended in practice for retrieving leaf chemical parameters

Estimating the crop leaf area index using hyperspectral remote sensing

AbstractThe leaf area index (LAI) is an important vegetation parameter, which is used widely in many applications. Remote sensing techniques are known to be effective but inexpensive methods for estimating the LAI of crop canopies. During the last two decades, hyperspectral remote sensing has been employed increasingly for crop LAI estimation, which requires unique technical procedures compared with conventional multispectral data, such as denoising and dimension reduction. Thus, we provide a comprehensive and intensive overview of crop LAI estimation based on hyperspectral remote sensing techniques. First, we compare hyperspectral data and multispectral data by highlighting their potential and limitations in LAI estimation. Second, we categorize the approaches used for crop LAI estimation based on hyperspectral data into three types: approaches based on statistical models, physical models (i.e., canopy reflectance models), and hybrid inversions. We summarize and evaluate the theoretical basis and different methods employed by these approaches (e.g., the characteristic parameters of LAI, regression methods for constructing statistical predictive models, commonly applied physical models, and inversion strategies for physical models). Thus, numerous models and inversion strategies are organized in a clear conceptual framework. Moreover, we highlight the technical difficulties that may hinder crop LAI estimation, such as the “curse of dimensionality” and the ill-posed problem. Finally, we discuss the prospects for future research based on the previous studies described in this review

Linear Unmixing of Hyperspectral Signals via Wavelet Feature Extraction

A pixel in remotely sensed hyperspectral imagery is typically a mixture of multiple electromagnetic radiances from various ground cover materials. Spectral unmixing is a quantitative analysis procedure used to recognize constituent ground cover materials (or endmembers) and obtain their mixing proportions (or abundances) from a mixed pixel. The abundances are typically estimated using the least squares estimation (LSE) method based on the linear mixture model (LMM). This dissertation provides a complete investigation on how the use of appropriate features can improve the LSE of endmember abundances using remotely sensed hyperspectral signals. The dissertation shows how features based on signal classification approaches, such as discrete wavelet transform (DWT), outperform features based on conventional signal representation methods for dimensionality reduction, such as principal component analysis (PCA), for the LSE of endmember abundances. Both experimental and theoretical analyses are reported in the dissertation. A DWT-based linear unmixing system is designed specially for the abundance estimation. The system utilizes the DWT as a pre-processing step for the feature extraction. Based on DWT-based features, the system utilizes the constrained LSE for the abundance estimation. Experimental results show that the use of DWT-based features reduces the abundance estimation deviation by 30-50% on average, as compared to the use of original hyperspectral signals or conventional PCA-based features. Based on the LMM and the LSE method, a series of theoretical analyses are derived to reveal the fundamental reasons why the use of the appropriate features, such as DWT-based features, can improve the LSE of endmember abundances. Under reasonable assumptions, the dissertation derives a generalized mathematical relationship between the abundance estimation error and the endmember separabilty. It is proven that the abundance estimation error can be reduced through increasing the endmember separability. The use of DWT-based features provides a potential to increase the endmember separability, and consequently improves the LSE of endmember abundances. The stability of the LSE of endmember abundances is also analyzed using the concept of the condition number. Analysis results show that the use of DWT-based features not only improves the LSE of endmember abundances, but also improves the LSE stability

On the Use of Imaging Spectroscopy from Unmanned Aerial Systems (UAS) to Model Yield and Assess Growth Stages of a Broadacre Crop

Snap bean production was valued at $363 million in 2018. Moreover, the increasing need in food production, caused by the exponential increase in population, makes this crop vitally important to study. Traditionally, harvest time determination and yield prediction are performed by collecting limited number of samples. While this approach could work, it is inaccurate, labor-intensive, and based on a small sample size. The ambiguous nature of this approach furthermore leaves the grower with under-ripe and over-mature plants, decreasing the final net profit and the overall quality of the product. A more cost-effective method would be a site-specific approach that would save time and labor for farmers and growers, while providing them with exact detail to when and where to harvest and how much is to be harvested (while forecasting yield). In this study we used hyperspectral (i.e., point-based and image-based), as well as biophysical data, to identify spectral signatures and biophysical attributes that could schedule harvest and forecast yield prior to harvest. Over the past two decades, there have been immense advances in the field of yield and harvest modeling using remote sensing data. Nevertheless, there still exists a wide gap in the literature covering yield and harvest assessment as a function of time using both ground-based and unmanned aerial systems. There is a need for a study focusing on crop-specific yield and harvest assessment using a rapid, affordable system. We hypothesize that a down-sampled multispectral system, tuned with spectral features identified from hyperspectral data, could address the mentioned gaps. Moreover, we hypothesize that the airborne data will contain noise that could negatively impact the performance and the reliability of the utilized models. Thus, We address these knowledge gaps with three objectives as below: 1. Assess yield prediction of snap bean crop using spectral and biophysical data and identify discriminating spectral features via statistical and machine learning approaches. 2. Evaluate snap bean harvest maturity at both the plant growth stage and pod maturity level, by means of spectral and biophysical indicators, and identify the corresponding discriminating spectral features. 3. Assess the feasibility of using a deep learning architecture for reducing noise in the hyperspectral data. In the light of the mentioned objectives, we carried out a greenhouse study in the winter and spring of 2019, where we studied temporal change in spectra and physical attributes of snap-bean crop, from Huntington cultivar, using a handheld spectrometer in the visible- to shortwave-infrared domain (400-2500 nm). Chapter 3 of this dissertation focuses on yield assessment of the greenhouse study. Findings from this best-case scenario yield study showed that the best time to study yield is approximately 20-25 days prior to harvest that would give out the most accurate yield predictions. The proposed approach was able to explain variability as high as R2 = 0.72, with spectral features residing in absorption regions for chlorophyll, protein, lignin, and nitrogen, among others. The captured data from this study contained minimal noise, even in the detector fall-off regions. Moving the focus to harvest maturity assessment, Chapter 4 presents findings from this objective in the greenhouse environment. Our findings showed that four stages of maturity, namely vegetative growth, budding, flowering, and pod formation, are distinguishable with 79% and 78% accuracy, respectively, via the two introduced vegetation indices, as snap-bean growth index (SGI) and normalized difference snap-bean growth index (NDSI), respectively. Moreover, pod-level maturity classification showed that ready-to-harvest and not-ready-to-harvest pods can be separated with 78% accuracy with identified wavelengths residing in green, red edge, and shortwave-infrared regions. Moreover, Chapters 5 and 6 focus on transitioning the learned concepts from the mentioned greenhouse scenario to UAS domain. We transitioned from a handheld spectrometer in the visible to short-wave infrared domain (400-2500 nm) to a UAS-mounted hyperspectral imager in the visible-to-near-infrared region (400-1000 nm). Two years worth of data, at two different geographical locations, were collected in upstate New York and examined for yield modeling and harvest scheduling objectives. For analysis of the collected data, we introduced a feature selection library in Python, named “Jostar”, to identify the most discriminating wavelengths. The findings from the yield modeling UAS study show that pod weight and seed length, as two different yield indicators, can be explained with R2 as high as 0.93 and 0.98, respectively. Identified wavelengths resided in blue, green, red, and red edge regions, and 44-55 days after planting (DAP) showed to be the optimal time for yield assessment. Chapter 6, on the other hand, evaluates maturity assessment, in terms of pod classification, from the UAS perspective. Results from this study showed that the identified features resided in blue, green, red, and red-edge regions, contributing to F1 score as high as 0.91 for differentiating between ready-to-harvest vs. not ready-to-harvest. The identified features from this study is in line with those detected from the UAS yield assessment study. In order to have a parallel comparison of the greenhouse study against the UAS study, we adopted the methodology employed for UAS studies and applied it to the greenhouse studies, in Chapter 7. Since the greenhouse data were captured in the visible-to-shortwave-infrared (400-2500 nm) domain, and the UAS study data were captured in the VNIR (400-1000 nm) domain, we truncated the spectral range of the collected data from the greenhouse study to the VNIR domain. The comparison experiment between the greenhouse study and the UAS studies for yield assessment, at two harvest stages early and late, showed that spectral features in 450-470, 500-520, 650, 700-730 nm regions were repeated on days with highest coefficient of determination. Moreover, 46-48 DAP with high coefficient of determination for yield prediction were repeated in five out of six data sets (two early stages, each three data sets). On the other hand, the harvest maturity comparison between the greenhouse study and the UAS data sets showed that similar identified wavelengths reside in ∼450, ∼530, ∼715, and ∼760 nm regions, with performance metric (F1 score) of 0.78, 0.84, and 0.9 for greenhouse, 2019 UAS, and 2020 UAS data, respectively. However, the incorporated noise in the captured data from the UAS study, along with the high computational cost of the classical mathematical approach employed for denoising hyperspectral data, have inspired us to leverage the computational performance of hyperspectral denoising by assessing the feasibility of transferring the learned concepts to deep learning models. In Chapter 8, we approached hyperspectral denoising in spectral domain (1D fashion) for two types of noise, integrated noise and non-independent and non-identically distributed (non-i.i.d.) noise. We utilized Memory Networks due to their power in image denoising for hyperspectral denoising, introduced a new loss and benchmarked it against several data sets and models. The proposed model, HypeMemNet, ranked first - up to 40% in terms of signal-to-noise ratio (SNR) for resolving integrated noise, and first or second, by a small margin for resolving non-i.i.d. noise. Our findings showed that a proper receptive field and a suitable number of filters are crucial for denoising integrated noise, while parameter size was shown to be of the highest importance for non-i.i.d. noise. Results from the conducted studies provide a comprehensive understanding encompassing yield modeling, harvest scheduling, and hyperspectral denoising. Our findings bode well for transitioning from an expensive hyperspectral imager to a multispectral imager, tuned with the identified bands, as well as employing a rapid deep learning model for hyperspectral denoising

Anomaly detection in hyperspectral signatures using automated derivative spectroscopy methods

The goal of this research was to detect anomalies in remotely sensed Hyperspectral images using automated derivative based methods. A database of Hyperspectral signatures was used that had simulated additive Gaussian anomalies that modeled a weakly concentrated aerosol in several spectral bands. The automated pattern detection system was carried out in four steps. They were: (1) feature extraction, (2) feature reduction through linear discriminant analysis, (3) performance characterization through receiver operating characteristic curves, and (4) signature classification using nearest mean and maximum likelihood classifiers. The Hyperspectral database contained signatures with various anomaly concentrations ranging from weakly present to moderately present and also anomalies in various spectral reflective and absorptive bands. It was found that the automated derivative based detection system gave classification accuracies of 97 percent for a Gaussian anomaly of SNR -45 dB and 70 percent for Gaussian anomaly of SNR -85 dB. This demonstrates the applicability of using derivative analysis methods for pattern detection and classification with remotely sensed Hyperspectral images

Uncertainty Assessment of Spectral Mixture Analysis in Remote Sensing Imagery

Spectral mixture analysis (SMA), a scheme of sub-pixel-based classifications, is one of the widely used models to map fractional land use and land cover information in remote sensing imagery. It assumes that: 1) a mixed pixel is composed by several pure land cover classes (endmembers) linearly or nonlinearly, and 2) the spectral signature of each endmember is a constant within the entire spatial extent of analysis. SMA has been commonly applied to impervious surface area extraction, vegetation fraction estimation, and land use and land cover change (LULC) mapping. Limitations of SMA, however, still exist. First, the existence of between- and within-class variability prevents the selection of accurate endmembers, which results in poor accuracy of fractional land cover estimates. Weighted spectral mixture analysis (WSMA) and transformed spectral mixture analysis (TSMA) are alternate means to address the within- and between- class variability. These methods, however, have not been analyzed systematically and comprehensively. The effectiveness of each WSMA and TSMA scheme is still unknown, in particular within different urban areas. Second, multiple endmember SMA (MESMA) is a better alternative to address spectral mixture model uncertainties. It, nonetheless, is time consuming and inefficient. Further, incorrect endmember selections may still limit model performance as the best-fit endmember model might not be the optimal model due to the existence of spectral variability. Therefore, this study aims 1) to explore endmember uncertainties by examining WSMA and TSMA modeling comprehensively, and 2) to develop an improved MESMA model in order to address the uncertainties of spectral mixture models. Results of the WSMA examination illustrated that some weighting schemes did reduce endmember uncertainties since they could improve the fractional estimates significantly. The results also indicated that spectral class variance played a key role in addressing the endmember uncertainties, as the better performing weighting schemes were constructed with spectral class variance. In addition, the results of TSMA examination demonstrated that some TSMAs, such as normalized spectral mixture analysis (NSMA), could effectively solve the endmember uncertainties because of their stable performance in different study areas. Results of Class-based MEMSA (C-MESMA) indicated that it could address spectral mixture model uncertainties by reducing a lot of the calculation burden and effectively improving accuracy. Assessment demonstrated that C-MEMSA significantly improving accuracy. Major contributions of this study can be summarized as follow. First, the effectiveness of addressing endmember uncertainties have been fully discussed by examining: 1) the effectiveness of ten weighted spectral mixture models in urban environments; and 2) the effectiveness of 26 transformed spectral mixture models in three locations. Constructive guidance regarding handling endmember uncertainties using WSMA and TSMA have been provided. Second, the uncertainties of spectral mixture model were reduced by developing an improved MESMA model, named C-MESMA. C-MESMA could restrict the distribution of endmembers and reduce the calculation burden of traditional MESMA, increasing SMA accuracy significantly

Caracterização e estudo comparativo de exsudações de hidrocarbonetos e plays petrolíferos em bacias terrestres das regiões central do Irã e sudeste do Brasil usando sensoriamento remoto espectral

Orientador: Carlos Roberto de Souza FilhoTese (doutorado) - Universidade Estadual de Campinas, Instituto de GeociênciasResumo: O objetivo desta pesquisa foi explorar as assinaturas de exsudações de hidrocarbonetos na superfície usando a tecnologia de detecção remota espectral. Isso foi alcançado primeiro, realizando uma revisão abrangente das capacidades e potenciais técnicas de detecção direta e indireta. Em seguida, a técnica foi aplicada para investigar dois locais de teste localizados no Irã e no Brasil, conhecidos por hospedar sistemas ativos de micro-exsudações e afloramentos betuminosos, respectivamente. A primeira área de estudo está localizada perto da cidade de Qom (Irã), e está inserida no campo petrolífero Alborz, enterrado sob sedimentos datados do Oligoceno da Formação Upper Red. O segundo local está localizado perto da cidade de Anhembi (SP), na margem oriental da bacia do Paraná, no Brasil, e inclui acumulações de betume em arenitos triássicos da Formação Pirambóia. O trabalho na área de Qom integrou evidências de (i) estudos petrográficos e geoquímicos em laboratório, (ii) investigações de afloramentos em campo, e (iii) mapeamento de anomalia em larga escala através de conjuntos de dados multi-espectrais ASTER e Sentinel-2. O resultado deste estudo se trata de novos indicadores mineralógicos e geoquímicos para a exploração de micro-exsudações e um modelo de micro-exsudações atualizado. Durante este trabalho, conseguimos desenvolver novas metodologias para análise de dados espectroscópicos. Através da utilização de dados simulados, indicamos que o instrumento de satélite WorldView-3 tem potencial para detecção direta de hidrocarbonetos. Na sequência do estudo, dados reais sobre afloramentos de arenitos e óleo na área de Anhembi foram investigados. A área foi fotografada novamente no chão e usando o sistema de imagem hiperespectral AisaFENIX. Seguiu-se estudos e amostragem no campo,incluindo espectroscopia de alcance fechado das amostras no laboratório usando instrumentos de imagem (ou seja, sisuCHEMA) e não-imagem (ou seja, FieldSpec-4). O estudo demonstrou que uma abordagem espectroscópica multi-escala poderia fornecer uma imagem completa das variações no conteúdo e composição do betume e minerais de alteração que acompanham. A assinatura de hidrocarbonetos, especialmente a centrada em 2300 nm, mostrou-se consistente e comparável entre as escalas e capaz de estimar o teor de betume de areias de petróleo em todas as escalas de imagemAbstract: The objective of this research was to explore for the signatures of seeping hydrocarbons on the surface using spectral remote sensing technology. It was achieved firstly by conducting a comprehensive review of the capacities and potentials of the technique for direct and indirect seepage detection. Next, the technique was applied to investigate two distinctive test sites located in Iran and Brazil known to retain active microseepage systems and bituminous outcrops, respectively. The first study area is located near the city of Qom in Iran, and consists of Alborz oilfield buried under Oligocene sediments of the Upper-Red Formation. The second site is located near the town of Anhembi on the eastern edge of the Paraná Basin in Brazil and includes bitumen accumulations in the Triassic sandstones of the Pirambóia Formation. Our work in Qom area integrated evidence from (i) petrographic, spectroscopic, and geochemical studies in the laboratory, (ii) outcrop investigations in the field, and (iii) broad-scale anomaly mapping via orbital remote sensing data. The outcomes of this study was novel mineralogical and geochemical indicators for microseepage characterization and a classification scheme for the microseepage-induced alterations. Our study indicated that active microseepage systems occur in large parts of the lithofacies in Qom area, implying that the extent of the petroleum reservoir is much larger than previously thought. During this work, we also developed new methodologies for spectroscopic data analysis and processing. On the other side, by using simulated data, we indicated that WorldView-3 satellite instrument has the potential for direct hydrocarbon detection. Following this demonstration, real datasets were acquired over oil-sand outcrops of the Anhembi area. The area was further imaged on the ground and from the air by using an AisaFENIX hyperspectral imaging system. This was followed by outcrop studies and sampling in the field and close-range spectroscopy in the laboratory using both imaging (i.e. sisuCHEMA) and nonimaging instruments. The study demonstrated that a multi-scale spectroscopic approach could provide a complete picture of the variations in the content and composition of bitumen and associated alteration mineralogy. The oil signature, especially the one centered at 2300 nm, was shown to be consistent and comparable among scales, and capable of estimating the bitumen content of oil-sands at all imaging scalesDoutoradoGeologia e Recursos NaturaisDoutor em Geociências2015/06663-7FAPES

Water quality monitoring of kettle holes by means of hyperspectral remote sensing in Mecklenburg-Vorpommern state, Germany

This research aims to present the ability of hyperspectral remote sensing (two-years field spectral data, HyMap and ROSIS sensors imagery) for kettle holes’ water quality parameters (chlorophyll, depth, total suspended sediment) mapping in agricultural young moraine landscapes in North-Eastern Germany. The objectives were to: (1) determine trophic state of several kettle holes (spatial heterogeneity and temporal dynamics); (2) evaluate and assess the applicability of hyperspectral remote sensing techniques to the water quality of kettle holes that are most suitable for various kettle holes.In dieser Arbeit wird die Eignung der hyperspektralen Fernerkundung (HRS) für das Monitoring von Wasserqualitätsparametern von Söllen (Chlorophyll, Tiefe, gelöste Stoffe) in einer intensiv landwirtschaftlich genutzten Jungmoränenlandschaft Nordostdeutschlands anhand von zweijährigen feldspektrischen Daten sowie Bilddaten von HyMap- und ROSIS-Sensoren untersucht. Diese Arbeit hatte zum Ziel (1) den Trophiestatus mehrerer Sölle zu erfassen (räumliche Variabilität und zeitliche Dynamik); (2) die HRS-Technik im Hinblick auf ihre Anwendbarkeit hin im Wasserqualitäts-Monitoring von Söllen zu bewerten