Field spectroradiometer data : acquisition, organisation, processing and analysis on the example of New Zealand native plants : a thesis presented in fulfilment of the requirements for the degree of Master of Philosophy in Earth Science at Massey University, Palmerston North, New Zealand

The purpose of this research was to investigate the acquisition, storage, processing and analysis of hyperspectral data for vegetation applications on the example of New Zealand native plants. Data covering the spectral range 350nm-2500nm were collected with a portable spectroradiometer. Hyperspectral data collection results in large datasets that need pre-processing before any analysis can be carried out. A review of the techniques used since the advent of hyperspectral field data showed the following general procedures were followed: 1. Removal of noisy or uncalibrated bands 2. Data smoothing 3. Reduction of dimensionality 4. Transformation into feature space 5. Analysis techniques Steps 1 to 4 which are concerned with the pre-processing of data were found to be repetitive procedures and thus had a high potential for automation. The pre-processing had a major impact on the results gained in the analysis stage. Finding the ideal pre-processing parameters involved repeated processing of the data. Hyperspectral field data should be stored in a structured way. The utilization of a relational database seemed a logical approach. A hierarchical data structure that reflected the real world and the setup of sampling campaigns was designed. This structure was transformed into a logical data model. Furthermore the database also held information needed for pre-processing and statistical analysis. This enabled the calculation of separability measurements such as the JM (Jeffries Matusila) distance or the application of discriminant analysis. Software was written to provide a graphical user interface to the database and implement pre-processing and analysis functionality. The acquisition, processing and analysis steps were applied to New Zealand native vegetation. A high degree of separability between species was achieved and using independent data a classification accuracy of 87.87% was reached. This outcome required smoothing, Hyperion synthesizing and principal components transformation to be applied to the data prior to the classification which used a generalized squared distance discriminant function. The mixed signature problem was addressed in experiments under controlled laboratory conditions and revealed that certain combinations of plants could not be unmixed successfully while mixtures of vegetation and artificial materials resulted in very good abundance estimations. The combination of a relational database with associated software for data processing was found to be highly efficient when dealing with hyperspectral field data

Uncertainty support in the spectral information System SPECCHIO

The spectral information system SPECCHIO was updated to support the generic handling of uncertainty information in the form of uncertainty tree diagrams. The updates involve changes to the relations database model as well as dedicated methods provided by the SPECCHIO application programming interface. A case study selected from classic field spectroscopy demonstrates the use of the functionality. In conclusion, a database-centric automated uncertainty propagation in combination with measurement protocol standardization will provide a crucial step toward spectroscopy data accompanied by propagated, traceable, uncertainty information

Uncertainty budget for a traceable operational radiometric calibration of field spectroradiometers, calibration of the heliosphere

To measure the distinct interaction of the Earth’smaterials with solar electromagnetic radiation, field spectroradiometers are commonly utilized. These are used to validate spectroradiometers deployed on various platforms through comparison exercises. Following metrology standards, the inclusion of uncertainties is required. Thus, field spectroradiometers need to be calibrated regularly against traceable radiance sources. In this article, we present a laboratory radiometric calibration protocol for the calibration of a heliosphere integrating sphere to make it traceable to the International System of Units as well as to establish an uncertainty budget. We adopted a transfer radiometer approach including four spectroradiometers that were calibrated at the Deutsches Zentrum für Luft und Raumfahrt Radiometric Standard facility before transferring that calibration to the heliosphere. After considering various sources of uncertainty by employing an uncertainty tree diagram approach, we arrive at an overall propagated uncertainty of approximately 1.5%. In future publications, we will present how to extend the traceability to other attenuations provided by the heliosphere. Its application to the calibration of a field spectroradiometer will be the focus of a future publication

Spectral information system for Australian spectroscopy data

Abstract presented at 2013 Fall Meeting, AGU, San Francisco, California, USA, 9-13 Dec

Optimized Spectrometers Characterization Procedure for Near Ground Support of ESA FLEX Observations: Part 1 Spectral Calibration and Characterisation

The paper presents two procedures for the wavelength calibration, in the oxygen telluric absorption spectral bands (O2-A, λc = 687 nm and O2-B, λc = 760.6 nm), of field fixed-point spectrometers used for reflectance and Sun-induced fluorescence measurements. In the first case, Ne and Ar pen-type spectral lamps were employed, while the second approach is based on a double monochromator setup. The double monochromator system was characterized for the estimation of errors associated with different operating configurations. The proposed methods were applied to three Piccolo Doppio-type systems built around two QE Pros and one USB2 + H16355 Ocean Optics spectrometers. The wavelength calibration errors for all the calibrations performed on the three spectrometers are reported and potential methodological improvements discussed. The suggested calibration methods were validated, as the wavelength corrections obtained by both techniques for the QE Pro designed for fluorescence investigations were similar. However, it is recommended that a neon emission line source, as well as an argon or mercury-argon source be used to have a reference wavelength closer to the O2-B feature. The wavelength calibration can then be optimised as close to the O2-B and O2-A features as possible. The monochromator approach could also be used, but that instrument would need to be fully characterized prior to use, and although it may offer a more accurate calibration, as it could be tuned to emit light at the same wavelengths as the absorption features, it would be more time consuming as it is a scanning approach

Genetic constraints on temporal variation of airborne reflectance spectra and their uncertainties over a temperate forest

Remote sensing enhances large-scale biodiversity monitoring by overcoming temporal and spatial limitations of ground-based measurements and allows assessment of multiple plant traits simultaneously. The total set of traits and their variation over time is specific for each individual and can reveal information about the genetic composition of forest communities. Measuring trait variation among individuals of one species continuously across space and time is a key component in monitoring genetic diversity but difficult to achieve with ground-based methods. Remote sensing approaches using imaging spectroscopy can provide high spectral, spatial, and temporal coverage to advance the monitoring of genetic diversity, if sufficient relation between spectral and genetic information can be established. We assessed reflectance spectra from individual Fagus sylvatica L. (European beech) trees acquired across eleven years from 69 flights of the Airborne Prism Experiment (APEX) above the same temperate forest in Switzerland. We derived reflectance spectra of 68 canopy trees and correlated differences in these spectra with genetic differences derived from microsatellite markers among the 68 individuals. We calculated these correlations for different points in time, wavelength regions and relative differences between wavelength regions. High correlations indicate high spectral-genetic similarities. We then tested the influence of environmental variables obtained at temporal scales from days to years on spectral-genetic similarities. We performed an uncertainty propagation of radiance measurements to provide a quality indicator for these correlations. We observed that genetically similar individuals had more similar reflectance spectra, but this varied between wavelength regions and across environmental variables. The short-wave infrared regions of the spectrum, influenced by water absorption, seemed to provide information on the population genetic structure at high temperatures, whereas the visible part of the spectrum, and the near-infrared region affected by scattering properties of tree canopies, showed more consistent patterns with genetic structure across longer time scales. Correlations of genetic similarity with reflectance spectra similarity were easier to detect when investigating relative differences between spectral bands (maximum correlation: 0.40) than reflectance data (maximum correlation: 0.33). Incorporating uncertainties of spectral measurements yielded improvements of spectral-genetic similarities of 36% and 20% for analyses based on single spectral bands, and relative differences between spectral bands, respectively. This study highlights the potential of dense multi-temporal airborne imaging spectroscopy data to detect the genetic structure of forest communities. We suggest that the observed temporal trajectories of reflectance spectra indicate physiological and possibly genetic constraints on plant responses to environmental change

Sun-Induced Chlorophyll Fluorescence I: Instrumental Considerations for Proximal Spectroradiometers

Growing interest in the proximal sensing of sun‐induced chlorophyll fluorescence (SIF) has been boosted by space-based retrievals and up-coming missions such as the FLuorescence EXplorer (FLEX). The European COST Action ES1309 “Innovative optical tools for proximal sensing of ecophysiological processes” (OPTIMISE, ES1309; https://optimise.dcs.aber.ac.uk/) has produced three manuscripts addressing the main current challenges in this field. This article provides a framework to model the impact of different instrument noise and bias on the retrieval of SIF; and to assess uncertainty requirements for the calibration and characterization of state-of-the-art SIF-oriented spectroradiometers. We developed a sensor simulator capable of reproducing biases and noises usually found in field spectroradiometers. First the sensor simulator was calibrated and characterized using synthetic datasets of known uncertainties defined from laboratory measurements and literature. Secondly, we used the sensor simulator and the characterized sensor models to simulate the acquisition of atmospheric and vegetation radiances from a synthetic dataset. Each of the sensor models predicted biases with propagated uncertainties that modified the simulated measurements as a function of different factors. Finally, the impact of each sensor model on SIF retrieval was analyzed. Results show that SIF retrieval can be significantly affected in situations where reflectance factors are barely modified. SIF errors were found to correlate with drivers of instrumental-induced biases which are as also drivers of plant physiology. This jeopardizes not only the retrieval of SIF, but also the understanding of its relationship with vegetation function, the study of diel and seasonal cycles and the validation of remote sensing SIF products. Further work is needed to determine the optimal requirements in terms of sensor design, characterization and signal correction for SIF retrieval by proximal sensing. In addition, evaluation/validation methods to characterize and correct instrumental responses should be developed and used to test sensors performance in operational conditions

Sun-induced chlorophyll fluorescence II:Review of passive measurement setups, protocols, and their application at the leaf to canopy level

Satellite gravimetry allows for determining large scale mass transport in the system Earth and to quantify ice mass change in polar regions. We provide, evaluate and compare a long time-series of monthly gravity field solutions derived either by satellite laser ranging (SLR) to geodetic satellites, by GPS and K-band observations of the GRACE mission, or by GPS observations of the three Swarm satellites. While GRACE provides gravity signal at the highest spatial resolution, SLR sheds light on mass transport in polar regions at larger scales also in the pre- and post-GRACE era. To bridge the gap between GRACE and GRACE Follow-On, we also derive monthly gravity fields using Swarm data and perform a combination with SLR. To correctly take all correlations into account, this combination is performed on the normal equation level. Validating the Swarm/SLR combination against GRACE during the overlapping period January 2015 to June 2016, the best fit is achieved when down-weighting Swarm compared to the weights determined by variance component estimation. While between 2014 and 2017 SLR alone slightly overestimates mass loss in Greenland compared to GRACE, the combined gravity fields match significantly better in the overlapping time period and the RMS of the differences is reduced by almost 100 Gt. After 2017, both SLR and Swarm indicate moderate mass gain in Greenland

Mapping the spatial distribution of NO2 with in situ and remote sensing instruments during the Munich NO2 imaging campaign

We present results from the Munich Nitrogen dioxide (NO2) Imaging Campaign (MuNIC), where NO2 near-surface concentrations (NSCs) and vertical column densities (VCDs) were measured with stationary, mobile, and airborne in situ and remote sensing instruments in Munich, Germany. The most intensive day of the campaign was 7 July 2016, when the NO2 VCD field was mapped with the Airborne Prism Experiment (APEX) imaging spectrometer. The spatial distribution of APEX VCDs was rather smooth, with a horizontal gradient between lower values upwind and higher values downwind of the city center. The NO2 map had no pronounced source signatures except for the plumes of two combined heat and power (CHP) plants. The APEX VCDs have a fair correlation with mobile multi-axis differential optical absorption spectroscopy (MAX-DOAS) observations from two vehicles conducted on the same afternoon (r=0.55). In contrast to the VCDs, mobile NSC measurements revealed high spatial and temporal variability along the roads, with the highest values in congested areas and tunnels. The NOx emissions of the two CHP plants were estimated from the APEX observations using a mass-balance approach. The NOx emission estimates are consistent with CO2 emissions determined from two ground-based Fourier transform infrared (FTIR) instruments operated near one CHP plant. The estimates are higher than the reported emissions but are probably overestimated because the uncertainties are large, as conditions were unstable and convective with low and highly variable wind speeds. Under such conditions, the application of mass-balance approaches is problematic because they assume steady-state conditions. We conclude that airborne imaging spectrometers are well suited for mapping the spatial distribution of NO2 VCDs over large areas. The emission plumes of point sources can be detected in the APEX observations, but accurate flow fields are essential for estimating emissions with sufficient accuracy. The application of airborne imaging spectrometers for studying NSCs is less straightforward and requires us to account for the non-trivial relationship between VCDs and NSCs

Hyperspectral leaf area index and chlorophyll retrieval over forest and row-structured vineyard canopies

As an unprecedented stream of decametric hyperspectral observations becomes available from recent and upcoming spaceborne missions, effective algorithms are required to retrieve vegetation biophysical and biochemical variables such as leaf area index (LAI) and canopy chlorophyll content (CCC). In the context of missions such as the Environmental Mapping and Analysis Program (EnMAP), Precursore Iperspettrale della Missione Applicativa (PRISMA), Copernicus Hyperspectral Imaging Mission for the Environment (CHIME), and Surface Biology Geology (SBG), several retrieval algorithms have been developed based upon the turbid medium Scattering by Arbitrarily Inclined Leaves (SAIL) radiative transfer model. Whilst well suited to cereal crops, SAIL is known to perform comparatively poorly over more heterogeneous canopies (including forests and row-structured crops). In this paper, we investigate the application of hybrid radiative transfer models, including a modified version of SAIL (rowSAIL) and the Invertible Forest Reflectance Model (INFORM), to such canopies. Unlike SAIL, which assumes a horizontally homogeneous canopy, such models partition the canopy into geometric objects, which are themselves treated as turbid media. By enabling crown transmittance, foliage clumping, and shadowing to be represented, they provide a more realistic representation of heterogeneous vegetation. Using airborne hyperspectral data to simulate EnMAP observations over vineyard and deciduous broadleaf forest sites, we demonstrate that SAIL-based algorithms provide moderate retrieval accuracy for LAI (RMSD = 0.92–2.15, NRMSD = 40–67%, bias = −0.64–0.96) and CCC (RMSD = 0.27–1.27 g m−2, NRMSD = 64–84%, bias = −0.17–0.89 g m−2). The use of hybrid radiative transfer models (rowSAIL and INFORM) reduces bias in LAI (RMSD = 0.88–1.64, NRMSD = 27–64%, bias = −0.78–−0.13) and CCC (RMSD = 0.30–0.87 g m−2, NRMSD = 52–73%, bias = 0.03–0.42 g m−2) retrievals. Based on our results, at the canopy level, we recommend that hybrid radiative transfer models such as rowSAIL and INFORM are further adopted for hyperspectral biophysical and biochemical variable retrieval over heterogeneous vegetation