Proximal hyperspectral imaging detects diurnal and drought-induced changes in maize physiology

Hyperspectral imaging is a promising tool for non-destructive phenotyping of plant physiological traits, which has been transferred from remote to proximal sensing applications, and from manual laboratory setups to automated plant phenotyping platforms. Due to the higher resolution in proximal sensing, illumination variation and plant geometry result in increased non-biological variation in plant spectra that may mask subtle biological differences. Here, a better understanding of spectral measurements for proximal sensing and their application to study drought, developmental and diurnal responses was acquired in a drought case study of maize grown in a greenhouse phenotyping platform with a hyperspectral imaging setup. The use of brightness classification to reduce the illumination-induced non-biological variation is demonstrated, and allowed the detection of diurnal, developmental and early drought-induced changes in maize reflectance and physiology. Diurnal changes in transpiration rate and vapor pressure deficit were significantly correlated with red and red-edge reflectance. Drought-induced changes in effective quantum yield and water potential were accurately predicted using partial least squares regression and the newly developed Water Potential Index 2, respectively. The prediction accuracy of hyperspectral indices and partial least squares regression were similar, as long as a strong relationship between the physiological trait and reflectance was present. This demonstrates that current hyperspectral processing approaches can be used in automated plant phenotyping platforms to monitor physiological traits with a high temporal resolution

Close-range hyperspectral imaging of whole plants for digital phenotyping : recent applications and illumination correction approaches

Digital plant phenotyping is emerging as a key research domain at the interface of information technology and plant science. Digital phenotyping aims to deploy high-end non-destructive sensing techniques and information technology infrastructures to automate the extraction of both structural and physiological traits from plants under phenotyping experiments. One of the promising sensor technologies for plant phenotyping is hyperspectral imaging (HSI). The main benefit of utilising HSI compared to other imaging techniques is the possibility to extract simultaneously structural and physiological information on plants. The use of HSI for analysis of parts of plants, e.g. plucked leaves, has already been demonstrated. However, there are several significant challenges associated with the use of HSI for extraction of information from a whole plant, and hence this is an active area of research. These challenges are related to data processing after image acquisition. The hyperspectral data acquired of a plant suffers from variations in illumination owing to light scattering, shadowing of plant parts, multiple scattering and a complex combination of scattering and shadowing. The extent of these effects depends on the type of plants and their complex geometry. A range of approaches has been introduced to deal with these effects, however, no concrete approach is yet ready. In this article, we provide a comprehensive review of recent studies of close-range HSI of whole plants. Several studies have used HSI for plant analysis but were limited to imaging of leaves, which is considerably more straightforward than imaging of the whole plant, and thus do not relate to digital phenotyping. In this article, we discuss and compare the approaches used to deal with the effects of variation in illumination, which are an issue for imaging of whole plants. Furthermore, future possibilities to deal with these effects are also highlighted

Development of the Ames Global Hyperspectral Synthetic Data Set: Surface Bidirectional Reflectance Distribution Function

This study introduces the Ames Global Hyperspectral Synthetic Data set (AGHSD), in particular the surface bidirectional reflectance distribution function (BRDF) product, to support the NASA Surface Biology and Geology (SBG) mission development. The data set is generated based on the corresponding multispectral BRDF products from NASA\u27s MODIS satellite sensor. Based on theories of radiative transfer in vegetation canopies, we derive a simple but robust relationship that indicates that the hyperspectral surface BRDF can be accurately approximated as a weighted sum of the soil surface reflectance, the leaf single albedo, and the canopy scattering coefficient, where the weights or coefficients are spectrally invariant and thus readily estimated from the multispectral MODIS products. We validate the algorithm with simulations by a Monte Carlo Ray Tracing model and find the results highly consistent with the theoretic derivation. Using reflectance spectra of soil and vegetation derived from existing spectral libraries, we apply the algorithm to generate the AGHSD BRDF product at 1 km and 8-day resolutions for the year of 2019. The data set is biogeochemically and biogeophysically coherent and consistent, and serves the goal to support the SBG community in developing sciences and applications for the future global imaging spectroscopy mission

Hyperspectral Imaging from Ground Based Mobile Platforms and Applications in Precision Agriculture

This thesis focuses on the use of line scanning hyperspectral sensors on mobile ground based platforms and applying them to agricultural applications. First this work deals with the geometric and radiometric calibration and correction of acquired hyperspectral data. When operating at low altitudes, changing lighting conditions are common and inevitable, complicating the retrieval of a surface's reflectance, which is solely a function of its physical structure and chemical composition. Therefore, this thesis contributes the evaluation of an approach to compensate for changes in illumination and obtain reflectance that is less labour intensive than traditional empirical methods. Convenient field protocols are produced that only require a representative set of illumination and reflectance spectral samples. In addition, a method for determining a line scanning camera's rigid 6 degree of freedom (DOF) offset and uncertainty with respect to a navigation system is developed, enabling accurate georegistration and sensor fusion. The thesis then applies the data captured from the platform to two different agricultural applications. The first is a self-supervised weed detection framework that allows training of a per-pixel classifier using hyperspectral data without manual labelling. The experiments support the effectiveness of the framework, rivalling classifiers trained on hand labelled training data. Then the thesis demonstrates the mapping of mango maturity using hyperspectral data on an orchard wide scale using efficient image scanning techniques, which is a world first result. A novel classification, regression and mapping pipeline is proposed to generate per tree mango maturity averages. The results confirm that maturity prediction in mango orchards is possible in natural daylight using a hyperspectral camera, despite complex micro-illumination-climates under the canopy

Use spectral derivatives for estimating canopy water content

Hyperspectral remote sensing has demonstrated great potential for accurate retrieval of canopy water content (CWC). This CWC is defined by the product of the leaf equivalent water thickness (EWT) and the leaf area index (LAI). In this paper the spectral information provided by the canopy water absorption feature at 970 nm for estimating and predicting CWC was studied using a modelling approach and in situ spectroradiometric measurements. The relationship of the first derivative at the right slope of the 970 nm water absorption feature with CWC was investigated with the PROSAIL radiative transfer model at a 1 nm sampling interval and tested for field spectroradiometer measurements obtained at an extensively grazed fen meadow as test site. PROSAIL simulations (using coupled SAIL/PROSPECT-5 models) showed a linear relationship between the first derivative over the 1015 – 1050 nm spectral interval and CWC (R2 = 0.97), which was not sensitive for leaf and canopy structure, soil brightness and illumination and observation geometry. For 40 plots at the fen meadow ASD FieldSpec spectral measurements yielded an R2 of 0.68 for the derivative over the 1015 – 1050 nm interval with CWC. This relationship appeared to match the simulated relationship obtained from the PROSAIL model. It showed that one may transfer simulated results to real measurements obtained in the field, thus giving them a physical basis and more general applicability. Consistency of the results confirmed the potential of using simulation results for calibrating the relationship between this first derivative and CWC. Another advantage of using the derivative at the right slope of the 970 nm absorption feature is its distance from the atmospheric water vapour absorption feature at 940 nm. If one cannot correct well for the effects of atmospheric water vapour, the derivative at the right slope is preferred over the one at the left slope

Assessing the impact of illumination on UAV pushbroom hyperspectral imagery collected under various cloud cover conditions

The recent development of small form-factor (<6 kg), full range (400–2500 nm) pushbroom hyperspectral imaging systems (HSI) for unmanned aerial vehicles (UAV) poses a new range of opportunities for passive remote sensing applications. The flexible deployment of these UAV-HSI systems have the potential to expand the data acquisition window to acceptable (though non-ideal) atmospheric conditions. This is an important consideration for time-sensitive applications (e.g. phenology) in areas with persistent cloud cover. Since the majority of UAV studies have focused on applications with ideal illumination conditions (e.g. minimal or non-cloud cover), little is known to what extent UAV-HSI data are affected by changes in illumination conditions due to variable cloud cover. In this study, we acquired UAV pushbroom HSI (400–2500 nm) over three consecutive days with various illumination conditions (i.e. cloud cover), which were complemented with downwelling irradiance data to characterize illumination conditions and in-situ and laboratory reference panel measurements across a range of reflectivity (i.e. 2%, 10%, 18% and 50%) used to evaluate reflectance products. Using these data we address four fundamental aspects for UAV-HSI acquired under various conditions ranging from high (624.6 ± 16.63 W·m2) to low (2.5 ± 0.9 W·m2) direct irradiance: atmospheric compensation, signal-to-noise ratio (SNR), spectral vegetation indices and endmembers extraction. For instance, two atmospheric compensation methods were applied, a radiative transfer model suitable for high direct irradiance, and an Empirical Line Model (ELM) for diffuse irradiance conditions. SNR results for two distinctive vegetation classes (i.e. tree canopy vs herbaceous vegetation) reveal wavelength dependent attenuation by cloud cover, with higher SNR under high direct irradiance for canopy vegetation. Spectral vegetation index (SVIs) results revealed high variability and index dependent effects. For example, NDVI had significant differences (p < 0.05) across illumination conditions, while NDWI appeared insensitive at the canopy level. Finally, often neglected diffuse illumination conditions may be beneficial for revealing spectral features in vegetation that are obscured by the predominantly non-Lambertian reflectance encountered under high direct illumination. To our knowledge, our study is the first to use a full range pushbroom UAV sensor (400–2500 nm) for assessing illumination effects on the aforementioned variables. Our findings pave the way for understanding the advantages and limitations of ultra-high spatial resolution full range high fidelity UAV-HSI for ecological and other applications

Effects of atmospheric, topographic, and BRDF correction on imaging spectroscopy-derived data products

Surface reflectance is an important data product in imaging spectroscopy for obtaining surface information. The complex retrieval of surface reflectance, however, critically relies on accurate knowledge of atmospheric absorption and scattering, and the compensation of these effects. Furthermore, illumination and observation geometry in combination with surface reflectance anisotropy determine dynamics in retrieved surface reflectance not related to surface absorption properties. To the best of authors’ knowledge, no comprehensive assessment of the impact of atmospheric, topographic, and anisotropy effects on derived surface information is available so far.This study systematically evaluates the impact of these effects on reflectance, albedo, and vegetation products. Using three well-established processing schemes (ATCOR F., ATCOR R., and BREFCOR), high-resolution APEX imaging spectroscopy data, covering a large gradient of illumination and observation angles, are brought to several processing states, varyingly affected by mentioned effects. Pixel-wise differences of surface reflectance, albedo, and spectral indices of neighboring flight lines are quantitatively analyzed in their respective overlapping area. We found that compensation of atmospheric effects reveals actual anisotropy-related dynamics in surface reflectance and derived albedo, related to an increase in pixel-wise relative reflectance and albedo differences of more than 40%. Subsequent anisotropy compensation allows us to successfully reduce apparent relative reflectance and albedo differences by up to 20%. In contrast, spectral indices are less affected by atmospheric and anisotropy effects, showing relative differences of 3% to 10% in overlapping regions of flight lines.We recommend to base decisions on the use of appropriate processing schemes on individual use cases considering envisioned data products

Early detection of drought stress in Arabidopsis thaliana utilsing a portable hyperspectral imaging setup

Close-range hyperspectral imaging (HSI) of plants is now a potential tool for non-destructive extraction of plant functional traits. A major motivation is the plant phenotyping related applications where different plant genotypes are explored for different environmental conditions. HSI of Arabidopsis thaliana is of particular importance as it is a model organism in plant biology. In the present work, a portable HSI setup has been used for the monitoring of a set of 6 Arabidopsis thaliana plants. The plants were monitored under controlled watering conditions where 3 plants were watered as normal and the other 3 plants were given 50% of the normal volume of water. The images were pre-processed utilising the standard normal variate (SNV) and changes over time were evaluated using unsupervised clustering over the time series. The results showed an early detection of stress from day 4 onwards compared to the commonly used normalised difference vegetation index (NDVI), which provided detection from day 9