Unmanned Aerial Vehicle-Based Phenotyping Using Morphometric and Spectral Analysis Can Quantify Responses of Wild Tomato Plants to Salinity Stress

With salt stress presenting a major threat to global food production, attention has turned to the identification and breeding of crop cultivars with improved salt tolerance. For instance, some accessions of wild species with higher salt tolerance than commercial varieties are being investigated for their potential to expand food production into marginal areas or to use brackish waters for irrigation. However, assessment of individual plant responses to salt stress in field trials is time-consuming, limiting, for example, longitudinal assessment of large numbers of plants. Developments in Unmanned Aerial Vehicle (UAV) sensing technologies provide a means for extensive, repeated and consistent phenotyping and have significant advantages over standard approaches. In this study, 199 accessions of the wild tomato species, Solanum pimpinellifolium, were evaluated through a field assessment of 600 control and 600 salt-treated plants. UAV imagery was used to: (1) delineate tomato plants from a time-series of eight RGB and two multi-spectral datasets, using an automated object-based image analysis approach; (2) assess four traits, i.e., plant area, growth rates, condition and Plant Projective Cover (PPC) over the growing season; and (3) use the mapped traits to identify the best-performing accessions in terms of yield and salt tolerance. For the first five campaigns, >99% of all tomato plants were automatically detected. The omission rate increased to 2–5% for the last three campaigns because of the presence of dead and senescent plants. Salt-treated plants exhibited a significantly smaller plant area (average control and salt-treated plant areas of 0.55 and 0.29 m2, respectively), maximum growth rate (daily maximum growth rate of control and salt-treated plant of 0.034 and 0.013 m2, respectively) and PPC (5–16% difference) relative to control plants. Using mapped plant condition, area, growth rate and PPC, we show that it was possible to identify eight out of the top 10 highest yielding accessions and that only five accessions produced high yield under both treatments. Apart from showcasing multi-temporal UAV-based phenotyping capabilities for the assessment of plant performance, this research has implications for agronomic studies of plant salt tolerance and for optimizing agricultural production under saline conditions

Reconstructing Cloud Contaminated Pixels Using Spatiotemporal Covariance Functions and Multitemporal Hyperspectral Imagery

One of the major challenges in optical-based remote sensing is the presence of clouds, which imposes a hard constraint on the use of multispectral or hyperspectral satellite imagery for earth observation. While some studies have used interpolation models to remove cloud affected data, relatively few aim at restoration via the use of multi-temporal reference images. This paper proposes not only the use of image time-series, but also the implementation of a geostatistical model that considers the spatiotemporal correlation between them to fill the cloud-related gaps. Using Hyperion hyperspectral images, we demonstrate a capacity to reconstruct cloud-affected pixels and predict their underlying surface reflectance values. To do this, cloudy pixels were masked and a parametric family of non-separable covariance functions was automated fitted, using a composite likelihood estimator. A subset of cloud-free pixels per scene was used to perform a kriging interpolation and to predict the spectral reflectance per each cloud-affected pixel. The approach was evaluated using a benchmark dataset of cloud-free pixels, with a synthetic cloud superimposed upon these data. An overall root mean square error (RMSE) of between 0.5% and 16% of the reflectance was achieved, representing a relative root mean square error (rRMSE) of between 0.2% and 7.5%. The spectral similarity between the predicted and reference reflectance signatures was described by a mean spectral angle (MSA) of between 1° and 11°, demonstrating the spatial and spectral coherence of predictions. The approach provides an efficient spatiotemporal interpolation framework for cloud removal, gap-filling, and denoising in remotely sensed datasets

Radiometric Assessment of a UAV-Based Push-Broom Hyperspectral Camera

The use of unmanned aerial vehicles (UAVs) for Earth and environmental sensing has increased significantly in recent years. This is particularly true for multi- and hyperspectral sensing, with a variety of both push-broom and snap-shot systems becoming available. However, information on their radiometric performance and stability over time is often lacking. The authors propose the use of a general protocol for sensor evaluation to characterize the data retrieval and radiometric performance of push-broom hyperspectral cameras, and illustrate the workflow with the Nano-Hyperspec (Headwall Photonics, Boston USA) sensor. The objectives of this analysis were to: (1) assess dark current and white reference consistency, both temporally and spatially; (2) evaluate spectral fidelity; and (3) determine the relationship between sensor-recorded radiance and spectroradiometer-derived reflectance. Both the laboratory-based dark current and white reference evaluations showed an insignificant increase over time (<2%) across spatial pixels and spectral bands for >99.5% of pixel–waveband combinations. Using a mercury/argon (Hg/Ar) lamp, the hyperspectral wavelength bands exhibited a slight shift of 1-3 nm against 29 Hg/Ar wavelength emission lines. The relationship between the Nano-Hyperspec radiance values and spectroradiometer-derived reflectance was found to be highly linear for all spectral bands. The developed protocol for assessing UAV-based radiometric performance of hyperspectral push-broom sensors showed that the Nano-Hyperspec data were both time-stable and spectrally sound

Detection of Chlorophyll and Leaf Area Index Dynamics from Sub-weekly Hyperspectral Imagery

Temporally rich hyperspectral time-series can provide unique time critical information on within-field variations in vegetation health and distribution needed by farmers to effectively optimize crop production. In this study, a dense time series of images were acquired from the Earth Observing-1 (EO-1) Hyperion sensor over an intensive farming area in the center of Saudi Arabia. After correction for atmospheric effects, optimal links between carefully selected explanatory hyperspectral vegetation indices and target vegetation characteristics were established using a machine learning approach. A dataset of in-situ measured leaf chlorophyll (Chll) and leaf area index (LAI), collected during five intensive field campaigns over a variety of crop types, were used to train the rule-based predictive models. The ability of the narrow-band hyperspectral reflectance information to robustly assess and discriminate dynamics in foliar biochemistry and biomass through empirical relationships were investigated. This also involved evaluations of the generalization and reproducibility of the predictions beyond the conditions of the training dataset. The very high temporal resolution of the satellite retrievals constituted a specifically intriguing feature that facilitated detection of total canopy Chl and LAI dynamics down to sub-weekly intervals. The study advocates the benefits associated with the availability of optimum spectral and temporal resolution spaceborne observations for agricultural management purposes

A Random Forest Machine Learning Approach for the Retrieval of Leaf Chlorophyll Content in Wheat

Developing rapid and non-destructive methods for chlorophyll estimation over large spatial areas is a topic of much interest, as it would provide an indirect measure of plant photosynthetic response, be useful in monitoring soil nitrogen content, and offer the capacity to assess vegetation structural and functional dynamics. Traditional methods of direct tissue analysis or the use of handheld meters, are not able to capture chlorophyll variability at anything beyond point scales, so are not particularly useful for informing decisions on plant health and status at the field scale. Examining the spectral response of plants via remote sensing has shown much promise as a means to capture variations in vegetation properties, while offering a non-destructive and scalable approach to monitoring. However, determining the optimum combination of spectra or spectral indices to inform plant response remains an active area of investigation. Here, we explore the use of a machine learning approach to enhance the estimation of leaf chlorophyll (Chlt), defined as the sum of chlorophyll a and b, from spectral reflectance data. Using an ASD FieldSpec 4 Hi-Res spectroradiometer, 2700 individual leaf hyperspectral reflectance measurements were acquired from wheat plants grown across a gradient of soil salinity and nutrient levels in a greenhouse experiment. The extractable Chlt was determined from laboratory analysis of 270 collocated samples, each composed of three leaf discs. A random forest regression algorithm was trained against these data, with input predictors based upon (1) reflectance values from 2102 bands across the 400–2500 nm spectral range; and (2) 45 established vegetation indices. As a benchmark, a standard univariate regression analysis was performed to model the relationship between measured Chlt and the selected vegetation indices. Results show that the root mean square error (RMSE) was significantly reduced when using the machine learning approach compared to standard linear regression. When exploiting the entire spectral range of individual bands as input variables, the random forest estimated Chlt with an RMSE of 5.49 µg·cm−2 and an R2 of 0.89. Model accuracy was improved when using vegetation indices as input variables, producing an RMSE ranging from 3.62 to 3.91 µg·cm−2, depending on the particular combination of indices selected. In further analysis, input predictors were ranked according to their importance level, and a step-wise reduction in the number of input features (from 45 down to 7) was performed. Implementing this resulted in no significant effect on the RMSE, and showed that much the same prediction accuracy could be obtained by a smaller subset of indices. Importantly, the random forest regression approach identified many important variables that were not good predictors according to their linear regression statistics. Overall, the research illustrates the promise in using established vegetation indices as input variables in a machine learning approach for the enhanced estimation of Chlt from hyperspectral data