The acquisition of Hyperspectral Digital Surface Models of crops from UAV snapshot cameras

This thesis develops a new approach to capture information about agricultural crops by utilizing advances in the field of robotics, sensor technology, computer vision and photogrammetry: Hyperspectral digital surface models (HS DSMs) generated with UAV snapshot cameras are a representation of a surface in 3D space linked with hyperspectral information emitted and reflected by the objects covered by that surface. The overall research aim of this thesis is to evaluate if HS DSMs are suited for supporting a site-specific crop management. Based on six research studies, three research objectives are discussed for this evaluation. Firstly the influences of environmental effects, the sensing system and data processing of the spectral data within HS DSMs are discussed. Secondly, the comparability of HS DSMs to data from other remote sensing methods is investigated and thirdly their potential to support site-specific crop management is evaluated. Most data within this thesis was acquired at a plant experimental-plot experiment in Klein-Altendorf, Germany, with six different barley varieties and two different fertilizer treatments in the growing seasons of 2013 and 2014. In total, 22 measurement campaigns were carried out in the context of this thesis. HS DSMs acquired with the hyperspectral snapshot cameras Cubert UHD 185-Firefly show great potential for practical applications. The combination of UAVs and the UHD allowed data to be captured at a high spatial, spectral and temporal resolution. The spatial resolution allowed detection of small-scale heterogeneities within the plant population. Additionally, with the spectral and 3D information contained in HS DSMs, plant parameters such as chlorophyll, biomass and plant height could be estimated within individual, and across different growing stages. The techniques developed in this thesis therefore offer a significant contribution towards increasing cropping efficiency through the support of site-specific management

Sun-Induced Chlorophyll Fluorescence I: Instrumental Considerations for Proximal Spectroradiometers

Growing interest in the proximal sensing of sun‐induced chlorophyll fluorescence (SIF) has been boosted by space-based retrievals and up-coming missions such as the FLuorescence EXplorer (FLEX). The European COST Action ES1309 “Innovative optical tools for proximal sensing of ecophysiological processes” (OPTIMISE, ES1309; https://optimise.dcs.aber.ac.uk/) has produced three manuscripts addressing the main current challenges in this field. This article provides a framework to model the impact of different instrument noise and bias on the retrieval of SIF; and to assess uncertainty requirements for the calibration and characterization of state-of-the-art SIF-oriented spectroradiometers. We developed a sensor simulator capable of reproducing biases and noises usually found in field spectroradiometers. First the sensor simulator was calibrated and characterized using synthetic datasets of known uncertainties defined from laboratory measurements and literature. Secondly, we used the sensor simulator and the characterized sensor models to simulate the acquisition of atmospheric and vegetation radiances from a synthetic dataset. Each of the sensor models predicted biases with propagated uncertainties that modified the simulated measurements as a function of different factors. Finally, the impact of each sensor model on SIF retrieval was analyzed. Results show that SIF retrieval can be significantly affected in situations where reflectance factors are barely modified. SIF errors were found to correlate with drivers of instrumental-induced biases which are as also drivers of plant physiology. This jeopardizes not only the retrieval of SIF, but also the understanding of its relationship with vegetation function, the study of diel and seasonal cycles and the validation of remote sensing SIF products. Further work is needed to determine the optimal requirements in terms of sensor design, characterization and signal correction for SIF retrieval by proximal sensing. In addition, evaluation/validation methods to characterize and correct instrumental responses should be developed and used to test sensors performance in operational conditions

Sun-induced chlorophyll fluorescence II:Review of passive measurement setups, protocols, and their application at the leaf to canopy level

Satellite gravimetry allows for determining large scale mass transport in the system Earth and to quantify ice mass change in polar regions. We provide, evaluate and compare a long time-series of monthly gravity field solutions derived either by satellite laser ranging (SLR) to geodetic satellites, by GPS and K-band observations of the GRACE mission, or by GPS observations of the three Swarm satellites. While GRACE provides gravity signal at the highest spatial resolution, SLR sheds light on mass transport in polar regions at larger scales also in the pre- and post-GRACE era. To bridge the gap between GRACE and GRACE Follow-On, we also derive monthly gravity fields using Swarm data and perform a combination with SLR. To correctly take all correlations into account, this combination is performed on the normal equation level. Validating the Swarm/SLR combination against GRACE during the overlapping period January 2015 to June 2016, the best fit is achieved when down-weighting Swarm compared to the weights determined by variance component estimation. While between 2014 and 2017 SLR alone slightly overestimates mass loss in Greenland compared to GRACE, the combined gravity fields match significantly better in the overlapping time period and the RMS of the differences is reduced by almost 100 Gt. After 2017, both SLR and Swarm indicate moderate mass gain in Greenland

Reviews and syntheses:Remotely sensed optical time series for monitoring vegetation productivity

International audienceAbstract. Vegetation productivity is a critical indicator of global ecosystem health and is impacted by human activities and climate change. A wide range of optical sensing platforms, from ground-based to airborne and satellite, provide spatially continuous information on terrestrial vegetation status and functioning. As optical Earth observation (EO) data are usually routinely acquired, vegetation can be monitored repeatedly over time; reflecting seasonal vegetation patterns and trends in vegetation productivity metrics. Such metrics include e.g., gross primary productivity, net primary productivity, biomass or yield. To summarize current knowledge, in this paper, we systematically reviewed time series (TS) literature for assessing state-of-the-art vegetation productivity monitoring approaches for different ecosystems based on optical remote sensing (RS) data. As the integration of solar-induced fluorescence (SIF) data in vegetation productivity processing chains has emerged as a promising source, we also include this relatively recent sensor modality. We define three methodological categories to derive productivity metrics from remotely sensed TS of vegetation indices or quantitative traits: (i) trend analysis and anomaly detection, (ii) land surface phenology, and (iii) integration and assimilation of TS-derived metrics into statistical and process-based dynamic vegetation models (DVM). Although the majority of used TS data streams originate from data acquired from satellite platforms, TS data from aircraft and unoccupied aerial vehicles have found their way into productivity monitoring studies. To facilitate processing, we provide a list of common toolboxes for inferring productivity metrics and information from TS data. We further discuss validation strategies of the RS-data derived productivity metrics: (1) using in situ measured data, such as yield, (2) sensor networks of distinct sensors, including spectroradiometers, flux towers, or phenological cameras, and (3) inter-comparison of different productivity products or modelled estimates. Finally, we address current challenges and propose a conceptual framework for productivity metrics derivation, including fully-integrated DVMs and radiative transfer models here labelled as "Digital Twin". This novel framework meets the requirements of multiple ecosystems and enables both an improved understanding of vegetation temporal dynamics in response to climate and environmental drivers and also enhances the accuracy of vegetation productivity monitoring

Reviews and syntheses: Remotely sensed optical time series for monitoring vegetation productivity

Vegetation productivity is a critical indicator of global ecosystem health and is impacted by human activities and climate change. A wide range of optical sensing platforms, from ground-based to airborne and satellite, provide spatially continuous information on terrestrial vegetation status and functioning. As optical Earth observation (EO) data are usually routinely acquired, vegetation can be monitored repeatedly over time, reflecting seasonal vegetation patterns and trends in vegetation productivity metrics. Such metrics include gross primary productivity, net primary productivity, biomass, or yield. To summarize current knowledge, in this paper we systematically reviewed time series (TS) literature for assessing state-of-the-art vegetation productivity monitoring approaches for different ecosystems based on optical remote sensing (RS) data. As the integration of solar-induced fluorescence (SIF) data in vegetation productivity processing chains has emerged as a promising source, we also include this relatively recent sensor modality. We define three methodological categories to derive productivity metrics from remotely sensed TS of vegetation indices or quantitative traits: (i) trend analysis and anomaly detection, (ii) land surface phenology, and (iii) integration and assimilation of TS-derived metrics into statistical and process-based dynamic vegetation models (DVMs). Although the majority of used TS data streams originate from data acquired from satellite platforms, TS data from aircraft and unoccupied aerial vehicles have found their way into productivity monitoring studies. To facilitate processing, we provide a list of common toolboxes for inferring productivity metrics and information from TS data. We further discuss validation strategies of the RS data derived productivity metrics: (1) using in situ measured data, such as yield; (2) sensor networks of distinct sensors, including spectroradiometers, flux towers, or phenological cameras; and (3) inter-comparison of different productivity metrics. Finally, we address current challenges and propose a conceptual framework for productivity metrics derivation, including fully integrated DVMs and radiative transfer models here labelled as “Digital Twin”. This novel framework meets the requirements of multiple ecosystems and enables both an improved understanding of vegetation temporal dynamics in response to climate and environmental drivers and enhances the accuracy of vegetation productivity monitoring

Global Wheat Head Detection 2021: an improved dataset for benchmarking wheat head detection methods

The Global Wheat Head Detection (GWHD) dataset was created in 2020 and has assembled 193,634 labelled wheat heads from 4700 RGB images acquired from various acquisition platforms and 7 countries/institutions. With an associated competition hosted in Kaggle, GWHD_2020 has successfully attracted attention from both the computer vision and agricultural science communities. From this first experience, a few avenues for improvements have been identified regarding data size, head diversity, and label reliability. To address these issues, the 2020 dataset has been reexamined, relabeled, and complemented by adding 1722 images from 5 additional countries, allowing for 81,553 additional wheat heads. We now release in 2021 a new version of the Global Wheat Head Detection dataset, which is bigger, more diverse, and less noisy than the GWHD_2020 version

Multi-sensor spectral synergies for crop stress detection and monitoring in the optical domain: A review

Remote detection and monitoring of the vegetation responses to stress became relevant for sustainable agriculture. Ongoing developments in optical remote sensing technologies have provided tools to increase our understanding of stress-related physiological processes. Therefore, this study aimed to provide an overview of the main spectral technologies and retrieval approaches for detecting crop stress in agriculture. Firstly, we present integrated views on: i) biotic and abiotic stress factors, the phases of stress, and respective plant responses, and ii) the affected traits, appropriate spectral domains and corresponding methods for measuring traits remotely. Secondly, representative results of a systematic literature analysis are highlighted, identifying the current status and possible future trends in stress detection and monitoring. Distinct plant responses occurring under short-term, medium-term or severe chronic stress exposure can be captured with remote sensing due to specific light interaction processes, such as absorption and scattering manifested in the reflected radiance, i.e. visible (VIS), near infrared (NIR), shortwave infrared, and emitted radiance, i.e. solar-induced fluorescence and thermal infrared (TIR). From the analysis of 96 research papers, the following trends can be observed: increasing usage of satellite and unmanned aerial vehicle data in parallel with a shift in methods from simpler parametric approaches towards more advanced physically-based and hybrid models. Most study designs were largely driven by sensor availability and practical economic reasons, leading to the common usage of VIS-NIR-TIR sensor combinations. The majority of reviewed studies compared stress proxies calculated from single-source sensor domains rather than using data in a synergistic way. We identified new ways forward as guidance for improved synergistic usage of spectral domains for stress detection: (1) combined acquisition of data from multiple sensors for analysing multiple stress responses simultaneously (holistic view); (2) simultaneous retrieval of plant traits combining multi-domain radiative transfer models and machine learning methods; (3) assimilation of estimated plant traits from distinct spectral domains into integrated crop growth models. As a future outlook, we recommend combining multiple remote sensing data streams into crop model assimilation schemes to build up Digital Twins of agroecosystems, which may provide the most efficient way to detect the diversity of environmental and biotic stresses and thus enable respective management decisions

State-of-the-art in UAV remote sensing survey - First insights into applications of UAV sensing systems

UAVs are increasingly adapted as remote sensing platforms. Together with specialized sensors, they become powerful sensing systems for environmental monitoring and surveying. Spectral data has great capabilities to the gather information about biophysical and biochemical properties. Still, capturing meaningful spectral data in a reproducible way is not trivial. Since a couple of years small and lightweight spectral sensors, which can be carried on small flexible platforms, have become available. With their adaption in the community, the responsibility to ensure the quality of the data is increasingly shifted from specialized companies and agencies to individual researchers or research teams. Due to the complexity of the data acquisition of spectral data, this poses a challenge for the community and standardized protocols, metadata and best practice procedures are needed to make data intercomparable. In November 2016, the ESSEM COST action Innovative optical Tools for proximal sensing of ecophysiological processes (OPTIMISE; http://optimise.dcs.aber.ac.uk/) held a workshop on best practices for UAV spectral sampling. The objective of this meeting was to trace the way from particle to pixel and identify influences on the data quality / reliability, to figure out how well we are currently doing with spectral sampling from UAVs and how we can improve. Additionally, a survey was designed to be distributed within the community to get an overview over the current practices and raise awareness for the topic. This talk will introduce the approach of the OPTIMISE community towards best practises in UAV spectral sampling and present first results of the survey (http://optimise.dcs.aber.ac.uk/uav-survey/). This contribution briefly introduces the survey and gives some insights into the first results given by the interviewees.ISSN:1682-1750ISSN:2194-9034ISSN:1682-177

Multi-temporal high-resolution imaging spectroscopy with hyperspectral 2D imagers - From theory to application

With the increasing availability of spectral sensors and consumer-grade data processing software, a democratization of imaging spectroscopy is taking place. In particular, novel lightweight 2D spectral imagers in combination with UAVs are increasingly being adapted for imaging spectroscopy. In contrast to traditional line scanners, these sensors capture spectral information as a 2D image within every exposure. With computer vision algorithms embedded in consumer grade software packages, these data can be processed to hyperspectral digital surface models that hold spectral and 3D spatial information in very high resolution. To understand the spectral signal, however, one must comprehend the complexity of the capturing and data processing process in imaging spectroscopy with 2D imagers. This study establishes the theoretical background to comprehend the properties of spectral data acquired with 2D imagers and investigates how different data processing schemes influence the data. To improve the interpretability of a spectral signal derived for an area of interest (AOI, the specific field of view is introduced as a concept to understand the composition of pixels and their angular properties used to characterize a specific AOI within a remote sensing scene. These considerations are applied to a multi-temporal field study carried out under different illumination conditions in a barley field phenotyping experiment. It is shown that data processing significantly affects the angular properties of the spectral data and influences the apparent spectral signature. The largest differences are found in the red domain, where the signal differs by approximately 10% relative to a single nadir image. Even larger differences of approximately 14% are found in comparison with ground-based non-imaging field spectrometer measurements. The differences are explained by investigating the interaction between the angular properties of the data and canopy anisotropy, which are wavelength and growth stage dependent. Additionally, it is shown that common vegetation indices cannot normalize the differences and that the retrieval of chlorophyll is affected. In conclusion, this study helps to understand the process of imaging spectroscopy with 2D imagers and provides recommendations for future missions