Multitemporal assessment of crop parameters using multisensorial flying platforms

UAV sensors suitable for precision farming (Sony NEX-5n RGB camera; Canon Powershot modified to infrared sensitivity; MCA6 Tetracam; UAV spectrometer) were compared over differently treated grassland. The high resolution infrared and RGB camera allows spatial analysis of vegetation cover while the UAV spectrometer enables detailed analysis of spectral reflectance at single points. The high spatial and six-band spectral resolution of the MCA6 combines the opportunities of spatial and spectral analysis, but requires huge calibration efforts to acquire reliable data. All investigated systems were able to provide useful information in different distinct research areas of interest in the spatial or spectral domain. The UAV spectrometer was further used to assess multiangular reflectance patterns of wheat. By flying the UAV in a hemispherical path and directing the spectrometer towards the center of this hemisphere, the system acts like a large goniometer. Other than ground based goniometers, this novel method allows huge diameters without any need for infrastructures on the ground. Our experimental results shows good agreement with models and other goniometers, proving the approach valid. UAVs are capable of providing airborne data with a high spatial and temporal resolution due to their flexible and easy use. This was demonstrated in a two year survey. A high resolution RGB camera was flown every week over experimental plots of barley. From the RGB imagery a time series of the barley development was created using the color values. From this analysis we could track differences in the growth of multiple seeding densities and identify events of plant development such as ear pushing. These results lead towards promising practical applications that could be used in breeding for the phenotyping of crop varieties or in the scope of precision farming. With the advent of high endurance UAVs such as airships and the development of better light weight sensors, an exciting future for remote sensing from UAV in agriculture is expected

Hyperspectral reflectance measurements from UAS under intermittent clouds: Correcting irradiance measurements for sensor tilt

One great advantage of optical hyperspectral remote sensing from unmanned aerial systems (UAS) compared to satellite missions is the possibility to fly and collect data below clouds. The most typical scenario is flying below intermittent clouds and under turbulent conditions, which causes tilting of the platform. This study aims to advance hyperspectral imaging from UAS in most weather conditions by addressing two challenges: (i) the radiometric and spectral calibrations of miniaturized hyperspectral sensors; and (ii) tilting effects on measured downwelling irradiance. We developed a novel method to correct the downwelling irradiance data for tilting effects. It uses a hybrid approach of minimizing measured irradiance variations for constant irradiance periods and spectral unmixing, to calculate the spectral diffuse irradiance fraction for all irradiance measurements within a flight. It only requires the platform's attitude data and a standard incoming light sensor. We demonstrated the method at the Palo Verde National Park wetlands in Costa Rica, a highly biodiverse area. Our results showed that the downwelling irradiance correction method reduced systematic shifts caused by a change in flight direction of the UAS, by 87% and achieving a deviation of 2.78% relative to a on ground reference in terms of broadband irradiance. High frequency (< 3 s) irradiance variations caused by high-frequency tilting movements of the UAS were reduced by up to 71%. Our complete spectral and radiometric calibration and irradiance correction can significantly remove typical striped illumination artifacts in the surface reflectance-factor map product. The possibility of collecting precise hyperspectral reflectance-factor data from UAS under varying cloud cover makes it more operational for environmental monitoring or precision agriculture applications, being an important step in advancing hyperspectral imaging from UAS.Innovation Fund Denmark/[7048-00001B]/IFD/DinamarcaAgricultural Water Innovations in the Tropics/[]/AgWIT/CanadáUniversidad de Costa Rica/[805-C0-603]/UCR/Costa RicaUCR::Vicerrectoría de Docencia::Ciencias Básicas::Facultad de Ciencias::Escuela de Físic

Integrated fiber optic spectrally resolved downwelling irradiance sensor for pushbroom spectrometers

We present an integrated fiber optic spectrally resolved downwelling irradiance sensor for pushbroom hyperspectral imagers. The system comprises of a cosine corrector and custom fiber patch cables, collecting the ambient light in a large solid angle and feeding it directly to the entrance slit of the spectrometer. The system enables simultaneous measurement of downwelling and upwelling irradiance using the main hyperspectral camera sensor. As a demonstration, the spectral reflectance of a soil sample was measured with a RMSE of 8.4%, a significant improvement on the RMSE of 54% found without correction. At a weight of approximately 10 grams, this system provides a substantial weight saving over standalone incident light sensing instruments

Direct reflectance transformation methodology for drone-based hyperspectral imaging

Multi- and hyperspectral cameras on drones can be valuable tools in environmental monitoring. A significant shortcoming complicating their usage in quantitative remote sensing applications is insufficient robust radiometric calibration methods. In a direct reflectance transformation method, the drone is equipped with a camera and an irradiance sensor, allowing transformation of image pixel values to reflectance factors without ground reference data. This method requires the sensors to be calibrated with higher accuracy than what is usually required by the empirical line method (ELM), but consequently it offers benefits in robustness, ease of operation, and ability to be used on Beyond-Visual Line of Sight flights. The objective of this study was to develop and assess a drone-based workflow for direct reflectance transformation and implement it on our hyperspectral remote sensing system. A novel atmospheric correction method is also introduced, using two reference panels, but, unlike in the ELM, the correction is not directly affected by changes in the illumination. The sensor system consists of a hyperspectral camera (Rikola HSI, by Senop) and an onboard irradiance spectrometer (FGI AIRS), which were both given thorough radiometric calibrations. In laboratory tests and in a flight experiment, the FGI AIRS tilt-corrected irradiances had accuracy better than 1.9% at solar zenith angles up to 70◦. The system’s lowaltitude reflectance factor accuracy was assessed in a flight experiment using reflectance reference panels, where the normalized root mean square errors (NRMSE) were less than ±2% for the light panels (25% and 50%) and less than ±4% for the dark panels (5% and 10%). In the high-altitude images, taken at 100–150 m altitude, the NRMSEs without atmospheric correction were within 1.4%–8.7% for VIS bands and 2.0%–18.5% for NIR bands. Significant atmospheric effects appeared already at 50 m flight altitude. The proposed atmospheric correction was found to be practical and it decreased the high-altitude NRMSEs to 1.3%–2.6% for VIS bands and to 2.3%– 5.3% for NIR bands. Overall, the workflow was found to be efficient and to provide similar accuracies as the ELM, but providing operational advantages in such challenging scenarios as in forest monitoring, large-scale autonomous mapping tasks, and real-time applications. Tests in varying illumination conditions showed that the reflectance factors of the gravel and vegetation targets varied up to 8% between sunny and cloudy conditions due to reflectance anisotropy effects, while the direct reflectance workflow had better accuracy. This suggests that the varying illumination conditions have to be further accounted for in drone-based in quantitative remote sensing applications

Copernicus Cal/Val Solution - D3.1 Recommendations for R&D activities on Instrumentation Technologies

The Document identifies the gaps in instrumentation technologies for pre-flight characterisation, onboard calibration and Fiducial Reference Measurements (FRM) used for calibration and validation (Cal/Val) activities for the current Copernicus missions. It also addresses the measurement needs for future Copernicus missions and gives a prioritised list of recommendations for R&D activities on instrumentation technologies. Four types of missions are covered based on the division used in the rest of the CCVS project: optical, altimetry, radar and microwave and atmospheric composition. It also gives an overview of some promising instrumentation technologies in each measurement field for FRM that could fill the gaps for requirements not yet met for the current and future Copernicus missions and identifies the research and development (R&D) activities needed to mature these example technologies. The Document does not provide an exhaustive list of all the new technologies being developed but will give a few examples for each field to show what efforts are being made to fill the gaps. None of the examples is promoted as the best possible solutions. The selection is based on the authors' knowledge during the preparation of the Document. The information included is mainly collected from the deliverables of work packages 1 and 2 in the CCVS project. The new technologies are primarily from the interviews with various measurement networks and campaigns carried out in tasks 2.4 and 2.5. Reference documents can be found in section 1.3

Multitemporaalisen hyper- ja multispektrisen UAV kuvauksen käyttö kuusen kaarnakuoriaistuhoissa

Various biotic and abiotic stresses are threatening forests. Modern remote sensing technologies provide powerful means for monitoring forest health, and provide a sustainable basis for forest management and protection. The objective of this study was to develop unmanned aerial vehicle (UAV) based spectral remote sensing technologies for tree health assessment, particularly, for detecting the European spruce bark beetle (Ips typographus L.) attacks. Our focus was to study the early detection of bark beetle attack, i.e. the “green attack” phase. This is a difficult remote sensing task as there does not exist distinct symptoms that can be observed by the human eye. A test site in a Norway spruce (Picea abies (L.) Karst.) dominated forest was established in Southern-Finland in summer 2019. It had an emergent bark beetle outbreak and it was also suffering from other stress factors, especially the root and butt rot (Heterobasidion annosum (Fr.) Bref. s. lato). Altogether seven multitemporal hyper- and multispectral UAV remote sensing datasets were captured from the area in August to October 2019. Firstly, we explored deterioration of tree health and development of spectral symptoms using a time series of UAV hyperspectral imagery. Secondly, we trained assessed a machine learning model for classification of spruce health into classes of “bark beetle green attack”, “root-rot”, and “healthy”. Finally, we demonstrated the use of the model in tree health mapping in a test area. Our preliminary results were promising and indicated that the green attack phase could be detected using the accurately calibrated spectral image data.Peer reviewe

The acquisition of Hyperspectral Digital Surface Models of crops from UAV snapshot cameras

This thesis develops a new approach to capture information about agricultural crops by utilizing advances in the field of robotics, sensor technology, computer vision and photogrammetry: Hyperspectral digital surface models (HS DSMs) generated with UAV snapshot cameras are a representation of a surface in 3D space linked with hyperspectral information emitted and reflected by the objects covered by that surface. The overall research aim of this thesis is to evaluate if HS DSMs are suited for supporting a site-specific crop management. Based on six research studies, three research objectives are discussed for this evaluation. Firstly the influences of environmental effects, the sensing system and data processing of the spectral data within HS DSMs are discussed. Secondly, the comparability of HS DSMs to data from other remote sensing methods is investigated and thirdly their potential to support site-specific crop management is evaluated. Most data within this thesis was acquired at a plant experimental-plot experiment in Klein-Altendorf, Germany, with six different barley varieties and two different fertilizer treatments in the growing seasons of 2013 and 2014. In total, 22 measurement campaigns were carried out in the context of this thesis. HS DSMs acquired with the hyperspectral snapshot cameras Cubert UHD 185-Firefly show great potential for practical applications. The combination of UAVs and the UHD allowed data to be captured at a high spatial, spectral and temporal resolution. The spatial resolution allowed detection of small-scale heterogeneities within the plant population. Additionally, with the spectral and 3D information contained in HS DSMs, plant parameters such as chlorophyll, biomass and plant height could be estimated within individual, and across different growing stages. The techniques developed in this thesis therefore offer a significant contribution towards increasing cropping efficiency through the support of site-specific management

A Compact, High Resolution Hyperspectral Imager for Remote Sensing of Soil Moisture

Measurement of soil moisture content is a key challenge across a variety of fields, ranging from civil engineering through to defence and agriculture. While dedicated satellite platforms like SMAP and SMOS provide high spatial coverage, their low spatial resolution limits their application to larger regional studies. The advent of compact, high lift capacity UAVs has enabled small scale surveys of specific farmland cites. This thesis presents work on the development of a compact, high spatial and spectral resolution hyperspectral imager, designed for remote measurement of soil moisture content. The optical design of the system incorporates a bespoke freeform blazed diffraction grating, providing higher optical performance at a similar aperture to conventional Offner-Chrisp designs. The key challenges of UAV-borne hyperspectral imaging relate to using only solar illumination, with both intermittent cloud cover and atmospheric water absorption creating challenges in obtaining accurate reflectance measurements. A hardware based calibration channel for mitigating cloud cover effects is introduced, along with a comparison of methods for recovering soil moisture content from reflectance data under varying illumination conditions. The data processing pipeline required to process the raw pushbroom data into georectified images is also discussed. Finally, preliminary work on applying soil moisture techniques to leaf imaging are presented

Assessing the impact of illumination on UAV pushbroom hyperspectral imagery collected under various cloud cover conditions

The recent development of small form-factor (<6 kg), full range (400–2500 nm) pushbroom hyperspectral imaging systems (HSI) for unmanned aerial vehicles (UAV) poses a new range of opportunities for passive remote sensing applications. The flexible deployment of these UAV-HSI systems have the potential to expand the data acquisition window to acceptable (though non-ideal) atmospheric conditions. This is an important consideration for time-sensitive applications (e.g. phenology) in areas with persistent cloud cover. Since the majority of UAV studies have focused on applications with ideal illumination conditions (e.g. minimal or non-cloud cover), little is known to what extent UAV-HSI data are affected by changes in illumination conditions due to variable cloud cover. In this study, we acquired UAV pushbroom HSI (400–2500 nm) over three consecutive days with various illumination conditions (i.e. cloud cover), which were complemented with downwelling irradiance data to characterize illumination conditions and in-situ and laboratory reference panel measurements across a range of reflectivity (i.e. 2%, 10%, 18% and 50%) used to evaluate reflectance products. Using these data we address four fundamental aspects for UAV-HSI acquired under various conditions ranging from high (624.6 ± 16.63 W·m2) to low (2.5 ± 0.9 W·m2) direct irradiance: atmospheric compensation, signal-to-noise ratio (SNR), spectral vegetation indices and endmembers extraction. For instance, two atmospheric compensation methods were applied, a radiative transfer model suitable for high direct irradiance, and an Empirical Line Model (ELM) for diffuse irradiance conditions. SNR results for two distinctive vegetation classes (i.e. tree canopy vs herbaceous vegetation) reveal wavelength dependent attenuation by cloud cover, with higher SNR under high direct irradiance for canopy vegetation. Spectral vegetation index (SVIs) results revealed high variability and index dependent effects. For example, NDVI had significant differences (p < 0.05) across illumination conditions, while NDWI appeared insensitive at the canopy level. Finally, often neglected diffuse illumination conditions may be beneficial for revealing spectral features in vegetation that are obscured by the predominantly non-Lambertian reflectance encountered under high direct illumination. To our knowledge, our study is the first to use a full range pushbroom UAV sensor (400–2500 nm) for assessing illumination effects on the aforementioned variables. Our findings pave the way for understanding the advantages and limitations of ultra-high spatial resolution full range high fidelity UAV-HSI for ecological and other applications

Service robotics and machine learning for close-range remote sensing

L'abstract è presente nell'allegato / the abstract is in the attachmen