An operational radiometric correction technique for shadow reduction in multispectral uav imagery

This study focuses on the recovery of information from shadowed pixels in RGB or multispectral imagery sensed from unmanned aerial vehicles (UAVs). The proposed technique is based on the concept that a property characterizing a given surface is its spectral reflectance, i.e., the ratio between the flux reflected by the surface and the radiant flux received by the surface, and this ratio is usually similar under direct-plus-diffuse irradiance and under diffuse irradiance when a Lambertian behavior can be assumed. Scene-dependent elements, such as trees, shrubs, man-made constructions, or terrain relief, can block part of the direct irradiance (usually sunbeams), in which part of the surface only receives diffuse irradiance. As a consequence, shadowed surfaces comprising pixels of the image created by the UAV remote sensor appear. Regardless of whether the imagery is analyzed by means of photointerpretation or digital classification methods, when the objective is to create land cover maps, it is hard to treat these areas in a coherent way in terms of the areas receiving direct and diffuse irradiance. The hypothesis of the present work is that the relationship between irradiance conditions in shadowed areas and non-shadowed areas can be determined by following classical empirical line techniques for fulfilling the objective of a coherent treatment in both kinds of areas. The novelty of the presented method relies on the simultaneous recovery of information in non-shadowed and shadowed areas by the in situ spectral reflectance measurements of characterized Lambertian targets followed by smoothing of the penumbra area. Once in the lab, firstly, we accurately detected the shadowed pixels by combining two well-known techniques for the detection of the shadowed areas: (1) using a physical approach based on the sun's position and the digital surface model of the area covered by the imagery; and (2) the image-based approach using the histogram properties of the intensity image. In this paper, we present the benefits of the combined usage of both techniques. Secondly, we applied a fit between non-shadowed and shadowed areas by using a twin set of spectrally characterized target sets. One set was placed under direct and diffuse irradiance (non-shadowed targets), whereas the second set (with the same spectral characteristics) was placed under diffuse irradiance (shadowed targets). Assuming that the reflectance of the homologous targets of each set was the same, we approximated the diffuse incoming irradiance through an empirical line correction. The model was applied to all detected shadowed areas in the whole scene. Finally, a smoothing filter was applied to the penumbra transitions. The presented empirical method allowed the operational and coherent recovery of information from shadowed areas, which is very common in high-resolution UAV imagery

Real-time and post-processed georeferencing for hyperpspectral drone remote sensing

The use of drones and photogrammetric technologies are increasing rapidly in different applications. Currently, drone processing workflow is in most cases based on sequential image acquisition and post-processing, but there are great interests towards real-time solutions. Fast and reliable real-time drone data processing can benefit, for instance, environmental monitoring tasks in precision agriculture and in forest. Recent developments in miniaturized and low-cost inertial measurement systems and GNSS sensors, and Real-time kinematic (RTK) position data are offering new perspectives for the comprehensive remote sensing applications. The combination of these sensors and light-weight and low-cost multi- or hyperspectral frame sensors in drones provides the opportunity of creating near real-time or real-time remote sensing data of target object. We have developed a system with direct georeferencing onboard drone to be used combined with hyperspectral frame cameras in real-time remote sensing applications. The objective of this study is to evaluate the real-time georeferencing comparing with post-processing solutions. Experimental data sets were captured in agricultural and forested test sites using the system. The accuracy of onboard georeferencing data were better than 0.5 m. The results showed that the real-time remote sensing is promising and feasible in both test sites. © Authors 2018. CC BY 4.0 License.Peer reviewe

Assessing the impact of illumination on UAV pushbroom hyperspectral imagery collected under various cloud cover conditions

The recent development of small form-factor (<6 kg), full range (400–2500 nm) pushbroom hyperspectral imaging systems (HSI) for unmanned aerial vehicles (UAV) poses a new range of opportunities for passive remote sensing applications. The flexible deployment of these UAV-HSI systems have the potential to expand the data acquisition window to acceptable (though non-ideal) atmospheric conditions. This is an important consideration for time-sensitive applications (e.g. phenology) in areas with persistent cloud cover. Since the majority of UAV studies have focused on applications with ideal illumination conditions (e.g. minimal or non-cloud cover), little is known to what extent UAV-HSI data are affected by changes in illumination conditions due to variable cloud cover. In this study, we acquired UAV pushbroom HSI (400–2500 nm) over three consecutive days with various illumination conditions (i.e. cloud cover), which were complemented with downwelling irradiance data to characterize illumination conditions and in-situ and laboratory reference panel measurements across a range of reflectivity (i.e. 2%, 10%, 18% and 50%) used to evaluate reflectance products. Using these data we address four fundamental aspects for UAV-HSI acquired under various conditions ranging from high (624.6 ± 16.63 W·m2) to low (2.5 ± 0.9 W·m2) direct irradiance: atmospheric compensation, signal-to-noise ratio (SNR), spectral vegetation indices and endmembers extraction. For instance, two atmospheric compensation methods were applied, a radiative transfer model suitable for high direct irradiance, and an Empirical Line Model (ELM) for diffuse irradiance conditions. SNR results for two distinctive vegetation classes (i.e. tree canopy vs herbaceous vegetation) reveal wavelength dependent attenuation by cloud cover, with higher SNR under high direct irradiance for canopy vegetation. Spectral vegetation index (SVIs) results revealed high variability and index dependent effects. For example, NDVI had significant differences (p < 0.05) across illumination conditions, while NDWI appeared insensitive at the canopy level. Finally, often neglected diffuse illumination conditions may be beneficial for revealing spectral features in vegetation that are obscured by the predominantly non-Lambertian reflectance encountered under high direct illumination. To our knowledge, our study is the first to use a full range pushbroom UAV sensor (400–2500 nm) for assessing illumination effects on the aforementioned variables. Our findings pave the way for understanding the advantages and limitations of ultra-high spatial resolution full range high fidelity UAV-HSI for ecological and other applications

Hyperspectral reflectance measurements from UAS under intermittent clouds: Correcting irradiance measurements for sensor tilt

One great advantage of optical hyperspectral remote sensing from unmanned aerial systems (UAS) compared to satellite missions is the possibility to fly and collect data below clouds. The most typical scenario is flying below intermittent clouds and under turbulent conditions, which causes tilting of the platform. This study aims to advance hyperspectral imaging from UAS in most weather conditions by addressing two challenges: (i) the radiometric and spectral calibrations of miniaturized hyperspectral sensors; and (ii) tilting effects on measured downwelling irradiance. We developed a novel method to correct the downwelling irradiance data for tilting effects. It uses a hybrid approach of minimizing measured irradiance variations for constant irradiance periods and spectral unmixing, to calculate the spectral diffuse irradiance fraction for all irradiance measurements within a flight. It only requires the platform's attitude data and a standard incoming light sensor. We demonstrated the method at the Palo Verde National Park wetlands in Costa Rica, a highly biodiverse area. Our results showed that the downwelling irradiance correction method reduced systematic shifts caused by a change in flight direction of the UAS, by 87% and achieving a deviation of 2.78% relative to a on ground reference in terms of broadband irradiance. High frequency (< 3 s) irradiance variations caused by high-frequency tilting movements of the UAS were reduced by up to 71%. Our complete spectral and radiometric calibration and irradiance correction can significantly remove typical striped illumination artifacts in the surface reflectance-factor map product. The possibility of collecting precise hyperspectral reflectance-factor data from UAS under varying cloud cover makes it more operational for environmental monitoring or precision agriculture applications, being an important step in advancing hyperspectral imaging from UAS.Innovation Fund Denmark/[7048-00001B]/IFD/DinamarcaAgricultural Water Innovations in the Tropics/[]/AgWIT/CanadáUniversidad de Costa Rica/[805-C0-603]/UCR/Costa RicaUCR::Vicerrectoría de Docencia::Ciencias Básicas::Facultad de Ciencias::Escuela de Físic

Service robotics and machine learning for close-range remote sensing

L'abstract è presente nell'allegato / the abstract is in the attachmen

An Analysis of the Radiometric Quality of Small Unmanned Aircraft System Imagery

In recent years, significant advancements have been made in both sensor technology and small Unmanned Aircraft Systems (sUAS). Improved sensor technology has provided users with cheaper, lighter, and higher resolution imaging tools, while new sUAS platforms have become cheaper, more stable and easier to navigate both manually and programmatically. These enhancements have provided remote sensing solutions for both commercial and research applications that were previously unachievable. However, this has provided non-scientific practitioners with access to technology and techniques previously only available to remote sensing professionals, sometimes leading to improper diagnoses and results. The work accomplished in this dissertation demonstrates the impact of proper calibration and reflectance correction on the radiometric quality of sUAS imagery. The first part of this research conducts an in-depth investigation into a proposed technique for radiance-to-reflectance conversion. Previous techniques utilized reflectance conversion panels in-scene, which, while providing accurate results, required extensive time in the field to position the panels as well as measure them. We have positioned sensors on board the sUAS to record the downwelling irradiance which then can be used to produce reflectance imagery without the use of these reflectance conversion panels. The second part of this research characterizes and calibrates a MicaSense RedEdge-3, a multispectral imaging sensor. This particular sensor comes pre-loaded with metadata values, which are never recalibrated, for dark level bias, vignette and row-gradient correction and radiometric calibration. This characterization and calibration studies were accomplished to demonstrate the importance of recalibration of any sensors over a period of time. In addition, an error propagation was performed to detect the highest contributors of error in the production of radiance and reflectance imagery. Finally, a study of the inherent reflectance variability of vegetation was performed. In other words, this study attempts to determine how accurate the digital count to radiance calibration and the radiance to reflectance conversion has to be. Can we lower our accuracy standards for radiance and reflectance imagery, because the target itself is too variable to measure? For this study, six Coneflower plants were analyzed, as a surrogate for other cash crops, under different illumination conditions, at different times of the day, and at different ground sample distances (GSDs)

UAVs for the Environmental Sciences

This book gives an overview of the usage of UAVs in environmental sciences covering technical basics, data acquisition with different sensors, data processing schemes and illustrating various examples of application