Unmixing-Based Fusion of Hyperspatial and Hyperspectral Airborne Imagery for Early Detection of Vegetation Stress

"© 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.” Upon publication, authors are asked to include either a link to the abstract of the published article in IEEE Xplore®, or the article’s Digital Object Identifier (DOI).Many applications require a timely acquisition of high spatial and spectral resolution remote sensing data. This is often not achievable since spaceborne remote sensing instruments face a tradeoff between spatial and spectral resolution, while airborne sensors mounted on a manned aircraft are too expensive to acquire a high temporal resolution. This gap between information needs and data availability inspires research on using Remotely Piloted Aircraft Systems (RPAS) to capture the desired high spectral and spatial information, furthermore providing temporal flexibility. Present hyperspectral imagers on board lightweight RPAS are still rare, due to the operational complexity, sensor weight, and instability. This paper looks into the use of a hyperspectral-hyperspatial fusion technique for an improved biophysical parameter retrieval and physiological assessment in agricultural crops. First, a biophysical parameter extraction study is performed on a simulated citrus orchard. Subsequently, the unmixing-based fusion is applied on a real test case in commercial citrus orchards with discontinuous canopies, in which a more efficient and accurate estimation of water stress is achieved by fusing thermal hyperspatial and hyperspectral (APEX) imagery. Narrowband reflectance indices that have proven their effectiveness as previsual indicators of water stress, such as the Photochemical Reflectance Index (PRI), show a significant increase in tree water-stress detection when applied on the fused dataset compared to the original hyperspectral APEX dataset (R-2 = 0.62, p 0.1). Maximal R-2 values of 0.93 and 0.86 are obtained by a linear relationship between the vegetation index and the resp., water and chlorophyll, parameter content maps.This work was supported in part by the Belgian Science Policy Office in the frame of the Stereo II program (Hypermix project-SR/00/141), in part by the project Chameleon of the Flemish Agency for Innovation by Science and Technology (IWT), and in part by the Spanish Ministry of Science and Education (MEC) for the projects AGL2012-40053-C03-01 and CONSOLIDER RIDECO (CSD2006-67). The European Facility for Airborne Research EUFAR (www.eufar.net) funded the flight campaign (Transnational Access Project 'Hyper-Stress'). The work of D. S. Intrigliolo was supported by the Spanish Ministry of Economy and Competitiveness program "Ramon y Cajal."Delalieux, S.; Zarco-Tejada, PJ.; Tits, L.; Jiménez Bello, MÁ.; Intrigliolo Molina, DS.; Somers, B. (2014). Unmixing-Based Fusion of Hyperspatial and Hyperspectral Airborne Imagery for Early Detection of Vegetation Stress. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 7(6):2571-2582. https://doi.org/10.1109/JSTARS.2014.2330352S257125827

Early detection and quantification of verticillium wilt in olive using hyperspectral and thermal imagery over large areas

© 2015 by the authors. Automatic methods for an early detection of plant diseases (i.e., visible symptoms at early stages of disease development) using remote sensing are critical for precision crop protection. Verticillium wilt (VW) of olive caused by Verticillium dahliae can be controlled only if detected at early stages of development. Linear discriminant analysis (LDA) and support vector machine (SVM) classification methods were applied to classify V. dahliae severity using remote sensing at large scale. High-resolution thermal and hyperspectral imagery were acquired with a manned platform which flew a 3000-ha commercial olive area. LDA reached an overall accuracy of 59.0% and a κ of 0.487 while SVM obtained a higher overall accuracy, 79.2% with a similar κ, 0.495. However, LDA better classified trees at initial and low severity levels, reaching accuracies of 71.4 and 75.0%, respectively, in comparison with the 14.3% and 40.6% obtained by SVM. Normalized canopy temperature, chlorophyll fluorescence, structural, xanthophyll, chlorophyll, carotenoid and disease indices were found to be the best indicators for early and advanced stage infection by VW. These results demonstrate that the methods developed in other studies at orchard scale are valid for flights in large areas comprising several olive orchards differing in soil and crop management characteristics.Financial support for this research was provided by Project P08-AGR-03528 from “Consejería de Economía, Innovación y Ciencia” of Junta de Andalucía and the European Social Fund, and projects AGL-2012-37521 and AGL2012-40053-C03-01 from the Spanish “Ministerio de Economía y Competitividad” and the European Social Fund. Rocio Calderón is a recipient of research fellowship BES-2010-035511 from the Spanish “Ministerio de Ciencia e Innovación”.We acknowledge support of the publication fee by the CSIC Open Access Publication Support Initiative through its Unit of Information Resources for Research (URICI).Peer Reviewe

Quantitative estimation of vegetation traits and temporal dynamics using 3-D radiative transfer models, high-resolution hyperspectral images and satellite imagery

Large-scale monitoring of vegetation dynamics by remote sensing is key to detecting early signs of vegetation decline. Spectral-based indicators of phys-iological plant traits (PTs) have the potential to quantify variations in pho-tosynthetic pigments, chlorophyll fluorescence emission, and structural changes of vegetation as a function of stress. However, the specific response of PTs to disease-induced decline in heterogeneous canopies remains largely unknown, which is critical for the early detection of irreversible damage at different scales. Four specific objectives were defined in this research: i) to assess the feasibility of modelling the incidence and severity of Phytophthora cinnamomi and Xylella fastidiosa based on PTs and biophysical properties of vegetation; ii) to assess non-visual early indicators, iii) to retrieve PT using radiative transfer models (RTM), high-resolution imagery and satellite observations; and iv) to establish the basis for scaling up PTs at different spatial resolutions using RTM for their retrieval in different vegetation co-vers. This thesis integrates different approaches combining field data, air- and space-borne imagery, and physical and empirical models that allow the retrieval of indicators and the evaluation of each component’s contribution to understanding temporal variations of disease-induced symptoms in heter-ogeneous canopies. Furthermore, the effects associated with the understory are introduced, showing not only their impact but also providing a compre-hensive model to account for it. Consequently, a new methodology has been established to detect vegetation health processes and the influence of biotic and abiotic factors, considering different components of the canopy and their impact on the aggregated signal. It is expected that, using the presented methods, existing remote sensors and future developments, the ability to detect and assess vegetation health globally will have a substantial impact not only on socio-economic factors, but also on the preservation of our eco-system as a whole

Hyperspectral Imaging from Ground Based Mobile Platforms and Applications in Precision Agriculture

This thesis focuses on the use of line scanning hyperspectral sensors on mobile ground based platforms and applying them to agricultural applications. First this work deals with the geometric and radiometric calibration and correction of acquired hyperspectral data. When operating at low altitudes, changing lighting conditions are common and inevitable, complicating the retrieval of a surface's reflectance, which is solely a function of its physical structure and chemical composition. Therefore, this thesis contributes the evaluation of an approach to compensate for changes in illumination and obtain reflectance that is less labour intensive than traditional empirical methods. Convenient field protocols are produced that only require a representative set of illumination and reflectance spectral samples. In addition, a method for determining a line scanning camera's rigid 6 degree of freedom (DOF) offset and uncertainty with respect to a navigation system is developed, enabling accurate georegistration and sensor fusion. The thesis then applies the data captured from the platform to two different agricultural applications. The first is a self-supervised weed detection framework that allows training of a per-pixel classifier using hyperspectral data without manual labelling. The experiments support the effectiveness of the framework, rivalling classifiers trained on hand labelled training data. Then the thesis demonstrates the mapping of mango maturity using hyperspectral data on an orchard wide scale using efficient image scanning techniques, which is a world first result. A novel classification, regression and mapping pipeline is proposed to generate per tree mango maturity averages. The results confirm that maturity prediction in mango orchards is possible in natural daylight using a hyperspectral camera, despite complex micro-illumination-climates under the canopy

Challenges and opportunities of using ecological and remote sensing variables for crop pest and disease mapping

Crop pest and diseases are responsible for major economic losses in the agricultural systems in Africa resulting in food insecurity. Potential yield losses for major crops across Africa are mainly caused by pests and diseases. Total losses have been estimated at 70% with approximately 30% caused by inefficient crop protection practices. With newly emerging crop pests and disease, monitoring plant health and detecting pathogens early is essential to reduce disease spread and to facilitate effective management practices. While many pest and diseases can be acquired from another host or via the environment, the majority are transmitted by biological vectors. Thus, vector ecology can serve an indirect explanation of disease cycles, outbreaks, and prevalence. Hence, better understanding of the vector niche and the dependence of pest and disease processes on their specific spatial and ecological contexts is therefore required for better management and control. While research in disease ecology has revealed important life history of hosts with the surrounding environment, other aspects need to be explored to better understand vector transmission and control strategies. For instance, choosing appropriate farming practices have proved to be an alternative to the use of synthetic pesticides. For instance, intercropping can serve as a buffer against the spread of plant pests and pathogens by attracting pests away from their host plant and also increasing the distance between plants of the same species, making it more exigent for the pest to target the main crop. Many studies have explored the potential applications of geospatial technology in disease ecology. However, pest and disease mapping in crops is rather crudely done thus far, using Spatial Distribution Models (SDM) on a regional scale. Previous research has explored climatic data to model habitat suitability and the distribution of different crop pests and diseases. However, there are limitation to using climate data since it ignores the dispersal and competition from other factors which determines the distribution of vectors transmitting the disease, thus resulting in model over prediction. For instance, vegetation patterns and heterogeneity at the landscape level has been identified to play a key role in influencing the vector-host-pathogen transmission, including vector distribution, abundance and diversity at large. Such variables can be extracted from remote sensing dataset with high accuracy over a large extent. The use of remotely sensed variables in modeling crop pest and disease has proved to increase the accuracy and precision of the models by reducing over fitting as compared to when only climatic data which are interpolated over large areas thus disregarding landscape heterogeneity.When used, remotely sensed predictors may capture subtle variances in the vegetation characteristic or in the phenology linked with the niche of the vector transmitting the disease which cannot be explained by climatic variables. Subsequently, the full potential of remote sensing applications to detect changes in habitat condition of species remains uncharted. This study aims at exploring the potential behind developing a framework which integrates both ecological and remotely sensed dataset with a robust mapping/modelling approach with aim of developing an integrated pest management approach for pest and disease affecting both annual and perrennial crops and whom currently there is no cure or existing germplasm to control further spread across sub Saharan Africa.Herausforderungen und Möglichkeiten der Verwendung von ökologischen und Fernerkundungsvariablen für die Schädlings- und Krankheitskartierung Pflanzenschädlinge und Krankheiten in der Landwirtschaft sind für große wirtschaftliche Verluste in Afrika verantwortlich, die zu Ernährungsunsicherheit führen. Die Verluste werden auf 70% geschätzt, wobei etwa 30% auf ineffiziente Pflanzenschutzpraktiken zurückzuführen sind. Bei neu auftretenden Pflanzenschädlingen und Krankheiten ist die Überwachung des Pflanzenzustands und die frühzeitige Erkennung von Krankheitserregern unerlässlich, um die Ausbreitung von Krankheiten zu reduzieren und effektive Managementpraktiken zu erleichtern. Während viele Schädlinge und Krankheiten von einem anderen Wirt oder über die Umwelt erworben werden können, wird die Mehrheit durch biologische Vektoren übertragen. Daraus folgt, dass die Vektorökologie als indirekte Erklärung von Krankheitszyklen, Ausbrüchen und Prävalenz untersucht werden sollte. Um effektive Vektorkontrollmaßnahmen zu entwickeln ist ein besseres Verständnis der ökologischen Vektor-Nischen und der Abhängigkeit von Schädlings- und Krankheits-Prozessen von ihrem spezifischen räumlichen und ökologischen Kontext wichtig. Während die Forschung in der Krankheitsökologie wichtige Lebenszyklen von Wirten mit der Umgebung schon gut aufgezeigt hat, müssen weitere Aspekte noch besser untersucht werden, um Vektorübertragungs- und Kontroll-Strategien zu entwickeln. So hat sich beispielsweise die Wahl geeigneter Anbaumethoden als Alternative zum Einsatz synthetischer Pestizide erwiesen. In einigen Fällen wurde der Zwischenfruchtanbau als ‚Puffer' gegen die Ausbreitung von Pflanzenschädlingen und Krankheitserregern vorgeschlagen. Bei diesem Anbausystem werden Schädlinge von ihrer Wirtspflanze abgezogen und auch der Abstand zwischen Pflanzen derselben Art vergrößert (was eine Übertragung erschwert). Viele Studien haben bereits die Einsatzmöglichkeiten von Geodaten in der Krankheitsökologie untersucht. Die Kartierung von Schädlingen und Krankheiten in Nutzpflanzen ist jedoch bisher eher großskalig erfolgt, unter der Zunahme von sogenannten ‚Spatial Distribution Models (SDM)' auf regionaler Ebene. Etliche Studien haben diesbezüglich klimatische Daten verwendet, um die Eignung und Verteilung verschiedener Pflanzenschädlinge und Krankheiten zu modellieren. Es gibt jedoch Einschränkungen bei der Verwendung von Klimadaten, da dabei andere landschaftsbezogene Verbreitungs-Faktoren ignoriert werden, die die Verteilung der Vektoren und Krankheitserreger bestimmen, was zu einer Modell-Überprognose führt. Vegetationsmuster und Heterogenität auf Landschaftsebene beeinflussen maßgeblich die Diversität und Verteilung eines Vektors und spielen somit eine wichtige Rolle bei der Vektor-Wirt-Pathogen-Übertragung. Bei der Verwendung von Fernerkundungsdaten können subtile Abweichungen in der Vegetationscharakteristik oder in der Phänologie, die mit der Nische des Vektors verbunden sind, besser erfasst werden. Es besteht noch Forschungs-Bedarf hinsichtlich der Rolle von Fernerkundungsdaten bei der Verbesserung von Artenmodellen, die zum Ziel haben den Lebensraum von Krankheitsvektoren besser zu erfassen. Ziel dieser Studie ist es, das Potenzial für die Entwicklung eines Rahmens zu untersuchen, der sowohl ökologische als auch aus der Ferne erfasste Daten mit einem robusten Mapping- / Modellierungsansatz kombiniert, um einen integrierten Ansatz zur Schädlingsbekämpfung für Schädlinge und Krankheiten zu entwickeln, der sowohl einjährige als auch mehrjährige Kulturpflanzen betrifft Keine Heilung oder vorhandenes Keimplasma zur weiteren Verbreitung in Afrika südlich der Sahara

Multiscale Imaging of Evapotranspiration

Evapotranspiration (ET; evaporation + transpiration) is central to a wide range of biological, chemical, and physical processes in the Earth system. Accurate remote sensing of ET is challenging due to the interrelated and generally scale dependent nature of the physical factors which contribute to the process. The evaporation of water from porous media like sands and soils is an important subset of the complete ET problem. Chapter 1 presents a laboratory investigation into this question, examining the effects of grain size and composition on the evolution of drying sands. The effects of composition are found to be 2-5x greater than the effects of grain size, indicating that differences in heating caused by differences in reflectance may dominate hydrologic differences caused by grain size variation. In order to relate the results of Chapter 1 to the satellite image archive, however, the question of information loss between hyperspectral (measurements at 100s of wavelength intervals) laboratory measurements and multispectral (≤ 12 wavelength intervals) satellite images must be addressed. Chapter 2 focuses on this question as applied to substrate materials such as sediment, soil, rock, and non-photosynthetic vegetation. The results indicate that the continuum that is resolved by multispectral sensors is sufficient to resolve the gradient between sand-rich and clay-rich soils, and that this gradient is also a dominant feature in hyperspectral mixing spaces where the actual absorptions can be resolved. Multispectral measurements can be converted to biogeophysically relevant quantities using spectral mixture analysis (SMA). However, retrospective multitemporal analysis first requires cross-sensor calibration of the mixture model. Chapter 3 presents this calibration, allowing multispectral image data to be used interchangeably throughout the Landsat 4-8 archive. In addition, a theoretical explanation is advanced for the observed superior scaling properties of SMA-derived fraction images over spectral indices. The physical quantities estimated by the spectral mixture model are then compared to simultaneously imaged surface temperature, as well as to the derived parameters of ET Fraction and Moisture Availability. SMA-derived vegetation abundance is found to produce substantially more informative ET maps, and SMA-derived substrate fraction is found to yield a surprisingly strong linear relationship with surface temperature. These results provide context for agricultural applications. Chapter 5 investigates the question of mapping and monitoring rice agricultural using optical and thermal satellite image time series. Thermal image time series are found to produce more accurate maps of rice presence/absence, but optical image time series are found to produce more accurate maps of rice crop timing. Chapter 6 takes a more global approach, investigating the spatial structure of agricultural networks for a diverse set of landscapes. Surprisingly consistent scaling relations are found. These relations are assessed in the context of a network-based approach to land cover analysis, with potential implications for the scale dependence of ET estimates. In sum, this thesis present a novel approach to improving ET estimation based on a synthesis of complementary laboratory measurements, satellite image analysis, and field observations. Alone, each of these independent sources of information provides novel insights. Viewed together, these insights form the basis of a more accurate and complete geophysical understanding of the ET phenomenon