Automatic Identification and Monitoring of Plant Diseases Using Unmanned Aerial Vehicles: A Review

Disease diagnosis is one of the major tasks for increasing food production in agriculture. Although precision agriculture (PA) takes less time and provides a more precise application of agricultural activities, the detection of disease using an Unmanned Aerial System (UAS) is a challenging task. Several Unmanned Aerial Vehicles (UAVs) and sensors have been used for this purpose. The UAVs’ platforms and their peripherals have their own limitations in accurately diagnosing plant diseases. Several types of image processing software are available for vignetting and orthorectification. The training and validation of datasets are important characteristics of data analysis. Currently, different algorithms and architectures of machine learning models are used to classify and detect plant diseases. These models help in image segmentation and feature extractions to interpret results. Researchers also use the values of vegetative indices, such as Normalized Difference Vegetative Index (NDVI), Crop Water Stress Index (CWSI), etc., acquired from different multispectral and hyperspectral sensors to fit into the statistical models to deliver results. There are still various drifts in the automatic detection of plant diseases as imaging sensors are limited by their own spectral bandwidth, resolution, background noise of the image, etc. The future of crop health monitoring using UAVs should include a gimble consisting of multiple sensors, large datasets for training and validation, the development of site-specific irradiance systems, and so on. This review briefly highlights the advantages of automatic detection of plant diseases to the growers

Leveraging very-high spatial resolution hyperspectral and thermal UAV imageries for characterizing diurnal indicators of grapevine physiology

Efficient and accurate methods to monitor crop physiological responses help growers better understand crop physiology and improve crop productivity. In recent years, developments in unmanned aerial vehicles (UAV) and sensor technology have enabled image acquisition at very-high spectral, spatial, and temporal resolutions. However, potential applications and limitations of very-high-resolution (VHR) hyperspectral and thermal UAV imaging for characterization of plant diurnal physiology remain largely unknown, due to issues related to shadow and canopy heterogeneity. In this study, we propose a canopy zone-weighting (CZW) method to leverage the potential of VHR (≤9 cm) hyperspectral and thermal UAV imageries in estimating physiological indicators, such as stomatal conductance (Gs) and steady-state fluorescence (Fs). Diurnal flights and concurrent in-situ measurements were conducted during grapevine growing seasons in 2017 and 2018 in a vineyard in Missouri, USA. We used neural net classifier and the Canny edge detection method to extract pure vine canopy from the hyperspectral and thermal images, respectively. Then, the vine canopy was segmented into three canopy zones (sunlit, nadir, and shaded) using K-means clustering based on the canopy shadow fraction and canopy temperature. Common reflectance-based spectral indices, sun-induced chlorophyll fluorescence (SIF), and simplified canopy water stress index (siCWSI) were computed as image retrievals. Using the coefficient of determination (R2) established between the image retrievals from three canopy zones and the in-situ measurements as a weight factor, weighted image retrievals were calculated and their correlation with in-situ measurements was explored. The results showed that the most frequent and the highest correlations were found for Gs and Fs, with CZW-based Photochemical reflectance index (PRI), SIF, and siCWSI (PRICZW, SIFCZW, and siCWSICZW), respectively. When all flights combined for the given field campaign date, PRICZW, SIFCZW, and siCWSICZW significantly improved the relationship with Gs and Fs. The proposed approach takes full advantage of VHR hyperspectral and thermal UAV imageries, and suggests that the CZW method is simple yet effective in estimating Gs and Fs

Improving Accuracy of Unmanned Aerial System Thermal Infrared Remote Sensing for Use in Energy Balance Models in Agriculture Applications

Unmanned aerial system (UAS) remote sensing has rapidly expanded in recent years, leading to the development of several multispectral and thermal infrared sensors suitable for UAS integration. Remotely sensed thermal infrared imagery has been used to detect crop water stress and manage irrigation by leveraging the increased thermal signatures of water stressed plants. Thermal infrared cameras suitable for UAS remote sensing are often uncooled microbolometers. This type of thermal camera is subject to inaccuracies not typically present in cooled thermal cameras. In addition, atmospheric interference also may present inaccuracies in measuring surface temperature. In this study, a UAS with integrated FLIR Duo Pro R (FDPR) thermal camera was used to collect thermal imagery over a maize and soybean field that contained twelve infrared thermometers (IRT) that measured surface temperature. Surface temperature measurements from the UAS FDPR thermal imagery and field IRTs corrected for emissivity and atmospheric interference were compared to determine accuracy of the FDPR thermal imagery. The comparison of the atmospheric interference corrected UAS FDPR and IRT surface temperature measurements yielded a RMSE of 2.24 degree Celsius and a R2 of 0.85. Additional approaches for correcting UAS FDPR thermal imagery explored linear, second order polynomial and artificial neural network models. These models simplified the process of correcting UAS FDPR thermal imagery. All three models performed well, with the linear model yielding a RMSE of 1.27 degree Celsius and a R2 of 0.93. Laboratory experiments also were completed to test the measurement stability of the FDPR thermal camera over time. These experiments found that the thermal camera required a warm-up period to achieve stability in thermal measurements, with increased warm-up duration likely improving accuracy of thermal measurements

Wheat yellow rust monitoring by learning from multispectral UAV aerial imagery

The use of a low-cost five-band multispectral camera (RedEdge, MicaSense, USA) and a low-altitude airborne platform is investigated for the detection of plant stress caused by yellow rust disease in winter wheat for sustainable agriculture. The research is mainly focused on: (i) determining whether or not healthy and yellow rust infected wheat plants can be discriminated; (ii) selecting spectral band and Spectral Vegetation Index (SVI) with a strong discriminating capability; (iii) developing a low-cost yellow rust monitoring system for use at farmland scales. An experiment was carefully designed by infecting winter wheat with different levels of yellow rust inoculum, where aerial multispectral images under different developmental stages of yellow rust were captured by an Unmanned Aerial Vehicle at an altitude of 16–24m with a ground resolution of 1–1.5cm/pixel. An automated yellow rust detection system is developed by learning (via random forest classifier) from labelled UAV aerial multispectral imagery. Experimental results indicate that: (i) good classification performance (with an average Precision, Recall and Accuracy of 89.2%, 89.4% and 89.3%) was achieved by the developed yellow rust monitoring at a diseased stage (45 days after inoculation); (ii) the top three SVIs for separating healthy and yellow rust infected wheat plants are RVI, NDVI and OSAVI; while the top two spectral bands are NIR and Red. The learnt system was also applied to the whole farmland of interest with a promising monitoring result. It is anticipated that this study by seamlessly integrating low-cost multispectral camera, low-altitude UAV platform and machine learning techniques paves the way for yellow rust monitoring at farmland scales

Using aerial thermal imagery to evaluate water status in <i>Vitis vinifera cv.</i> Loureiro

The crop water stress index (CWSI) is a widely used analytical tool based on portable thermography. This method can be useful in replacing the traditional stem water potential method obtained with a Scholander chamber (PMS Model 600) because the latter is not feasible for large-scale studies due to the time involved and the fact that it is invasive and can cause damage to the plant. The present work had three objectives: (i) to understand if CWSI estimated using an aerial sensor can estimate the water status of the plant; (ii) to compare CWSI from aerial-thermographic and portable thermal cameras with stem water potential; (iii) to estimate the capacity of an unmanned aerial vehicle (UAV) to calculate and spatialize CWSI. Monitoring of CWSI (CWSIP) using a portable device was performed directly in the canopy, by measuring reference temperatures (Tdry, Twet, and canopy temperature (Tc)). Aerial CWSI calculation was performed using two models: (i) a simplified CWSI model (CWSIS), where the Tdry and Twet were estimated as the average of 1% of the extreme temperature, and (ii) an air temperature model (CWSITair) where air temperatures (Tair + 7 ?C) were recorded as Tdry and in the Twet, considering the average of the lowest 33% of histogram values. In these two models, the Tc value corresponded to the temperature value in each pixel of the aerial thermal image. The results show that it was possible to estimate CWSI by calculating canopy temperatures and spatializing CWSI using aerial thermography. Of the two models, it was found that for CWSITair, CWSIS (R2 = 0.55) evaluated crop water stress better than stem water potential. The CWSIS had good correlation compared with the portable sensor (R2 = 0.58), and its application in field measurements is possible.E518-D54F-9490 | Susana Miguel Afonso Mendes MouraN/

Principal variable selection to explain grain yield variation in winter wheat from features extracted from UAV imagery

Background: Automated phenotyping technologies are continually advancing the breeding process. However, collecting various secondary traits throughout the growing season and processing massive amounts of data still take great efforts and time. Selecting a minimum number of secondary traits that have the maximum predictive power has the potential to reduce phenotyping efforts. The objective of this study was to select principal features extracted from UAV imagery and critical growth stages that contributed the most in explaining winter wheat grain yield. Five dates of multispectral images and seven dates of RGB images were collected by a UAV system during the spring growing season in 2018. Two classes of features (variables), totaling to 172 variables, were extracted for each plot from the vegetation index and plant height maps, including pixel statistics and dynamic growth rates. A parametric algorithm, LASSO regression (the least angle and shrinkage selection operator), and a non-parametric algorithm, random forest, were applied for variable selection. The regression coefficients estimated by LASSO and the permutation importance scores provided by random forest were used to determine the ten most important variables influencing grain yield from each algorithm. Results: Both selection algorithms assigned the highest importance score to the variables related with plant height around the grain filling stage. Some vegetation indices related variables were also selected by the algorithms mainly at earlier to mid growth stages and during the senescence. Compared with the yield prediction using all 172 variables derived from measured phenotypes, using the selected variables performed comparable or even better. We also noticed that the prediction accuracy on the adapted NE lines (r = 0.58–0.81) was higher than the other lines (r = 0.21–0.59) included in this study with different genetic backgrounds. Conclusions: With the ultra-high resolution plot imagery obtained by the UAS-based phenotyping we are now able to derive more features, such as the variation of plant height or vegetation indices within a plot other than just an averaged number, that are potentially very useful for the breeding purpose. However, too many features or variables can be derived in this way. The promising results from this study suggests that the selected set from those variables can have comparable prediction accuracies on the grain yield prediction than the full set of them but possibly resulting in a better allocation of efforts and resources on phenotypic data collection and processing

New strategies for row-crop management based on cost-effective remote sensors

Agricultural technology can be an excellent antidote to resource scarcity. Its growth has led to the extensive study of spatial and temporal in-field variability. The challenge of accurate management has been addressed in recent years through the use of accurate high-cost measurement instruments by researchers. However, low rates of technological adoption by farmers motivate the development of alternative technologies based on affordable sensors, in order to improve the sustainability of agricultural biosystems. This doctoral thesis has as main objective the development and evaluation of systems based on affordable sensors, in order to address two of the main aspects affecting the producers: the need of an accurate plant water status characterization to perform a proper irrigation management and the precise weed control. To address the first objective, two data acquisition methodologies based on aerial platforms have been developed, seeking to compare the use of infrared thermometry and thermal imaging to determine the water status of two most relevant row-crops in the region, sugar beet and super high-density olive orchards. From the data obtained, the use of an airborne low-cost infrared sensor to determine the canopy temperature has been validated. Also the reliability of sugar beet canopy temperature as an indicator its of water status has been confirmed. The empirical development of the Crop Water Stress Index (CWSI) has also been carried out from aerial thermal imaging combined with infrared temperature sensors and ground measurements of factors such as water potential or stomatal conductance, validating its usefulness as an indicator of water status in super high-density olive orchards. To contribute to the development of precise weed control systems, a system for detecting tomato plants and measuring the space between them has been developed, aiming to perform intra-row treatments in a localized and precise way. To this end, low cost optical sensors have been used and compared with a commercial LiDAR laser scanner. Correct detection results close to 95% show that the implementation of these sensors can lead to promising advances in the automation of weed control. The micro-level field data collected from the evaluated affordable sensors can help farmers to target operations precisely before plant stress sets in or weeds infestation occurs, paving the path to increase the adoption of Precision Agriculture techniques

Remote Sensing in Agriculture: State-of-the-Art

The Special Issue on “Remote Sensing in Agriculture: State-of-the-Art” gives an exhaustive overview of the ongoing remote sensing technology transfer into the agricultural sector. It consists of 10 high-quality papers focusing on a wide range of remote sensing models and techniques to forecast crop production and yield, to map agricultural landscape and to evaluate plant and soil biophysical features. Satellite, RPAS, and SAR data were involved. This preface describes shortly each contribution published in such Special Issue

Water status evaluation of maize cultivars using aerial images.

The objective of this study was to evaluate the water status of maize cultivars through thermal and vegetation indexes generated from multispectral aerial images obtained from an unmanned aerial vehicle (UAV), and correlate them with physiological indicators and soil water contents

A review of current and potential applications of remote sensing to study the water status of horticultural crops

Published: 17 January 2020With increasingly advanced remote sensing systems, more accurate retrievals of crop water status are being made at the individual crop level to aid in precision irrigation. This paper summarises the use of remote sensing for the estimation of water status in horticultural crops. The remote measurements of the water potential, soil moisture, evapotranspiration, canopy 3D structure, and vigour for water status estimation are presented in this comprehensive review. These parameters directly or indirectly provide estimates of crop water status, which is critically important for irrigation management in farms. The review is organised into four main sections: (i) remote sensing platforms; (ii) the remote sensor suite; (iii) techniques adopted for horticultural applications and indicators of water status; and, (iv) case studies of the use of remote sensing in horticultural crops. Finally, the authors’ view is presented with regard to future prospects and research gaps in the estimation of the crop water status for precision irrigation.Deepak Gautam and Vinay Paga