Unmanned aerial systems-based remote sensing for monitoring sorghum growth and development

Unmanned Aerial Vehicles and Systems (UAV or UAS) have become increasingly popular in recent years for agricultural research applications. UAS are capable of acquiring images with high spatial and temporal resolutions that are ideal for applications in agriculture. The objective of this study was to evaluate the performance of a UAS-based remote sensing system for quantification of crop growth parameters of sorghum (Sorghum bicolor L.) including leaf area index (LAI), fractional vegetation cover (fc) and yield. The study was conducted at the Texas A&M Research Farm near College Station, Texas, United States. A fixed-wing UAS equipped with a multispectral sensor was used to collect image data during the 2016 growing season (April±October). Flight missions were successfully carried out at 50 days after planting (DAP; 25 May), 66 DAP (10 June) and 74 DAP (18 June). These flight missions provided image data covering the middle growth period of sorghum with a spatial resolution of approximately 6.5 cm. Field measurements of LAI and fc were also collected. Four vegetation indices were calculated using the UAS images. Among those indices, the normalized difference vegetation index (NDVI) showed the highest correlation with LAI, fc and yield with R2 values of 0.91, 0.89 and 0.58 respectively. Empirical relationships between NDVI and LAI and between NDVI and fc were validated and proved to be accurate for estimating LAI and fc from UAS-derived NDVI values. NDVI determined from UAS imagery acquired during the flowering stage (74 DAP) was found to be the most highly correlated with final grain yield. The observed high correlations between UAS-derived NDVI and the crop growth parameters (fc, LAI and grain yield) suggests the applicability of UAS for withinseason data collection of agricultural crops such as sorghum

Assessment of vegetation índices derived from UAV images for predicting biometric variables in bean during ripening stage

Here, we report the prediction of vegetative stages variables of canary bean crop employing RGB and multispectral images obtained from UAV during the ripening stage, correlating the vegetation indices with biometric variables measured manually in the field. Results indicated a highly significant correlation of plant height with eight vegetation indices derived from UAV images from the canary bean, which were evaluated by multiple regression models, obtaining a maximum correlation of R2 = 0.79. On the other hand, the estimated indices of multispectral images did not show significant correlations

Forestry Applications of Unmanned Aerial Vehicles (UAVs) 2019

Unmanned aerial vehicles (UAVs) are new platforms that have been increasingly used in the last few years for forestry applications that benefit from the added value of flexibility, low cost, reliability, autonomy, and capability of timely provision of high-resolution data. The main adopted image-based technologies are RGB, multispectral, and thermal infrared. LiDAR sensors are becoming commonly used to improve the estimation of relevant plant traits. In comparison with other permanent ecosystems, forests are particularly affected by climatic changes due to the longevity of the trees, and the primary objective is the conservation and protection of forests. Nevertheless, forestry and agriculture involve the cultivation of renewable raw materials, with the difference that forestry is less tied to economic aspects and this is reflected by the delay in using new monitoring technologies. The main forestry applications are aimed toward inventory of resources, map diseases, species classification, fire monitoring, and spatial gap estimation. This Special Issue focuses on new technologies (UAV and sensors) and innovative data elaboration methodologies (object recognition and machine vision) for applications in forestry

Prediction of biometric variables through multispectral images obtained from UAV in beans (Phaseolus vulgaris L.) during ripening stage

Here, we report the prediction of vegetative stages variables of canary bean crop by means of RGB and multispectral images obtained from UAV during the ripening stage, correlating the vegetation indices with biometric variables measured manually in the field. Results indicated a highly significant correlation of plant height with eight RGB image vegetation indices for the canary bean crop, which were used for predictive models, obtaining a maximum correlation of R2 = 0.79. On the other hand, the estimated indices of multispectral images did not show significant correlations

Drones: Innovative Technology for Use in Precision Pest Management.

Arthropod pest outbreaks are unpredictable and not uniformly distributed within fields. Early outbreak detection and treatment application are inherent to effective pest management, allowing management decisions to be implemented before pests are well-established and crop losses accrue. Pest monitoring is time-consuming and may be hampered by lack of reliable or cost-effective sampling techniques. Thus, we argue that an important research challenge associated with enhanced sustainability of pest management in modern agriculture is developing and promoting improved crop monitoring procedures. Biotic stress, such as herbivory by arthropod pests, elicits physiological defense responses in plants, leading to changes in leaf reflectance. Advanced imaging technologies can detect such changes, and can, therefore, be used as noninvasive crop monitoring methods. Furthermore, novel methods of treatment precision application are required. Both sensing and actuation technologies can be mounted on equipment moving through fields (e.g., irrigation equipment), on (un)manned driving vehicles, and on small drones. In this review, we focus specifically on use of small unmanned aerial robots, or small drones, in agricultural systems. Acquired and processed canopy reflectance data obtained with sensing drones could potentially be transmitted as a digital map to guide a second type of drone, actuation drones, to deliver solutions to the identified pest hotspots, such as precision releases of natural enemies and/or precision-sprays of pesticides. We emphasize how sustainable pest management in 21st-century agriculture will depend heavily on novel technologies, and how this trend will lead to a growing need for multi-disciplinary research collaborations between agronomists, ecologists, software programmers, and engineers

Evaluation of the UAV-Based Multispectral Imagery and Its Application for Crop Intra-Field Nitrogen Monitoring and Yield Prediction in Ontario

Unmanned Aerial Vehicle (UAV) has the capability of acquiring high spatial and temporal resolution images. This new technology fills the data gap between satellite and ground survey in agriculture. In addition, UAV-based crop monitoring and methods are new challenge of remote sensing application in agriculture. First, in my thesis the potential of UAV-based imagery was investigated to monitor spatial and temporal variation of crop status in comparison with RapidEye. The correlation between red-edge indices and LAI and biomass are higher for UAV-based imagery than that of RapidEye. Secondly, the nitrogen weight and yield in wheat was predicted using the UAV-based imagery. The intra-field nitrogen prediction model performs well at wheat early growth stage. Additionally, the best data collection time for yield prediction is at the end of booting stage. The results demonstrate the UAV-based data could be an alternative effective and affordable approach for farmers on intra-field management

Investigating the Potential of UAV-Based Low-Cost Camera Imagery for Measuring Biophysical Variables in Maize

The potential for improved crop productivity is readily investigated in agronomic field experiments. Frequent measurements of biophysical crop variables are necessary to allow for confident statements on crop performance. Commonly, in-field measurements are tedious, labour-intensive, costly and spatially selective and therefore pose a challenge in field experiments. With the versatile, flexible employment of the platform and the high spatial and temporal resolution of the sensor data, Unmanned Aerial Vehicle (UAV)-based remote sensing offers the possibility to derive variables quickly, contactless and at low cost. This thesis examined if UAV-borne modified low-cost camera imagery allowed for remote estimation of the crop variables green leaf area index (gLAI) and radiation use efficiency (RUE) in a maize field trial under different management influences. For this, a field experiment was established at the university's research station Campus Klein-Altendorf southwest of Bonn in the years 2015 and 2016. In four treatments (two levels of nitrogen fertilisation and two levels of plant density) with five repetitions each, leaf growth of maize plants was supposed to occur differently. gLAI and biomass was measured destructively, UAV-based data was acquired in 14-day intervals over the entire experiment. Three studies were conducted and submitted for peer-review in international journals. In study I, three selected spectral vegetation indices (NDVI, GNDVI, 3BSI) were related to the gLAI measurements. Differing but definite relationships per treatment factor were found. gLAI estimation using the two-band indices (NDVI, GNDVI) yielded good results up to gLAI values of 3. The 3-bands approach (3BSI) did not provide improved accuracies. Comparing gLAI results to the spectral vegetation indices, it was determined that sole reliance on these was insufficient to draw the right conclusions on the impact of management factors on leaf area development in maize canopies. Study II evaluated parametric and non-parametric regression methods on their capability to estimate gLAI in maize, relying on UAV-based low-cost camera imagery with non-plants pixels (i.e. shaded and illuminated soil background) a) included in and b) excluded from the analysis. With regard to the parametric regression methods, all possible band combinations for a selected number of two- and three-band formulations as well as different fitting functions were tested. With regard to non-parametric methods, six regression algorithms (Random Forests Regression, Support Vector Regression, Relevance Vector Machines, Gaussian Process Regression, Kernel Regularized Least Squares, Extreme Learning Machine) were tested. It was found that all non-parametric methods performed better than the parametric methods, and that kernel-based algorithms outperformed the other tested algorithms. Excluding non-plant pixels from the analysis deteriorated models' performances. When using parametric regression methods, signal saturation occurred at gLAI values of about 3, and at values around 4 when employing non-parametric methods. Study III investigated if a) UAV-based low-cost camera imagery allowed estimating RUEs in different experimental plots where maize was cultivated in the growing season of 2016, b) those values were different from the ones previously reported in literature and c) there was a difference between RUEtotal and RUEgreen. Fractional cover and canopy reflectance was determined based on the RS imagery. Our study showed that RUEtotal ranges between 4.05 and 4.59, and RUEgreen between 4.11 and 4.65. These values were higher than those published in other research articles, but not outside the range of plausibility. The difference between RUEtotal and RUEgreen was minimal, possibly due to prolonged canopy greenness induced by the stay-green trait of the cultivar grown. In conclusion, UAV-based low-cost camera imagery allows for estimation of plant variables within a range of limitations

Mehitamata õhusõiduki rakendamine põllukultuuride saagikuse ja maa harimisviiside tuvastamisel

A Thesis for applying for the degree of Doctor of Philosophy in Environmental Protection.Väitekiri filosoofiadoktori kraadi taotlemiseks keskkonnakaitse erialal.This thesis aims to examine how machine learning (ML) technologies have aided significant advancements in image analysis in the area of precision agriculture. These multimodal computing technologies extend the use of machine learning to a broader spectrum of data collecting and selection for the advancement of agricultural practices (Nawar et al., 2017) These techniques will assist complicated cropping systems with more informed decisions with less human intervention, and provide a scalable framework for incorporating expert knowledge of the PA system. (Chlingaryan et al., 2018). Complexity, on the other hand, can be seen as a disadvantage in crop trials, as machine learning models require training/testing databases, limited areas with insignificant sampling sizes, time and space-specificity, and environmental factor interventions, all of which complicate parameter selection and make using a single empirical model for an entire region impractical. During the early stages of writing this thesis, we used a relatively traditional machine learning method to address the regression problem of crop yield and biomass prediction [(i.e., random forest regression (RFR), support vector regression (SVR), and artificial neural network (ANN)] to predicted dry matter (DM) yields of red clover. It obtained favourable results, however, the choosing of hyperparameters, the lengthy algorithms selection process, data cleaning, and redundant collinearity issues significantly limited the way of the machine learning application. We will further discuss the recent trend of automated machine learning (AutoML) that has been driving further significant technological innovation in the application of artificial intelligence from its automated algorithm selection and hyperparameter optimization of the deployable pipeline model for unravelling substance problems. However, a present knowledge gap exists in the integration of machine learning (ML) technology with unmanned aerial systems (UAS) and hyperspectral-based imaging data categorization and regression applications. In this thesis, we explored a state-of-the-art (SOTA) and entirely open-source AutoML framework, Auto-sklearn, which was built on one of the most frequently used machine learning systems, Scikit-learn. It was integrated with two unique AutoML visualization tools to examine the recognition and acceptance of multispectral vegetation indices (VI) data collected from UAS and hyperspectral narrow-band VIs across a varied spectrum of agricultural management practices (AMP). These procedures incorporate soil tillage method (STM), cultivation method (CM), and manure application (MA), and are classified as four-crop combination fields (i.e., red clover-grass mixture, spring wheat, pea-oat mixture, and spring barley). Additionally, they have not been thoroughly evaluated and lack characteristics that are accessible in agriculture remote sensing applications. This thesis further explores the existing gaps in the knowledge base for several critical crop categories and cultivation management methods referring to biomass and yield analysis, as well as to gain a better understanding of the potential for remotely sensed solutions to field-based and multifunctional platforms to meet precision agriculture demands. To overcome these knowledge gaps, this research introduces a rapid, non-destructive, and low-cost framework for field-based biomass and grain yield modelling, as well as the identification of agricultural management practices. The results may aid agronomists and farmers in establishing more accurate agricultural methods and in monitoring environmental conditions more effectively.Doktoritöö eesmärk oli uurida, kuidas masinõppe (MÕ) tehnoloogiad võimaldavad edusamme täppispõllumajanduse valdkonna pildianalüüsis. Multimodaalsed arvutustehnoloogiad laiendavad masinõppe kasutamist põllumajanduses andmete kogumisel ja valimisel (Nawar et al., 2017). Selline täpsemal informatsioonil põhinev tehnoloogia võimaldab keerukate viljelussüsteemide puhul teha otsuseid inimese vähema sekkumisega, ja loob skaleeritava raamistiku täppispõllumajanduse jaoks (Chlingaryan et al., 2018). Põllukultuuride katsete korral on komplekssete masinõppemudelite kasutamine keerukas, sest alad on piiratud ning valimi suurus ei ole piisav; vaja on testandmebaase, kindlaid aja- ja ruumitingimusi ning keskkonnategureid. See komplitseerib parameetrite valikut ning muudab ebapraktiliseks ühe empiirilise mudeli kasutamise terves piirkonnas. Siinse uurimuse algetapis rakendati suhteliselt traditsioonilist masinõppemeetodit, et lahendada saagikuse ja biomassi prognoosimise regressiooniprobleem (otsustusmetsa regression, tugivektori regressioon ja tehisnärvivõrk) punase ristiku prognoositava kuivaine saagikuse suhtes. Saadi sobivaid tulemusi, kuid hüperparameetrite valimine, pikk algoritmide valimisprotsess, andmete puhastamine ja kollineaarsusprobleemid takistasid masinõpet oluliselt. Automatiseeritud masinõppe (AMÕ) uusimate suundumustena rakendatakse tehisintellekti, et lahendada põhiprobleemid automatiseeritud algoritmi valiku ja rakendatava pipeline-mudeli hüperparameetrite optimeerimise abil. Seni napib teadmisi MÕ tehnoloogia integreerimiseks mehitamata õhusõidukite ning hüperspektripõhiste pildiandmete kategoriseerimise ja regressioonirakendustega. Väitekirjas uuriti nüüdisaegset ja avatud lähtekoodiga AMÕ tehnoloogiat Auto-sklearn, mis on ühe enimkasutatava masinõppesüsteemi Scikit-learn edasiarendus. Süsteemiga liideti kaks unikaalset AMÕ visualiseerimisrakendust, et uurida mehitamata õhusõidukiga kogutud andmete multispektraalsete taimkatteindeksite ja hüperspektraalsete kitsaribaandmete taimkatteindeksite tuvastamist ja rakendamist põllumajanduses. Neid võtteid kasutatakse mullaharimisel, kultiveerimisel ja sõnnikuga väetamisel nelja kultuuriga põldudel (punase ristiku rohusegu, suvinisu, herne-kaera segu, suvioder). Neid ei ole põhjalikult hinnatud, samuti ei hõlma need omadusi, mida kasutatatakse põllumajanduses kaugseire rakendustes. Uurimus käsitleb biomassi ja saagikuse seni uurimata analüüsivõimalusi oluliste põllukultuuride ja viljelusmeetodite näitel. Hinnatakse ka kaugseirelahenduste potentsiaali põllupõhiste ja multifunktsionaalsete platvormide kasutamisel täppispõllumajanduses. Uurimus tutvustab kiiret, keskkonna suhtes kahjutut ja mõõduka hinnaga tehnoloogiat põllupõhise biomassi ja teraviljasaagi modelleerimiseks, et leida sobiv viljelusviis. Töö tulemused võimaldavad põllumajandustootjatel ja agronoomidel tõhusamalt valida põllundustehnoloogiaid ning arvestada täpsemalt keskkonnatingimustega.Publication of this thesis is supported by the Estonian University of Life Scieces and by the Doctoral School of Earth Sciences and Ecology created under the auspices of the European Social Fund

Use of an Active Canopy Sensor Mounted on an Unmanned Aerial Vehicle to Monitor the Growth and Nitrogen Status of Winter Wheat

Using remote sensing to rapidly acquire large-area crop growth information (e.g., shoot biomass, nitrogen status) is an urgent demand for modern crop production; unmanned aerial vehicle (UAV) acts as an effective monitoring platform. In order to improve the practicability and efficiency of UAV based monitoring technique, four field experiments involving different nitrogen (N) rates (0–360 kg N ha−1 ) and seven winter wheat (Triticum aestivum L.) varieties were conducted at different eco-sites (Sihong, Rugao, and Xinghua) during 2015–2019. A multispectral active canopy sensor (RapidSCAN CS-45; Holland Scientific Inc., Lincoln, NE, USA) mounted on a multirotor UAV platform was used to collect the canopy spectral reflectance data of winter wheat at key growth stages, three growth parameters (leaf area index (LAI), leaf dry matter (LDM), plant dry matter (PDM)) and three N indicators (leaf N accumulation (LNA), plant N accumulation (PNA) and N nutrition index (NNI)) were measured synchronously. The quantitative linear relationships between spectral data and six growth indices were systematically analyzed. For monitoring growth and N nutrition status at Feekes stages 6.0–10.0, 10.3–11.1 or entire growth stages, red edge ratio vegetation index (RERVI), red edge chlorophyll index (CIRE) and difference vegetation index (DVI) performed the best among the red edge band-based and red-based vegetation indices, respectively. Across all growth stages, DVI was highly correlated with LAI (R2 = 0.78), LDM (R2 = 0.61), PDM (R2 = 0.63), LNA (R2 = 0.65) and PNA (R2 = 0.73), whereas the relationships between RERVI (R2 = 0.62), CIRE (R2 = 0.62) and NNI had high coefficients of determination. The developed models performed better in monitoring growth indices and N status at Feekes stages 10.3–11.1 than Feekes stages 6.0–10.0. To sum it up, the UAV-mounted active sensor system is able to rapidly monitor the growth and N nutrition status of winter wheat and can be deployed for UAV-based remote-sensing of crops