Mehitamata õhusõiduki rakendamine põllukultuuride saagikuse ja maa harimisviiside tuvastamisel

A Thesis for applying for the degree of Doctor of Philosophy in Environmental Protection.Väitekiri filosoofiadoktori kraadi taotlemiseks keskkonnakaitse erialal.This thesis aims to examine how machine learning (ML) technologies have aided significant advancements in image analysis in the area of precision agriculture. These multimodal computing technologies extend the use of machine learning to a broader spectrum of data collecting and selection for the advancement of agricultural practices (Nawar et al., 2017) These techniques will assist complicated cropping systems with more informed decisions with less human intervention, and provide a scalable framework for incorporating expert knowledge of the PA system. (Chlingaryan et al., 2018). Complexity, on the other hand, can be seen as a disadvantage in crop trials, as machine learning models require training/testing databases, limited areas with insignificant sampling sizes, time and space-specificity, and environmental factor interventions, all of which complicate parameter selection and make using a single empirical model for an entire region impractical. During the early stages of writing this thesis, we used a relatively traditional machine learning method to address the regression problem of crop yield and biomass prediction [(i.e., random forest regression (RFR), support vector regression (SVR), and artificial neural network (ANN)] to predicted dry matter (DM) yields of red clover. It obtained favourable results, however, the choosing of hyperparameters, the lengthy algorithms selection process, data cleaning, and redundant collinearity issues significantly limited the way of the machine learning application. We will further discuss the recent trend of automated machine learning (AutoML) that has been driving further significant technological innovation in the application of artificial intelligence from its automated algorithm selection and hyperparameter optimization of the deployable pipeline model for unravelling substance problems. However, a present knowledge gap exists in the integration of machine learning (ML) technology with unmanned aerial systems (UAS) and hyperspectral-based imaging data categorization and regression applications. In this thesis, we explored a state-of-the-art (SOTA) and entirely open-source AutoML framework, Auto-sklearn, which was built on one of the most frequently used machine learning systems, Scikit-learn. It was integrated with two unique AutoML visualization tools to examine the recognition and acceptance of multispectral vegetation indices (VI) data collected from UAS and hyperspectral narrow-band VIs across a varied spectrum of agricultural management practices (AMP). These procedures incorporate soil tillage method (STM), cultivation method (CM), and manure application (MA), and are classified as four-crop combination fields (i.e., red clover-grass mixture, spring wheat, pea-oat mixture, and spring barley). Additionally, they have not been thoroughly evaluated and lack characteristics that are accessible in agriculture remote sensing applications. This thesis further explores the existing gaps in the knowledge base for several critical crop categories and cultivation management methods referring to biomass and yield analysis, as well as to gain a better understanding of the potential for remotely sensed solutions to field-based and multifunctional platforms to meet precision agriculture demands. To overcome these knowledge gaps, this research introduces a rapid, non-destructive, and low-cost framework for field-based biomass and grain yield modelling, as well as the identification of agricultural management practices. The results may aid agronomists and farmers in establishing more accurate agricultural methods and in monitoring environmental conditions more effectively.Doktoritöö eesmärk oli uurida, kuidas masinõppe (MÕ) tehnoloogiad võimaldavad edusamme täppispõllumajanduse valdkonna pildianalüüsis. Multimodaalsed arvutustehnoloogiad laiendavad masinõppe kasutamist põllumajanduses andmete kogumisel ja valimisel (Nawar et al., 2017). Selline täpsemal informatsioonil põhinev tehnoloogia võimaldab keerukate viljelussüsteemide puhul teha otsuseid inimese vähema sekkumisega, ja loob skaleeritava raamistiku täppispõllumajanduse jaoks (Chlingaryan et al., 2018). Põllukultuuride katsete korral on komplekssete masinõppemudelite kasutamine keerukas, sest alad on piiratud ning valimi suurus ei ole piisav; vaja on testandmebaase, kindlaid aja- ja ruumitingimusi ning keskkonnategureid. See komplitseerib parameetrite valikut ning muudab ebapraktiliseks ühe empiirilise mudeli kasutamise terves piirkonnas. Siinse uurimuse algetapis rakendati suhteliselt traditsioonilist masinõppemeetodit, et lahendada saagikuse ja biomassi prognoosimise regressiooniprobleem (otsustusmetsa regression, tugivektori regressioon ja tehisnärvivõrk) punase ristiku prognoositava kuivaine saagikuse suhtes. Saadi sobivaid tulemusi, kuid hüperparameetrite valimine, pikk algoritmide valimisprotsess, andmete puhastamine ja kollineaarsusprobleemid takistasid masinõpet oluliselt. Automatiseeritud masinõppe (AMÕ) uusimate suundumustena rakendatakse tehisintellekti, et lahendada põhiprobleemid automatiseeritud algoritmi valiku ja rakendatava pipeline-mudeli hüperparameetrite optimeerimise abil. Seni napib teadmisi MÕ tehnoloogia integreerimiseks mehitamata õhusõidukite ning hüperspektripõhiste pildiandmete kategoriseerimise ja regressioonirakendustega. Väitekirjas uuriti nüüdisaegset ja avatud lähtekoodiga AMÕ tehnoloogiat Auto-sklearn, mis on ühe enimkasutatava masinõppesüsteemi Scikit-learn edasiarendus. Süsteemiga liideti kaks unikaalset AMÕ visualiseerimisrakendust, et uurida mehitamata õhusõidukiga kogutud andmete multispektraalsete taimkatteindeksite ja hüperspektraalsete kitsaribaandmete taimkatteindeksite tuvastamist ja rakendamist põllumajanduses. Neid võtteid kasutatakse mullaharimisel, kultiveerimisel ja sõnnikuga väetamisel nelja kultuuriga põldudel (punase ristiku rohusegu, suvinisu, herne-kaera segu, suvioder). Neid ei ole põhjalikult hinnatud, samuti ei hõlma need omadusi, mida kasutatatakse põllumajanduses kaugseire rakendustes. Uurimus käsitleb biomassi ja saagikuse seni uurimata analüüsivõimalusi oluliste põllukultuuride ja viljelusmeetodite näitel. Hinnatakse ka kaugseirelahenduste potentsiaali põllupõhiste ja multifunktsionaalsete platvormide kasutamisel täppispõllumajanduses. Uurimus tutvustab kiiret, keskkonna suhtes kahjutut ja mõõduka hinnaga tehnoloogiat põllupõhise biomassi ja teraviljasaagi modelleerimiseks, et leida sobiv viljelusviis. Töö tulemused võimaldavad põllumajandustootjatel ja agronoomidel tõhusamalt valida põllundustehnoloogiaid ning arvestada täpsemalt keskkonnatingimustega.Publication of this thesis is supported by the Estonian University of Life Scieces and by the Doctoral School of Earth Sciences and Ecology created under the auspices of the European Social Fund

Evaluation of the UAV-Based Multispectral Imagery and Its Application for Crop Intra-Field Nitrogen Monitoring and Yield Prediction in Ontario

Unmanned Aerial Vehicle (UAV) has the capability of acquiring high spatial and temporal resolution images. This new technology fills the data gap between satellite and ground survey in agriculture. In addition, UAV-based crop monitoring and methods are new challenge of remote sensing application in agriculture. First, in my thesis the potential of UAV-based imagery was investigated to monitor spatial and temporal variation of crop status in comparison with RapidEye. The correlation between red-edge indices and LAI and biomass are higher for UAV-based imagery than that of RapidEye. Secondly, the nitrogen weight and yield in wheat was predicted using the UAV-based imagery. The intra-field nitrogen prediction model performs well at wheat early growth stage. Additionally, the best data collection time for yield prediction is at the end of booting stage. The results demonstrate the UAV-based data could be an alternative effective and affordable approach for farmers on intra-field management

Intra-field Canopy Nitrogen Retrieval from Unmanned Aerial Vehicle Imagery for Wheat and Corn Crops in Ontario, Canada

The optimization of crop nitrogen fertilization to accurately predict and match the nitrogen (N) supply to the crop N demand is the subject of intense research due to the environmental and economic impact of N fertilization. Excess N could seep into the water supplies around the field and cause unnecessary spending by farmers. Understanding the detailed spatial information about a crop status is known as a farming management technique called precision agriculture, which allows farmers to maximize their yield and profit while reducing the inputs of fertilizers, pesticides, water, and insecticides. The goal of this study is to document and test the applicability and feasibility of using Unmanned Aerial Vehicle (UAV) to predict nitrogen weight of wheat and corn fields in south-west Ontario. This is investigated using various statistical modelling techniques to achieve the best accuracy. Machine learning techniques such as Random Forests and Support Vector Regression are used, which provide more robust models than traditional linear regression models. The results demonstrate that most spectral indices have a non-linear relationship with canopy nitrogen weight and show high degree of multicollinearity among the variables. In this thesis, the final nitrogen prediction maps of wheat and corn fields using UAV images and the derived models are provided

Investigating the Potential of UAV-Based Low-Cost Camera Imagery for Measuring Biophysical Variables in Maize

The potential for improved crop productivity is readily investigated in agronomic field experiments. Frequent measurements of biophysical crop variables are necessary to allow for confident statements on crop performance. Commonly, in-field measurements are tedious, labour-intensive, costly and spatially selective and therefore pose a challenge in field experiments. With the versatile, flexible employment of the platform and the high spatial and temporal resolution of the sensor data, Unmanned Aerial Vehicle (UAV)-based remote sensing offers the possibility to derive variables quickly, contactless and at low cost. This thesis examined if UAV-borne modified low-cost camera imagery allowed for remote estimation of the crop variables green leaf area index (gLAI) and radiation use efficiency (RUE) in a maize field trial under different management influences. For this, a field experiment was established at the university's research station Campus Klein-Altendorf southwest of Bonn in the years 2015 and 2016. In four treatments (two levels of nitrogen fertilisation and two levels of plant density) with five repetitions each, leaf growth of maize plants was supposed to occur differently. gLAI and biomass was measured destructively, UAV-based data was acquired in 14-day intervals over the entire experiment. Three studies were conducted and submitted for peer-review in international journals. In study I, three selected spectral vegetation indices (NDVI, GNDVI, 3BSI) were related to the gLAI measurements. Differing but definite relationships per treatment factor were found. gLAI estimation using the two-band indices (NDVI, GNDVI) yielded good results up to gLAI values of 3. The 3-bands approach (3BSI) did not provide improved accuracies. Comparing gLAI results to the spectral vegetation indices, it was determined that sole reliance on these was insufficient to draw the right conclusions on the impact of management factors on leaf area development in maize canopies. Study II evaluated parametric and non-parametric regression methods on their capability to estimate gLAI in maize, relying on UAV-based low-cost camera imagery with non-plants pixels (i.e. shaded and illuminated soil background) a) included in and b) excluded from the analysis. With regard to the parametric regression methods, all possible band combinations for a selected number of two- and three-band formulations as well as different fitting functions were tested. With regard to non-parametric methods, six regression algorithms (Random Forests Regression, Support Vector Regression, Relevance Vector Machines, Gaussian Process Regression, Kernel Regularized Least Squares, Extreme Learning Machine) were tested. It was found that all non-parametric methods performed better than the parametric methods, and that kernel-based algorithms outperformed the other tested algorithms. Excluding non-plant pixels from the analysis deteriorated models' performances. When using parametric regression methods, signal saturation occurred at gLAI values of about 3, and at values around 4 when employing non-parametric methods. Study III investigated if a) UAV-based low-cost camera imagery allowed estimating RUEs in different experimental plots where maize was cultivated in the growing season of 2016, b) those values were different from the ones previously reported in literature and c) there was a difference between RUEtotal and RUEgreen. Fractional cover and canopy reflectance was determined based on the RS imagery. Our study showed that RUEtotal ranges between 4.05 and 4.59, and RUEgreen between 4.11 and 4.65. These values were higher than those published in other research articles, but not outside the range of plausibility. The difference between RUEtotal and RUEgreen was minimal, possibly due to prolonged canopy greenness induced by the stay-green trait of the cultivar grown. In conclusion, UAV-based low-cost camera imagery allows for estimation of plant variables within a range of limitations

Using Unmanned Aerial Vehicle and Ground-Based RGB Indices to Assess Agronomic Performance of Wheat Landraces and Cultivars in a Mediterranean-Type Environment

The adaptability and stability of new bread wheat cultivars that can be successfully grown in rainfed conditions are of paramount importance. Plant improvement can be boosted using effective high-throughput phenotyping tools in dry areas of the Mediterranean basin, where drought and heat stress are expected to increase yield instability. Remote sensing has been of growing interest in breeding programs since it is a cost-effective technology useful for assessing the canopy structure as well as the physiological traits of large genotype collections. The purpose of this study was to evaluate the use of a 4-band multispectral camera on-board an unmanned aerial vehicle (UAV) and ground-based RGB imagery to predict agronomic traits as well as quantify the best estimation of leaf area index (LAI) in rainfed conditions. A collection of 365 bread wheat genotypes, including 181 Mediterranean landraces and 184 modern cultivars, was evaluated during two consecutive growing seasons. Several vegetation indices (VI) derived from multispectral UAV and ground-based RGB images were calculated at different image acquisition dates of the crop cycle. The modified triangular vegetation index (MTVI2) proved to have a good accuracy to estimate LAI (R2 = 0.61). Although the stepwise multiple regression analysis showed that grain yield and number of grains per square meter (NGm2) were the agronomic traits most suitable to be predicted, the R2 were low due to field trials were conducted under rainfed conditions. Moreover, the prediction of agronomic traits was slightly better with ground-based RGB VI rather than with UAV multispectral VIs. NDVI and GNDVI, from multispectral images, were present in most of the prediction equations. Repeated measurements confirmed that the ability of VIs to predict yield depends on the range of phenotypic data. The current study highlights the potential use of VI and RGB images as an efficient tool for high-throughput phenotyping under rainfed Mediterranean conditions.info:eu-repo/semantics/publishedVersio

The use of Unmanned Aerial Vehicle based photogrammetric point cloud data for winter wheat intra-field variable retrieval and yield estimation in Southwestern Ontario

Precision agriculture uses high spatial and temporal resolution soil and crop information to control the crop intra-field variability to achieve optimal economic benefit and environmental resources sustainable development. As a new imagery collection platform between airborne and ground measurements, Unmanned Aerial Vehicle (UAV) is used to collect high spatial resolution images at a user selected period for precision agriculture. Most studies extract crop parameters from the UAV-based orthomosaic imagery using spectral methods derived from the satellite and airborne based remote sensing. The new dataset, photogrammetric point cloud data (PCD), generated from the Structure from Motion (SfM) methods using the UAV-based images contains the feature’s structural information, which has not been fully utilized to extract crop’s biophysical information. This thesis explores the potential for the applications of the UAV-based photogrammetric PCD in crop biophysical variable retrieval and in final biomass and yield estimation. First, a new moving cuboid filter is applied to the voxel of UAV-based photogrammetric PCD of winter wheat to eliminate noise points, and the crop height is calculated from the highest and lowest points in each voxel. The results show that the winter wheat height can be estimated from the UAV-based photogrammetric PCD directly with high accuracy. Secondly, a new Simulated Observation of Point Cloud (SOPC) method was designed to obtain the 3D spatial distribution of vegetation and bare ground points and calculate the gap fraction and effective leaf area index (LAIe). It reveals that the ground-based crop biophysical methods are possible to be adopted by the PCD to retrieve LAIe without ground measurements. Finally, the SOPC method derived LAIe maps were applied to the Simple Algorithm for Yield estimation (SAFY) to generate the sub-field biomass and yield maps. The pixel-based biomass and yield maps were generated in this study revealed clearly the intra-field yield variation. This framework using the UAV-based SOPC-LAIe maps and SAFY model could be a simple and low-cost alternative for final yield estimation at the sub-field scale. The results of this thesis show that the UAV-based photogrammetric PCD is an alternative source of data in crop monitoring for precision agriculture

Performance of the Two-Source Energy Balance (TSEB) Model as a Tool for Monitoring the Response of Durum Wheat to Drought by High-Throughput Field Phenotyping

The current lack of efficient methods for high throughput field phenotyping is a constraint on the goal of increasing durum wheat yields. This study illustrates a comprehensive methodology for phenotyping this crop's water use through the use of the two-source energy balance (TSEB) model employing very high resolution imagery. An unmanned aerial vehicle (UAV) equipped with multispectral and thermal cameras was used to phenotype 19 durum wheat cultivars grown under three contrasting irrigation treatments matching crop evapotranspiration levels (ETc): 100%ETc treatment meeting all crop water requirements (450 mm), 50%ETc treatment meeting half of them (285 mm), and a rainfed treatment (122 mm). Yield reductions of 18.3 and 48.0% were recorded in the 50%ETc and rainfed treatments, respectively, in comparison with the 100%ETc treatment. UAV flights were carried out during jointing (April 4th), anthesis (April 30th), and grain-filling (May 22nd). Remotely-sensed data were used to estimate: (1) plant height from a digital surface model (H, R2 = 0.95, RMSE = 0.18m), (2) leaf area index from multispectral vegetation indices (LAI, R2 = 0.78, RMSE = 0.63), and (3) actual evapotranspiration (ETa) and transpiration (T) through the TSEB model (R2 = 0.50, RMSE = 0.24 mm/h). Compared with ground measurements, the four traits estimated at grain-filling provided a good prediction of days from sowing to heading (DH, r = 0.58–0.86), to anthesis (DA, r = 0.59–0.85) and to maturity (r = 0.67–0.95), grain-filling duration (GFD, r = 0.54–0.74), plant height (r = 0.62–0.69), number of grains per spike (NGS, r = 0.41–0.64), and thousand kernel weight (TKW, r = 0.37–0.42). The best trait to estimate yield, DH, DA, and GFD was ETa at anthesis or during grain filling. Better forecasts for yield-related traits were recorded in the irrigated treatments than in the rainfed one. These results show a promising perspective in the use of energy balance models for the phenotyping of large numbers of durum wheat genotypes under Mediterranean conditions.info:eu-repo/semantics/publishedVersio

Unmanned Aerial Vehicles for High-Throughput Phenotyping and Agronomic Research

Advances in automation and data science have led agriculturists to seek real-time, high-quality, high-volume crop data to accelerate crop improvement through breeding and to optimize agronomic practices. Breeders have recently gained massive data-collection capability in genome sequencing of plants. Faster phenotypic trait data collection and analysis relative to genetic data leads to faster and better selections in crop improvement. Furthermore, faster and higher-resolution crop data collection leads to greater capability for scientists and growers to improve precision-agriculture practices on increasingly larger farms; e.g., site-specific application of water and nutrients. Unmanned aerial vehicles (UAVs) have recently gained traction as agricultural data collection systems. Using UAVs for agricultural remote sensing is an innovative technology that differs from traditional remote sensing in more ways than strictly higher-resolution images; it provides many new and unique possibilities, as well as new and unique challenges. Herein we report on processes and lessons learned from year 1-the summer 2015 and winter 2016 growing seasons-of a large multidisciplinary project evaluating UAV images across a range of breeding and agronomic research trials on a large research farm. Included are team and project planning, UAV and sensor selection and integration, and data collection and analysis workflow. The study involved many crops and both breeding plots and agronomic fields. The project's goal was to develop methods for UAVs to collect high-quality, high-volume crop data with fast turnaround time to field scientists. The project included five teams: Administration, Flight Operations, Sensors, Data Management, and Field Research. Four case studies involving multiple crops in breeding and agronomic applications add practical descriptive detail. Lessons learned include critical information on sensors, air vehicles, and configuration parameters for both. As the first and most comprehensive project of its kind to date, these lessons are particularly salient to researchers embarking on agricultural research with UAVs

High-throughput estimation of crop traits: A review of ground and aerial phenotyping platforms

Crop yields need to be improved in a sustainable manner to meet the expected worldwide increase in population over the coming decades as well as the effects of anticipated climate change. Recently, genomics-assisted breeding has become a popular approach to food security; in this regard, the crop breeding community must better link the relationships between the phenotype and the genotype. While high-throughput genotyping is feasible at a low cost, highthroughput crop phenotyping methods and data analytical capacities need to be improved. High-throughput phenotyping offers a powerful way to assess particular phenotypes in large-scale experiments, using high-tech sensors, advanced robotics, and imageprocessing systems to monitor and quantify plants in breeding nurseries and field experiments at multiple scales. In addition, new bioinformatics platforms are able to embrace large-scale, multidimensional phenotypic datasets. Through the combined analysis of phenotyping and genotyping data, environmental responses and gene functions can now be dissected at unprecedented resolution. This will aid in finding solutions to currently limited and incremental improvements in crop yields