Hyperspectral classification of Cyperus esculentus clones and morphologically similar weeds

Cyperus esculentus (yellow nutsedge) is one of the world's worst weeds as it can cause great damage to crops and crop production. To eradicate C. esculentus, early detection is key-a challenging task as it is often confused with other Cyperaceae and displays wide genetic variability. In this study, the objective was to classify C. esculentus clones and morphologically similar weeds. Hyperspectral reflectance between 500 and 800 nm was tested as a measure to discriminate between (I) C. esculentus and morphologically similar Cyperaceae weeds, and between (II) different clonal populations of C. esculentus using three classification models: random forest (RF), regularized logistic regression (RLR) and partial least squares-discriminant analysis (PLS-DA). RLR performed better than RF and PLS-DA, and was able to adequately classify the samples. The possibility of creating an affordable multispectral sensing tool, for precise in-field recognition of C. esculentus plants based on fewer spectral bands, was tested. Results of this study were compared against simulated results from a commercially available multispectral camera with four spectral bands. The model created with customized bands performed almost equally well as the original PLS-DA or RLR model, and much better than the model describing multispectral image data from a commercially available camera. These results open up the opportunity to develop a dedicated robust tool for C. esculentus recognition based on four spectral bands and an appropriate classification model

Automatic methods for crop classification by merging satellite radar (sentinel 1) and optical (sentinel 2) . data and artificial intelligence analysis

Land use and land cover maps can support our understanding of coupled human- environment systems and provide important information for environmental modelling and water resource management. Satellite data are a valuable source for land use and land cover mapping. However, cloud-free or weather independent data are necessary to map cloud-prone regions. Merging radar with optical images would increase the accuracy of the study. Agricultural land cover is characterized by strong variations within relatively short time intervals. These dynamics are challenging for land cover classifications on the one hand, but deliver crucial information that can be used to improve the machine learning classifier’s performance on the other hand. A parcel-based map of the main crop classes of the Netherlands was produced implementing a script on GEE and using Copernicus data. The machine-learning model used is a Random Forest Classifier. This was done by combining time series of radar and multispectral images from Sentinel 1 and Sentinel 2 satellites, respectively. The results show the potential of providing useful information delivered by entirely open source data and uses a cloud computing-based approach. The algorithm combines the two satellites data of one year in a multibands image to feed in the classifier. Standard deviation and several vegetation indexes were added in order to have more variables for each 15-day-median image composite. The process paid particular attention to time variability of mean values of each field. This will provide useful information both for understanding differences among crops and variability over the phenology of the plant. The accuracy assessment demonstrates that several crop types (i.e. corn, tulip) can be better classified with both radar and optical images while others (i.e. sugar beet, barley) have an increased accuracy with only radar. The overall accuracy of RFC with optical and radar is 76% while it is 74% if only radar is used

Mapping of multitemporal rice (Oryza sativa L.) growth stages using remote sensing with multi-sensor and machine learning : a thesis dissertation presented in partial fulfilment of the requirements for the degree of Doctor of Philosophy in Earth Science at Massey University, Manawatū, New Zealand

Figure 2.1 is adapted and re-used under a Creative Commons Attribution 4.0 International (CC BY 4.0) license.Rice (Oryza Sativa) plays a pivotal role in food security for Asian countries, especially in Indonesia. Due to the increasing pressure of environmental changes, such as land use and climate, rice cultivation areas need to be monitored regularly and spatially to ensure sustainable rice production. Moreover, timely information of rice growth stages (RGS) can lead to more efficient of inputs distribution from water, seed, fertilizer, and pesticide. One of the efficient solutions for regularly mapping the rice crop is using Earth observation satellites. Moreover, the increasing availability of open access satellite images such as Landsat-8, Sentinel-1, and Sentinel-2 provides ample opportunities to map continuous and high-resolution rice growth stages with greater accuracy. The majority of the literature has focused on mapping rice area, cropping patterns and relied mainly on the phenology of vegetation. However, the mapping process of RGS was difficult to assess the accuracy, time-consuming, and depended on only one sensor. In this work, we discuss the use of machine learning algorithms (MLA) for mapping paddy RGS with multiple remote sensing data in near-real-time. The study area was Java Island, which is the primary rice producer in Indonesia. This study has investigated: (1) the mapping of RGS using Landsat-8 imagery and different MLAs, and their rigorous performance was evaluated by conducting a multitemporal analysis; (2) the temporal consistency of predicting RGS using Sentinel-2, MOD13Q1, and Sentinel-1 data; (3) evaluating the correlation of local statistics data and paddy RGS using Sentinel-2, PROBA-V, and Sentinel-1 with MLAs. The ground truth datasets were collected from multi-year web camera data (2014-2016) and three months of the field campaign in different regions of Java (2018). The study considered the RGS in the analysis to be vegetative, reproductive, ripening, bare land, and flooding, and MLAs such as support vector machines (SVMs), random forest (RF), and artificial neural network (ANN) were used. The temporal consistency matrix was used to compare the classification maps within three sensor datasets (Landsat-8 OLI, Sentinel-2, and Sentinel-2, MOD13Q1, Sentinel-1) and in four periods (5, 10, 15, 16 days). Moreover, the result of the RGS map was also compared with monthly data from local statistics within each sub-district using cross-correlation analysis. The result from the analysis shows that SVM with a radial base function outperformed the RF and ANN and proved to be a robust method for small-size datasets (< 1,000 points). Compared to Sentinel-2, Landsat-8 OLI gives less accuracy due to the lack of a red-edge band and larger pixel size (30 x 30 m). Integration of Sentinel-2, MOD13Q1, and Sentinel-1 improved the classification performance and increased the temporal availability of cloud-free maps. The integration of PROBA-V and Sentinel-1 improved the classification accuracy from the Landsat-8 result, consistent with the monthly rice planting area statistics at the sub-district level. The western area of Java has the highest accuracy and consistency since the cropping pattern only relied on rice cultivation. In contrast, less accuracy was noticed in the eastern area because of upland rice cultivation due to limited irrigation facilities and mixed cropping. In addition, the cultivation of shallots to the north of Nganjuk Regency interferes with the model predictions because the cultivation of shallots resembles the vegetative phase due to the water banks. One future research idea is the auto-detection of the cropping index in the complex landscape to be able to use it for mapping RGS on a global scale. Detection of the rice area and RGS using Google Earth Engine (GEE) can be an action plan to disseminate the information quickly on a planetary scale. Our results show that the multitemporal Sentinel-1 combined with RF can detect rice areas with high accuracy (>91%). Similarly, accurate RGS maps can be detected by integrating multiple remote sensing (Sentinel-2, Landsat-8 OLI, and MOD13Q1) data with acceptable accuracy (76.4%), with high temporal frequency and lower cloud interference (every 16 days). Overall, this study shows that remote sensing combined with the machine learning methodology can deliver information on RGS in a timely fashion, which is easy to scale up and consistent both in time and space and matches the local statistics. This thesis is also in line with the existing rice monitoring projects such as Crop Monitor, Crop Watch, AMIS, and Sen4Agri to support disseminating information over a large area. To sum up, the proposed workflow and detailed map provide a more accurate method and information in near real-time for stakeholders, such as governmental agencies against the existing mapping method. This method can be introduced to provide accurate information to rice farmers promptly with sufficient inputs such as irrigation, seeds, and fertilisers for ensuring national food security from the shifting planting time due to climate change

Mapping urban tree species in a tropical environment using airborne multispectral and LiDAR data

Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial TechnologiesAccurate and up-to-date urban tree inventory is an essential resource for the development of strategies towards sustainable urban planning, as well as for effective management and preservation of biodiversity. Trees contribute to thermal comfort within urban centers by lessening heat island effect and have a direct impact in the reduction of air pollution. However, mapping individual trees species normally involves time-consuming field work over large areas or image interpretation performed by specialists. The integration of airborne LiDAR data with high-spatial resolution and multispectral aerial image is an alternative and effective approach to differentiate tree species at the individual crown level. This thesis aims to investigate the potential of such remotely sensed data to discriminate 5 common urban tree species using traditional Machine Learning classifiers (Random Forest, Support Vector Machine, and k-Nearest Neighbors) in the tropical environment of Salvador, Brazil. Vegetation indices and texture information were extracted from multispectral imagery, and LiDAR-derived variables for tree crowns, were tested separately and combined to perform tree species classification applying three different classifiers. Random Forest outperformed the other two classifiers, reaching overall accuracy of 82.5% when using combined multispectral and LiDAR data. The results indicate that (1) given the similarity in spectral signature, multispectral data alone is not sufficient to distinguish tropical tree species (only k-NN classifier could detect all species); (2) height values and intensity of crown returns points were the most relevant LiDAR features, combination of both datasets improved accuracy up to 20%; (3) generation of canopy height model derived from LiDAR point cloud is an effective method to delineate individual tree crowns in a semi-automatic approach

Quantifying soybean phenotypes using UAV imagery and machine learning, deep learning methods

Crop breeding programs aim to introduce new cultivars to the world with improved traits to solve the food crisis. Food production should need to be twice of current growth rate to feed the increasing number of people by 2050. Soybean is one the major grain in the world and only US contributes around 35 percent of world soybean production. To increase soybean production, breeders still rely on conventional breeding strategy, which is mainly a 'trial and error' process. These constraints limit the expected progress of the crop breeding program. The goal was to quantify the soybean phenotypes of plant lodging and pubescence color using UAV-based imagery and advanced machine learning. Plant lodging and soybean pubescence color are two of the most important phenotypes for soybean breeding programs. Soybean lodging and pubescence color is conventionally evaluated visually by breeders, which is time-consuming and subjective to human errors. The goal of this study was to investigate the potential of unmanned aerial vehicle (UAV)-based imagery and machine learning in the assessment of lodging conditions and deep learning in the assessment pubescence color of soybean breeding lines. A UAV imaging system equipped with an RGB (red-green-blue) camera was used to collect the imagery data of 1,266 four-row plots in a soybean breeding field at the reproductive stage. Soybean lodging scores and pubescence scores were visually assessed by experienced breeders. Lodging scores were grouped into four classes, i.e., non-lodging, moderate lodging, high lodging, and severe lodging. In contrast, pubescence color scores were grouped into three classes, i.e., gray, tawny, and segregation. UAV images were stitched to build orthomosaics, and soybean plots were segmented using a grid method. Twelve image features were extracted from the collected images to assess the lodging scores of each breeding line. Four models, i.e., extreme gradient boosting (XGBoost), random forest (RF), K-nearest neighbor (KNN), and artificial neural network (ANN), were evaluated to classify soybean lodging classes. Five data pre-processing methods were used to treat the imbalanced dataset to improve the classification accuracy. Results indicate that the pre-processing method SMOTE-ENN consistently performs well for all four (XGBoost, RF, KNN, and ANN) classifiers, achieving the highest overall accuracy (OA), lowest misclassification, higher F1-score, and higher Kappa coefficient. This suggests that Synthetic Minority Over-sampling-Edited Nearest Neighbor (SMOTE-ENN) may be an excellent pre-processing method for using unbalanced datasets and classification tasks. Furthermore, an overall accuracy of 96 percent was obtained using the SMOTE-ENN dataset and ANN classifier. On the other hand, to classify the soybean pubescence color, seven pre-trained deep learning models, i.e., DenseNet121, DenseNet169, DenseNet201, ResNet50, InceptionResNet-V2, Inception-V3, and EfficientNet were used, and images of each plot were fed into the model. Data was enhanced using two rotational and two scaling factors to increase the datasets. Among the seven pre-trained deep learning models, ResNet50 and DenseNet121 classifiers showed a higher overall accuracy of 88 percent, along with higher precision, recall, and F1-score for all three classes of pubescence color. In conclusion, the developed UAV-based high-throughput phenotyping system can gather image features to estimate soybean crucial phenotypes and classify the phenotypes, which will help the breeders in phenotypic variations in breeding trials. Also, the RGB imagery-based classification could be a cost-effective choice for breeders and associated researchers for plant breeding programs in identifying superior genotypes.Includes bibliographical references

Challenges and opportunities of using ecological and remote sensing variables for crop pest and disease mapping

Crop pest and diseases are responsible for major economic losses in the agricultural systems in Africa resulting in food insecurity. Potential yield losses for major crops across Africa are mainly caused by pests and diseases. Total losses have been estimated at 70% with approximately 30% caused by inefficient crop protection practices. With newly emerging crop pests and disease, monitoring plant health and detecting pathogens early is essential to reduce disease spread and to facilitate effective management practices. While many pest and diseases can be acquired from another host or via the environment, the majority are transmitted by biological vectors. Thus, vector ecology can serve an indirect explanation of disease cycles, outbreaks, and prevalence. Hence, better understanding of the vector niche and the dependence of pest and disease processes on their specific spatial and ecological contexts is therefore required for better management and control. While research in disease ecology has revealed important life history of hosts with the surrounding environment, other aspects need to be explored to better understand vector transmission and control strategies. For instance, choosing appropriate farming practices have proved to be an alternative to the use of synthetic pesticides. For instance, intercropping can serve as a buffer against the spread of plant pests and pathogens by attracting pests away from their host plant and also increasing the distance between plants of the same species, making it more exigent for the pest to target the main crop. Many studies have explored the potential applications of geospatial technology in disease ecology. However, pest and disease mapping in crops is rather crudely done thus far, using Spatial Distribution Models (SDM) on a regional scale. Previous research has explored climatic data to model habitat suitability and the distribution of different crop pests and diseases. However, there are limitation to using climate data since it ignores the dispersal and competition from other factors which determines the distribution of vectors transmitting the disease, thus resulting in model over prediction. For instance, vegetation patterns and heterogeneity at the landscape level has been identified to play a key role in influencing the vector-host-pathogen transmission, including vector distribution, abundance and diversity at large. Such variables can be extracted from remote sensing dataset with high accuracy over a large extent. The use of remotely sensed variables in modeling crop pest and disease has proved to increase the accuracy and precision of the models by reducing over fitting as compared to when only climatic data which are interpolated over large areas thus disregarding landscape heterogeneity.When used, remotely sensed predictors may capture subtle variances in the vegetation characteristic or in the phenology linked with the niche of the vector transmitting the disease which cannot be explained by climatic variables. Subsequently, the full potential of remote sensing applications to detect changes in habitat condition of species remains uncharted. This study aims at exploring the potential behind developing a framework which integrates both ecological and remotely sensed dataset with a robust mapping/modelling approach with aim of developing an integrated pest management approach for pest and disease affecting both annual and perrennial crops and whom currently there is no cure or existing germplasm to control further spread across sub Saharan Africa.Herausforderungen und Möglichkeiten der Verwendung von ökologischen und Fernerkundungsvariablen für die Schädlings- und Krankheitskartierung Pflanzenschädlinge und Krankheiten in der Landwirtschaft sind für große wirtschaftliche Verluste in Afrika verantwortlich, die zu Ernährungsunsicherheit führen. Die Verluste werden auf 70% geschätzt, wobei etwa 30% auf ineffiziente Pflanzenschutzpraktiken zurückzuführen sind. Bei neu auftretenden Pflanzenschädlingen und Krankheiten ist die Überwachung des Pflanzenzustands und die frühzeitige Erkennung von Krankheitserregern unerlässlich, um die Ausbreitung von Krankheiten zu reduzieren und effektive Managementpraktiken zu erleichtern. Während viele Schädlinge und Krankheiten von einem anderen Wirt oder über die Umwelt erworben werden können, wird die Mehrheit durch biologische Vektoren übertragen. Daraus folgt, dass die Vektorökologie als indirekte Erklärung von Krankheitszyklen, Ausbrüchen und Prävalenz untersucht werden sollte. Um effektive Vektorkontrollmaßnahmen zu entwickeln ist ein besseres Verständnis der ökologischen Vektor-Nischen und der Abhängigkeit von Schädlings- und Krankheits-Prozessen von ihrem spezifischen räumlichen und ökologischen Kontext wichtig. Während die Forschung in der Krankheitsökologie wichtige Lebenszyklen von Wirten mit der Umgebung schon gut aufgezeigt hat, müssen weitere Aspekte noch besser untersucht werden, um Vektorübertragungs- und Kontroll-Strategien zu entwickeln. So hat sich beispielsweise die Wahl geeigneter Anbaumethoden als Alternative zum Einsatz synthetischer Pestizide erwiesen. In einigen Fällen wurde der Zwischenfruchtanbau als ‚Puffer' gegen die Ausbreitung von Pflanzenschädlingen und Krankheitserregern vorgeschlagen. Bei diesem Anbausystem werden Schädlinge von ihrer Wirtspflanze abgezogen und auch der Abstand zwischen Pflanzen derselben Art vergrößert (was eine Übertragung erschwert). Viele Studien haben bereits die Einsatzmöglichkeiten von Geodaten in der Krankheitsökologie untersucht. Die Kartierung von Schädlingen und Krankheiten in Nutzpflanzen ist jedoch bisher eher großskalig erfolgt, unter der Zunahme von sogenannten ‚Spatial Distribution Models (SDM)' auf regionaler Ebene. Etliche Studien haben diesbezüglich klimatische Daten verwendet, um die Eignung und Verteilung verschiedener Pflanzenschädlinge und Krankheiten zu modellieren. Es gibt jedoch Einschränkungen bei der Verwendung von Klimadaten, da dabei andere landschaftsbezogene Verbreitungs-Faktoren ignoriert werden, die die Verteilung der Vektoren und Krankheitserreger bestimmen, was zu einer Modell-Überprognose führt. Vegetationsmuster und Heterogenität auf Landschaftsebene beeinflussen maßgeblich die Diversität und Verteilung eines Vektors und spielen somit eine wichtige Rolle bei der Vektor-Wirt-Pathogen-Übertragung. Bei der Verwendung von Fernerkundungsdaten können subtile Abweichungen in der Vegetationscharakteristik oder in der Phänologie, die mit der Nische des Vektors verbunden sind, besser erfasst werden. Es besteht noch Forschungs-Bedarf hinsichtlich der Rolle von Fernerkundungsdaten bei der Verbesserung von Artenmodellen, die zum Ziel haben den Lebensraum von Krankheitsvektoren besser zu erfassen. Ziel dieser Studie ist es, das Potenzial für die Entwicklung eines Rahmens zu untersuchen, der sowohl ökologische als auch aus der Ferne erfasste Daten mit einem robusten Mapping- / Modellierungsansatz kombiniert, um einen integrierten Ansatz zur Schädlingsbekämpfung für Schädlinge und Krankheiten zu entwickeln, der sowohl einjährige als auch mehrjährige Kulturpflanzen betrifft Keine Heilung oder vorhandenes Keimplasma zur weiteren Verbreitung in Afrika südlich der Sahara

Landcover and crop type classification with intra-annual times series of sentinel-2 and machine learning at central Portugal

Dissertation submitted in partial fulfilment of the requirements for the degree of Master of Science in Geospatial TechnologiesLand cover and crop type mapping have benefited from a daily revisiting period of sensors such as MODIS, SPOT-VGT, NOAA-AVHRR that contains long time-series archive. However, they have low accuracy in an Area of Interest (ROI) due to their coarse spatial resolution (i.e., pixel size > 250m). The Copernicus Sentinel-2 mission from the European Spatial Agency (ESA) provides free data access for Sentinel 2-A(S2a) and B (S2b). This satellite constellation guarantees a high temporal (5-day revisit cycle) and high spatial resolution (10m), allowing frequent updates on land cover products through supervised classification. Nevertheless, this requires training samples that are traditionally collected manually via fieldwork or image interpretation. This thesis aims to implement an automatic workflow to classify land cover and crop types at 10m resolution in central Portugal using existing databases, intra-annual time series of S2a and S2b, and Random Forest, a supervised machine learning algorithm. The agricultural classes such as temporary and permanent crops as well as agricultural grasslands were extracted from the Portuguese Land Parcel Identification System (LPIS) of the Instituto de Financiamento da Agricultura e Pescas (IFAP); land cover classes like urban, forest and water were trained from the Carta de Ocupação do Solo (COS) that is the national Land Use and Land Cover (LULC) map of Portugal; and lastly, the burned areas are identified from the corresponding national map of the Instituto da Conservação da Natureza e das Florestas (ICNF). Also, a set of preprocessing steps were defined based on the implementation of ancillary data allowing to avoid the inclusion of mislabeled pixels to the classifier. Mislabeling of pixels can occur due to errors in digitalization, generalization, and differences in the Minimum Mapping Unit (MMU) between datasets. An inner buffer was applied to all datasets to reduce border overlap among classes; the mask from the ICNF was applied to remove burned areas, and NDVI rule based on Landsat 8 allowed to erase recent clear-cuts in the forest. Also, the Copernicus High-Resolution Layers (HRL) datasets from 2015 (latest available), namely Dominant Leaf Type (DLT) and Tree Cover Density (TCD) are used to distinguish between forest with more than 60% coverage (coniferous and broadleaf) such as Holm Oak and Stone Pine and between 10 and 60% (coniferous) for instance Open Maritime Pine. Next, temporal gap-filled monthly composites were created for the agricultural period in Portugal, ranging from October 2017 till September 2018. The composites provided data free of missing values in opposition to single date acquisition images. Finally, a pixel-based approach classification was carried out in the “Tejo and Sado” region of Portugal using Random Forest (RF). The resulting map achieves a 76% overall accuracy for 31 classes (17 land cover and 14 crop types). The RF algorithm captured the most relevant features for the classification from the cloud-free composites, mainly during the spring and summer and in the bands on the Red Edge, NIR and SWIR. Overall, the classification was more successful on the irrigated temporary crops whereas the grasslands presented the most complexity to classify as they were confused with other rainfed crops and burned areas

A survey of image-based computational learning techniques for frost detection in plants

Frost damage is one of the major concerns for crop growers as it can impact the growth of the plants and hence, yields. Early detection of frost can help farmers mitigating its impact. In the past, frost detection was a manual or visual process. Image-based techniques are increasingly being used to understand frost development in plants and automatic assessment of damage resulting from frost. This research presents a comprehensive survey of the state-of the-art methods applied to detect and analyse frost stress in plants. We identify three broad computational learning approaches i.e., statistical, traditional machine learning and deep learning, applied to images to detect and analyse frost in plants. We propose a novel taxonomy to classify the existing studies based on several attributes. This taxonomy has been developed to classify the major characteristics of a significant body of published research. In this survey, we profile 80 relevant papers based on the proposed taxonomy. We thoroughly analyse and discuss the techniques used in the various approaches, i.e., data acquisition, data preparation, feature extraction, computational learning, and evaluation. We summarise the current challenges and discuss the opportunities for future research and development in this area including in-field advanced artificial intelligence systems for real-time frost monitoring

Understanding Striga occurrence and risk under changing climatic conditions across different agroecological farming systems at local and regional scales122

Philosophiae Doctor - PhDThe invasion by Striga in most cereal crop fields in Africa has posed an acute threat to food security and socioeconomic integrity. Consequently, numerous technological and research developments have been made to minimize and even control the Striga impacts on crop production. So far, efforts to control Striga have primarily focused on the manipulation of the genetics of the host crops, as well as understanding the phenological and physiological traits, along with the chemical composition of the weed