Numerical Modeling and Design of Machine Learning Based Paddy Leaf Disease Detection System for Agricultural Applications

In order to satisfy the insatiable need for ever more bountiful harvests on the global market, the majority of countries deploy cutting-edge technologies to increase agricultural output. Only the most cutting-edge technologies can ensure an appropriate pace of food production. Abiotic stress factors that can affect plants at any stage of development include insects, diseases, drought, nutrient deficiencies, and weeds. On the amount and quality of agricultural production, this has a minimal effect. Identification of plant diseases is therefore essential but challenging and complicated. Paddy leaves must thus be closely watched in order to assess their health and look for disease symptoms. The productivity and production of the post-harvest period are significantly impacted by these illnesses. To gauge the severity of plant disease in the past, only visual examination (bare eye observation) methods have been employed. The skill of the analyst doing this analysis is essential to the caliber of the outcomes. Due to the large growing area and need for ongoing human monitoring, visual crop inspection takes a long time. Therefore, a system is required to replace human inspection. In order to identify the kind and severity of plant disease, image processing techniques are used in agriculture. This dissertation goes into great length regarding the many ailments that may be detected in rice fields using image processing. Identification and classification of the four rice plant diseases bacterial blight, sheath rot, blast, and brown spot are important to enhance yield. The other communicable diseases, such as stem rot, leaf scald, red stripe, and false smut, are not discussed in this paper. Despite the increased accuracy they offer, the categorization and optimization strategies utilized in this work lead it to take longer than typical to finish. It was evident that employing SVM techniques enabled superior performance results, but at a cost of substantial effort. K-means clustering is used in this paper segmentation process, which makes figuring out the cluster size, or K-value, more challenging. This clustering method operates best when used with images that are comparable in size and brightness. However, when the images have complicated sizes and intensity values, clustering is not particularly effective

Local Binary Pattern based algorithms for the discrimination and detection of crops and weeds with similar morphologies

In cultivated agricultural fields, weeds are unwanted species that compete with the crop plants for nutrients, water, sunlight and soil, thus constraining their growth. Applying new real-time weed detection and spraying technologies to agriculture would enhance current farming practices, leading to higher crop yields and lower production costs. Various weed detection methods have been developed for Site-Specific Weed Management (SSWM) aimed at maximising the crop yield through efficient control of weeds. Blanket application of herbicide chemicals is currently the most popular weed eradication practice in weed management and weed invasion. However, the excessive use of herbicides has a detrimental impact on the human health, economy and environment. Before weeds are resistant to herbicides and respond better to weed control strategies, it is necessary to control them in the fallow, pre-sowing, early post-emergent and in pasture phases. Moreover, the development of herbicide resistance in weeds is the driving force for inventing precision and automation weed treatments. Various weed detection techniques have been developed to identify weed species in crop fields, aimed at improving the crop quality, reducing herbicide and water usage and minimising environmental impacts. In this thesis, Local Binary Pattern (LBP)-based algorithms are developed and tested experimentally, which are based on extracting dominant plant features from camera images to precisely detecting weeds from crops in real time. Based on the efficient computation and robustness of the first LBP method, an improved LBP-based method is developed based on using three different LBP operators for plant feature extraction in conjunction with a Support Vector Machine (SVM) method for multiclass plant classification. A 24,000-image dataset, collected using a testing facility under simulated field conditions (Testbed system), is used for algorithm training, validation and testing. The dataset, which is published online under the name “bccr-segset”, consists of four subclasses: background, Canola (Brassica napus), Corn (Zea mays), and Wild radish (Raphanus raphanistrum). In addition, the dataset comprises plant images collected at four crop growth stages, for each subclass. The computer-controlled Testbed is designed to rapidly label plant images and generate the “bccr-segset” dataset. Experimental results show that the classification accuracy of the improved LBP-based algorithm is 91.85%, for the four classes. Due to the similarity of the morphologies of the canola (crop) and wild radish (weed) leaves, the conventional LBP-based method has limited ability to discriminate broadleaf crops from weeds. To overcome this limitation and complex field conditions (illumination variation, poses, viewpoints, and occlusions), a novel LBP-based method (denoted k-FLBPCM) is developed to enhance the classification accuracy of crops and weeds with similar morphologies. Our contributions include (i) the use of opening and closing morphological operators in pre-processing of plant images, (ii) the development of the k-FLBPCM method by combining two methods, namely, the filtered local binary pattern (LBP) method and the contour-based masking method with a coefficient k, and (iii) the optimal use of SVM with the radial basis function (RBF) kernel to precisely identify broadleaf plants based on their distinctive features. The high performance of this k-FLBPCM method is demonstrated by experimentally attaining up to 98.63% classification accuracy at four different growth stages for all classes of the “bccr-segset” dataset. To evaluate performance of the k-FLBPCM algorithm in real-time, a comparison analysis between our novel method (k-FLBPCM) and deep convolutional neural networks (DCNNs) is conducted on morphologically similar crops and weeds. Various DCNN models, namely VGG-16, VGG-19, ResNet50 and InceptionV3, are optimised, by fine-tuning their hyper-parameters, and tested. Based on the experimental results on the “bccr-segset” dataset collected from the laboratory and the “fieldtrip_can_weeds” dataset collected from the field under practical environments, the classification accuracies of the DCNN models and the k-FLBPCM method are almost similar. Another experiment is conducted by training the algorithms with plant images obtained at mature stages and testing them at early stages. In this case, the new k-FLBPCM method outperformed the state-of-the-art CNN models in identifying small leaf shapes of canola-radish (crop-weed) at early growth stages, with an order of magnitude lower error rates in comparison with DCNN models. Furthermore, the execution time of the k-FLBPCM method during the training and test phases was faster than the DCNN counterparts, with an identification time difference of approximately 0.224ms per image for the laboratory dataset and 0.346ms per image for the field dataset. These results demonstrate the ability of the k-FLBPCM method to rapidly detect weeds from crops of similar appearance in real time with less data, and generalize to different size plants better than the CNN-based methods

Development of a smart weed detector and selective herbicide sprayer

Abstract: The fourth industrial revolution has brought about tremendous advancements in various sectors of the economy including the agricultural domain. Aimed at improving food production and alleviating poverty, these technological advancements through precision agriculture has ushered in optimized agricultural processes, real-time analysis and monitoring of agricultural data. The detrimental effects of applying agrochemicals in large or hard-to-reach farmlands and the need to treat a specific class of weed with a particular herbicide for effective weed elimination gave rise to the necessity of this research work...M.Ing. (Mechanical Engineering

Boosting precision crop protection towards agriculture 5.0 via machine learning and emerging technologies: A contextual review

Crop protection is a key activity for the sustainability and feasibility of agriculture in a current context of climate change, which is causing the destabilization of agricultural practices and an increase in the incidence of current or invasive pests, and a growing world population that requires guaranteeing the food supply chain and ensuring food security. In view of these events, this article provides a contextual review in six sections on the role of artificial intelligence (AI), machine learning (ML) and other emerging technologies to solve current and future challenges of crop protection. Over time, crop protection has progressed from a primitive agriculture 1.0 (Ag1.0) through various technological developments to reach a level of maturity closelyin line with Ag5.0 (section 1), which is characterized by successfully leveraging ML capacity and modern agricultural devices and machines that perceive, analyze and actuate following the main stages of precision crop protection (section 2). Section 3 presents a taxonomy of ML algorithms that support the development and implementation of precision crop protection, while section 4 analyses the scientific impact of ML on the basis of an extensive bibliometric study of >120 algorithms, outlining the most widely used ML and deep learning (DL) techniques currently applied in relevant case studies on the detection and control of crop diseases, weeds and plagues. Section 5 describes 39 emerging technologies in the fields of smart sensors and other advanced hardware devices, telecommunications, proximal and remote sensing, and AI-based robotics that will foreseeably lead the next generation of perception-based, decision-making and actuation systems for digitized, smart and real-time crop protection in a realistic Ag5.0. Finally, section 6 highlights the main conclusions and final remarks

Dimensionality Reduction of Hyperspectral Signatures for Optimized Detection of Invasive Species

The aim of this thesis is to investigate the use of hyperspectral reflectance signals for the discrimination of cogongrass (Imperata cylindrica) from other subtly different vegetation species. Receiver operating characteristics (ROC) curves are used to determine which spectral bands should be considered as candidate features. Multivariate statistical analysis is then applied to the candidate features to determine the optimum subset of spectral bands. Linear discriminant analysis (LDA) is used to compute the optimum linear combination of the selected subset to be used as a feature for classification. Similarly, for comparison purposes, ROC analysis, multivariate statistical analysis, and LDA are utilized to determine the most advantageous discrete wavelet coefficients for classification. The overall system was applied to hyperspectral signatures collected with a handheld spectroradiometer (ASD) and to simulated satellite signatures (Hyperion). A leave-one-out testing of a nearest mean classifier for the ASD data shows that cogongrass can be detected amongst various other grasses with an accuracy as high as 87.86% using just the pure spectral bands and with an accuracy of 92.77% using the Haar wavelet decomposition coefficients. Similarly, the Hyperion signatures resulted in classification accuracies of 92.20% using just the pure spectral bands and with an accuracy of 96.82% using the Haar wavelet decomposition coefficients. These results show that hyperspectral reflectance signals can be used to reliably detect cogongrass from subtly different vegetation

Deep convolutional neural networks for image-based Convolvulus sepium detection in sugar beet fields

Background Convolvulus sepium (hedge bindweed) detection in sugar beet fields remains a challenging problem due to variation in appearance of plants, illumination changes, foliage occlusions, and different growth stages under field conditions. Current approaches for weed and crop recognition, segmentation and detection rely predominantly on conventional machine-learning techniques that require a large set of hand-crafted features for modelling. These might fail to generalize over different fields and environments. Results Here, we present an approach that develops a deep convolutional neural network (CNN) based on the tiny YOLOv3 architecture for C. sepium and sugar beet detection. We generated 2271 synthetic images, before combining these images with 452 field images to train the developed model. YOLO anchor box sizes were calculated from the training dataset using a k-means clustering approach. The resulting model was tested on 100 field images, showing that the combination of synthetic and original field images to train the developed model could improve the mean average precision (mAP) metric from 0.751 to 0.829 compared to using collected field images alone. We also compared the performance of the developed model with the YOLOv3 and Tiny YOLO models. The developed model achieved a better trade-off between accuracy and speed. Specifically, the average precisions ([email protected]) of C. sepium and sugar beet were 0.761 and 0.897 respectively with 6.48 ms inference time per image (800 × 1200) on a NVIDIA Titan X GPU environment

Towards edge intelligence in smart spaces

After more than two decades of existence, the internet of things has been revolutionizing the way we interact with the world around us. Although, in its origins, the adoption of a cloud computing paradigm supported this ubiquitous computing model, the increasing complexity of IoT systems has led to the gradual fading of the traditional hierarchical model of cloud computing. The search for solutions to the problems of latency, scalability and privacy has, in recent years, driven the movement of data processing and storage, from the cloud, to the edge of the network (edge computing). Starting from the particular case of edge computing that keeps the focus on extending the boundaries of artificial intelligence to the edge of the network - Edge intelligence - a survey of the current state of the art is carried out, culminating into the specification of an architecture to support edge intelligence applications. In order to validate the proposed architecture, two scenarios are presented. In the scope of waste management and energy recycling, a system for used cooking oil classification in a national domestic collection network is presented. With the local classification of the trustworthiness of each deposit, it was possible to significantly shorten the response times, with a direct impact on energy consumption levels. Aimed at smart cities, a second application scenario, proposes an approach based on computer vision and deep learning, for local detection of pedestrians on crosswalks. In this context, an edge intelligence paradigm allowed to overcome privacy related issues, as well as reducing response times by more than 80 times, when compared to a cloud computing based solution.Após mais de duas décadas de existência, a internet das coisas, tem vindo a revolucionar a forma como interagimos com o mundo que nos rodeia. Apesar de, nas suas origens, a adoção de um paradigma de computação em nuvem ter servido de suporte a este modelo de computação ubíqua, a crescente complexidade dos sistemas IoT tem conduzido ao paulatino esvanecer do tradicional modelo hierárquico da computação em nuvem. A procura por soluções para os problemas de latência, escalabilidade e garantia de qualidade de serviço tem, nos últimos anos, impulsionado a deslocação do processamento e armazenamento de dados, da nuvem, para a periferia da rede (computação periférica). Partindo do caso particular de computação periférica que mantém o foco no alargar das fronteiras da inteligência artificial para a periferia da rede - Periferia inteligente - um levantamento do atual estado da arte é levado a cabo, culminando na especificação de uma arquitetura de suporte a cenários de periferia inteligente. Com vista à validação da arquitetura proposta, dois cenários são apresentados. No âmbito da gestão de resíduos e reciclagem energética, um sistema para classificação de óleo alimentar usado, numa rede nacional de recolha doméstica é apresentado. Com classificação local da veracidade de cada depósito foi possível encurtar significativamente os tempos de resposta, com impacto direto nos níveis de consumo energético. Direcionado às cidades inteligentes, um segundo cenário de aplicação, propõe uma abordagem baseada em visão computacional e aprendizagem profunda, para deteção local de peões em passadeiras. Neste contexto, um paradigma de periferia inteligente permitiu ultrapassar questões relativas à privacidade na transmissão de dados, assim como reduzir em mais de 80 vezes os tempos de resposta, quando comparado com uma solução de computação em nuvem

Improving the accuracy of weed species detection for robotic weed control in complex real-time environments

Alex Olsen applied deep learning and machine vision to improve the accuracy of weed species detection in real time complex environments. His robotic weed control prototype, AutoWeed, presents a new efficient tool for weed management in crop and pasture and has launched a startup agricultural technology company

Técnicas de visión por computador para la detección del verdor y la detección de obstáculos en campos de maíz

Tesis inédita de la Universidad Complutense de Madrid, Facultad de Informática, Departamento de Ingeniería del Software e Inteligencia Artificial, leída el 22/06/2017There is an increasing demand in the use of Computer Vision techniques in Precision Agriculture (PA) based on images captured with cameras on-board autonomous vehicles. Two techniques have been developed in this research. The rst for greenness identi cation and the second for obstacle detection in maize elds, including people and animals, for tractors in the RHEA (robot eets for highly e ective and forestry management) project, equipped with monocular cameras on-board the tractors. For vegetation identi cation in agricultural images the combination of colour vegetation indices (CVIs) with thresholding techniques is the usual strategy where the remaining elements on the image are also extracted. The main goal of this research line is the development of an alternative strategy for vegetation detection. To achieve our goal, we propose a methodology based on two well-known techniques in computer vision: Bag of Words representation (BoW) and Support Vector Machines (SVM). Then, each image is partitioned into several Regions Of Interest (ROIs). Afterwards, a feature descriptor is obtained for each ROI, then the descriptor is evaluated with a classi er model (previously trained to discriminate between vegetation and background) to determine whether or not the ROI is vegetation...Cada vez existe mayor demanda en el uso de t ecnicas de Visi on por Computador en Agricultura de Precisi on mediante el procesamiento de im agenes captadas por c amaras instaladas en veh culos aut onomos. En este trabajo de investigaci on se han desarrollado dos tipos de t ecnicas. Una para la identi caci on de plantas verdes y otra para la detecci on de obst aculos en campos de ma z, incluyendo personas y animales, para tractores del proyecto RHEA. El objetivo nal de los veh culos aut onomos fue la identi caci on y eliminaci on de malas hierbas en los campos de ma z. En im agenes agr colas la vegetaci on se detecta generalmente mediante ndices de vegetaci on y m etodos de umbralizaci on. Los ndices se calculan a partir de las propiedades espectrales en las im agenes de color. En esta tesis se propone un nuevo m etodo con tal n, lo que constituye un objetivo primordial de la investigaci on. La propuesta se basa en una estrategia conocida como \bolsa de palabras" conjuntamente con un modelo se aprendizaje supervisado. Ambas t ecnicas son ampliamente utilizadas en reconocimiento y clasi caci on de im agenes. La imagen se divide inicialmente en regiones homog eneas o de inter es (RIs). Dada una colecci on de RIs, obtenida de un conjunto de im agenes agr colas, se calculan sus caracter sticas locales que se agrupan por su similitud. Cada grupo representa una \palabra visual", y el conjunto de palabras visuales encontradas forman un \diccionario visual". Cada RI se representa por un conjunto de palabras visuales las cuales se cuanti can de acuerdo a su ocurrencia dentro de la regi on obteniendo as un vector-c odigo o \codebook", que es descriptor de la RI. Finalmente, se usan las M aquinas de Vectores Soporte para evaluar los vectores-c odigo y as , discriminar entre RIs que son vegetaci on del resto...Depto. de Ingeniería de Software e Inteligencia Artificial (ISIA)Fac. de InformáticaTRUEunpu