Hyperspectral image analysis techniques for the detection and classification of the early onset of plant disease and stress

This review explores how imaging techniques are being developed with a focus on deployment for crop monitoring methods. Imaging applications are discussed in relation to both field and glasshouse-based plants, and techniques are sectioned into ‘healthy and diseased plant classification’ with an emphasis on classification accuracy, early detection of stress, and disease severity. A central focus of the review is the use of hyperspectral imaging and how this is being utilised to find additional information about plant health, and the ability to predict onset of disease. A summary of techniques used to detect biotic and abiotic stress in plants is presented, including the level of accuracy associated with each method

A review of hyperspectral image analysis techniques for plant disease detection and identif ication

Plant diseases cause signif icant economic losses in agriculture around the world. Early detection, quantif ication and identif ication of plant diseases are crucial for targeted application of plant protection measures in crop production. Recently, intensive research has been conducted to develop innovative methods for diagnosing plant diseases based on hyperspectral technologies. The analysis of the ref lection spectrum of plant tissue makes it possible to classify healthy and diseased plants, assess the severity of the disease, differentiate the types of pathogens, and identify the symptoms of biotic stresses at early stages, including during the incubation period, when the symptoms are not visible to the human eye. This review describes the basic principles of hyperspectral measurements and different types of available hyperspectral sensors. Possible applications of hyperspectral sensors and platforms on different scales for diseases diagnosis are discussed and evaluated. Hyperspectral analysis is a new subject that combines optical spectroscopy and image analysis methods, which make it possible to simultaneously evaluate both physiological and morphological parameters. The review describes the main steps of the hyperspectral data analysis process: image acquisition and preprocessing; data extraction and processing; modeling and analysis of data. The algorithms and methods applied at each step are mainly summarized. Further, the main areas of application of hyperspectral sensors in the diagnosis of plant diseases are considered, such as detection, differentiation and identif ication of diseases, estimation of disease severity, phenotyping of disease resistance of genotypes. A comprehensive review of scientif ic publications on the diagnosis of plant diseases highlights the benef its of hyperspectral technologies in investigating interactions between plants and pathogens at various measurement scales. Despite the encouraging progress made over the past few decades in monitoring plant diseases based on hyperspectral technologies, some technical problems that make these methods diff icult to apply in practice remain unresolved. The review is concluded with an overview of problems and prospects of using new technologies in agricultural production

Detection, identification, and quantification of fungal diseases of sugar beet leaves using imaging and non-imaging hyperspectral techniques

Plant diseases influence the optical properties of plants in different ways. Depending on the host pathogen system and disease specific symptoms, different regions of the reflectance spectrum are affected, resulting in specific spectral signatures of diseased plants. The aim of this study was to examine the potential of hyperspectral imaging and non-imaging sensor systems for the detection, differentiation, and quantification of plant diseases. Reflectance spectra of sugar beet leaves infected with the fungal pathogens Cercospora beticola, Erysiphe betae, and Uromyces betae causing Cercospora leaf spot, powdery mildew, and sugar beet rust, respectively, were recorded repeatedly during pathogenesis. Hyperspectral data were analyzed using various methods of data and image analysis and were compared to ground truth data. Several approaches with different sensors on the measuring scales leaf, canopy, and field have been tested and compared. Much attention was paid on the effect of spectral, spatial, and temporal resolution of hyperspectral sensors on disease recording. Another focus of this study was the description of spectral characteristics of disease specific symptoms. Therefore, different data analysis methods have been applied to gain a maximum of information from spectral signatures. Spectral reflectance of sugar beet was affected by each disease in a characteristic way, resulting in disease specific signatures. Reflectance differences, sensitivity, and best correlating spectral bands differed depending on the disease and the developmental stage of the diseases. Compared to non-imaging sensors, the hyperspectral imaging sensor gave extra information related to spatial resolution. The preciseness in detecting pixel-wise spatial and temporal differences was on a high level. Besides characterization of diseased leaves also the assessment of pure disease endmembers as well as of different regions of typical symptoms was realized. Spectral vegetation indices (SVIs) related to physiological parameters were calculated and correlated to the severity of diseases. The SVIs differed in their sensitivity to the different diseases. Combining the information from multiple SVIs in an automatic classification method with Support Vector Machines, high sensitivity and specificity for the detection and differentiation of diseased leaves was reached in an early stage. In addition to the detection and identification, the quantification of diseases was possible with high accuracy by SVIs and Spectral Angle Mapper classification, calculated from hyperspectral images. Knowledge from measurements under controlled condition was carried over to the field scale. Early detection and monitoring of Cercospora leaf spot and powdery mildew was facilitated. The results of this study contribute to a better understanding of plant optical properties during disease development. Methods will further be applicable in precision crop protection, to realize the detection, differentiation, and quantification of plant diseases in early stages.Nachweis, Identifizierung und Quantifizierung pilzlicher Blattkrankheiten der Zuckerrübe mit abbildenden und nicht-abbildenden hyperspektralen Sensoren Pflanzenkrankheiten wirken sich auf die optischen Eigenschaften von Pflanzen in unterschiedlicher Weise aus. Verschiedene Bereiche des Reflektionsspektrums werden in Abhängigkeit von Wirt-Pathogen System und krankheitsspezifischen Symptomen beeinflusst. Hyperspektrale, nicht-invasive Sensoren bieten die Möglichkeit, optische Veränderungen zu einem frühen Zeitpunkt der Krankheitsentwicklung zu detektieren. Ziel dieser Arbeit war es, das Potential hyperspektraler abbildender und nicht abbildender Sensoren für die Erkennung, Identifizierung und Quantifizierung von Pflanzenkrankheiten zu beurteilen. Zuckerrübenblätter wurden mit den pilzlichen Erregern Cercospora beticola, Erysiphe betae bzw. Uromyces betae inokuliert und die Auswirkungen der Entwicklung von Cercospora Blattflecken, Echtem Mehltau bzw. Rübenrost auf die Reflektionseigenschaften erfasst und mit optischen Bonituren verglichen. Auf den Skalenebenen Blatt, Bestand und Feld wurden Messansätze mit unterschiedlichen Sensoren verglichen. Besonders berücksichtigt wurden hierbei Anforderungen an die spektrale, räumliche und zeitliche Auflösung der Sensoren. Ein weiterer Schwerpunkt lag auf der Beschreibung der spektralen Eigenschaften von charakteristischen Symptomen. Verschiedene Auswerteverfahren wurden mit dem Ziel angewendet, einen maximalen Informationsgehalt aus spektralen Signaturen zu gewinnen. Jede Krankheit beeinflusste die spektrale Reflektion von Zuckerrübenblättern auf charakteristische Weise. Differenz der Reflektion, Sensitivität sowie Korrelation der spektralen Bänder zur Befallsstärke variierten in Abhängigkeit von den Krankheiten. Eine höhere Präzision durch die pixelweise Erfassung räumlicher und zeitlicher Unterschiede von befallenem und gesundem Gewebe konnte durch abbildende Sensoren erreicht werden. Spektrale Vegetationsindizes (SVIs), mit Bezug zu pflanzenphysiologischen Parametern wurden aus den Hyperspektraldaten errechnet und mit der Befallsstärke korreliert. Die SVIs unterschieden sich in ihrer Sensitivität gegenüber den drei Krankheiten. Durch den Einsatz von maschinellem Lernen wurde die kombinierte Information der errechneten Vegetationsindizes für eine automatische Klassifizierung genutzt. Eine hohe Sensitivität sowie eine hohe Spezifität bezüglich der Erkennung und Differenzierung von Krankheiten wurden erreicht. Eine Quantifizierung der Krankheiten war neben der Detektion und Identifizierung mittels SVIs bzw. Klassifizierung mit Spektral Angle Mapper an hyperspektralen Bilddaten möglich. Die Ergebnisse dieser Arbeit tragen zu einem besseren Verständnis der optischen Eigenschaften von Pflanzen unter Pathogeneinfluss bei. Die untersuchten Methoden bieten die Möglichkeit in Anwendungen des Präzisionspflanzenschutzes implementiert zu werden, um eine frühzeitige Erkennung, Differenzierung und Quantifizierung von Pflanzenkrankheiten zu ermöglichen

Crop Disease Detection Using Remote Sensing Image Analysis

Pest and crop disease threats are often estimated by complex changes in crops and the applied agricultural practices that result mainly from the increasing food demand and climate change at global level. In an attempt to explore high-end and sustainable solutions for both pest and crop disease management, remote sensing technologies have been employed, taking advantages of possible changes deriving from relative alterations in the metabolic activity of infected crops which in turn are highly associated to crop spectral reflectance properties. Recent developments applied to high resolution data acquired with remote sensing tools, offer an additional tool which is the opportunity of mapping the infected field areas in the form of patchy land areas or those areas that are susceptible to diseases. This makes easier the discrimination between healthy and diseased crops, providing an additional tool to crop monitoring. The current book brings together recent research work comprising of innovative applications that involve novel remote sensing approaches and their applications oriented to crop disease detection. The book provides an in-depth view of the developments in remote sensing and explores its potential to assess health status in crops

Multi-sensor and data fusion approach for determining yield limiting factors and for in-situ measurement of yellow rust and fusarium head blight in cereals

The world’s population is increasing and along with it, the demand for food. A novel parametric model (Volterra Non-linear Regressive with eXogenous inputs (VNRX)) is introduced for quantifying influences of individual and multiple soil properties on crop yield and normalised difference vegetation Index. The performance was compared to a random forest method over two consecutive years, with the best results of 55.6% and 52%, respectively. The VNRX was then implemented using high sampling resolution soil data collected with an on-line visible and near infrared (vis-NIR) spectroscopy sensor predicting yield variation of 23.21%. A hyperspectral imager coupled with partial least squares regression was successfully applied in the detection of fusarium head blight and yellow rust infection in winter wheat and barley canopies, under laboratory and on-line measurement conditions. Maps of the two diseases were developed for four fields. Spectral indices of the standard deviation between 500 to 650 nm, and the squared difference between 650 and 700 nm, were found to be useful in differentiating between the two diseases, in the two crops, under variable water stress. The optimisation of the hyperspectral imager for field measurement was based on signal-to-noise ratio, and considered; camera angle and distance, integration time, and light source angle and distance from the crop canopy. The study summarises in the proposal of a new method of disease management through suggested selective harvest and fungicide applications, for winter wheat and barley which theoretically reduced fungicide rate by an average of 24% and offers a combined saving of the two methods of £83 per hectare

Early Detection of Wild Rocket Tracheofusariosis Using Hyperspectral Image-Based Machine Learning

Fusarium oxysporum f. sp. raphani is responsible for wilting wild rocket (Diplotaxis tenuifolia L. [D.C.]). A machine learning model based on hyperspectral data was constructed to monitor disease progression. Thus, pathogenesis after artificial inoculation was monitored over a 15-day period by symptom assessment, qPCR pathogen quantification, and hyperspectral imaging. The host colonization by a pathogen evolved accordingly with symptoms as confirmed by qPCR. Spectral data showed differences as early as 5-day post infection and 12 hypespectral vegetation indices were selected to follow disease development. The hyperspectral dataset was used to feed the XGBoost machine learning algorithm with the aim of developing a model that discriminates between healthy and infected plants during the time. The multiple cross-prediction strategy of the pixel-level models was able to detect hyperspectral disease profiles with an average accuracy of 0.8. For healthy pixel detection, the mean Precision value was 0.78, the Recall was 0.88, and the F1 Score was 0.82. For infected pixel detection, the average evaluation metrics were Precision: 0.73, Recall: 0.57, and F1 Score: 0.63. Machine learning paves the way for automatic early detection of infected plants, even a few days after infection

Alkynyl N-BODIPYs as Reactive Intermediates for the Development of Dyes for Biophotonics

A new approach for the rapid multi-functionalization of BODIPY dyes towards biophotonics is reported. It is based on novel N-BODIPYs, through reactive intermediates with alkynyl groups to be further derivatized by click chemistry. This approach has been exemplified by the development of new dyes for cell bio-imaging, which have proven to successfully internalize into pancreatic cancer cells and accumulate in the mitochondria. The in vitro suitability for photodynamic therapy (PDT) was also analyzed and confirmed our compounds to be promising PDT candidates for the treatment of pancreatic cancer

CONTRIBUTIONS ON ADVANCED AUTOMATION FOR SELECTIVE PROTECTION TREATMENTS ON SPECIALTY CROPS

Food security and food safety are the main global objectives of today\u2019s agriculture. Within this framework, the recent growing sensibility of both policy makers and consumers for food safety themes appear to be a hopeful sign for the introduction of new strategies and technological systems in the next future\u2019s agriculture. A particularly challenging issue for current crops management is the control of plant\u2019s diseases while avoiding environmental pollution. Precision pest management techniques \u2013an emerging subset of precision agriculture suite- aim at facing this challenge by means of: i) sensing technologies for the early detection and localization of diseased areas in the canopy, and ii) variable rate technologies for the selective application of crop protection treatments on target areas. In this dissertation, two innovative methodologies for hyperspectral crop\u2019s disease detection are presented. The measurements were acquired by means of a hyperspectral camera mounted onto a robotic manipulator which allowed to compose the subsequent hyperspectral scans (1 spatial dimension x 1 spectral dimension) into an hypercube (2D spatial x 1D spectral) of the imaged plant. The first disease detection method is based on the combinatorial selection of the most significant wavelengths from the hypercube data by applying linear discriminant analysis, and the classification power of the optimal selected combination is then evaluated by applying a principal component analysis. The second method is based on a new spatial filter approach, acting along the different channels of the hypercube. The two methods of detection are applied by discussing two case studies of diseases, both on cucumber plants. A first set of experiments was conducted on plants artificially inoculated with powdery mildew. A second and more extensive set of experiments was conducted on plants infected by the cucumber green mottle mosaic virus (CGMMV), which is nowadays considered one of the most dangerous diseases for the Cucurbitaceae family. The application of the two methodologies was successful in identifying the major symptoms of the diseases considered, and specifically the spatial filtering approach enable to detect the subtle morphological modifications in the plant tissue at rather early stage of CGMMV infection. Due to the high cost and complexity of the technologies adopted in the disease detection and of precision spraying equipment, the second part of the thesis applies the classical methods of mechanization cost-analysis to investigate what are the economic thresholds, which may enable the introduction of new precision pest management technologies. To this aim, the analysis is focused on vineyard and apple orchard that represent a favourable case for introducing these kind of innovations, due to the high protection treatments costs typical for these specialty crops. Starting from the results obtained in research on precision spraying in speciality crops, the technical-economic analysis considers on three different technological levels of precision spraying equipment, associated with increasing levels of reduction of the distributed amount of pesticide. This reduction is assumed to be linked to the improved accuracy in targeting the application without affecting the biological efficiency of the treatment, and hence generating a net cost benefit for the farmer. To gain insights into evaluating this benefit is of primary interest, since the profitability of precision spraying technologies will be a major driver for their adoption in speciality crops. Therefore, this study aims at: a) assessing the total costs associated to spraying equipment at the different technological levels considered; b) evaluating weather more advanced equipment can be profitable compared to current conventional sprayers. Furthermore, this analysis was extended to a high-precision, robotic spraying platform, here considered as a perspective scenario for precision spraying technologies. For this specific case, the study aimed at assessing the maximum allowed cost for such a robotic platform, which could generate positive net benefits for the farmer thanks to the envisaged pesticide reduction

Three dimensional estimation of vegetation moisture content using dual-wavelength terrestrial laser scanning

PhD ThesisLeaf Equivalent Water Thickness (EWT) is a water status metric widely used in vegetation health monitoring. Optical Remote Sensing (RS) data, spaceborne and airborne, can be used to estimate canopy EWT at landscape level, but cannot provide information about EWT vertical heterogeneity, or estimate EWT predawn. Dual-wavelength Terrestrial Laser Scanning (TLS) can overcome these limitations, as TLS intensity data, following radiometric corrections, can be used to estimate EWT in three dimensions (3D). In this study, a Normalized Difference Index (NDI) of 808 nm wavelength, utilized in the Leica P20 TLS instrument, and 1550 nm wavelength, employed in the Leica P40 and P50 TLS systems, was used to produce 3D EWT estimates at canopy level. Intensity correction models were developed, and NDI was found to be able to minimize the incidence angle and leaf internal structure effects. Multiple data collection campaigns were carried out. An indoors dry-down experiment revealed a strong correlation between NDI and EWT at leaf level. At canopy level, 3D EWT estimates were generated with a relative error of 3 %. The method was transferred to a mixed-species broadleaf forest plot and 3D EWT estimates were generated with relative errors < 7 % across four different species. Next, EWT was estimated in six short-rotation willow plots during leaf senescence with relative errors < 8 %. Furthermore, a broadleaf mixed-species urban tree plot was scanned during and two months after a heatwave, and EWT temporal changes were successfully detected. Relative error in EWT estimates was 6 % across four tree species. The last step in this research was to study the effects of EWT vertical heterogeneity on forest plot reflectance. Two virtual forest plots were reconstructed in the Discrete Anisotropic Radiative Transfer (DART) model. 3D EWT estimates from TLS were utilized in the model and Sentinel-2A bands were simulated. The simulations revealed that the top four to five metres of canopy dominated the plot reflectance. The satellite sensor was not able to detect severe water stress that started in the lower canopy layers. This study showed the potential of using dual-wavelength TLS to provide important insights into the EWT distribution within the canopy, by mapping the EWT at canopy level in 3D. EWT was found to vary vertically within the canopy, with EWT and Leaf Mass per Area (LMA) being highly correlated, suggesting that sun leaves were able to hold more moisture than shade leaves. The EWT vertical profiles varied between species, and trees reacted in different ways during drought conditions, losing moisture from different canopy layers. The proposed method can provide time series of the change in EWT at very high spatial and temporal resolutions, as TLS instruments are active sensors, independent of the solar illumination. It also has the potential to provide EWT estimates at the landscape level, if coupled with automatic tree ii segmentation and leaf-wood separation techniques, and thus filling the gaps in the time series produced from satellite data. In addition, the technique can potentially allow the characterisation of whole-tree leaf water status and total water content, by combining the EWT estimates with Leaf Area Index (LAI) measurements, providing new insights into forest health and tree physiology.Egyptian Ministry of Higher Educatio