Designing a fruit identification algorithm in orchard conditions to develop robots using video processing and majority voting based on hybrid artificial neural network

The first step in identifying fruits on trees is to develop garden robots for different purposes such as fruit harvesting and spatial specific spraying. Due to the natural conditions of the fruit orchards and the unevenness of the various objects throughout it, usage of the controlled conditions is very difficult. As a result, these operations should be performed in natural conditions, both in light and in the background. Due to the dependency of other garden robot operations on the fruit identification stage, this step must be performed precisely. Therefore, the purpose of this paper was to design an identification algorithm in orchard conditions using a combination of video processing and majority voting based on different hybrid artificial neural networks. The different steps of designing this algorithm were: (1) Recording video of different plum orchards at different light intensities; (2) converting the videos produced into its frames; (3) extracting different color properties from pixels; (4) selecting effective properties from color extraction properties using hybrid artificial neural network-harmony search (ANN-HS); and (5) classification using majority voting based on three classifiers of artificial neural network-bees algorithm (ANN-BA), artificial neural network-biogeography-based optimization (ANN-BBO), and artificial neural network-firefly algorithm (ANN-FA). Most effective features selected by the hybrid ANN-HS consisted of the third channel in hue saturation lightness (HSL) color space, the second channel in lightness chroma hue (LCH) color space, the first channel in L*a*b* color space, and the first channel in hue saturation intensity (HSI). The results showed that the accuracy of the majority voting method in the best execution and in 500 executions was 98.01% and 97.20%, respectively. Based on different performance evaluation criteria of the classifiers, it was found that the majority voting method had a higher performance.European Union (EU) under Erasmus+ project entitled “Fostering Internationalization in Agricultural Engineering in Iran and Russia” [FARmER] with grant number 585596-EPP-1-2017-1-DE-EPPKA2-CBHE-JPinfo:eu-repo/semantics/publishedVersio

Nondestructive estimation of three apple fruit properties at various ripening levels with optimal Vis-NIR spectral wavelength regression data

Producción CientíficaNondestructive estimation of fruit properties during their ripening stages ensures the best value for producers and vendors. Among common quality measurement methods, spectroscopy is popular and enables physicochemical properties to be nondestructively estimated. The current study aims to nondestructively predict tissue firmness (kgf/cm), acidity (pH level) and starch content index (%) in apples (Malus M. pumila) samples (Fuji var.) at various ripening stages using visible/near infrared (Vis-NIR) spectral data in 400–1000 nm wavelength range. Results show that non-linear regression done by an artificial neural network-cultural algorithm (ANN-CA) was able to properly estimate the investigated fruit properties. Moreover, the performance of the proposed method was evaluated for Vis-NIR data based on optimal NIR wavelength values selected by a genetic optimization tool.Agencia Estatal de Investigación - Fondo Europeo de Desarrollo Regional (project RTI2018-098958-B-I00

A computer vision system for the automatic classification of five varieties of tree leaf images

Producción CientíficaA computer vision system for automatic recognition and classification of five varieties of plant leaves under controlled laboratory imaging conditions, comprising: 1–Cydonia oblonga (quince), 2–Eucalyptus camaldulensis dehn (river red gum), 3–Malus pumila (apple), 4–Pistacia atlantica (mt. Atlas mastic tree) and 5–Prunus armeniaca (apricot), is proposed. 516 tree leaves images were taken and 285 features computed from each object including shape features, color features, texture features based on the gray level co-occurrence matrix, texture descriptors based on histogram and moment invariants. Seven discriminant features were selected and input for classification purposes using three classifiers: hybrid artificial neural network–ant bee colony (ANN–ABC), hybrid artificial neural network–biogeography based optimization (ANN–BBO) and Fisher linear discriminant analysis (LDA). Mean correct classification rates (CCR), resulted in 94.04%, 89.23%, and 93.99%, for hybrid ANN–ABC; hybrid ANN–BBO; and LDA classifiers, respectively. Best classifier mean area under curve (AUC), mean sensitivity, and mean specificity, were computed for the five tree varieties under study, resulting in: 1–Cydonia oblonga (quince) 0.991 (ANN–ABC), 95.89% (ANN–ABC), 95.91% (ANN–ABC); 2–Eucalyptus camaldulensis dehn (river red gum) 1.00 (LDA), 100% (LDA), 100% (LDA); 3–Malus pumila (apple) 0.996 (LDA), 96.63% (LDA), 94.99% (LDA); 4–Pistacia atlantica (mt. Atlas mastic tree) 0.979 (LDA), 91.71% (LDA), 82.57% (LDA); and 5–Prunus armeniaca (apricot) 0.994 (LDA), 88.67% (LDA), 94.65% (LDA), respectively.Unión Europea (project 585596-EPP-1-2017-1-DE-EPPKA2-CBHE-JP

An automatic visible-range video weed detection, segmentation and classification prototype in potato field

Weeds might be defined as destructive plants that grow and compete with agricultural crops in order to achieve water and nutrients. Uniform spray of herbicides is nowadays a common cause in crops poisoning, environment pollution and high cost of herbicide consumption. Site-specific spraying is a possible solution for the problems that occur with uniform spray in fields. For this reason, a machine vision prototype is proposed in this study based on video processing and meta-heuristic classifiers for online identification and classification of Marfona potato plant (Solanum tuberosum) and 4299 samples from five weed plant varieties: Malva neglecta (mallow), Portulaca oleracea (purslane), Chenopodium album L (lamb's quarters), Secale cereale L (rye) and Xanthium strumarium (coklebur). In order to properly train the machine vision system, various videos taken from two Marfona potato fields within a surface of six hectares are used. After extraction of texture features based on the gray level co-occurrence matrix (GLCM), color features, spectral descriptors of texture, moment invariants and shape features, six effective discriminant features were selected: the standard deviation of saturation (S) component in HSV color space, difference of first and seventh moment invariants, mean value of hue component (H) in HSI color space, area to length ratio, average blue-difference chrominance (Cb) component in YCbCr color space and standard deviation of in-phase (I) component in YIQ color space. Classification results show a high accuracy of 98% correct classification rate (CCR) over the test set, being able to properly identify potato plant from previously mentioned five different weed varieties. Finally, the machine vision prototype was tested in field under real conditions and was able to properly detect, segment and classify weed from potato plant at a speed of up to 0.15 m/s.This work was supported in part by MINECO under grant number RTI2018-098958-B-I00, Spain, and by the European Union (EU) under Erasmus+ project entitled Fostering Internationalization in Agricultural Engineering in Iran and Russia [FARmER] with grant number 585596-EPP-1-2017-DE-EPPKA2-CBHE-JP

Determination of the most effective wavelengths for prediction of Fuji Apple starch and total soluble solids properties

Proper physical properties and standard chemical properties are among the criteria that consumers use to select fruits. Recently, researchers attempted to develop non-destructive methods for measuring properties, among which the near-infrared (NIR) spectroscopy is of great use. Fuji apples were collected in three di erent growth stages, and then starch and soluble solids were extracted. Spectral data in the range of 800 to 900 nm were used to predict the amount of starch content and 920 to 980 nm to estimate total soluble solids (TSS). Reflectance spectra were pre-processed and the most e ective wavelengths of each property were selected using hybrid artificial neural network-simulated annealing (ANN-SA). Non-destructive estimation of physicochemical properties was conducted using spectral data of the most e ective wavelengths using a hybrid artificial neural network-biogeography-based optimization algorithm (ANN-BBO). The results indicated that the regression coe cient of the best state of training for predicting starch was 0.97 and of TSS was 0.96, while R2 was 0.92 for both. The most e ective wavelengths were 852.58, 855.54, 849.03, 855.83, 853.47, 844.90 nm for starch and 967.86, 966.67, 964.90, 958.40, 957.22, 963.97 nm for TSS.FEDER ALG-01-0247-FEDER-037303; AGNETICS funded the APCinfo:eu-repo/semantics/publishedVersio

Exploring the best model for sorting Blood orange using ANFIS method

OranOrange has abundant nutritional properties and is consumed worldwide.  Sorting oranges of different masses based on their physical traits could help reduce packaging and transportation cost.  The ‘Blood’ cultivar of Iranian oranges from Kermanshah province of Iran (7.03 °E 4.22 °N) was used in this study.  100 samples were randomly selected.  During the two-day experiment, all measurements were carried out inside the laboratory at mean temperature of 24°C.  In this study, some physical properties of ‘Blood’ orange were measured, such as length, width, thickness, volume, mass, mean value of geometric diameter, sphericity and projected area.  ANFIS and linear regression models were employed to predict the mass based on sphericity and mean of projected area inputs.  In ANFIS model, samples were divided into two sets, with 70% for training set and 30% for testing set.  The coefficient of determination (R2) for ANFIS and linear regression models were 0.983 and 0.927, respectively.  It is shown that the mass can be estimated based on ANFIS model better than linear regression model.   Keywords: linear regression, orange, packaging, physical properties, sorting

A combined method of image processing and artificial neural network for the identification of 13 Iranian rice cultivars

Due to the importance of identifying crop cultivars, the advancement of accurate assessment of cultivars is considered essential. The existing methods for identifying rice cultivars are mainly time-consuming, costly, and destructive. Therefore, the development of novel methods is highly beneficial. The aim of the present research is to classify common rice cultivars in Iran based on color, morphologic, and texture properties using artificial intelligence (AI) methods. In doing so, digital images of 13 rice cultivars in Iran in three forms of paddy, brown, and white are analyzed through pre-processing and segmentation of using MATLAB. Ninety-two specificities, including 60 color, 14 morphologic, and 18 texture properties, were identified for each rice cultivar. In the next step, the normal distribution of data was evaluated, and the possibility of observing a significant difference between all specificities of cultivars was studied using variance analysis. In addition, the least significant difference (LSD) test was performed to obtain a more accurate comparison between cultivars. To reduce data dimensions and focus on the most effective components, principal component analysis (PCA) was employed. Accordingly, the accuracy of rice cultivar separations was calculated for paddy, brown rice, and white rice using discriminant analysis (DA), which was 89.2%, 87.7%, and 83.1%, respectively. To identify and classify the desired cultivars, a multilayered perceptron neural network was implemented based on the most effective components. The results showed 100% accuracy of the network in identifying and classifying all mentioned rice cultivars. Hence, it is concluded that the integrated method of image processing and pattern recognition methods, such as statistical classification and artificial neural networks, can be used for identifying and classification of rice cultivars

A computer vision system based on majority-voting ensemble neural network for the automatic classification of three chickpea varieties

Producción CientíficaSince different varieties of crops have specific applications, it is therefore important to properly identify each cultivar, in order to avoid fake varieties being sold as genuine, i.e., fraud. Despite that properly trained human experts might accurately identify and classify crop varieties, computer vision systems are needed since conditions such as fatigue, reproducibility, and so on, can influence the expert’s judgment and assessment. Chickpea (Cicer arietinum L.) is an important legume at the world-level and has several varieties. Three chickpea varieties with a rather similar visual appearance were studied here: Adel, Arman, and Azad chickpeas. The purpose of this paper is to present a computer vision system for the automatic classification of those chickpea varieties. First, segmentation was performed using an Hue Saturation Intensity (HSI) color space threshold. Next, color and textural (from the gray level co-occurrence matrix, GLCM) properties (features) were extracted from the chickpea sample images. Then, using the hybrid artificial neural network-cultural algorithm (ANN-CA), the sub-optimal combination of the five most effective properties (mean of the RGB color space components, mean of the HSI color space components, entropy of GLCM matrix at 90°, standard deviation of GLCM matrix at 0°, and mean third component in YCbCr color space) were selected as discriminant features. Finally, an ANN-PSO/ACO/HS majority voting (MV) ensemble methodology merging three different classifier outputs, namely the hybrid artificial neural network-particle swarm optimization (ANN-PSO), hybrid artificial neural network-ant colony optimization (ANN-ACO), and hybrid artificial neural network-harmonic search (ANN-HS), was used. Results showed that the ensemble ANN-PSO/ACO/HS-MV classifier approach reached an average classification accuracy of 99.10 ± 0.75% over the test set, after averaging 1000 random iterations.Unión Europea (project 585596-EPP-1-2017-1-DE-EPPKA2-CBHE-JP

Identification of internal defects in potato using spectroscopy and computational intelligence based on majority voting techniques

Producción CientíficaPotatoes are one of the most demanded products due to their richness in nutrients. However, the lack of attention to external and, especially, internal defects greatly reduces its marketability and makes it prone to a variety of diseases. The present study aims to identify healthy-looking potatoes but with internal defects. A visible (Vis), near-infrared (NIR), and short-wavelength infrared (SWIR) spectrometer was used to capture spectral data from the samples. Using a hybrid of artificial neural networks (ANN) and the cultural algorithm (CA), the wavelengths of 861, 883, and 998 nm in Vis/NIR region, and 1539, 1858, and 1896 nm in the SWIR region were selected as optimal. Then, the samples were classified into either healthy or defective class using an ensemble method consisting of four classifiers, namely hybrid ANN and imperialist competitive algorithm (ANN-ICA), hybrid ANN and harmony search algorithm (ANN-HS), linear discriminant analysis (LDA), and k-nearest neighbors (KNN), combined with the majority voting (MV) rule. The performance of the classifier was assessed using only the selected wavelengths and using all the spectral data. The total correct classification rates using all the spectral data were 96.3% and 86.1% in SWIR and Vis/NIR ranges, respectively, and using the optimal wavelengths 94.1% and 83.4% in SWIR and Vis/NIR, respectively. The statistical tests revealed that there are no significant differences between these datasets. Interestingly, the best results were obtained using only LDA, achieving 97.7% accuracy for the selected wavelengths in the SWIR spectral range.Ministerio de Ciencia, Innovación y Universidades; Ministerio de Ciencia e Innovación; Agencia Estatal de Investigación y Fondo Europeo de Desarrollo Regional (FEDER) - (grant RTI2018-098156-B-C53

Automatic Classification of Chickpea Varieties Using Computer Vision Techniques

There are about 90 different varieties of chickpeas around the world. In Iran, where this study takes place, there are five species that are the most popular (Adel, Arman, Azad, Bevanij and Hashem), with different properties and prices. However, distinguishing them manually is difficult because they have very similar morphological characteristics. In this research, two different computer vision methods for the classification of the variety of chickpeas are proposed and compared. The images were captured with an industrial camera in Kermanshah, Iran. The first method is based on color and texture features extraction, followed by a selection of the most effective features, and classification with a hybrid of artificial neural networks and particle swarm optimization (ANN-PSO). The second method is not based on an explicit extraction of features; instead, image patches (RGB pixel values) are directly used as input for a three-layered backpropagation ANN. The first method achieved a correct classification rate (CCR) of 97.0%, while the second approach achieved a CCR of 99.3%. These results prove that visual classification of fruit varieties in agriculture can be done in a very precise way using a suitable method. Although both techniques are feasible, the second method is generic and more easily applicable to other types of crops, since it is not based on a set of given features.This research was funded by the Spanish MICINN, as well as European Commission FEDER funds, under grant RTI2018-098156-B-C53. It has also been supported by the European Union (EU) under Erasmus + project entitled "Fostering Internationalization in Agricultural Engineering in Iran and Russia [FARmER]" with grant number 585596-EPP-1-2017-1-DE-EPPKA2-CBHE-JP