A Wireless Sensor Network for Vineyard Monitoring That Uses Image Processing

The first step to detect when a vineyard has any type of deficiency, pest or disease is to observe its stems, its grapes and/or its leaves. To place a sensor in each leaf of every vineyard is obviously not feasible in terms of cost and deployment. We should thus look for new methods to detect these symptoms precisely and economically. In this paper, we present a wireless sensor network where each sensor node takes images from the field and internally uses image processing techniques to detect any unusual status in the leaves. This symptom could be caused by a deficiency, pest, disease or other harmful agent. When it is detected, the sensor node sends a message to a sink node through the wireless sensor network in order to notify the problem to the farmer. The wireless sensor uses the IEEE 802.11 a/b/g/n standard, which allows connections from large distances in open air. This paper describes the wireless sensor network design, the wireless sensor deployment, how the node processes the images in order to monitor the vineyard, and the sensor network traffic obtained from a test bed performed in a flat vineyard in Spain. Although the system is not able to distinguish between deficiency, pest, disease or other harmful agents, a symptoms image database and a neuronal network could be added in order learn from the experience and provide an accurate problem diagnosis

Robust Crop and Weed Segmentation under Uncontrolled Outdoor Illumination

An image processing algorithm for detecting individual weeds was developed and evaluated. Weed detection processes included were normalized excessive green conversion, statistical threshold value estimation, adaptive image segmentation, median filter, morphological feature calculation and Artificial Neural Network (ANN). The developed algorithm was validated for its ability to identify and detect weeds and crop plants under uncontrolled outdoor illuminations. A machine vision implementing field robot captured field images under outdoor illuminations and the image processing algorithm automatically processed them without manual adjustment. The errors of the algorithm, when processing 666 field images, ranged from 2.1 to 2.9%. The ANN correctly detected 72.6% of crop plants from the identified plants, and considered the rest as weeds. However, the ANN identification rates for crop plants were improved up to 95.1% by addressing the error sources in the algorithm. The developed weed detection and image processing algorithm provides a novel method to identify plants against soil background under the uncontrolled outdoor illuminations, and to differentiate weeds from crop plants. Thus, the proposed new machine vision and processing algorithm may be useful for outdoor applications including plant specific direct applications (PSDA)

Automatic segmentation of relevant textures in agricultural images

One important issue emerging strongly in agriculture is related with the automatization of tasks, where the optical sensors play an important role. They provide images that must be conveniently processed. The most relevantimage processing procedures require the identification of green plants, in our experiments they come from barley and corn crops including weeds, so that some types of action can be carried out, including site-specific treatments with chemical products or mechanical manipulations. Also the identification of textures belonging to the soil could be useful to know some variables, such as humidity, smoothness or any others. Finally, from the point of view of the autonomous robot navigation, where the robot is equipped with the imaging system, some times it is convenient to know not only the soil information and the plants growing in the soil but also additional information supplied by global references based on specific areas. This implies that the images to be processed contain textures of three main types to be identified: green plants, soil and sky if any. This paper proposes a new automatic approach for segmenting these main textures and also to refine the identification of sub-textures inside the main ones. Concerning the green identification, we propose a new approach that exploits the performance of existing strategies by combining them. The combination takes into account the relevance of the information provided by each strategy based on the intensity variability. This makes an important contribution. The combination of thresholding approaches, for segmenting the soil and the sky, makes the second contribution; finally the adjusting of the supervised fuzzy clustering approach for identifying sub-textures automatically, makes the third finding. The performance of the method allows to verify its viability for automatic tasks in agriculture based on image processin

Accuracy and Feasibility of Optoelectronic Sensors for Weed Mapping in Wide Row Crops

The main objectives of this study were to assess the accuracy of a ground-based weed mapping system that included optoelectronic sensors for weed detection, and to determine the sampling resolution required for accurate weed maps in maize crops. The optoelectronic sensors were located in the inter-row area of maize to distinguish weeds against soil background. The system was evaluated in three maize fields in the early spring. System verification was performed with highly reliable data from digital images obtained in a regular 12 m × 12 m grid throughout the three fields. The comparison in all these sample points showed a good relationship (83% agreement on average) between the data of weed presence/absence obtained from the optoelectronic mapping system and the values derived from image processing software (“ground truth”). Regarding the optimization of sampling resolution, the comparison between the detailed maps (all crop rows with sensors separated 0.75 m) with maps obtained with various simulated distances between sensors (from 1.5 m to 6.0 m) indicated that a 4.5 m distance (equivalent to one in six crop rows) would be acceptable to construct accurate weed maps. This spatial resolution makes the system cheap and robust enough to generate maps of inter-row weeds

Automatic detection of crop rows in maize fields with high weeds pressure

This paper proposes a new method, oriented to crop row detection in images from maize fields with high weed pressure. The vision system is designed to be installed onboard a mobile agricultural vehicle, i.e. submitted to gyros, vibrations and undesired movements. The images are captured under image perspective, being affected by the above undesired effects. The image processing consists of three main processes: image segmentation, double thresholding, based on the Otsu’s method, and crop row detection. Image segmentation is based on the application of a vegetation index, the double thresholding achieves the separation between weeds and crops and the crop row detection applies least squares linear regression for line adjustment. Crop and weed separation becomes effective and the crop row detection can be favorably compared against the classical approach based on the Hough transform. Both gain effectiveness and accuracy thanks to the double thresholding that makes the main finding of the paper

Digital Image Sensor-Based Assessment of the Status of Oat (Avena sativa L.) Crops after Frost Damage

The aim of this paper is to classify the land covered with oat crops, and the quantification of frost damage on oats, while plants are still in the flowering stage. The images are taken by a digital colour camera CCD-based sensor. Unsupervised classification methods are applied because the plants present different spectral signatures, depending on two main factors: illumination and the affected state. The colour space used in this application is CIELab, based on the decomposition of the colour in three channels, because it is the closest to human colour perception. The histogram of each channel is successively split into regions by thresholding. The best threshold to be applied is automatically obtained as a combination of three thresholding strategies: (a) Otsu’s method, (b) Isodata algorithm, and (c) Fuzzy thresholding. The fusion of these automatic thresholding techniques and the design of the classification strategy are some of the main findings of the paper, which allows an estimation of the damages and a prediction of the oat production

Digital photography provides a fast, reliable, and noninvasive method to estimate anthocyanin pigment concentration in reproductive and vegetative plant tissues

Anthocyanin pigments have become a model trait for evolutionary ecology as they often provide adaptive benefits for plants. Anthocyanins have been traditionally quantified biochemically or more recently using spectral reflectance. However, both methods require destructive sampling and can be labor intensive and challenging with small samples. Recent advances in digital photography and image processing make it the method of choice for measuring color in the wild. Here, we use digital images as a quick, noninvasive method to estimate relative anthocyanin concentrations in species exhibiting color variation. Using a consumer‐level digital camera and a free image processing toolbox, we extracted RGB values from digital images to generate color indices. We tested petals, stems, pedicels, and calyces of six species, which contain different types of anthocyanin pigments and exhibit different pigmentation patterns. Color indices were assessed by their correlation to biochemically determined anthocyanin concentrations. For comparison, we also calculated color indices from spectral reflectance and tested the correlation with anthocyanin concentration. Indices perform differently depending on the nature of the color variation. For both digital images and spectral reflectance, the most accurate estimates of anthocyanin concentration emerge from anthocyanin content‐chroma ratio, anthocyanin content‐chroma basic, and strength of green indices. Color indices derived from both digital images and spectral reflectance strongly correlate with biochemically determined anthocyanin concentration; however, the estimates from digital images performed better than spectral reflectance in terms of r2 and normalized root‐mean‐square error. This was particularly noticeable in a species with striped petals, but in the case of striped calyces, both methods showed a comparable relationship with anthocyanin concentration. Using digital images brings new opportunities to accurately quantify the anthocyanin concentrations in both floral and vegetative tissues. This method is efficient, completely noninvasive, applicable to both uniform and patterned color, and works with samples of any size

Latitudinal gradient of spruce forest understory and tundra phenology in Alaska as observed from satellite and ground-based data

The latitudinal gradient of the start of the growing season (SOS) and the end of the growing season (EOS) were quantified in Alaska (61°N to 71°N) using satellite-based and ground-based datasets. The Alaskan evergreen needleleaf forests are sparse and the understory vegetation has a substantial impact on the satellite signal. We evaluated SOS and EOS of understory and tundra vegetation using time-lapse camera images. From the comparison of three SOS algorithms for determining SOS from two satellite datasets (SPOT-VEGETATION and Terra-MODIS), we found that the satellite-based SOS timing was consistent with the leaf emergence of the forest understory and tundra vegetation. The ensemble average of SOS over all satellite algorithms can be used as a measure of spring leaf emergence for understory and tundra vegetation. In contrast, the relationship between the ground-based and satellite-based EOSs was not as strong as that of SOS both for boreal forest and tundra sites because of the large biases between those two EOSs (19 to 26 days). The satellite-based EOS was more relevant to snowfall events than the senescence of understory or tundra. The plant canopy radiative transfer simulation suggested that 84–86% of the NDVI seasonal amplitude could be a reasonable threshold for the EOS determination. The latitudinal gradients of SOS and EOS evaluated by the satellite and ground data were consistent and the satellite-derived SOS and EOS were 3.5 to 5.7 days degree− 1 and − 2.3 to − 2.7 days degree− 1, which corresponded to the spring (May) temperature sensitivity of − 2.5 to − 3.9 days °C− 1 in SOS and the autumn (August and September) temperature sensitivity of 3.0 to 4.6 days °C− 1 in EOS. This demonstrates the possible impact of phenology in spruce forest understory and tundra ecosystems in response to climate change in the warming Artic and sub-Arctic regions