BRUISE DETECTION IN APPLES USING 3D INFRARED IMAGING AND MACHINE LEARNING TECHNOLOGIES

Bruise detection plays an important role in fruit grading. A bruise detection system capable of finding and removing damaged products on the production lines will distinctly improve the quality of fruits for sale, and consequently improve the fruit economy. This dissertation presents a novel automatic detection system based on surface information obtained from 3D near-infrared imaging technique for bruised apple identification. The proposed 3D bruise detection system is expected to provide better performance in bruise detection than the existing 2D systems. We first propose a mesh denoising filter to reduce noise effect while preserving the geometric features of the meshes. Compared with several existing mesh denoising filters, the proposed filter achieves better performance in reducing noise effect as well as preserving bruised regions in 3D meshes of bruised apples. Next, we investigate two different machine learning techniques for the identification of bruised apples. The first technique is to extract hand-crafted feature from 3D meshes, and train a predictive classifier based on hand-crafted features. It is shown that the predictive model trained on the proposed hand-crafted features outperforms the same models trained on several other local shape descriptors. The second technique is to apply deep learning to learn the feature representation automatically from the mesh data, and then use the deep learning model or a new predictive model for the classification. The optimized deep learning model achieves very high classification accuracy, and it outperforms the performance of the detection system based on the proposed hand-crafted features. At last, we investigate GPU techniques for accelerating the proposed apple bruise detection system. Specifically, the dissertation proposes a GPU framework, implemented in CUDA, for the acceleration of the algorithm that extracts vertex-based local binary patterns. Experimental results show that the proposed GPU program speeds up the process of extracting local binary patterns by 5 times compared to a single-core CPU program

Nondestructive Detection of Codling Moth Infestation in Apples Using Pixel-Based NIR Hyperspectral Imaging with Machine Learning and Feature Selection

Codling moth (CM) (Cydia pomonella L.), a devastating pest, creates a serious issue for apple production and marketing in apple-producing countries. Therefore, effective nondestructive early detection of external and internal defects in CM-infested apples could remarkably prevent postharvest losses and improve the quality of the final product. In this study, near-infrared (NIR) hyperspectral reflectance imaging in the wavelength range of 900–1700 nm was applied to detect CM infestation at the pixel level for three organic apple cultivars, namely Gala, Fuji and Granny Smith. An effective region of interest (ROI) acquisition procedure along with different machine learning and data processing methods were used to build robust and high accuracy classification models. Optimal wavelength selection was implemented using sequential stepwise selection methods to build multispectral imaging models for fast and effective classification purposes. The results showed that the infested and healthy samples were classified at pixel level with up to 97.4% total accuracy for validation dataset using a gradient tree boosting (GTB) ensemble classifier, among others. The feature selection algorithm obtained a maximum accuracy of 91.6% with only 22 selected wavelengths. These findings indicate the high potential of NIR hyperspectral imaging (HSI) in detecting and classifying latent CM infestation in apples of different cultivars

Evaluation of Deep Learning based Pose Estimation for Sign Language Recognition

Human body pose estimation and hand detection are two important tasks for systems that perform computer vision-based sign language recognition(SLR). However, both tasks are challenging, especially when the input is color videos, with no depth information. Many algorithms have been proposed in the literature for these tasks, and some of the most successful recent algorithms are based on deep learning. In this paper, we introduce a dataset for human pose estimation for SLR domain. We evaluate the performance of two deep learning based pose estimation methods, by performing user-independent experiments on our dataset. We also perform transfer learning, and we obtain results that demonstrate that transfer learning can improve pose estimation accuracy. The dataset and results from these methods can create a useful baseline for future works

Early detection of slight bruises in apples by cost-efficient near-infrared imaging

Near-infrared (NIR) spectroscopy has been widely reported for its useful applications in assessing internal fruit qualities. Motivated by apple consumption in the global market, this study aims to evaluate the possibility of applying NIR imaging to detect slight bruises in apple fruits. A simple optical setup was designed, and low-cost system components were used to promote the future development of practical and cost-efficient devices. To evaluate the effectiveness of the proposed approach, slight bruises were created by a mild impact with a comparably low impact energy of only 0.081 Joules. Experimental results showed that 100% of bruises in Jazz and Gala apples were accurately detected immediately after bruising and within 3 hours of storage. Thus, it is promising to develop customer devices to detect slight bruises for not only apple fruits but also other fruits with soft and thin skin at their early damage stages

Hyperspectral Imaging and Their Applications in the Nondestructive Quality Assessment of Fruits and Vegetables

Over the past decade, hyperspectral imaging has been rapidly developing and widely used as an emerging scientific tool in nondestructive fruit and vegetable quality assessment. Hyperspectral imaging technique integrates both the imaging and spectroscopic techniques into one system, and it can acquire a set of monochromatic images at almost continuous hundreds of thousands of wavelengths. Many researches based on spatial image and/or spectral image processing and analysis have been published proposing the use of hyperspectral imaging technique in the field of quality assessment of fruits and vegetables. This chapter presents a detailed overview of the introduction, latest developments and applications of hyperspectral imaging in the nondestructive assessment of fruits and vegetables. Additionally, the principal components, basic theories, and corresponding processing and analytical methods are also reported in this chapter

Emerging thermal imaging techniques for seed quality evaluation: Principles and applications

Due to the massive progress occurred in the past few decades in imaging, electronics and computer science, infrared thermal imaging technique has witnessed numerous technological advancement and smart applications in non-destructive testing and quality monitoring of different agro-food produces. Thermal imaging offers a potential non-contact imaging modality for the determination of various quality traits based on the infrared radiation emitted from target foods. The technique has been moved from just an exploration method in engineering and astronomy into an effective tool in many fields for forming unambiguous images called thermograms eventuated from the temperature and thermal properties of the target objects. It depends principally on converting the invisible infrared radiation emitted by the objects into visible two-dimensional temperature data without making a direct contact with the examined objects. This method has been widely used for different applications in agriculture and food science and technology with special applications in seed quality assessment. This article provides an overview of thermal imaging theory, briefly describes the fundamentals of the system and explores the recent advances and research works conducted in quality evaluation of different sorts of seeds. The article comprehensively reviewed research efforts of using thermal imaging systems in seed applications including estimation of seed viability, detection of fungal growth and insect infections, detection of seed damage and impurities, seed classification and variety identification.info:eu-repo/semantics/acceptedVersio