Recent Advances and Applications of Hyperspectral Imaging for Fruit and Vegetable Quality Assessment

Hyperspectral imaging systems are starting to be used as a scientific tool for food quality assessment. A typical hyperspectral image is composed of a set of a relatively wide range of monochromatic images corresponding to continuous wavelengths that normally contain redundant information or may exhibit a high degree of correlation. In addition, computation of the classifiers used to deal with the data obtained from the images can become excessively complex and time-consuming for such high-dimensional datasets, and this makes it difficult to incorporate such systems into an industry that demands standard protocols or high-speed processes. Therefore, recent works have focused on the development of new systems based on this technology that are capable of analysing quality features that cannot be inspected using visible imaging. Many of those studies have also centred on finding new statistical techniques to reduce the hyperspectral images to multispectral ones, which are easier to implement in automatic, non-destructive systems. This article reviews recent works that use hyperspectral imaging for the inspection of fruit and vegetables. It explains the different technologies available to acquire the images and their use for the non-destructive inspection of the internal and external features of these products. Particular attention is paid to the works aimed at reducing the dimensionality of the images, with details of the statistical techniques most commonly used for this task

Nondestructive measurement of fruit and vegetable quality

We review nondestructive techniques for measuring internal and external quality attributes of fruit and vegetables, such as color, size and shape, flavor, texture, and absence of defects. The different techniques are organized according to their physical measurement principle. We first describe each technique and then list some examples. As many of these techniques rely on mathematical models and particular data processing methods, we discuss these where needed. We pay particular attention to techniques that can be implemented online in grading lines

Hyperspectral Imaging and Their Applications in the Nondestructive Quality Assessment of Fruits and Vegetables

Over the past decade, hyperspectral imaging has been rapidly developing and widely used as an emerging scientific tool in nondestructive fruit and vegetable quality assessment. Hyperspectral imaging technique integrates both the imaging and spectroscopic techniques into one system, and it can acquire a set of monochromatic images at almost continuous hundreds of thousands of wavelengths. Many researches based on spatial image and/or spectral image processing and analysis have been published proposing the use of hyperspectral imaging technique in the field of quality assessment of fruits and vegetables. This chapter presents a detailed overview of the introduction, latest developments and applications of hyperspectral imaging in the nondestructive assessment of fruits and vegetables. Additionally, the principal components, basic theories, and corresponding processing and analytical methods are also reported in this chapter

Low-cost hyperspectral imaging system: Design and testing for laboratory-based environmental applications

The recent surge in the development of low-cost, miniaturised technologies provides a significant opportunity to develop miniaturised hyperspectral imagers at a fraction of the cost of currently available commercial set-ups. This article introduces a low-cost laboratory-based hyperspectral imager developed using commercially available components. The imager is capable of quantitative and qualitative hyperspectral measurements, and it was tested in a variety of laboratory-based environmental applications where it demonstrated its ability to collect data that correlates well with existing datasets. In its current format, the imager is an accurate laboratory measurement tool, with significant potential for ongoing future developments. It represents an initial development in accessible hyperspectral technologies, providing a robust basis for future improvements

Visible and Hyperspectral Imaging Systems for the Detection and Discrimination of Mechanical and Microbiological Damage of Mushrooms

Horticultural products such as mushrooms are exposed to environmental conditions during their postharvest life, which may affect product quality. Loss of whiteness during storage is particularly important in the mushroom industry. Rough handling and distribution, fruiting body senescence and bacterial infections are among the main causes of mushroom discolouration. The aim of this work was to study the use of visible and hyperspectral imaging (HSI) systems for the detection and discrimination of mechanical and microbiological damage of mushrooms. This piece of research involved a) monitoring the browning of mushroom with visible computer imaging systems, b) investigating the effect of mechanical damage on the kinetics of enzymes responsible for mushroom browning, c) exploring the potential use of Vis-NIR HSI to predict PPO activity in mushroom caps and d) studying the potential application of Vis-NIR HSI for microbial and viral detection on mushroom caps and for their discrimination from mechanical damage. Results presented in this thesis show that the efficacy of commercial webcams was limited in the detection of mechanical damage on mushroom caps. Damage increased the activity of PPOs on mushroom pileipellis, but the effect of the extent of damage was not significant at the levels of study. Vis-NIR HSI showed some potential as a tool to estimate the activity of PPO enzymes on mushroom caps. The combination of HSI with chemometric tools allowed for the differentiation of mechanically and microbiologically damaged mushroom classes. Results from this study could be used for developing non-destructive monitoring systems for mechanical and microbiological damage detection and discrimination. The potential application of such systems as on-line process analytical tools would facilitate rapid assessment of mushroom quality.

Innovations in non-destructive techniques for fruit quality control applied to manipulation and inspection lines

Tesis por compendioLa industria alimentaria, concretamente el sector poscosecha, necesita innovar en sus procesos productivos, optimizando los mismos para rentabilizar sus actividades, garantizando productos de calidad capaces de satisfacer las necesidades de los consumidores. La presente tesis doctoral se centra en evaluar el potencial de la espectroscopia VIS-NIR para la caracterización e inspección de la calidad de la fruta tanto fuera de línea como a tiempo real en procesos automatizados. En un primer lugar, la viabilidad de la técnica se estudió a nivel de laboratorio en estado estático (off-line), con el fin de conocer y optimizar las condiciones de medición. Posteriormente, se evaluó la calidad interna y externa de diferentes tipos de frutas como son caqui, nectarina y mango. En una segunda etapa, se llevó a cabo una automatización de los procesos de inspección mediante el desarrollo de nuevos prototipos in-line. Para este propósito, y con el objetivo de completar y corroborar los resultados obtenidos de manera estática, se estudió la integración de dos sondas VIS-NIR en una garra robótica capaz de manipular mangos. Finalmente, se estudió la integración de una sonda VIS-NIR a una cinta transportadora. Los resultados obtenidos a nivel estático han demostrado que la espectroscopia VIS-NIR es un método no destructivo muy prometedor para predecir la astringencia en caqui. Así mismo, ha demostrado ser una adecuada herramienta para clasificar al 100% entre variedades de nectarinas como "Big Top" y "Diamond Ray" con una apariencia externa e interna muy similar, pero con diferentes propiedades organolépticas. De manera similar, fue posible clasificar al 100% variedades como "Big Top" y "Magique" de apariencia externa y composición similar pero distinto color de pulpa., y además se desarrolló un índice de calidad interna (IQI) para evaluar la calidad de las nectarinas. Por lo que respecta a los trabajos off-line realizados con mangos de la variedad "Osteen", fue posible predecir su calidad interna mediante los índices de madurez (RPI) y de calidad (IQI) con un gran rendimiento. A su vez, los ensayos experimentales efectuados con estos mismos mangos bajo la manipulación no destructiva de una garra robótica, demostraron que los mejores modelos eran capaces de predecir tanto la firmeza mecánica, el contenido en sólidos solubles, la luminosidad de la pulpa, así como el índice RPI de las muestras en base a la información obtenida por los acelerómetros instalados en los dedos de la garra robótica. En cuanto a los ensayos realizados de manera in-line, el primer prototipo desarrollado se basó en la integración de dos sondas VIS-NIR en una garra robótica dispuesta con dos acelerómetros. El sistema desarrollado permitió alcanzar una buena estimación de la calidad del mango a través del índice RPI fusionando la información tanto de los espectros VIS-NIR como del impacto no destructivo de los acelerómetros. De este modo quedó demostrado que era posible obtener una predicción similar trabajando de forma in-line como trabajando de manera off-line para la predicción del mismo índice de calidad en mangos. El segundo prototipo in-line desarrollado se basa en la integración de una sonda VIS-NIR en una cinta transportadora para la identificación de distintas variedades y orígenes de manzanas. El prototipo desarrollado permitió registrar resultados de clasificación tan buenos como los efectuados de manera off-line con, por ejemplo, nectarina. De este modo, se puede concluir que la espectroscopia VIS-NIR permite monitorear la calidad y clasificar fruta poscosecha tanto en modo off-line como in-line. Los nuevos prototipos desarrollados aportan claras ventajas respecto a los procesos tradicionales realizados a mano, como son la reducción del tiempo de inspección, la disminución de la cantidad de residuos generados y la posibilidad de inspeccionar toda la producción, obteniendo así un análisis más estandarizThe food industry, concretely the post-harvest sector, needs to innovate in their production processes, optimizing them to make their activities profitable, guaranteeing quality products capable of satisfying the needs of consumers. The present doctoral thesis focuses on evaluating the potential of visible and near infrared spectroscopy (VIS-NIR) for the characterization and inspection of fruit quality both off-line and in real time in automated processes. Firstly, the viability of the technique was studied at the laboratory level in a static mode (off-line), in order to know and optimise the measurement conditions. Subsequently, the internal and external quality of different types of fruits such as persimmon, nectarine and mango were evaluated. Secondly, an automation of the inspection processes was carried out through the development of new in-line prototypes. For this purpose, and with the aim of completing and corroborating the results obtained in a static mode, the integration of two VIS-NIR probes in a robotic gripper capable of manipulating mangoes was studied. Finally, the integration of a VIS-NIR probe to a conveyor belt was studied as an in-line monitoring tool on the inspection process of different apple varieties. The results obtained in static mode have shown that VIS-NIR spectroscopy is a very promising non-destructive method to predict the astringency in persimmon. Likewise, it has demonstrated to be an adequate tool to classify 100% between nectarine varieties such as 'Big Top' and 'Diamond Ray' with very similar external and internal appearance, but with different organoleptic properties. Similarly, it was possible to classify 100% varieties such as 'Big Top' and 'Magique' with external appearance and similar composition but different pulp colour. An internal quality index (IQI) was developed to evaluate the quality of nectarines, which can be predicted through VIS-NIR spectroscopy. Regarding the off-line work carried out with mangoes of 'Osteen' variety, it was possible to predict its internal quality through the indexes of maturity (RPI) and quality (IQI) with a high performance. Moreover, the experimental tests carried out with these same mangoes under the non-destructive manipulation of a robotic gripper, showed that the best models were able to predict both the mechanical firmness, the soluble solids content, the brightness of the pulp, as well as the RPI index of the samples based on the information obtained by the accelerometers installed on the fingers of the robotic gripper. Regarding the tests carried out in an in-line mode, the first developed prototype was based on the integration of two VIS-NIR probes in a robotic gripper fitted with two accelerometers. The developed system allowed reaching a good estimation of mango quality through the RPI index. In this way, it was demonstrated that it was possible to obtain a similar prediction working in-line as off-line mode for the prediction of the same quality index in mangoes. The second developed in-line prototype is based on the integration of a VIS-NIR probe in a conveyor belt for the identification of different varieties and origins of apples, achieving a success rate of 98% with the system. The developed prototype allowed to register classification results as good as those carried out off-line with, for example, nectarine. In this way, it can be concluded that VIS-NIR spectroscopy allows monitoring the quality and classifying post-harvest fruit in both off-line and in-line mode, being a tool that allows improving and guaranteeing the correct quality and food safety. The new developed prototypes provide clear advantages over the traditional processes performed by hand, such as the reduction of inspection time, the reduction of the amount of waste generated by destructive quality analysis and the possibility of inspecting full production, obtaining a more standardised analysis of the quality of the products.La indústria alimentària, concretament el sector postcollita, necessita innovar en els seus processos productius, optimitzant els mateixos per a rendibilitzar les seues activitats, garantint productes de qualitat capaços de satisfer les necessitats dels consumidors. La present tesi doctoral es centra en avaluar el potencial de l'espectroscòpia visible i infraroig pròxim (VIS-NIR) per a la caracterització i la inspecció de la qualitat de la fruita tant fora de línia com a temps real en processos automatitzats. En un primer lloc, la viabilitat de la tècnica es va estudiar a nivell de laboratori en estat estàtic (off-line), a fi de conéixer i optimitzar les condicions de mesurament. Posteriorment, es va avaluar la qualitat interna i externa de diferents tipus de fruites com són caqui, nectarina i mango. En una segona etapa, es va dur a terme una automatització dels processos d'inspecció per mitjà del desenvolupament de nous prototips in-line. Per aquest propòsit, i amb l'objectiu de completar i corroborar els resultats obtinguts de manera estàtica, es va estudiar la integració de dos sondes VIS-NIR en una garra robòtica capaç de manipular. Finalment, es va estudiar la integració d'una sonda VIS-NIR a una cinta transportadora. Els resultats obtinguts a nivell estàtic han demostrat que l'espectroscòpia VIS-NIR és un mètode no destructiu molt prometedor per a predir l'astringència en caqui. Així mateix, ha demostrat ser una adequada ferramenta per a classificar al 100% entre varietats de nectarines com "Big Top" i "Diamond Ray" amb una aparença externa i interna molt semblant, però amb diferents propietats organolèptiques. De manera semblant, va ser possible classificar al 100% varietats com "Big Top" i "Magique" d'aparença externa i composició semblant però distint color de polpa. Es va desenvolupar un índex de qualitat interna (IQI) per avaluar la qualitat de les nectarines. Pel que fa als treballs off-line realitzats amb mangos de la varietat "Osteen" va ser possible predir la seua qualitat interna mitjançant els índexs de maduresa (RPI) i de qualitat (IQI) amb un gran rendiment. Al mateix temps, els assajos experimentals efectuats amb estos mateixos mangos baix la manipulació no destructiva d'una garra robòtica, van demostrar que els millors models eren capaços de predir tant la fermesa mecánica, el contingut en sòlids solubles, la lluminositat de la polpa, així com l'índex RPI de les mostres basant-se en l'informació obtinguda pels acceleròmetres instal¿lats en els dits de la garra robòtica. En quant als assajos realitzats de manera in-line, el primer prototip desenvolupat es va basar en la integració de dos sondes VIS-NIR en una garra robòtica disposada amb dos acceleròmetres. El sistema desenvolupat va permetre aconseguir una bona estimació de la qualitat del mango a través de l'índex RPI fusionant l'informació tant dels espectres VIS-NIR com de l'impacte no destructiu dels acceleròmetres. D'esta manera va quedar demostrat que era possible obtindre una predicció semblant treballant de forma in-line com off-line per a la predicció del mateix índex de qualitat en mangos. El segon prototip in-line desenvolupat es va basar en la integració d'una sonda VIS-NIR en una cinta transportadora per a l'identificació de distintes varietats i orígens de pomes. El prototip desenvolupat va permetre registrar resultats de classificació tan bons com els efectuats de manera off-line. D'aquesta manera, es pot concloure que l'espectroscòpia VIS-NIR permet monitorar la qualitat i classificar fruita postcollita tant en mode off-line com in-line. Els nous prototips desenvolupats aporten clars avantatges respecte als processos tradicionals realitzats a mà, com són la reducció del temps d'inspecció, la disminució de la quantitat de residus generats pels anàlisis destructives de qualitat i la possibilitat d'inspeccionar tota la producció, obtenint així un anàlisi més estandarditzCortés López, V. (2018). Innovations in non-destructive techniques for fruit quality control applied to manipulation and inspection lines [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/110969TESISCompendi

The non-invasive assessment of avocado maturity and quality

Horticultural products in today's modern market must have high quality standards. Consumer demand for consistent quality agricultural produce remains strong and continues to increase, this will lead to the development and subsequent increased availability of sophisticated techniques, sensors, and user-friendly non-invasive systems for measuring product quality indices. The inability to consistently guarantee internal fruit quality is a major factor not only for the Australian avocado industry but also the entire horticulture sector. Poor fruit quality is seen as a key factor affecting consumer confidence and impacts on supply chain efficiency and profitability. Removing fruit quality inconsistencies while providing the consumer with a consistent quality product is a vital commercial consideration of the Australian avocado industry for both domestic and export markets. Many fruit quality attributes affecting consumer acceptance are assessed using traditional methods that are generally subjective, labour intensive and costly. Commercially, avocado maturity is measured destructively by the determination of dry matter (DM) content, moisture content (MC) or oil content, all of which are highly correlated. Maturity is an important component in avocado fruit quality and a prime factor in palatability. A rapid, non-destructive measurement system that can accurately and simultaneously monitor external and internal attributes of every avocado fruit either in the field or in an in-line setting, is highly desirable for ensuring consistent product quality over an extended season, increasing industry marketability and profitability. The utility of near infrared (NIR) spectroscopy was investigated as a non-invasive assessment tool for estimating avocado maturity and thereby eating quality based on dry matter content of whole intact fruit primarily for the avocado variety 'Hass'. The technique was also assessed for detecting bruises and for predicting rot susceptibility as an indication of shelf-life for possible implementation in a commercial in-line application. The project also investigated the importance of the calibration model development process to incorporate seasonal and geographical variability to ensure model robustness. NIR spectroscopy has an obvious place in agriculture and environmental applications with its core strength in the analysis of biological materials, plus low cost of analysis, simplicity in sample preparation, no chemical reagent requirements, simultaneous analysis of multiple constituents, good repeatability and high throughput capability. The commercially available NIR spectroscopy systems assessed in this project highlighted the potential of NIR spectroscopy and its suitability for application in a commercial in-line setting for predicting avocado maturity and palatability of whole intact avocados, based on DM content. With horticultural products, the major challenge of implementing NIR spectroscopy is to ensure that the calibration model is robust, that is, that the calibration model holds across growing seasons and potentially across growing districts. The present project represents the first study to investigate the effect of seasonal variation on model robustness to be applied to avocado fruit. It found that seasonal variability has a significant effect on model predictive performance for DM in avocados. The robustness of the calibration model, which in general limits the commercial application for the technique, was found to increase across seasons when more seasonal variability was included in the calibration set. Across the seasons it achieved predictive performances in this case in the range of: validation coefficient of determination (Rᵥ²) of 0.76 – 0.89, root mean square error of prediction (RMSEP) of 1.43 - 1.97%, and standard deviation ratio's (SDR) of 2.0 to 3.1. Similarly, there are spectral differences between geographical regions and that specific regional models may have significantly reduced predictive performance when applied to samples containing biological variability from a different growing region. As with seasonal variability, this can be addressed by incorporating multiple geographical growing regions into the calibration model to account for the biological variability to improve model robustness as demonstrated in this study (i.e., Rᵥ² of 0.89, RMSEP of 1.51%, and SDR of 3.6). Furthermore, when models are constructed to include both season and geographical variability, model performance can be more robust when dealing with a broader range of future sample variability. This was demonstrated with calibration models constructed to incorporate 3 years of seasonal variability and encompassing 3 geographical regions, obtaining predictive performances ranging from Rᵥ ² 0.87 - 0.89; RMSEP of 1.42 - 1.64% and SDR of 2.7 - 3.1 across the various geographical regions. NIR spectroscopy shows great promise for the application in a commercial, in-line setting for the non-destructive evaluation of impact damage (bruising) and rot susceptibility of whole avocado fruit, although optimisation of the technology is required to address speed of throughput and environmental issues. The adoption of a rapid, non-invasive method to identify fruit that are less prone to rots and internal disorders would allow selection of fruit that could be sent to more distant markets with greater confidence that it will arrive in acceptable quality, thus ensuring maximum yield and higher returns for the producer and marketer. The ability of the NIR classification models to accurately predict rot development of hard green avocado fruit (stage 0 ripeness) into two classes, ≤10% and >10% of flesh affected, ranged from 65-84% over the three growing seasons. When the rot classes were defined as ≤30% and >30% the accuracy ranged from 69%-77%. In relation to impact damage (bruising), trials conducted over three growing seasons using an NIR spot assessment technique found hard green fruit at stage 2 ripeness, that were deliberately bruised could be correctly detected with 70-79% accuracy after 2-5 hours of impacting and with 83-89% accuracy after 24 hours. For eating ripe (stage 4) fruit, the accuracy was 60-100% after 2-5 hours of impacting and 66-100% after 24 hours across the three growing seasons. This indicates that in a commercial situation it would be an advantage to hold the fruit for 24 hours before undertaking NIR scanning

Using infrared spectroscopy to evaluate physiological ageing in stored potatoes (Solanum tuberosum)

The potato tuber is one of world’s largest food crops and in most growing regions is only harvested once a year. A proportion of tubers must therefore be stored efficiently to ensure there are enough provisions to last until the next harvest. Dormancy break during storage causes reduced tuber quality and potentially considerable losses. The aim of this work has been to determine whether Vis/NIR Spectroscopy can be used to monitor tuber dormancy, and further, to predict the onset of sprouting within a potato tuber. Small changes in Chlorophyll (Chl) production can be tracked in the tissue under the surface skin of a potato tuber, using a Vis/NIR spectrometer equipped with a fibre-optic probe. A static experimental setup yielded precise measurements of these subtle changes when the tuber was stimulated with light, long before visible greening occurred. It was found that there is a greater capacity for Chl production around the apical buds or “eyes” of a tuber compared with the surrounding tissue. These results held true for several cultivars from multiple harvests over the four years of the project. The technique however is very sensitive to the exact positioning of the tuber-probe alignment, due to the highly localised area of increased activity in the Chl production under an eye and the shape of the tuber itself. Although Chl is not produced in tubers whilst kept in cold dark storage, a tuber’s capacity to produce Chl once removed was found to change over the course of long-term storage. This behaviour was well fitted by a generalised logistic function. Prediction of the onset of dormancy break could be made from the shape of the curve from individual tuber batches. A proviso throughout is that sufficient tubers need to be analysed to obtain a meaningful batch average. The large tuber-to-tuber variance in behaviour remains the greatest challenge to translating this work into real world settings