Automatic identification and classification of compostable and biodegradable plastics using hyperspectral imaging

In the UK waste management systems biodegradable and compostable packaging are not automatically detected and separated. As a result, their fate is generally landfill or incineration, neither of which is an environmentally good outcome. Thus, effective sorting technologies for compostable plastics are needed to help improve composting rates of these materials and reduce the contamination of recycling waste streams. Hyperspectral imaging (HSI) was applied in this study to develop classification models for automatically identifying and classifying compostable plastics with the analysis focused on the spectral region 950–1,730 nm. The experimental design includes a hyperspectral imaging camera, allowing different chemometric techniques to be applied including principal component analysis (PCA) and partial least square discriminant analysis (PLS-DA) to develop a classification model for the compostable materials plastics. Materials used in this experimental analysis included compostable materials (sugarcane-derived and palm leaf derived), compostable plastics (PLA, PBAT) and conventional plastics (PP, PET, and LDPE). Our strategy was to develop a classification model to identify and categorize various fragments over the size range of 50 x 50 mm to 5 x 5 mm. Results indicated that both PCA and PLS-DA achieved classification scores of 100% when the size of material was larger than 10 mm x 10 mm. However, the misclassification rate increased to 20% for sugarcane-derived and 40% for palm leaf-based materials at sizes of 10 x 10 mm or below. In addition, for sizes of 5 x 5 mm, the misclassification rate for LDPE and PBAT increased to 20%, and for sugarcane and palm-leaf based materials to 60 and 80% respectively while the misclassification rate for PLA, PP, and PET was still 0%. The system is capable of accurately sorting compostable plastics (compostable spoons, forks, coffee lids) and differentiating them from identical looking conventional plastic items with high accuracy

Towards recycling of challenging waste fractions: Identifying flame retardants in plastics with optical spectroscopic techniques

The use of plastics is rapidly rising around the world causing a major challenge for recycling. Lately, a lot of emphasis has been put on recycling of packaging plastics, but, in addition, there are high volume domains with low recycling rate such as automotive, building and construction, and electric and electronic equipment. Waste plastics from these domains often contain additives that restrict their recycling due to the hazardousness and challenges they bring to chemical and mechanical recycling. As such, the first step for enabling the reuse of these fractions is the identification of these additives in the waste plastics. This study compares the ability of different optical spectroscopy technologies to detect two different plastic additives, fire retardants ammonium polyphosphate and aluminium trihydrate, inside polypropylene plastic matrix. The detection techniques near-infrared (NIR), Fourier-transform infrared (FTIR) and Raman spectroscopy as well as hyperspectral imaging (HSI) in the short-wavelength infrared (SWIR) and mid-wavelength infrared (MWIR) range were evaluated. The results indicate that Raman, NIR and SWIR HSI have the potential to detect these additives inside the plastic matrix even at relatively low concentrations. As such, utilising these methods has the possibility to facilitate sorting and recycling of as of yet unused plastic waste streams, although more research is needed in applying them in actual waste sorting facilities

Comparison of latent variable-based and artificial intelligence methods for impurity detection in PET recycling from NIR hyperspectral images

[EN] In polyethylene terephthalate's (PET)'s recycling processes, separation from polyvinyl chloride (PVC) is of prior relevance due to its toxicity, which degrades the final quality of recycled PET. Moreover, the potential presence of some polymers in mixed plastics (such as PVC in PET) is a key aspect for the use of recycled plastic in products such as medical equipment, toys, or food packaging. Many works have dealt with plastic classification by hyperspectral imaging, although only some of them have been directly focused on PET sorting and very few on its separation from PVC. These works use different classification models and preprocessing techniques and show their performance for the problem at hand. However, still, there is a lack of methodology to address the goal of comparing and finding the best model and preprocessing technique. Thus, this paper presents a design of experiments-based methodology for comparing and selecting, for the problem at hand, the best preprocessing technique, and the best latent variable-based and/or artificial intelligence classification method, when using NIR hyperspectral images. There is a lack of methodology to address the goal of comparing and finding the best model and preprocessing technique. Thus, this paper presents a design of experiments-based methodology for comparing and selecting, for the problem at hand, the best preprocessing technique, and the best latent variable-based and/or artificial intelligence classification method when using near-infrared hyperspectral images.Universitat Politecnica de Valencia, Grant/Award Number: UPV-FE-16-B18This research was partially supported by the Universitat Politècnica de València under the project UPV‐FE‐16‐B18.Galdón-Navarro, B.; Prats-Montalbán, JM.; Cubero-García, S.; Blasco Ivars, J.; Ferrer, A. (2018). Comparison of latent variable-based and artificial intelligence methods for impurity detection in PET recycling from NIR hyperspectral images. Journal of Chemometrics. 32(1):1-14. https://doi.org/10.1002/cem.2980S11432

The Need for Accurate Pre-processing and Data Integration for the Application of Hyperspectral Imaging in Mineral Exploration

Die hyperspektrale Bildgebung stellt eine Schlüsseltechnologie in der nicht-invasiven Mineralanalyse dar, sei es im Labormaßstab oder als fernerkundliche Methode. Rasante Entwicklungen im Sensordesign und in der Computertechnik hinsichtlich Miniaturisierung, Bildauflösung und Datenqualität ermöglichen neue Einsatzgebiete in der Erkundung mineralischer Rohstoffe, wie die drohnen-gestützte Datenaufnahme oder digitale Aufschluss- und Bohrkernkartierung. Allgemeingültige Datenverarbeitungsroutinen fehlen jedoch meist und erschweren die Etablierung dieser vielversprechenden Ansätze. Besondere Herausforderungen bestehen hinsichtlich notwendiger radiometrischer und geometrischer Datenkorrekturen, der räumlichen Georeferenzierung sowie der Integration mit anderen Datenquellen. Die vorliegende Arbeit beschreibt innovative Arbeitsabläufe zur Lösung dieser Problemstellungen und demonstriert die Wichtigkeit der einzelnen Schritte. Sie zeigt das Potenzial entsprechend prozessierter spektraler Bilddaten für komplexe Aufgaben in Mineralexploration und Geowissenschaften.Hyperspectral imaging (HSI) is one of the key technologies in current non-invasive material analysis. Recent developments in sensor design and computer technology allow the acquisition and processing of high spectral and spatial resolution datasets. In contrast to active spectroscopic approaches such as X-ray fluorescence or laser-induced breakdown spectroscopy, passive hyperspectral reflectance measurements in the visible and infrared parts of the electromagnetic spectrum are considered rapid, non-destructive, and safe. Compared to true color or multi-spectral imagery, a much larger range and even small compositional changes of substances can be differentiated and analyzed. Applications of hyperspectral reflectance imaging can be found in a wide range of scientific and industrial fields, especially when physically inaccessible or sensitive samples and processes need to be analyzed. In geosciences, this method offers a possibility to obtain spatially continuous compositional information of samples, outcrops, or regions that might be otherwise inaccessible or too large, dangerous, or environmentally valuable for a traditional exploration at reasonable expenditure. Depending on the spectral range and resolution of the deployed sensor, HSI can provide information about the distribution of rock-forming and alteration minerals, specific chemical compounds and ions. Traditional operational applications comprise space-, airborne, and lab-scale measurements with a usually (near-)nadir viewing angle. The diversity of available sensors, in particular the ongoing miniaturization, enables their usage from a wide range of distances and viewing angles on a large variety of platforms. Many recent approaches focus on the application of hyperspectral sensors in an intermediate to close sensor-target distance (one to several hundred meters) between airborne and lab-scale, usually implying exceptional acquisition parameters. These comprise unusual viewing angles as for the imaging of vertical targets, specific geometric and radiometric distortions associated with the deployment of small moving platforms such as unmanned aerial systems (UAS), or extreme size and complexity of data created by large imaging campaigns. Accurate geometric and radiometric data corrections using established methods is often not possible. Another important challenge results from the overall variety of spatial scales, sensors, and viewing angles, which often impedes a combined interpretation of datasets, such as in a 2D geographic information system (GIS). Recent studies mostly referred to work with at least partly uncorrected data that is not able to set the results in a meaningful spatial context. These major unsolved challenges of hyperspectral imaging in mineral exploration initiated the motivation for this work. The core aim is the development of tools that bridge data acquisition and interpretation, by providing full image processing workflows from the acquisition of raw data in the field or lab, to fully corrected, validated and spatially registered at-target reflectance datasets, which are valuable for subsequent spectral analysis, image classification, or fusion in different operational environments at multiple scales. I focus on promising emerging HSI approaches, i.e.: (1) the use of lightweight UAS platforms, (2) mapping of inaccessible vertical outcrops, sometimes at up to several kilometers distance, (3) multi-sensor integration for versatile sample analysis in the near-field or lab-scale, and (4) the combination of reflectance HSI with other spectroscopic methods such as photoluminescence (PL) spectroscopy for the characterization of valuable elements in low-grade ores. In each topic, the state of the art is analyzed, tailored workflows are developed to meet key challenges and the potential of the resulting dataset is showcased on prominent mineral exploration related examples. Combined in a Python toolbox, the developed workflows aim to be versatile in regard to utilized sensors and desired applications

Hyperspectral drill-core scanning in geometallurgy

Driven by the need to use mineral resources more sustainably, and the increasing complexity of ore deposits still available for commercial exploitation, the acquisition of quantitative data on mineralogy and microfabric has become an important need in the execution of exploration and geometallurgical test programmes. Hyperspectral drill-core scanning has the potential to be an excellent tool for providing such data in a fast, non- destructive and reproducible manner. However, there is a distinct lack of integrated methodologies to make use of these data through-out the exploration and mining chain. This thesis presents a first framework for the use of hyperspectral drill-core scanning as a pillar in exploration and geometallurgical programmes. This is achieved through the development of methods for (1) the automated mapping of alteration minerals and assemblages, (2) the extraction of quantitative mineralogical data with high resolution over the drill-cores, (3) the evaluation of the suitability of hyperspectral sensors for the pre-concentration of ores and (4) the use of hyperspectral drill- core imaging as a basis for geometallurgical domain definition and the population of these domains with mineralogical and microfabric information.:Introduction Materials and methods Assessment of alteration mineralogy and vein types using hyperspectral data Hyperspectral imaging for quasi-quantitative mineralogical studies Hyperspectral sensors for ore beneficiation 3D integration of hyperspectral data for deposit modelling Concluding remarks Reference

A Versatile Sensor Data Processing Framework for Resource Technology

Die Erweiterung experimenteller Infrastrukturen um neuartige Sensor eröffnen die Möglichkeit, qualitativ neuartige Erkenntnisse zu gewinnen. Um diese Informationen vollständig zu erschließen ist ein Abdecken der gesamten Verarbeitungskette von der Datenauslese bis zu anwendungsbezogenen Auswertung erforderlich. Eine Erweiterung bestehender wissenschaftlicher Instrumente beinhaltet die strukturelle und zeitbezogene Integration der neuen Sensordaten in das Bestandssystem. Das hier vorgestellte Framework bietet durch seinen flexiblen Ansatz das Potenzial, unterschiedliche Sensortypen in unterschiedliche, leistungsfähige Plattformen zu integrieren. Zwei unterschiedliche Integrationsansätze zeigen die Flexibilität dieses Ansatzes, wobei einer auf die Steigerung der Sensitivität einer Anlage zur Sekundärionenmassenspektroskopie und der andere auf die Bereitstellung eines Prototypen zur Untersuchung von Rezyklaten ausgerichtet ist. Die sehr unterschiedlichen Hardwarevoraussetzungen und Anforderungen der Anwendung bildeten die Basis zur Entwicklung eines flexiblen Softwareframeworks. Um komplexe und leistungsfähige Applikationsbausteine bereitzustellen wurde eine Softwaretechnologie entwickelt, die modulare Pipelinestrukturen mit Sensor- und Ausgabeschnittstellen sowie einer Wissensbasis mit entsprechenden Konfigurations- und Verarbeitungsmodulen kombiniert.:1. Introduction 2. Hardware Architecture and Application Background 3. Software Concept 4. Experimental Results 5. Conclusion and OutlookNovel sensors with the ability to collect qualitatively new information offer the potential to improve experimental infrastructure and methods in the field of research technology. In order to get full access to this information, the entire range from detector readout data transfer over proper data and knowledge models up to complex application functions has to be covered. The extension of existing scientific instruments comprises the integration of diverse sensor information into existing hardware, based on the expansion of pivotal event schemes and data models. Due to its flexible approach, the proposed framework has the potential to integrate additional sensor types and offers migration capabilities to high-performance computing platforms. Two different implementation setups prove the flexibility of this approach, one extending the material analyzing capabilities of a secondary ion mass spectrometry device, the other implementing a functional prototype setup for the online analysis of recyclate. Both setups can be regarded as two complementary parts of a highly topical and ground-breaking unique scientific application field. The requirements and possibilities resulting from different hardware concepts on one hand and diverse application fields on the other hand are the basis for the development of a versatile software framework. In order to support complex and efficient application functions under heterogeneous and flexible technical conditions, a software technology is proposed that offers modular processing pipeline structures with internal and external data interfaces backed by a knowledge base with respective configuration and conclusion mechanisms.:1. Introduction 2. Hardware Architecture and Application Background 3. Software Concept 4. Experimental Results 5. Conclusion and Outloo

Mineral identification using data-mining in hyperspectral infrared imagery

Les applications de l’imagerie infrarouge dans le domaine de la géologie sont principalement des applications hyperspectrales. Elles permettent entre autre l’identification minérale, la cartographie, ainsi que l’estimation de la portée. Le plus souvent, ces acquisitions sont réalisées in-situ soit à l’aide de capteurs aéroportés, soit à l’aide de dispositifs portatifs. La découverte de minéraux indicateurs a permis d’améliorer grandement l’exploration minérale. Ceci est en partie dû à l’utilisation d’instruments portatifs. Dans ce contexte le développement de systèmes automatisés permettrait d’augmenter à la fois la qualité de l’exploration et la précision de la détection des indicateurs. C’est dans ce cadre que s’inscrit le travail mené dans ce doctorat. Le sujet consistait en l’utilisation de méthodes d’apprentissage automatique appliquées à l’analyse (au traitement) d’images hyperspectrales prises dans les longueurs d’onde infrarouge. L’objectif recherché étant l’identification de grains minéraux de petites tailles utilisés comme indicateurs minéral -ogiques. Une application potentielle de cette recherche serait le développement d’un outil logiciel d’assistance pour l’analyse des échantillons lors de l’exploration minérale. Les expériences ont été menées en laboratoire dans la gamme relative à l’infrarouge thermique (Long Wave InfraRed, LWIR) de 7.7m à 11.8 m. Ces essais ont permis de proposer une méthode pour calculer l’annulation du continuum. La méthode utilisée lors de ces essais utilise la factorisation matricielle non négative (NMF). En utlisant une factorisation du premier ordre on peut déduire le rayonnement de pénétration, lequel peut ensuite être comparé et analysé par rapport à d’autres méthodes plus communes. L’analyse des résultats spectraux en comparaison avec plusieurs bibliothèques existantes de données a permis de mettre en évidence la suppression du continuum. Les expérience ayant menés à ce résultat ont été conduites en utilisant une plaque Infragold ainsi qu’un objectif macro LWIR. L’identification automatique de grains de différents matériaux tels que la pyrope, l’olivine et le quartz a commencé. Lors d’une phase de comparaison entre des approches supervisées et non supervisées, cette dernière s’est montrée plus approprié en raison du comportement indépendant par rapport à l’étape d’entraînement. Afin de confirmer la qualité de ces résultats quatre expériences ont été menées. Lors d’une première expérience deux algorithmes ont été évalués pour application de regroupements en utilisant l’approche FCC (False Colour Composite). Cet essai a permis d’observer une vitesse de convergence, jusqu’a vingt fois plus rapide, ainsi qu’une efficacité significativement accrue concernant l’identification en comparaison des résultats de la littérature. Cependant des essais effectués sur des données LWIR ont montré un manque de prédiction de la surface du grain lorsque les grains étaient irréguliers avec présence d’agrégats minéraux. La seconde expérience a consisté, en une analyse quantitaive comparative entre deux bases de données de Ground Truth (GT), nommée rigid-GT et observed-GT (rigide-GT: étiquet manuel de la région, observée-GT:étiquetage manuel les pixels). La précision des résultats était 1.5 fois meilleur lorsque l’on a utlisé la base de données observed-GT que rigid-GT. Pour les deux dernières epxérience, des données venant d’un MEB (Microscope Électronique à Balayage) ainsi que d’un microscopie à fluorescence (XRF) ont été ajoutées. Ces données ont permis d’introduire des informations relatives tant aux agrégats minéraux qu’à la surface des grains. Les résultats ont été comparés par des techniques d’identification automatique des minéraux, utilisant ArcGIS. Cette dernière a montré une performance prometteuse quand à l’identification automatique et à aussi été utilisée pour la GT de validation. Dans l’ensemble, les quatre méthodes de cette thèse représentent des méthodologies bénéfiques pour l’identification des minéraux. Ces méthodes présentent l’avantage d’être non-destructives, relativement précises et d’avoir un faible coût en temps calcul ce qui pourrait les qualifier pour être utilisée dans des conditions de laboratoire ou sur le terrain.The geological applications of hyperspectral infrared imagery mainly consist in mineral identification, mapping, airborne or portable instruments, and core logging. Finding the mineral indicators offer considerable benefits in terms of mineralogy and mineral exploration which usually involves application of portable instrument and core logging. Moreover, faster and more mechanized systems development increases the precision of identifying mineral indicators and avoid any possible mis-classification. Therefore, the objective of this thesis was to create a tool to using hyperspectral infrared imagery and process the data through image analysis and machine learning methods to identify small size mineral grains used as mineral indicators. This system would be applied for different circumstances to provide an assistant for geological analysis and mineralogy exploration. The experiments were conducted in laboratory conditions in the long-wave infrared (7.7μm to 11.8μm - LWIR), with a LWIR-macro lens (to improve spatial resolution), an Infragold plate, and a heating source. The process began with a method to calculate the continuum removal. The approach is the application of Non-negative Matrix Factorization (NMF) to extract Rank-1 NMF and estimate the down-welling radiance and then compare it with other conventional methods. The results indicate successful suppression of the continuum from the spectra and enable the spectra to be compared with spectral libraries. Afterwards, to have an automated system, supervised and unsupervised approaches have been tested for identification of pyrope, olivine and quartz grains. The results indicated that the unsupervised approach was more suitable due to independent behavior against training stage. Once these results obtained, two algorithms were tested to create False Color Composites (FCC) applying a clustering approach. The results of this comparison indicate significant computational efficiency (more than 20 times faster) and promising performance for mineral identification. Finally, the reliability of the automated LWIR hyperspectral infrared mineral identification has been tested and the difficulty for identification of the irregular grain’s surface along with the mineral aggregates has been verified. The results were compared to two different Ground Truth(GT) (i.e. rigid-GT and observed-GT) for quantitative calculation. Observed-GT increased the accuracy up to 1.5 times than rigid-GT. The samples were also examined by Micro X-ray Fluorescence (XRF) and Scanning Electron Microscope (SEM) in order to retrieve information for the mineral aggregates and the grain’s surface (biotite, epidote, goethite, diopside, smithsonite, tourmaline, kyanite, scheelite, pyrope, olivine, and quartz). The results of XRF imagery compared with automatic mineral identification techniques, using ArcGIS, and represented a promising performance for automatic identification and have been used for GT validation. In overall, the four methods (i.e. 1.Continuum removal methods; 2. Classification or clustering methods for mineral identification; 3. Two algorithms for clustering of mineral spectra; 4. Reliability verification) in this thesis represent beneficial methodologies to identify minerals. These methods have the advantages to be a non-destructive, relatively accurate and have low computational complexity that might be used to identify and assess mineral grains in the laboratory conditions or in the field

Deep learning for chemometric analysis of plastic spectral data from infrared and Raman databases

Increasing plastic recycling rates is key to addressing plastic pollution. New technologies such as chemometric analysis of spectral data have shown great promises in improving the plastic sorting efficiency to boost recycling rates. In this work, a novel deep learning architecture, PolymerSpectraDecisionNet (PSDN) was developed, consisting of convolutional neural networks, residual networks and inception networks in a decision tree structure. To better represent the conditions in the plastic recycling industry, the models were built to identify the most widely recycled polymers – polyethylene, polypropylene and polyethylene terephthalate from open-sourced infrared and Raman spectral dataset containing over 20 different polymers. PSDN performed better than end-to-end neural networks, obtaining an accuracy of 0.949 and 0.967 with the Raman and infrared datasets respectively. The use of deep learning can also distinguish between weathered and unaged polymer samples, with accuracies of 0.954 for high density polyethylene and 0.906 for polyethylene terephthalate