A clinically translatable hyperspectral endoscopy (HySE) system for imaging the gastrointestinal tract.

Hyperspectral imaging (HSI) enables visualisation of morphological and biochemical information, which could improve disease diagnostic accuracy. Unfortunately, the wide range of image distortions that arise during flexible endoscopy in the clinic have made integration of HSI challenging. To address this challenge, we demonstrate a hyperspectral endoscope (HySE) that simultaneously records intrinsically co-registered hyperspectral and standard-of-care white light images, which allows image distortions to be compensated computationally and an accurate hyperspectral data cube to be reconstructed as the endoscope moves in the lumen. Evaluation of HySE performance shows excellent spatial, spectral and temporal resolution and high colour fidelity. Application of HySE enables: quantification of blood oxygenation levels in tissue mimicking phantoms; differentiation of spectral profiles from normal and pathological ex vivo human tissues; and recording of hyperspectral data under freehand motion within an intact ex vivo pig oesophagus model. HySE therefore shows potential for enabling HSI in clinical endoscopy

Dynamic Hyperspectral and Polarized Endoscopic Imaging

The health of rich, developed nations has seen drastic improvement in the last two centuries. For it to continue improving at a similar rate new or improved diagnostic and treatment technologies are required, especially for those diseases such as cancer which are forecast to constitute the majority of disease burden in the future. Optical techniques such as microscopy have long played their part in the diagnostic process. However there are several new biophotonic modalities that aim to exploit various interactions between light and tissue to provide enhanced diagnostic information. Many of these show promise in a laboratory setting but few have progressed to a clinical setting. We have designed and constructed a flexible, multi-modal, multi-spectral laparoscopic imaging system that could be used to demonstrate several different techniques in a clinical setting. The core of this system is a dynamic hyperspectral illumination system based around a supercontinuum laser and Digital Micromirror Device that can provide specified excitation light in the visible and near infra-red ranges. This is a powerful tool for spectroscopic techniques as it is not limited to interrogating a fixed range of wavelengths and can switch between excitation bands instantaneously. The excitation spectra can be customised to match particular fluorophores or absorption features, introducing new possibilities for spectral imaging. A standard 10 mm diameter rigid endoscope was incorporated into the system to reduce cost and demonstrate compatibility with existing equipment. The polarization properties of two commercial endoscopes were characterised and found to be unsuited to current polarization imaging techniques as birefringent materials used in their construction introduce complex, spatially dependent transformations of the polarization state. Preliminary exemplar data from phantoms and ex vivo tissue was collected and the feasibility and accuracy of different analysis techniques demonstrated including multiple class classification algorithms. Finally, a novel visualisation method was implemented in order to display the complex hyperspectral data sets in a meaningful and intuitive way to the user

OCM 2021 - Optical Characterization of Materials

The state of the art in the optical characterization of materials is advancing rapidly. New insights have been gained into the theoretical foundations of this research and exciting developments have been made in practice, driven by new applications and innovative sensor technologies that are constantly evolving. The great success of past conferences proves the necessity of a platform for presentation, discussion and evaluation of the latest research results in this interdisciplinary field

OCM 2021 - Optical Characterization of Materials : Conference Proceedings

The state of the art in the optical characterization of materials is advancing rapidly. New insights have been gained into the theoretical foundations of this research and exciting developments have been made in practice, driven by new applications and innovative sensor technologies that are constantly evolving. The great success of past conferences proves the necessity of a platform for presentation, discussion and evaluation of the latest research results in this interdisciplinary field

Artificial Intelligence in Materials Science: Applications of Machine Learning to Extraction of Physically Meaningful Information from Atomic Resolution Microscopy Imaging

Materials science is the cornerstone for technological development of the modern world that has been largely shaped by the advances in fabrication of semiconductor materials and devices. However, the Moore’s Law is expected to stop by 2025 due to reaching the limits of traditional transistor scaling. However, the classical approach has shown to be unable to keep up with the needs of materials manufacturing, requiring more than 20 years to move a material from discovery to market. To adapt materials fabrication to the needs of the 21st century, it is necessary to develop methods for much faster processing of experimental data and connecting the results to theory, with feedback flow in both directions. However, state-of-the-art analysis remains selective and manual, prone to human error and unable to handle large quantities of data generated by modern equipment. Recent advances in scanning transmission electron and scanning tunneling microscopies have allowed imaging and manipulation of materials on the atomic level, and these capabilities require development of automated, robust, reproducible methods.Artificial intelligence and machine learning have dealt with similar issues in applications to image and speech recognition, autonomous vehicles, and other projects that are beginning to change the world around us. However, materials science faces significant challenges preventing direct application of the such models without taking physical constraints and domain expertise into account.Atomic resolution imaging can generate data that can lead to better understanding of materials and their properties through using artificial intelligence methods. Machine learning, in particular combinations of deep learning and probabilistic modeling, can learn to recognize physical features in imaging, making this process automated and speeding up characterization. By incorporating the knowledge from theory and simulations with such frameworks, it is possible to create the foundation for the automated atomic scale manufacturing

Raman spectral imaging in tissue engineering & regenerative medicine applications

The label-free nature of Raman spectroscopy makes it a valuable tool for cellular and tissue characterisation. Its ability to probe molecular vibrations within biological structures without affecting their biochemistry offers an advantage over conventional histological and biochemical assays. Providing a pure investigation of unperturbed biological processes, without the need for introduction of exogenous molecules for labelling, makes the information Raman spectroscopy offers very valuable in deciphering complex biological functions and mechanisms. Raman spectral signatures are unique "fingerprints" of each biomolecule probed and can be used for cellular phenotype characterisation, tissue composition, disease development in a cellular or tissue level and much more. This thesis focuses on the use of Raman spectral imaging in novel biological applications displaying its flexibility across the fields of tissue engineering and regenerative medicine. Bone regeneration was the first biological process investigated, where Raman spectral imaging was used to characterise bioactive glass-assisted bone repair using standard and novel glass compositions. Newly-formed bone quality was assessed using multivariate analysis, showing similar quality between glass compositions and existing bone. Morphological analysis after in vivo implantation of bioactive glass particles showed distinct spectral zones confirming results from existing in vitro models. The second application, focused on the development of a novel Raman-based gene delivery tracking methodology. Viral particles, containing modified viral-nucleotides with alkyne bonds were produced were successfully detected using Raman spectral imaging in cells after infection. The implications of this technology offer a new cell screening methodology for gene therapy. Finally, the potential of Raman spectral imaging as a complementary technique for 3D cell culture systems was explored. A computational framework was developed which allows for the visualisation and quantification of subcellular structures. The accurate 3D reconstruction of whole cells of known architecture from a volumetric hyperspectral Raman dataset was reported here for the first time. Moreover, using spectral unmixing algorithms to quantify subcellular components, revealed an unprecedented molecular specificity. This allowed imaging of cells within hydrogel-based 3D cell culture systems. The synergy of Raman spectral imaging, multivariate and image analysis to answer complex biological questions offers objective biomolecular characterisation, quantification and visualisation of molecular architecture. This work demonstrates the potential of Raman spectroscopy as a valuable complementary tool in tissue engineering and regenerative medicine applications.Open Acces

Investigations on chemometric approaches for diagnostic applications utilizing various combinations of spectral and image data types

In the presented work, several data fusion and machine learning approaches were explored within the frame of the data combination for various measurement techniques in biomedical applications. For each of the measurement techniques used in this work, the data was ana-lyzed by means of machine learning. Prior to applying these machine learning algorithms, a specific preprocessing pipeline for each type of data had to be established. These pipelines made it possible to standardize the data and to decrease sample-to-sample variations which originate from the instability of devices or small deviations in the sample preparation or measurement routine. The preprocessed data sets were used for various analyses of biological samples. Separate data analyses were performed for microscopic images, Raman spectra, and SERS data. However, this work mainly focused on the application of data fusion methods for the analy-sis of biological tissues and cells. To do so, different data fusion pipelines were constructed for each task, depending on the data structure. Both low-level (centralized) and high-level (distributed) data fusion approaches were tested and investigated within in this work. To demonstrate centralized and distributed data fusion, two examples were implemented for tissue investigation. In both examples, a combination of Raman spectroscopic and MALDI spectrometric data were analyzed. One example demonstrated centralized data fusion for the analysis of the chemical composition of a mouse brain section, and the other example employed distributed data fusion for liver cancer detection. Other data fusion examples were demonstrated for cell-based analysis. It was demonstrated that leukocyte cell subtype identification can be improved by a centralized data fusion of Raman spectroscopic data and morphological features obtained from microscopic images of stained cells. The last example presented in this work demonstrated a sepsis diagnostic pipeline based on the combination of Raman spectroscopic data and biomarkers. Besides the measured values, the demographic information of the patient was included in the analysis process for considering non-disease-related variations. During the construction of data fusion pipelines, such issues as unbalanced data contribu-tion, missing values, and variations that are not related to the investigated responses were faced. To resolve these issues, data weighting, missing data imputation, and the introduc-tion of additional responses were employed. For further improvement of analysis reliability, the data fusion pipelines and data processing routine were adjusted for each study in this work. As a result, the most suitable data fusion approach was found for every example, and a combination of the machine learning methods with data fusion approaches was demon-strated as a powerful tool for data analysis in biomedical applications