TPCNN: Two-path convolutional neural network for tumor and liver segmentation in CT images using a novel encoding approach

Automatic liver and tumour segmentation in CT images are crucial in numerous clinical applications, such as postoperative assessment, surgical planning, and pathological diagnosis of hepatic diseases. However, there are still a considerable number of difficulties to overcome due to the fuzzy boundary, irregular shapes, and complex tissues of the liver. In this paper, for liver and tumor segmentation and to overcome the mentioned challenges a simple but powerful strategy is presented based on a cascade convolutional neural network. At the first, the input image is normalized using the Z-Score algorithm. This normalized image provides more information about the boundary of tumor and liver. Also, the Local Direction of Gradient (LDOG) which is a novel encoding algorithm is proposed to demonstrate some key features inside the image. The proposed encoding image is highly effective in recognizing the border of liver, even in the regions close to the touching organs. Then, a cascade CNN structure for extracting both local and semi-global features is used which utilized the original image and two other obtained images as the input data. Rather than using a complex deep CNN model with a lot of hyperparameters, we employ a simple but effective model to decrease the train and testing time. Our technique outperforms the state-of-the-art works in terms of segmentation accuracy and efficiency

Methods for Analysing Endothelial Cell Shape and Behaviour in Relation to the Focal Nature of Atherosclerosis

The aim of this thesis is to develop automated methods for the analysis of the spatial patterns, and the functional behaviour of endothelial cells, viewed under microscopy, with applications to the understanding of atherosclerosis. Initially, a radial search approach to segmentation was attempted in order to trace the cell and nuclei boundaries using a maximum likelihood algorithm; it was found inadequate to detect the weak cell boundaries present in the available data. A parametric cell shape model was then introduced to fit an equivalent ellipse to the cell boundary by matching phase-invariant orientation fields of the image and a candidate cell shape. This approach succeeded on good quality images, but failed on images with weak cell boundaries. Finally, a support vector machines based method, relying on a rich set of visual features, and a small but high quality training dataset, was found to work well on large numbers of cells even in the presence of strong intensity variations and imaging noise. Using the segmentation results, several standard shear-stress dependent parameters of cell morphology were studied, and evidence for similar behaviour in some cell shape parameters was obtained in in-vivo cells and their nuclei. Nuclear and cell orientations around immature and mature aortas were broadly similar, suggesting that the pattern of flow direction near the wall stayed approximately constant with age. The relation was less strong for the cell and nuclear length-to-width ratios. Two novel shape analysis approaches were attempted to find other properties of cell shape which could be used to annotate or characterise patterns, since a wide variability in cell and nuclear shapes was observed which did not appear to fit the standard parameterisations. Although no firm conclusions can yet be drawn, the work lays the foundation for future studies of cell morphology. To draw inferences about patterns in the functional response of cells to flow, which may play a role in the progression of disease, single-cell analysis was performed using calcium sensitive florescence probes. Calcium transient rates were found to change with flow, but more importantly, local patterns of synchronisation in multi-cellular groups were discernable and appear to change with flow. The patterns suggest a new functional mechanism in flow-mediation of cell-cell calcium signalling

CT Scanning

Since its introduction in 1972, X-ray computed tomography (CT) has evolved into an essential diagnostic imaging tool for a continually increasing variety of clinical applications. The goal of this book was not simply to summarize currently available CT imaging techniques but also to provide clinical perspectives, advances in hybrid technologies, new applications other than medicine and an outlook on future developments. Major experts in this growing field contributed to this book, which is geared to radiologists, orthopedic surgeons, engineers, and clinical and basic researchers. We believe that CT scanning is an effective and essential tools in treatment planning, basic understanding of physiology, and and tackling the ever-increasing challenge of diagnosis in our society

Tumour grading and discrimination based on class assignment and quantitative texture analysis techniques

Medical imaging represents the utilisation of technology in biology for the purpose of noninvasively revealing the internal structure of the organs of the human body. It is a way to improve the quality of the patient's life through a more precise and rapid diagnosis, and with limited side-effects, leading to an effective overall treatment procedure. The main objective of this thesis is to propose novel tumour discrimination techniques that cover both micro and macro-scale textures encountered in computed tomography (CI') and digital microscopy (DM) modalities, respectively. Image texture can provide significant information on the (ab)normality of tissue, and this thesis expands this idea to tumour texture grading and classification. The fractal dimension (FO) as a texture measure was applied to contrast enhanced CT lung tumour images in an aim to improve tumour grading accuracy from conventional CI' modality, and quantitative performance analysis showed an accuracy of 83.30% in distinguishing between advanced (aggressive) and early stage (non-aggressive) malignant tumours. A different approach was adopted for subtype discrimination of brain tumour OM images via a set of statistical and model-based texture analysis algorithms. The combined Gaussian Markov random field and run-length matrix texture measures outperformed all other combinations, achieving an overall class assignment classification accuracy of 92.50%. Also two new histopathological multi resolution approaches based on applying the FO as the best bases selection for discrete wavelet packet transform, and when fused with the Gabor filters' energy output improved the accuracy to 91.25% and 95.00%, respectively. While noise is quite common in all medical imaging modalities, the impact of noise on the applied texture measures was assessed as well. The developed lung and brain texture analysis techniques can improve the physician's ability to detect and analyse pathologies leading for a more reliable diagnosis and treatment of disease

Developing advanced mathematical models for detecting abnormalities in 2D/3D medical structures.

Detecting abnormalities in two-dimensional (2D) and three-dimensional (3D) medical structures is among the most interesting and challenging research areas in the medical imaging field. Obtaining the desired accurate automated quantification of abnormalities in medical structures is still very challenging. This is due to a large and constantly growing number of different objects of interest and associated abnormalities, large variations of their appearances and shapes in images, different medical imaging modalities, and associated changes of signal homogeneity and noise for each object. The main objective of this dissertation is to address these problems and to provide proper mathematical models and techniques that are capable of analyzing low and high resolution medical data and providing an accurate, automated analysis of the abnormalities in medical structures in terms of their area/volume, shape, and associated abnormal functionality. This dissertation presents different preliminary mathematical models and techniques that are applied in three case studies: (i) detecting abnormal tissue in the left ventricle (LV) wall of the heart from delayed contrast-enhanced cardiac magnetic resonance images (MRI), (ii) detecting local cardiac diseases based on estimating the functional strain metric from cardiac cine MRI, and (iii) identifying the abnormalities in the corpus callosum (CC) brain structure—the largest fiber bundle that connects the two hemispheres in the brain—for subjects that suffer from developmental brain disorders. For detecting the abnormal tissue in the heart, a graph-cut mathematical optimization model with a cost function that accounts for the object’s visual appearance and shape is used to segment the the inner cavity. The model is further integrated with a geometric model (i.e., a fast marching level set model) to segment the outer border of the myocardial wall (the LV). Then the abnormal tissue in the myocardium wall (also called dead tissue, pathological tissue, or infarct area) is identified based on a joint Markov-Gibbs random field (MGRF) model of the image and its region (segmentation) map that accounts for the pixel intensities and the spatial interactions between the pixels. Experiments with real in-vivo data and comparative results with ground truth (identified by a radiologist) and other approaches showed that the proposed framework can accurately detect the pathological tissue and can provide useful metrics for radiologists and clinicians. To estimate the strain from cardiac cine MRI, a novel method based on tracking the LV wall geometry is proposed. To achieve this goal, a partial differential equation (PDE) method is applied to track the LV wall points by solving the Laplace equation between the LV contours of each two successive image frames over the cardiac cycle. The main advantage of the proposed tracking method over traditional texture-based methods is its ability to track the movement and rotation of the LV wall based on tracking the geometric features of the inner, mid-, and outer walls of the LV. This overcomes noise sources that come from scanner and heart motion. To identify the abnormalities in the CC from brain MRI, the CCs are aligned using a rigid registration model and are segmented using a shape-appearance model. Then, they are mapped to a simple unified space for analysis. This work introduces a novel cylindrical mapping model, which is conformal (i.e., one to one transformation and bijective), that enables accurate 3D shape analysis of the CC in the cylindrical domain. The framework can detect abnormalities in all divisions of the CC (i.e., splenium, rostrum, genu and body). In addition, it offers a whole 3D analysis of the CC abnormalities instead of only area-based analysis as done by previous groups. The initial classification results based on the centerline length and CC thickness suggest that the proposed CC shape analysis is a promising supplement to the current techniques for diagnosing dyslexia. The proposed techniques in this dissertation have been successfully tested on complex synthetic and MR images and can be used to advantage in many of today’s clinical applications of computer-assisted medical diagnostics and intervention

Development of Imaging Mass Spectrometry Analysis of Lipids in Biological and Clinically Relevant Applications

La spectrométrie de masse mesure la masse des ions selon leur rapport masse sur charge. Cette technique est employée dans plusieurs domaines et peut analyser des mélanges complexes. L’imagerie par spectrométrie de masse (Imaging Mass Spectrometry en anglais, IMS), une branche de la spectrométrie de masse, permet l’analyse des ions sur une surface, tout en conservant l’organisation spatiale des ions détectés. Jusqu’à présent, les échantillons les plus étudiés en IMS sont des sections tissulaires végétales ou animales. Parmi les molécules couramment analysées par l’IMS, les lipides ont suscité beaucoup d'intérêt. Les lipides sont impliqués dans les maladies et le fonctionnement normal des cellules; ils forment la membrane cellulaire et ont plusieurs rôles, comme celui de réguler des événements cellulaires. Considérant l’implication des lipides dans la biologie et la capacité du MALDI IMS à les analyser, nous avons développé des stratégies analytiques pour la manipulation des échantillons et l’analyse de larges ensembles de données lipidiques. La dégradation des lipides est très importante dans l’industrie alimentaire. De la même façon, les lipides des sections tissulaires risquent de se dégrader. Leurs produits de dégradation peuvent donc introduire des artefacts dans l’analyse IMS ainsi que la perte d’espèces lipidiques pouvant nuire à la précision des mesures d’abondance. Puisque les lipides oxydés sont aussi des médiateurs importants dans le développement de plusieurs maladies, leur réelle préservation devient donc critique. Dans les études multi-institutionnelles où les échantillons sont souvent transportés d’un emplacement à l’autre, des protocoles adaptés et validés, et des mesures de dégradation sont nécessaires. Nos principaux résultats sont les suivants : un accroissement en fonction du temps des phospholipides oxydés et des lysophospholipides dans des conditions ambiantes, une diminution de la présence des lipides ayant des acides gras insaturés et un effet inhibitoire sur ses phénomènes de la conservation des sections au froid sous N2. A température et atmosphère ambiantes, les phospholipides sont oxydés sur une échelle de temps typique d’une préparation IMS normale (~30 minutes). Les phospholipides sont aussi décomposés en lysophospholipides sur une échelle de temps de plusieurs jours. La validation d’une méthode de manipulation d’échantillon est d’autant plus importante lorsqu’il s’agit d’analyser un plus grand nombre d’échantillons. L’athérosclérose est une maladie cardiovasculaire induite par l’accumulation de matériel cellulaire sur la paroi artérielle. Puisque l’athérosclérose est un phénomène en trois dimension (3D), l'IMS 3D en série devient donc utile, d'une part, car elle a la capacité à localiser les molécules sur la longueur totale d’une plaque athéromateuse et, d'autre part, car elle peut identifier des mécanismes moléculaires du développement ou de la rupture des plaques. l'IMS 3D en série fait face à certains défis spécifiques, dont beaucoup se rapportent simplement à la reconstruction en 3D et à l’interprétation de la reconstruction moléculaire en temps réel. En tenant compte de ces objectifs et en utilisant l’IMS des lipides pour l’étude des plaques d’athérosclérose d’une carotide humaine et d’un modèle murin d’athérosclérose, nous avons élaboré des méthodes «open-source» pour la reconstruction des données de l’IMS en 3D. Notre méthodologie fournit un moyen d’obtenir des visualisations de haute qualité et démontre une stratégie pour l’interprétation rapide des données de l’IMS 3D par la segmentation multivariée. L’analyse d’aortes d’un modèle murin a été le point de départ pour le développement des méthodes car ce sont des échantillons mieux contrôlés. En corrélant les données acquises en mode d’ionisation positive et négative, l’IMS en 3D a permis de démontrer une accumulation des phospholipides dans les sinus aortiques. De plus, l’IMS par AgLDI a mis en évidence une localisation différentielle des acides gras libres, du cholestérol, des esters du cholestérol et des triglycérides. La segmentation multivariée des signaux lipidiques suite à l’analyse par IMS d’une carotide humaine démontre une histologie moléculaire corrélée avec le degré de sténose de l’artère. Ces recherches aident à mieux comprendre la complexité biologique de l’athérosclérose et peuvent possiblement prédire le développement de certains cas cliniques. La métastase au foie du cancer colorectal (Colorectal cancer liver metastasis en anglais, CRCLM) est la maladie métastatique du cancer colorectal primaire, un des cancers le plus fréquent au monde. L’évaluation et le pronostic des tumeurs CRCLM sont effectués avec l’histopathologie avec une marge d’erreur. Nous avons utilisé l’IMS des lipides pour identifier les compartiments histologiques du CRCLM et extraire leurs signatures lipidiques. En exploitant ces signatures moléculaires, nous avons pu déterminer un score histopathologique quantitatif et objectif et qui corrèle avec le pronostic. De plus, par la dissection des signatures lipidiques, nous avons identifié des espèces lipidiques individuelles qui sont discriminants des différentes histologies du CRCLM et qui peuvent potentiellement être utilisées comme des biomarqueurs pour la détermination de la réponse à la thérapie. Plus spécifiquement, nous avons trouvé une série de plasmalogènes et sphingolipides qui permettent de distinguer deux différents types de nécrose (infarct-like necrosis et usual necrosis en anglais, ILN et UN, respectivement). L’ILN est associé avec la réponse aux traitements chimiothérapiques, alors que l’UN est associé au fonctionnement normal de la tumeur.Mass spectrometry is the measurement of the mass over charge ratio of ions. It is broadly applicable and capable of analyzing complex mixtures. Imaging mass spectrometry (IMS) is a branch of mass spectrometry that analyses ions across a surface while conserving their spatial organization on said surface. At this juncture, the most studied IMS samples are thin tissue sections from plants and animals. Among the molecules routinely imaged by IMS, lipids have generated significant interest. Lipids are important in disease and normal cell function as they form cell membranes and act as signaling molecules for cellular events among many other roles. Considering the potential of lipids in biological and clinical applications and the capability of MALDI to ionize lipids, we developed analytical strategies for the handling of samples and analysis of large lipid MALDI IMS datasets. Lipid degradation is massively important in the food industry with oxidized products producing a bad smell and taste. Similarly, lipids in thin tissue sections cut from whole tissues are subject to degradation, and their degradation products can introduce IMS artifacts and the loss of normally occurring species to degradation can skew accuracy in IMS measures of abundance. Oxidized lipids are also known to be important mediators in the progression of several diseases and their accurate preservation is critical. As IMS studies become multi-institutional and collaborations lead to sample exchange, the need for validated protocols and measures of degradation are necessary. We observed the products of lipid degradation in tissue sections from multiple mouse organs and reported on the conditions promoting and inhibiting their presence as well as the timeline of degradation. Our key findings were the increase in oxidized phospholipids and lysophospholipids from degradation at ambient conditions, the decrease in the presence of lipids containing unsaturations on their fatty acyl chains, and the inhibition of degradation by matrix coating and cold storage of sections under N2 atmosphere. At ambient atmospheric and temperature, lipids degraded into oxidized phospholipids on the time-scale of a normal IMS experiment sample preparation (within 30 min). Lipids then degraded into lysophospholipids’ on a time scale on the order of several days. Validation of sample handling is especially important when a greater number of samples are to be analyzed either through a cohort of samples, or analysis of multiple sections from a single tissue as in serial 3D IMS. Atherosclerosis is disease caused by accumulation of cellular material at the arterial wall. The accumulation implanted in the cell wall grows and eventually occludes the blood vessel, or causes a stroke. Atherosclerosis is a 3D phenomenon and serial 3D IMS is useful for its ability to localize molecules throughout the length of a plaque and help to define the molecular mechanisms of plaque development and rupture. Serial 3D IMS has many challenges, many of which are simply a matter of producing 3D reconstructions and interpreting them in a timely fashion. In this aim and using analysis of lipids from atherosclerotic plaques from a human carotid and mouse aortic sinuses, we described 3D reconstruction methods using open-source software. Our methodology provides means to obtain high quality visualizations and demonstrates strategies for rapid interpretation of 3D IMS datasets through multivariate segmentation. Mouse aorta from model animals provided a springboard for developing the methods on lower risk samples with less variation with interesting molecular results. 3D MALDI IMS showed localized phospholipid accumulation in the mouse aortic sinuses with correlation between separate positive and negative ionization datasets. Silver-assisted LDI imaging presented differential localization of free fatty acids, cholesterol / cholesterol esters, and triglycerides. The human carotid’s 3D segmentation shows molecular histologies (spatial groupings of imaging pixels with similar spectral fingerprints) correlating to the degree of arterial stenosis. Our results outline the potential for 3D IMS in atherosclerotic research. Molecular histologies and their 3D spatial organization, obtained from the IMS techniques used herein, may predict high-risk features, and particularly identify areas of plaque that have higher-risk of rupture. These investigations would help further unravel the biological complexities of atherosclerosis, and predict clinical outcomes. Colorectal cancer liver metastasis (CRCLM) is the metastatic disease of primary colorectal cancer, one of the most common cancers worldwide. CRC is a cancer of the endothelial lining of the colon or rectum. CRC itself is often cured with surgery, while CRCLM is more deadly and treated with chemotherapy with more limited efficacy. Prognosticating and assessment of tumors is performed using classical histopathology with a margin of error. We have used lipid IMS to identify the histological compartments and extract their signatures. Using these IMS signatures we obtained a quantitative and objective histopathological score that correlates with prognosis. Additionally, by dissecting out the lipid signatures we have identified single lipid moieties that are unique to different histologies that could potentially be used as new biomarkers for assessing response to therapy. Particularly, we found a series of plasmalogen and sphingolipid species that differentiate infarct-like and usual necrosis, typical of chemotherapeutic response and normal tumor function, respectively

A multi-technique hierarchical X-ray phase-based approach for the characterization and quantification of the effects of novel radiotherapies

Cancer is the first or second leading cause of premature deaths worldwide with an overall rapidly growing burden. Standard cancer therapies include surgery, chemotherapy and radiotherapy (RT) and often a combination of the three is applied to improve the probability of tumour control. Standard therapy protocols have been established for many types of cancers and new approaches are under study especially for treating radio-resistant tumours associated to an overall poor prognosis, as for brain and lung cancers. Follow up techniques able to monitor and investigate the effects of therapies are important for surveying the efficacy of conventionally applied treatments and are key for accessing the curing capabilities and the onset of acute and late adverse effects of new therapies. In this framework, this doctoral Thesis proposes the X-ray Phase Contrast Im-aging - Computed Tomography (XPCI-CT) technique as an imaging-based tool to study and quantify the effects of novel RTs, namely Microbeam and Minibeam Radiation therapy (MRT and MB), and to compare them to the standard Broad Beam (BB) induced effects on brain and lungs. MRT and MB are novel radiotherapies that deliver an array of spatially fractionated X-ray beamlets issued from a synchrotron radiation source, with widths of tens or hundreds of micrometres, respectively. MRT and MB exploit the so-called dose-volume effect: hundreds of Grays are well tolerated by healthy tissues and show a preferential effect on tumour cells and vasculature when delivered in a micrometric sized micro-plane, while induce lethal effects if applied over larger uniform irradiation fields. Such highly collimated X-ray beams need a high-resolution and a full-organ approach that can visualize, with high sensitivity, the effects of the treatment along and outside the beamlets path. XPCI-CT is here suggested and proven as a powerful imaging technique able to determine and quantify the effects of the radiation on normal and tumour-bearing tissues. Moreover, it is shown as an effective technique to complement, with 3D information, the histology findings in the follow-up of the RT treatments. Using a multi-scale and multi-technique X-ray-based approach, I have visualized and analysed the effects of RT delivery on healthy and glioblastoma multiforme (GBM)-bearing rat brains as well as on healthy rat lungs. Ex-vivo XPCI-CT datasets acquired with isotropic voxel sizes in the range 3.253 – 0.653 μm3 could distinguish, with high sensitivity, the idiopathic effects of MRT, MB and BB therapies. Histology, immunohistochemistry, Small- and Wide-Angle X-ray Scattering and X-ray Fluorescence experiments were also carried out to accurately interpret and complement the XPCI-CT findings as well as to obtain a detailed structural and chemical characterization of the detected pathological features. Overall, this multi-technique approach could detect: i) a different radio-sensitivity for the MRT-treated brain areas; ii) Ca and Fe deposits, hydroxyapatite crystals formation; iii) extended and isolated fibrotic contents. Full-organ XPCI-CT datasets allowed for the quantification of tumour and mi-crocalcifications’ volumes in treated brains and the amount of scarring tissue in irradiated lungs. Herein, the role of XPCI-CT as a 3D virtual histology technique for the follow-up of ex-vivo RT effects has been assessed as a complementary method for an accurate volumetric investigation of normal and pathological states in brains and lungs, in a small animal model. Moreover, the technique is proposed as a guidance and auxiliary tool for conventional histology, which is the gold standard for pathological evaluations, owing to its 3D capabilities and the possibility of virtually navigating within samples. This puts a landmark for XPCI-CT inclusion in the pre-clinical studies pipeline and for advancing towards in-vivo XPCI-CT imaging of treated organs.Weltweit gilt Krebs als häufigste bzw. zweithäufigste Ursache eines zu früh erfolgenden Todes, wobei die Zahlen rasch ansteigen. Standardmäßige Krebstherapien umfassen chirurgische Eingriffe, Chemotherapie und Strahlentherapie (radiotherapy, RT); oft kommt eine Kombination daraus zur Anwendung, um die Wahrscheinlichkeit der Tumorkontrolle zu erhöhen. Es wurden Standardtherapieprotokolle für zahlreiche Krebsarten eingerichtet und es wird vor allem in der Behandlung von strahlenresistenten Tumoren mit allgemein schlechter Prognose wie bei Hirn- und Lungentumoren an neuen Ansätzen geforscht. Nachverfolgungstechniken, welche die Auswirkungen von Therapien überwachen und ermitteln, sind zur Überwachung der Wirksamkeit herkömmlich angewandter Behandlungen wichtig und auch maßgeblich am Zugang zu den Fähigkeiten zur Heilung sowie zum Auftreten akuter und verzögerter Nebenwirkungen neuer Therapien beteiligt. In diesem Rahmenwerk unterbreitet diese Doktorarbeit die Technik der Röntgen-Phasenkontrast-Bildgebung über Computertomographie (X-ray Phase Contrast Imaging - Computed Tomography, XPCI‑CT) als bildverarbeitungs-basiertes Tool zur Untersuchung und Quantifizierung der Auswirkungen neuartiger Strahlentherapien, nämlich der Mikrobeam- und Minibeam-Strahlentherapie (MRT und MB), sowie zum Vergleich derselben mit den herkömmlichen durch Breitstrahlen (Broad Beam, BB) erzielten Auswirkungen auf Gehirn und Lunge. MRT und MB sind neuartige Strahlentherapien, die ein Array räumlich aufgeteilter Röntgenstrahlenbeamlets aus einer synchrotronen Strahlenquelle mit einer Breite von Zehnteln bzw. Hundersteln Mikrometern abgeben. MRT und MB nutzen den sogenannten Dosis-Volumen-Effekt: Hunderte Gray werden von gesundem Gewebe gut vertragen und wirken bei der Abgabe in einer Mikroebene im Mikrometerbereich vorrangig auf Tumorzellen und Blutgefäße, während sie bei einer Anwendung über größere gleichförmige Strahlungsfelder letale Auswirkungen aufweisen. Solche hoch kollimierten Röntgenstrahlen erfordern eine hohe Auflösung und einen Zugang zum gesamten Organ, bei dem die Auswirkungen der Behandlung entlang und außerhalb der Beamletpfade mit hoher Empfindlichkeit visualisiert werden können. Hier empfiehlt und bewährt sich die XPCI‑CT als leistungsstarke Bildverarbeitungstechnik, welche die Auswirkungen der Strahlung auf normale und tumortragende Gewebe feststellen und quantifizieren kann. Außerdem hat sich gezeigt, dass sie durch 3‑D-Informationen eine effektive Technik zur Ergänzung der histologischen Erkenntnisse in der Nachverfolgung der Strahlenbehandlung ist. Anhand eines mehrstufigen und multitechnischen röntgenbasierten Ansatzes habe ich die Auswirkungen der Strahlentherapie auf gesunde und von Glioblastomen (GBM) befallene Rattenhirne sowie auf gesunde Rattenlungen visualisiert und analysiert. Mit isotropen Voxelgrößen im Bereich von 3,53 bis 0,653 μm3 erfasste Ex-vivo-XPCI-CT-Datensätze konnten die idiopathischen Auswirkungen der MRT-, MB- und BB‑Behandlung mit hoher Empfindlichkeit unterscheiden. Es wurden auch Experimente zu Histologie, Immunhistochemie, Röntgenklein- und ‑weitwinkelstreuung und Röntgenfluoreszenz durchgeführt, um die XPCI‑CT-Erkenntnisse präzise zu interpretieren und zu ergänzen sowie eine detaillierte strukturelle und chemische Charakterisierung der nachgewiesenen pathologischen Merkmale zu erhalten. Im Allgemeinen wurde durch diesen multitechnischen Ansatz Folgendes ermittelt: i) eine un-terschiedliche Strahlenempfindlichkeit der mit MRT behandelten Gehirnbereiche; ii) Ca- und Fe-Ablagerungen und die Bildung von Hydroxylapatitkristallen; iii) ein ausgedehnter und isolierter Fibrosegehalt. XPCI‑CT-Datensätze des gesamten Organs ermöglichten die Quantifizierung der Volume von Tumoren und Mikroverkalkungen in den behandelten Gehirnen und der Menge des Narbengewebes in bestrahlten Lungen. Dabei wurde die Rolle der XPCI‑CT als virtuelle 3‑D-Histologietechnik für die Nachverfolgung von Ex-vivo-RT‑Auswirkungen als ergänzende Methode für eine präzise volumetrische Untersuchung des normalen und pathologischen Zustands von Gehirnen und Lungen im Kleintiermodell untersucht. Darüber hinaus wird die Technik aufgrund ihrer 3‑D-Fähigkeiten und der Möglichkeit zur virtuellen Navigation in den Proben als Leitfaden und Hilfstool für die herkömmliche Histologie vorgeschlagen, die der Goldstandard für die pathologische Evaluierung ist. Dies markiert einen Meilenstein für die Übernahme der XPCI‑CT in die Pipeline präklinischer Studien und für den Übergang zur In-vivo-XPCI‑CT von behandelten Organen

Deep Reinforcement Learning in Medical Object Detection and Segmentation

Medical object detection and segmentation are crucial pre-processing steps in the clinical workflow for diagnosis and therapy planning. Although deep learning methods have achieved considerable performance in this field, they impose several shortcomings, such as computational limitations, sub-optimal parameter optimization, and weak generalization. Deep reinforcement learning as the newest artificial intelligence algorithm has great potential to address the limitation of traditional deep learning methods, as well as obtaining accurate detection and segmentation results. Deep reinforcement learning has a cognitive-like process to propose the area of desirable objects, thereby facilitating accurate object detection and segmentation. In this thesis, we deploy deep reinforcement learning into two challenging and representative medical object detection and segmentation tasks: 1) Sequential-Conditional Reinforcement Learning (SCRL) for vertebral body detection and segmentation by modeling the spine anatomy with deep reinforcement learning; 2) Weakly-Supervised Teacher-Student network (WSTS) for liver tumor segmentation from the non-enhanced image by transferring tumor knowledge from the enhanced image with deep reinforcement learning. The experiment indicates our methods are effective and outperform state-of-art deep learning methods. Therefore, this thesis improves object detection and segmentation accuracy and offers researchers a novel approach based on deep reinforcement learning in medical image analysis

Image analytic tools for tissue characterization using optical coherence tomography

Optical coherence tomography (OCT) has been emerging as a promising imaging technique, with a strong capability of non-invasive, in vivo, high resolution, depth-resolved imaging. There is a great potential to use OCT to guide the treatment of arrhythmias, to prevent preterm birth, and to detect breast cancer. To facilitate the clinical applications, this thesis presents three image analytic tools to characterize biological tissue: 1) automated fiber direction analysis; 2) automated volumetric stitching; 3) automated tissue classification. The fiber direction analysis consists of a particle-filter-based 3D tractography scheme and a pixel-wise fiber analysis scheme. The stitching algorithm enlarges the field of view of current OCT system from millimeter to centimeter level by volumetric stitching using scale-invariant feature transform. Based on relevance vector machine, a region-based classification scheme and a grid-based classification scheme are developed to automatically identify tissue composition in human cardiac tissue and human breast tissue. These tools are collaboratively used to study OCT images from cardiac, cervical, and breast tissue. In cardiac tissue, we apply the fiber orientation analysis to reconstruct 3D cardiac myofibers tractography and perform pixel-wise fiber analysis on the collagen region within human heart. In addition, we apply the region-based algorithm to segment and classify tissue compositions, such as collagen, adipose tissue, fibrotic myocardium, and normal myocardium, over a single or a stitched OCT volume. Using our algorithm, we observe fiber directionality change over depths and find that the fiber orientation changes more dramatically in atria than in ventricle. We also observe different dispersion patterns within collagen layer. In cervical tissue, our stitching algorithm enables a paramount 3D view of entire axial slices. Together with pixel-wise fiber orientation scheme, we analyze the difference of dispersion property within inner/outer regions of four quadrants. We observe two dispersion patterns in pregnant and non-pregnant cervical tissue at the location close to upper cervix. In addition, we discover that an increasing trend of dispersion and an increasing trend of penetration depth from internal orifice (os) to external os. In breast tissue, we visualize various features in both benign and malignant tissues such as invasive ductal carcinoma (IDC), ductal carcinoma in situ, cyst, and terminal duct lobule unit in stitched OCT images. Focusing on the automated detection of IDC, we propose a hierarchy framework of classification model and apply our classifier in two OCT systems and achieve both reasonable sensitivity and specificity in identifying cancerous region

Development of an image guidance system for laparoscopic liver surgery and evaluation of optical and computer vision techniques for the assessment of liver tissue

Introduction: Liver resection is increasingly being carried out via the laparoscopic approach (keyhole surgery) because there is mounting evidence that it benefits patients by reducing pain and length of hospitalisation. There are however ongoing concerns about oncological radicality (i.e. ability to completely remove cancer) and an inability to control massive haemorrhage. These issues can partially be attributed to a loss of sensation such as depth perception, tactile feedback and a reduced field of view. Utilisation of optical imaging and computer vision may be able to compensate for some of the lost sensory input because these modalities can facilitate visualisation of liver tissue and structural anatomy. Their use in laparoscopy is attractive because it is easy to adapt or integrate with existing technology. The aim of this thesis is to explore to what extent this technology can aid in the detection of normal and abnormal liver tissue and structures. / Methods: The current state of the art for optical imaging and computer vision in laparoscopic liver surgery is assessed in a systematic review. Evaluation of confocal laser endomicroscopy is carried out on a murine and porcine model of liver disease. Multispectral near infrared imaging is evaluated on ex-vivo liver specimen. Video magnification is assessed on a mechanical flow phantom and a porcine model of liver disease. The latter model was also employed to develop a computer vision based image guidance system for laparoscopic liver surgery. This image guidance system is further evaluated in a clinical feasibility study. Where appropriate, experimental findings are substantiated with statistical analysis. / Results: Use of confocal laser endomicroscopy enabled discrimination between cancer and normal liver tissue with a sub-millimetre precision. This technology also made it possible to verify the adequacy of thermal liver ablation. Multispectral imaging, at specific wavelengths was shown to have the potential to highlight the presence of colorectal and hepatocellular cancer. An image reprocessing algorithm is proposed to simplify visual interpretation of the resulting images. It is shown that video magnification can determine the presence of pulsatile motion but that it cannot reliably determine the extent of motion. Development and performance metrics of an image guidance system for laparoscopic liver surgery are outlined. The system was found to improve intraoperative orientation more development work is however required to enable reliable prediction of oncological margins. / Discussion: The results in this thesis indicate that confocal laser endomicroscopy and image guidance systems have reached a development stage where their intraoperative use may benefit surgeons by visualising features of liver anatomy and tissue characteristics. Video magnification and multispectral imaging require more development and suggestions are made to direct this work. It is also highlighted that it is crucial to standardise assessment methods for these technologies which will allow a more direct comparison between the outcomes of different groups. Limited imaging depth is a major restriction of these technologies but this may be overcome by combining them with preoperatively obtained imaging data. Just like laparoscopy, optical imaging and computer vision use functions of light, a shared characteristic that makes their combined use complementary