Synergistic Visualization And Quantitative Analysis Of Volumetric Medical Images

The medical diagnosis process starts with an interview with the patient, and continues with the physical exam. In practice, the medical professional may require additional screenings to precisely diagnose. Medical imaging is one of the most frequently used non-invasive screening methods to acquire insight of human body. Medical imaging is not only essential for accurate diagnosis, but also it can enable early prevention. Medical data visualization refers to projecting the medical data into a human understandable format at mediums such as 2D or head-mounted displays without causing any interpretation which may lead to clinical intervention. In contrast to the medical visualization, quantification refers to extracting the information in the medical scan to enable the clinicians to make fast and accurate decisions. Despite the extraordinary process both in medical visualization and quantitative radiology, efforts to improve these two complementary fields are often performed independently and synergistic combination is under-studied. Existing image-based software platforms mostly fail to be used in routine clinics due to lack of a unified strategy that guides clinicians both visually and quan- titatively. Hence, there is an urgent need for a bridge connecting the medical visualization and automatic quantification algorithms in the same software platform. In this thesis, we aim to fill this research gap by visualizing medical images interactively from anywhere, and performing a fast, accurate and fully-automatic quantification of the medical imaging data. To end this, we propose several innovative and novel methods. Specifically, we solve the following sub-problems of the ul- timate goal: (1) direct web-based out-of-core volume rendering, (2) robust, accurate, and efficient learning based algorithms to segment highly pathological medical data, (3) automatic landmark- ing for aiding diagnosis and surgical planning and (4) novel artificial intelligence algorithms to determine the sufficient and necessary data to derive large-scale problems

Multimodal optical systems for clinical oncology

This thesis presents three multimodal optical (light-based) systems designed to improve the capabilities of existing optical modalities for cancer diagnostics and theranostics. Optical diagnostic and therapeutic modalities have seen tremendous success in improving the detection, monitoring, and treatment of cancer. For example, optical spectroscopies can accurately distinguish between healthy and diseased tissues, fluorescence imaging can light up tumours for surgical guidance, and laser systems can treat many epithelial cancers. However, despite these advances, prognoses for many cancers remain poor, positive margin rates following resection remain high, and visual inspection and palpation remain crucial for tumour detection. The synergistic combination of multiple optical modalities, as presented here, offers a promising solution. The first multimodal optical system (Chapter 3) combines Raman spectroscopic diagnostics with photodynamic therapy using a custom-built multimodal optical probe. Crucially, this system demonstrates the feasibility of nanoparticle-free theranostics, which could simplify the clinical translation of cancer theranostic systems without sacrificing diagnostic or therapeutic benefit. The second system (Chapter 4) applies computer vision to Raman spectroscopic diagnostics to achieve spatial spectroscopic diagnostics. It provides an augmented reality display of the surgical field-of-view, overlaying spatially co-registered spectroscopic diagnoses onto imaging data. This enables the translation of Raman spectroscopy from a 1D technique to a 2D diagnostic modality and overcomes the trade-off between diagnostic accuracy and field-of-view that has limited optical systems to date. The final system (Chapter 5) integrates fluorescence imaging and Raman spectroscopy for fluorescence-guided spatial spectroscopic diagnostics. This facilitates macroscopic tumour identification to guide accurate spectroscopic margin delineation, enabling the spectroscopic examination of suspicious lesions across large tissue areas. Together, these multimodal optical systems demonstrate that the integration of multiple optical modalities has potential to improve patient outcomes through enhanced tumour detection and precision-targeted therapies.Open Acces

SwinCross: Cross-modal Swin Transformer for Head-and-Neck Tumor Segmentation in PET/CT Images

Radiotherapy (RT) combined with cetuximab is the standard treatment for patients with inoperable head and neck cancers. Segmentation of head and neck (H&N) tumors is a prerequisite for radiotherapy planning but a time-consuming process. In recent years, deep convolutional neural networks have become the de facto standard for automated image segmentation. However, due to the expensive computational cost associated with enlarging the field of view in DCNNs, their ability to model long-range dependency is still limited, and this can result in sub-optimal segmentation performance for objects with background context spanning over long distances. On the other hand, Transformer models have demonstrated excellent capabilities in capturing such long-range information in several semantic segmentation tasks performed on medical images. Inspired by the recent success of Vision Transformers and advances in multi-modal image analysis, we propose a novel segmentation model, debuted, Cross-Modal Swin Transformer (SwinCross), with cross-modal attention (CMA) module to incorporate cross-modal feature extraction at multiple resolutions.To validate the effectiveness of the proposed method, we performed experiments on the HECKTOR 2021 challenge dataset and compared it with the nnU-Net (the backbone of the top-5 methods in HECKTOR 2021) and other state-of-the-art transformer-based methods such as UNETR, and Swin UNETR. The proposed method is experimentally shown to outperform these comparing methods thanks to the ability of the CMA module to capture better inter-modality complimentary feature representations between PET and CT, for the task of head-and-neck tumor segmentation.Comment: 9 pages, 3 figures. Med Phys. 202

NeuroEconomics

Over the last two years a research field has developed under the banner of 'neuroeconomics' in which recent neuroscientific methods are deploid to analyze economically relevant processes. This paper aims to provide an overview of the methodology and current state of neuroeconomic research by giving a brief definition of the concept of neuroeconomics, outlining relevant methodologies, and describing studies undertaken in the current research areas to date. Finally, some future prospects are considered.

Deep learning for cardiac image segmentation: A review

Deep learning has become the most widely used approach for cardiac image segmentation in recent years. In this paper, we provide a review of over 100 cardiac image segmentation papers using deep learning, which covers common imaging modalities including magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound (US) and major anatomical structures of interest (ventricles, atria and vessels). In addition, a summary of publicly available cardiac image datasets and code repositories are included to provide a base for encouraging reproducible research. Finally, we discuss the challenges and limitations with current deep learning-based approaches (scarcity of labels, model generalizability across different domains, interpretability) and suggest potential directions for future research

Exploring the applicability of machine learning based artificial intelligence in the analysis of cardiovascular imaging

Worldwide, the prevalence of cardiovascular diseases has doubled, demanding new diagnostic tools. Artificial intelligence, especially machine learning and deep learning, offers innovative possibilities for medical research. Despite historical challenges, such as a lack of data, these techniques have potential for cardiovascular research. This thesis explores the application of machine learning and deep learning in cardiology, focusing on automation and decision support in cardiovascular imaging.Part I of this thesis focuses on automating cardiovascular MRI analysis. A deep learning model was developed to analyze the ascending aorta in cardiovascular MRI images. The model's results were used to investigate connections between genetic material and aortic properties, and between aortic properties and cardiovascular diseases and mortality. A second model was developed to select MRI images suitable for analyzing the pulmonary artery.Part II focuses on decision support in nuclear cardiovascular imaging. A first machine learning model was developed to predict myocardial ischemia based on CTA variables. In addition, a deep neural network was used to identify reduced oxygen supply through the arteries supplying oxygen-rich blood to the heart and cardiovascular risk features using PET images.This thesis successfully explores the possibilities of machine learning and deep learning in cardiovascular research, with a focus on automated analysis and decision support

Deep Learning in Radiation Oncology Treatment Planning for Prostate Cancer: A Systematic Review

Radiation oncology for prostate cancer is important as it can decrease the morbidity and mortality associated with this disease. Planning for this modality of treatment is both fundamental, time-consuming and prone to human-errors, leading to potentially avoidable delays in start of treatment. A fundamental step in radiotherapy planning is contouring of radiation targets, where medical specialists contouring, i.e., segment, the boundaries of the structures to be irradiated. Automating this step can potentially lead to faster treatment planning without a decrease in quality, while increasing time available to physicians and also more consistent treatment results. This can be framed as an image segmentation task, which has been studied for many decades in the fields of Computer Vision and Machine Learning. With the advent of Deep Learning, there have been many proposals for different network architectures achieving high performance levels. In this review, we searched the literature for those methods and describe them briefly, grouping those based on Computed Tomography (CT) or Magnetic Resonance Imaging (MRI). This is a booming field, evidenced by the date of the publications found. However, most publications use data from a very limited number of patients, which presents an obstacle to deep learning models training. Although the performance of the models has achieved very satisfactory results, there is still room for improvement, and there is arguably a long way before these models can be used safely and effectively in clinical practice. (c) 2020, Springer Science+Business Media, LLC, part of Springer Nature

Exploring the applicability of machine learning based artificial intelligence in the analysis of cardiovascular imaging

Worldwide, the prevalence of cardiovascular diseases has doubled, demanding new diagnostic tools. Artificial intelligence, especially machine learning and deep learning, offers innovative possibilities for medical research. Despite historical challenges, such as a lack of data, these techniques have potential for cardiovascular research. This thesis explores the application of machine learning and deep learning in cardiology, focusing on automation and decision support in cardiovascular imaging.Part I of this thesis focuses on automating cardiovascular MRI analysis. A deep learning model was developed to analyze the ascending aorta in cardiovascular MRI images. The model's results were used to investigate connections between genetic material and aortic properties, and between aortic properties and cardiovascular diseases and mortality. A second model was developed to select MRI images suitable for analyzing the pulmonary artery.Part II focuses on decision support in nuclear cardiovascular imaging. A first machine learning model was developed to predict myocardial ischemia based on CTA variables. In addition, a deep neural network was used to identify reduced oxygen supply through the arteries supplying oxygen-rich blood to the heart and cardiovascular risk features using PET images.This thesis successfully explores the possibilities of machine learning and deep learning in cardiovascular research, with a focus on automated analysis and decision support