Medical imaging analysis with artificial neural networks

Given that neural networks have been widely reported in the research community of medical imaging, we provide a focused literature survey on recent neural network developments in computer-aided diagnosis, medical image segmentation and edge detection towards visual content analysis, and medical image registration for its pre-processing and post-processing, with the aims of increasing awareness of how neural networks can be applied to these areas and to provide a foundation for further research and practical development. Representative techniques and algorithms are explained in detail to provide inspiring examples illustrating: (i) how a known neural network with fixed structure and training procedure could be applied to resolve a medical imaging problem; (ii) how medical images could be analysed, processed, and characterised by neural networks; and (iii) how neural networks could be expanded further to resolve problems relevant to medical imaging. In the concluding section, a highlight of comparisons among many neural network applications is included to provide a global view on computational intelligence with neural networks in medical imaging

Deep Learning for Classification of Brain Tumor Histopathological Images

Histopathological image classification has been at the forefront of medical research. We evaluated several deep and non-deep learning models for brain tumor histopathological image classification. The challenges were characterized by an insufficient amount of training data and identical glioma features. We employed transfer learning to tackle these challenges. We also employed some state-of-the-art non-deep learning classifiers on histogram of gradient features extracted from our images, as well as features extracted using CNN activations. Data augmentation was utilized in our study. We obtained an 82% accuracy with DenseNet-201 as our best for the deep learning models and an 83.8% accuracy with ANN for the non-deep learning classifiers. The average of the diagonals of the confusion matrices for each model was calculated as their accuracy. The performance metrics criteria in this study are our model’s precision in classifying each class and their average classification accuracy. Our result emphasizes the significance of deep learning as an invaluable tool for histopathological image studies

Multimodality carotid plaque tissue characterization and classification in the artificial intelligence paradigm: a narrative review for stroke application

Cardiovascular disease (CVD) is one of the leading causes of morbidity and mortality in the United States of America and globally. Carotid arterial plaque, a cause and also a marker of such CVD, can be detected by various non-invasive imaging modalities such as magnetic resonance imaging (MRI), computer tomography (CT), and ultrasound (US). Characterization and classification of carotid plaque-type in these imaging modalities, especially into symptomatic and asymptomatic plaque, helps in the planning of carotid endarterectomy or stenting. It can be challenging to characterize plaque components due to (I) partial volume effect in magnetic resonance imaging (MRI) or (II) varying Hausdorff values in plaque regions in CT, and (III) attenuation of echoes reflected by the plaque during US causing acoustic shadowing. Artificial intelligence (AI) methods have become an indispensable part of healthcare and their applications to the non-invasive imaging technologies such as MRI, CT, and the US. In this narrative review, three main types of AI models (machine learning, deep learning, and transfer learning) are analyzed when applied to MRI, CT, and the US. A link between carotid plaque characteristics and the risk of coronary artery disease is presented. With regard to characterization, we review tools and techniques that use AI models to distinguish carotid plaque types based on signal processing and feature strengths. We conclude that AI-based solutions offer an accurate and robust path for tissue characterization and classification for carotid artery plaque imaging in all three imaging modalities. Due to cost, user-friendliness, and clinical effectiveness, AI in the US has dominated the most

Design and development of optical reflectance spectroscopy and optical coherence tomography catheters for myocardial tissue characterization

Catheter ablation therapy attempts to restore sinus rhythm in arrhythmia patients by producing site-specific tissue modification along regions which cause abnormal electrical activity. This treatment, though widely used, often requires repeat procedures to observe long-term therapeutic benefits. This limitation is driven in part by challenges faced by conventional schemes in validating lesion adequacy at the time of the procedure. Optical techniques are well-suited for the interrogation and characterization of biological tissues. In particular, optical coherence tomography (OCT) relies on coherence gating of singly-scattered light to enable high-resolution structural imaging for tissue diagnostics and procedural guidance. Alternatively, optical reflectance spectroscopy (ORS) is a point measurement technique which makes use of incoherent, multiply-scattered light to probe tissue volumes and derive important data from its optical signature. ORS relies on the fact that light-tissue interactions are regulated by absorption and scattering, which directly relate to the intrinsic tissue biochemistry and cellular organization. In this thesis, we explore the integration of these modalities into ablation catheters for obtaining procedural metrics which could be utilized to guide catheter ablation therapy. We first present the development of an accelerated computational light transport model and its application for guiding ORS catheter design. A custom ORS-integrated ablation catheter is then implemented and tested within porcine specimens in vitro. A model is proposed for real-time estimation of lesion size based on changes in spectral morphology acquired during ablation. We then fabricated custom integrated OCT M-mode RF catheters and present a model for detecting contact status based on deep convolutional neural networks trained on endomyocardial images. Additionally, we demonstrate for the first time, tracking of RF-induced lesion formation employing OCT Doppler micro-velocimetry; this response is shown to be commensurate with the degree of treatment. We further demonstrate for the first time spectroscopic tracking of kinetics related to the heme oxidation cascade during thermal treatment, which are linked to tissue denaturation. The pairing of these modalities into a single RF catheter was also validated for guiding lesion delivery in vitro and within live pigs. Finally, we conclude with a proof-of-concept demonstration of ORS as a mapping tool to guide epicardial ablation in human donor hearts. These results showcase the vast potential of ORS and OCT empowered RF catheters for aiding intraprocedural guidance of catheter ablation procedures which could be utilized alongside current practices

AI in Medical Imaging Informatics: Current Challenges and Future Directions

This paper reviews state-of-the-art research solutions across the spectrum of medical imaging informatics, discusses clinical translation, and provides future directions for advancing clinical practice. More specifically, it summarizes advances in medical imaging acquisition technologies for different modalities, highlighting the necessity for efficient medical data management strategies in the context of AI in big healthcare data analytics. It then provides a synopsis of contemporary and emerging algorithmic methods for disease classification and organ/ tissue segmentation, focusing on AI and deep learning architectures that have already become the de facto approach. The clinical benefits of in-silico modelling advances linked with evolving 3D reconstruction and visualization applications are further documented. Concluding, integrative analytics approaches driven by associate research branches highlighted in this study promise to revolutionize imaging informatics as known today across the healthcare continuum for both radiology and digital pathology applications. The latter, is projected to enable informed, more accurate diagnosis, timely prognosis, and effective treatment planning, underpinning precision medicine

Linking quantitative radiology to molecular mechanism for improved vascular disease therapy selection and follow-up

Objective: Therapeutic advancements in atherosclerotic cardiovascular disease have improved the prevention of ischemic stroke and myocardial infarction. However, diagnostic methods for atherosclerotic plaque phenotyping to aid individualized therapy are lacking. In this thesis, we aimed to elucidate plaque biology through the analysis of computed-tomography angiography (CTA) with sufficient sensitivity and specificity to capture the differentiated drivers of the disease. We then aimed to use such data to calibrate a systems biology model of atherosclerosis with adequate granularity to be clinically relevant. Such development may be possible with computational modeling, but given, the multifactorial biology of atherosclerosis, modeling must be based on complete biological networks that capture protein-protein interactions estimated to drive disease progression. Approach and Results: We employed machine intelligence using CTA paired with a molecular assay to determine cohort-level associations and individual patient predictions. Examples of predicted transcripts included ion transporters, cytokine receptors, and a number of microRNAs. Pathway analyses elucidated enrichment of several biological processes relevant to atherosclerosis and plaque pathophysiology. The ability of the models to predict plaque gene expression from CTAs was demonstrated using sequestered patients with transcriptomes of corresponding lesions. We further performed a case study exploring the relationship between biomechanical quantities and plaque morphology, indicating the ability to determine stress and strain from tissue characteristics. Further, we used a uniquely constituted plaque proteomic dataset to create a comprehensive systems biology disease model, which was finally used to simulate responses to different drug categories in individual patients. Individual patient response was simulated for intensive lipid-lowering, anti-inflammatory drugs, anti-diabetic, and combination therapy. Plaque tissue was collected from 18 patients with 6735 proteins at two locations per patient. 113 pathways were identified and included in the systems biology model of endothelial cells, vascular smooth muscle cells, macrophages, lymphocytes, and the integrated intima, altogether spanning 4411 proteins, demonstrating a range of 39-96% plaque instability. Simulations of drug responses varied in patients with initially unstable lesions from high (20%, on combination therapy) to marginal improvement, whereas patients with initially stable plaques showed generally less improvement, but importantly, variation across patients. Conclusion: The results of this thesis show that atherosclerotic plaque phenotyping by multi-scale image analysis of conventional CTA can elucidate the molecular signatures that reflect atherosclerosis. We further showed that calibrated system biology models may be used to simulate drug response in terms of atherosclerotic plaque instability at the individual level, providing a potential strategy for improved personalized management of patients with cardiovascular disease. These results hold promise for optimized and personalized therapy in the prevention of myocardial infarction and ischemic stroke, which warrants further investigations in larger cohorts

Optical Diagnostics in Human Diseases

Optical technologies provide unique opportunities for the diagnosis of various pathological disorders. The range of biophotonics applications in clinical practice is considerably wide given that the optical properties of biological tissues are subject to significant changes during disease progression. Due to the small size of studied objects (from μm to mm) and despite some minimum restrictions (low-intensity light is used), these technologies have great diagnostic potential both as an additional tool and in cases of separate use, for example, to assess conditions affecting microcirculatory bed and tissue viability. This Special Issue presents topical articles by researchers engaged in the development of new methods and devices for optical non-invasive diagnostics in various fields of medicine. Several studies in this Special Issue demonstrate new information relevant to surgical procedures, especially in oncology and gynecology. Two articles are dedicated to the topical problem of breast cancer early detection, including during surgery. One of the articles is devoted to urology, namely to the problem of chronic or recurrent episodic urethral pain. Several works describe the studies in otolaryngology and dentistry. One of the studies is devoted to diagnosing liver diseases. A number of articles contribute to the studying of the alterations caused by diabetes mellitus and cardiovascular diseases. The results of all the presented articles reflect novel innovative research and emerging ideas in optical non-invasive diagnostics aimed at their wider translation into clinical practice

AI slipping on tiles: data leakage in digital pathology

Reproducibility of AI models on biomedical data still stays as a major concern for their acceptance into the clinical practice. Initiatives for reproducibility in the development of predictive biomarkers as the MAQC Consortium already underlined the importance of appropriate Data Analysis Plans (DAPs) to control for different types of bias, including data leakage from the training to the test set. In the context of digital pathology, the leakage typically lurks in weakly designed experiments not accounting for the subjects in their data partitioning schemes. This issue is then exacerbated when fractions or subregions of slides (i.e. "tiles") are considered. Despite this aspect is largely recognized by the community, we argue that it is often overlooked. In this study, we assess the impact of data leakage on the performance of machine learning models trained and validated on multiple histology data collection. We prove that, even with a properly designed DAP (10x5 repeated cross-validation), predictive scores can be inflated up to 41% when tiles from the same subject are used both in training and validation sets by deep learning models. We replicate the experiments for $4$ classification tasks on 3 histopathological datasets, for a total of 374 subjects, 556 slides and more than 27,000 tiles. Also, we discuss the effects of data leakage on transfer learning strategies with models pre-trained on general-purpose datasets or off-task digital pathology collections. Finally, we propose a solution that automates the creation of leakage-free deep learning pipelines for digital pathology based on histolab, a novel Python package for histology data preprocessing. We validate the solution on two public datasets (TCGA and GTEx)