A new framework for the integrative analytics of intravascular ultrasound and optical coherence tomography images

Abstract:The integrative analysis of multimodal medical images plays an important role in the diagnosis of coronary artery disease by providing additional comprehensive information that cannot be found in an individual source image. Intravascular ultrasound (IVUS) and optical coherence tomography (IV-OCT) are two imaging modalities that have been widely used in the medical practice for the assessment of arterial health and the detection of vascular lumen lesions. IV-OCT has a high resolution and poor penetration, while IVUS has a low resolution and high detection depth. This paper proposes a new approach for the fusion of intravascular ultrasound and optical coherence tomography pullbacks to significantly improve the use of those two types of medical images. It also presents a new two-phase multimodal fusion framework using a coarse-to-fine registration and a wavelet fusion method. In the coarse-registration process, we define a set of new feature points to match the IVUS image and IV-OCT image. Then, the improved quality image is obtained based on the integration of the mutual information of two types of images. Finally, the matched registered images are fused with an approach based on the new proposed wavelet algorithm. The experimental results demonstrate the performance of the proposed new approach for significantly enhancing both the precision and computational stability. The proposed approach is shown to be promising for providing additional information to enhance the diagnosis and enable a deeper understanding of atherosclerosis

Deep Learning in Cardiology

The medical field is creating large amount of data that physicians are unable to decipher and use efficiently. Moreover, rule-based expert systems are inefficient in solving complicated medical tasks or for creating insights using big data. Deep learning has emerged as a more accurate and effective technology in a wide range of medical problems such as diagnosis, prediction and intervention. Deep learning is a representation learning method that consists of layers that transform the data non-linearly, thus, revealing hierarchical relationships and structures. In this review we survey deep learning application papers that use structured data, signal and imaging modalities from cardiology. We discuss the advantages and limitations of applying deep learning in cardiology that also apply in medicine in general, while proposing certain directions as the most viable for clinical use.Comment: 27 pages, 2 figures, 10 table

A clustering based transfer function for volume rendering using gray-gradient mode histogram

Volume rendering is an emerging technique widely used in the medical field to visualize human organs using tomography image slices. In volume rendering, sliced medical images are transformed into attributes, such as color and opacity through transfer function. Thus, the design of the transfer function directly affects the result of medical images visualization. A well-designed transfer function can improve both the image quality and visualization speed. In one of our previous paper, we designed a multi-dimensional transfer function based on region growth to determine the transparency of a voxel, where both gray threshold and gray change threshold are used to calculate the transparency. In this paper, a new approach of the transfer function is proposed based on clustering analysis of gray-gradient mode histogram, where volume data is represented in a two-dimensional histogram. Clustering analysis is carried out based on the spatial information of volume data in the histogram, and the transfer function is automatically generated by means of clustering analysis of the spatial information. The dataset of human thoracic is used in our experiment to evaluate the performance of volume rendering using the proposed transfer function. By comparing with the original transfer function implemented in two popularly used volume rendering systems, visualization toolkit (VTK) and RadiAnt DICOM Viewer, the effectiveness and performance of the proposed transfer function are demonstrated in terms of the rendering efficiency and image quality, where more accurate and clearer features are presented rather than a blur red area. Furthermore, the complex operations on the two-dimensional histogram are avoided in our proposed approach and more detailed information can be seen from our final visualized image

AI in Medical Imaging Informatics: Current Challenges and Future Directions

This paper reviews state-of-the-art research solutions across the spectrum of medical imaging informatics, discusses clinical translation, and provides future directions for advancing clinical practice. More specifically, it summarizes advances in medical imaging acquisition technologies for different modalities, highlighting the necessity for efficient medical data management strategies in the context of AI in big healthcare data analytics. It then provides a synopsis of contemporary and emerging algorithmic methods for disease classification and organ/ tissue segmentation, focusing on AI and deep learning architectures that have already become the de facto approach. The clinical benefits of in-silico modelling advances linked with evolving 3D reconstruction and visualization applications are further documented. Concluding, integrative analytics approaches driven by associate research branches highlighted in this study promise to revolutionize imaging informatics as known today across the healthcare continuum for both radiology and digital pathology applications. The latter, is projected to enable informed, more accurate diagnosis, timely prognosis, and effective treatment planning, underpinning precision medicine

A Pharmaceutical Paradigm for Cardiovascular Composite Risk Assessment Using Novel Radiogenomics Risk Predictors in Precision Explainable Artificial Intelligence Framework: Clinical Trial Tool

Background: Cardiovascular disease (CVD) is challenging to diagnose and treat since symptoms appear late during the progression of atherosclerosis. Conventional risk factors alone are not always sufficient to properly categorize at-risk patients, and clinical risk scores are inadequate in predicting cardiac events. Integrating genomic-based biomarkers (GBBM) found in plasma/serum samples with novel non-invasive radiomics-based biomarkers (RBBM) such as plaque area, plaque burden, and maximum plaque height can improve composite CVD risk prediction in the pharmaceutical paradigm. These biomarkers consider several pathways involved in the pathophysiology of atherosclerosis disease leading to CVD. Objective: This review proposes two hypotheses: (i) The composite biomarkers are strongly correlated and can be used to detect the severity of CVD/Stroke precisely, and (ii) an explainable artificial intelligence (XAI)-based composite risk CVD/Stroke model with survival analysis using deep learning (DL) can predict in preventive, precision, and personalized (aiP 3 ) framework benefiting the pharmaceutical paradigm. Method: The PRISMA search technique resulted in 214 studies assessing composite biomarkers using radiogenomics for CVD/Stroke. The study presents a XAI model using AtheroEdge TM 4.0 to determine the risk of CVD/Stroke in the pharmaceutical framework using the radiogenomics biomarkers. Conclusions: Our observations suggest that the composite CVD risk biomarkers using radiogenomics provide a new dimension to CVD/Stroke risk assessment. The proposed review suggests a unique, unbiased, and XAI model based on AtheroEdge TM 4.0 that can predict the composite risk of CVD/Stroke using radiogenomics in the pharmaceutical paradigm

A Pharmaceutical Paradigm for Cardiovascular Composite Risk Assessment Using Novel Radiogenomics Risk Predictors in Precision Explainable Artificial Intelligence Framework: Clinical Trial Tool

Cardiovascular disease (CVD) is challenging to diagnose and treat since symptoms appear late during the progression of atherosclerosis. Conventional risk factors alone are not always sufficient to properly categorize at-risk patients, and clinical risk scores are inadequate in predicting cardiac events. Integrating genomic-based biomarkers (GBBM) found in plasma/serum samples with novel non-invasive radiomics-based biomarkers (RBBM) such as plaque area, plaque burden, and maximum plaque height can improve composite CVD risk prediction in the pharmaceutical paradigm. These biomarkers consider several pathways involved in the pathophysiology of atherosclerosis disease leading to CVD.This review proposes two hypotheses: (i) The composite biomarkers are strongly correlated and can be used to detect the severity of CVD/Stroke precisely, and (ii) an explainable artificial intelligence (XAI)-based composite risk CVD/Stroke model with survival analysis using deep learning (DL) can predict in preventive, precision, and personalized (aiP3) framework benefiting the pharmaceutical paradigm.The PRISMA search technique resulted in 214 studies assessing composite biomarkers using radiogenomics for CVD/Stroke. The study presents a XAI model using AtheroEdgeTM 4.0 to determine the risk of CVD/Stroke in the pharmaceutical framework using the radiogenomics biomarkers.Our observations suggest that the composite CVD risk biomarkers using radiogenomics provide a new dimension to CVD/Stroke risk assessment. The proposed review suggests a unique, unbiased, and XAI model based on AtheroEdgeTM 4.0 that can predict the composite risk of CVD/Stroke using radiogenomics in the pharmaceutical paradigm

Non-communicable Diseases, Big Data and Artificial Intelligence

This reprint includes 15 articles in the field of non-communicable Diseases, big data, and artificial intelligence, overviewing the most recent advances in the field of AI and their application potential in 3P medicine

Advanced Computational Methods for Oncological Image Analysis

[Cancer is the second most common cause of death worldwide and encompasses highly variable clinical and biological scenarios. Some of the current clinical challenges are (i) early diagnosis of the disease and (ii) precision medicine, which allows for treatments targeted to specific clinical cases. The ultimate goal is to optimize the clinical workflow by combining accurate diagnosis with the most suitable therapies. Toward this, large-scale machine learning research can define associations among clinical, imaging, and multi-omics studies, making it possible to provide reliable diagnostic and prognostic biomarkers for precision oncology. Such reliable computer-assisted methods (i.e., artificial intelligence) together with clinicians’ unique knowledge can be used to properly handle typical issues in evaluation/quantification procedures (i.e., operator dependence and time-consuming tasks). These technical advances can significantly improve result repeatability in disease diagnosis and guide toward appropriate cancer care. Indeed, the need to apply machine learning and computational intelligence techniques has steadily increased to effectively perform image processing operations—such as segmentation, co-registration, classification, and dimensionality reduction—and multi-omics data integration.