Automatic IVUS segmentation of atherosclerotic plaque with Stop & Go snake

Since the upturn of intravascular ultrasound (IVUS)as an imaging technique for the coronary artery system, much research has been done to simplify the complicated analysis of the resulting images. In this study, an attempt to develop an automatic tissue characterization algorithm for IVUS images was done. We concentrated on the segmentation of calcium and soft plaque, because these structures predict the extension and the vulnerability of the atherosclerotic disease, respectively. The first step in the procedure was the extraction of texture features like local binary patterns, co-occurrence matrices and Gabor filter banks. After dimensionality reduction, the resulting feature space was used for classification, constructing a likelihood map to represent different coronary plaques. The information in this map was organized using a recently developed geodesic snake formulation,the so-called Stop & Go snake. The novelty of our study lies in this last step, as it was the first time to apply the Stop & Go snake to segment IVUS images

Deep Learning in Cardiology

The medical field is creating large amount of data that physicians are unable to decipher and use efficiently. Moreover, rule-based expert systems are inefficient in solving complicated medical tasks or for creating insights using big data. Deep learning has emerged as a more accurate and effective technology in a wide range of medical problems such as diagnosis, prediction and intervention. Deep learning is a representation learning method that consists of layers that transform the data non-linearly, thus, revealing hierarchical relationships and structures. In this review we survey deep learning application papers that use structured data, signal and imaging modalities from cardiology. We discuss the advantages and limitations of applying deep learning in cardiology that also apply in medicine in general, while proposing certain directions as the most viable for clinical use.Comment: 27 pages, 2 figures, 10 table

Multimodality carotid plaque tissue characterization and classification in the artificial intelligence paradigm: a narrative review for stroke application

Cardiovascular disease (CVD) is one of the leading causes of morbidity and mortality in the United States of America and globally. Carotid arterial plaque, a cause and also a marker of such CVD, can be detected by various non-invasive imaging modalities such as magnetic resonance imaging (MRI), computer tomography (CT), and ultrasound (US). Characterization and classification of carotid plaque-type in these imaging modalities, especially into symptomatic and asymptomatic plaque, helps in the planning of carotid endarterectomy or stenting. It can be challenging to characterize plaque components due to (I) partial volume effect in magnetic resonance imaging (MRI) or (II) varying Hausdorff values in plaque regions in CT, and (III) attenuation of echoes reflected by the plaque during US causing acoustic shadowing. Artificial intelligence (AI) methods have become an indispensable part of healthcare and their applications to the non-invasive imaging technologies such as MRI, CT, and the US. In this narrative review, three main types of AI models (machine learning, deep learning, and transfer learning) are analyzed when applied to MRI, CT, and the US. A link between carotid plaque characteristics and the risk of coronary artery disease is presented. With regard to characterization, we review tools and techniques that use AI models to distinguish carotid plaque types based on signal processing and feature strengths. We conclude that AI-based solutions offer an accurate and robust path for tissue characterization and classification for carotid artery plaque imaging in all three imaging modalities. Due to cost, user-friendliness, and clinical effectiveness, AI in the US has dominated the most

Framework for Detection and Localization of Coronary Non-Calcified Plaques in Cardiac CTA using Mean Radial Profiles

Background and Objective: The high mortality rate associated with coronary heart disease (CHD) has driven intensive research in cardiac imaging and image analysis. The advent of computed tomography angiography (CTA) has turned non-invasive diagnosis of cardiovascular anomalies into reality as calcified coronary plaques can be easily identified due to their high intensity values. However, the detection of non-calcified plaques in CTA is still a challenging problem because of lower intensity values, which are often similar to the nearby blood and muscle tissues. In this work, we propose the use of mean radial profiles for the detection of non-calcified plaques in CTA imagery. Methods: Accordingly, we computed radial profiles by averaging the image intensity in concentric rings around the vessel centreline in a first stage. In the subsequent stage, an SVM classifier is applied to identify the abnormal coronary segments. For occluded segments, we further propose a derivative-based method to localize the position and length of the plaque inside the segment. Results: A total of 32 CTA volumes were analysed and a detection accuracy of 88.4% with respect to the manual expert was achieved. The plaque localization accuracy was computed using the Dice similarity coefficient and a mean of 83.2% was achieved. Conclusion: The consistent performance for multi-vendor, multi-institution data demonstrates the reproducibility of our method across different CTA datasets with a good agreement with manual expert annotations

Framework for Detection and Localization of Coronary Non-Calcified Plaques in Cardiac CTA using Mean Radial Profiles

Background and Objective: The high mortality rate associated with coronary heart disease (CHD) has driven intensive research in cardiac imaging and image analysis. The advent of computed tomography angiography (CTA) has turned non-invasive diagnosis of cardiovascular anomalies into reality as calcified coronary plaques can be easily identified due to their high intensity values. However, the detection of non-calcified plaques in CTA is still a challenging problem because of lower intensity values, which are often similar to the nearby blood and muscle tissues. In this work, we propose the use of mean radial profiles for the detection of non-calcified plaques in CTA imagery. Methods: Accordingly, we computed radial profiles by averaging the image intensity in concentric rings around the vessel centreline in a first stage. In the subsequent stage, an SVM classifier is applied to identify the abnormal coronary segments. For occluded segments, we further propose a derivative-based method to localize the position and length of the plaque inside the segment. Results: A total of 32 CTA volumes were analysed and a detection accuracy of 88.4% with respect to the manual expert was achieved. The plaque localization accuracy was computed using the Dice similarity coefficient and a mean of 83.2% was achieved. Conclusion: The consistent performance for multi-vendor, multi-institution data demonstrates the reproducibility of our method across different CTA datasets with a good agreement with manual expert annotations

Combinatorial optimisation for arterial image segmentation.

Cardiovascular disease is one of the leading causes of the mortality in the western world. Many imaging modalities have been used to diagnose cardiovascular diseases. However, each has different forms of noise and artifacts that make the medical image analysis field important and challenging. This thesis is concerned with developing fully automatic segmentation methods for cross-sectional coronary arterial imaging in particular, intra-vascular ultrasound and optical coherence tomography, by incorporating prior and tracking information without any user intervention, to effectively overcome various image artifacts and occlusions. Combinatorial optimisation methods are proposed to solve the segmentation problem in polynomial time. A node-weighted directed graph is constructed so that the vessel border delineation is considered as computing a minimum closed set. A set of complementary edge and texture features is extracted. Single and double interface segmentation methods are introduced. Novel optimisation of the boundary energy function is proposed based on a supervised classification method. Shape prior model is incorporated into the segmentation framework based on global and local information through the energy function design and graph construction. A combination of cross-sectional segmentation and longitudinal tracking is proposed using the Kalman filter and the hidden Markov model. The border is parameterised using the radial basis functions. The Kalman filter is used to adapt the inter-frame constraints between every two consecutive frames to obtain coherent temporal segmentation. An HMM-based border tracking method is also proposed in which the emission probability is derived from both the classification-based cost function and the shape prior model. The optimal sequence of the hidden states is computed using the Viterbi algorithm. Both qualitative and quantitative results on thousands of images show superior performance of the proposed methods compared to a number of state-of-the-art segmentation methods

Quantifying Atherosclerosis: IVUS Imaging For Lumen Border Detection And Plaque Characterization

The importance of atherosclerotic disease in coronary artery has been a subject of study for many researchers in the past decade. In brief, the aim is to understand progression of such a disease, detect plaques at risks (vulnerable plaques), and treat them selectively to prevent mortality and immobility. Consequently, several imaging modalities have been developed and among them intravascular ultrasound (IVUS) has been of particular interest since it provides useful information about tissues microstructures and images with sufficient penetration as well as resolution. In general, the ultimate goal is to provide interventional cardiologists with reliable clinical tools so they can identify vulnerable plaques, make decisions confidently, choose the most appropriate drugs or implant devices (i.e. stent), and stabilize them during catheterization procedures with minimal risk. In this work, we review existing atherosclerotic tissue characterization algorithms including the state-of-the-art virtual histology (VH) framework, which has been implemented in the Volcano (Rancho Cordova, CA) IVUS clinical scanners using 64-elements 20 MHz phased-array transducer. Initially, we intended to extend this technique for data acquired with 40 MHz single-element transducers. For this reason, we started acquiring in vitro IVUS data and studied involved challenges from specimen preparation toward classification. We observed inconsistency among extracted features along with transducer's spectral parameters (i.e. bandwidth, center frequency). This, in addition to infeasibility of construction of reliable training dataset due to heterogeneity of atherosclerotic tissues motivated us to develop an unsupervised texture-based atherosclerotic tissue characterization algorithm. We proposed a two-dimensional multiscale wavelet-based algorithm to expand IVUS backscattered signals and/or grayscale images onto orthogonal symmetric quadrature mirror filters (QMF) such as Lemarie-Battle. At the bottom of decomposition tree, we employed ISODATA to cluster enveloped detected features in an unsupervised fashion and classify atherosclerotic plaque constitutes into fibrotic, lipidic, calcified, and no tissues. For the first time, we studied numbers of factors that were necessary for extension of in vitro derived classifier for in vivo applications such as reliability of classified tissues behind arc of calcified plaques and effects of pressure changes as well as flowing blood on constructed tissue color maps, called prognosis histology (PH) images. The second half of this dissertation is devoted to automatic detection of lumen borders in IVUS grayscale images acquired with high frequency (40 MHz up) transducers where more scattering exhibited within lumen area that makes the problem of interest more challenging. We established our framework on three-dimensional expansion of IVUS sub-volumes onto orthonormal brushlet basis function. The rational behind our framework was presence of incoherent (i.e. blood) versus coherent (i.e. plaque, surrounding fat) textural patterns along pullback direction, which was motivated by what an interventional cardiologist does to locate the lumen border visually by going back and forth among IVUS frames. We studied the feasibility of brushlet analysis through filtering blood speckles and supervised classification of blood versus non-blood regions. Our preliminary study confirmed that the most informative features reside in the innermost cubes, representing low-frequency components in transformed domain. Finally, we explored that tissue responses to IVUS signals are proportionally preserved in brushlet coefficients and it enabled us to classify blood regions in complex brushlet space. Subsequently, we employed surface function actives (SFA) to estimate the lumen borders after regularization. In a comparison study, we quantified our results with two of existing algorithms, employing IVUS grayscale images acquired with 40 MHz and 45 MHz single-element transducers. Overall, our proposed algorithm outperformed and the resulting automated detected borders showed good correlation with manually traced borders by an expert