Fully automated segmentation and tracking of the intima media thickness in ultrasound video sequences of the common carotid artery

Abstract—The robust identification and measurement of the intima media thickness (IMT) has a high clinical relevance because it represents one of the most precise predictors used in the assessment of potential future cardiovascular events. To facilitate the analysis of arterial wall thickening in serial clinical investigations, in this paper we have developed a novel fully automatic algorithm for the segmentation, measurement, and tracking of the intima media complex (IMC) in B-mode ultrasound video sequences. The proposed algorithm entails a two-stage image analysis process that initially addresses the segmentation of the IMC in the first frame of the ultrasound video sequence using a model-based approach; in the second step, a novel customized tracking procedure is applied to robustly detect the IMC in the subsequent frames. For the video tracking procedure, we introduce a spatially coherent algorithm called adaptive normalized correlation that prevents the tracking process from converging to wrong arterial interfaces. This represents the main contribution of this paper and was developed to deal with inconsistencies in the appearance of the IMC over the cardiac cycle. The quantitative evaluation has been carried out on 40 ultrasound video sequences of the common carotid artery (CCA) by comparing the results returned by the developed algorithm with respect to ground truth data that has been manually annotated by clinical experts. The measured IMTmean ± standard deviation recorded by the proposed algorithm is 0.60 mm ± 0.10, with a mean coefficient of variation (CV) of 2.05%, whereas the corresponding result obtained for the manually annotated ground truth data is 0.60 mm ± 0.11 with a mean CV equal to 5.60%. The numerical results reported in this paper indicate that the proposed algorithm is able to correctly segment and track the IMC in ultrasound CCA video sequences, and we were encouraged by the stability of our technique when applied to data captured under different imaging conditions. Future clinical studies will focus on the evaluation of patients that are affected by advanced cardiovascular conditions such as focal thickening and arterial plaques

Automating Carotid Intima-Media Thickness Video Interpretation with Convolutional Neural Networks

Cardiovascular disease (CVD) is the leading cause of mortality yet largely preventable, but the key to prevention is to identify at-risk individuals before adverse events. For predicting individual CVD risk, carotid intima-media thickness (CIMT), a noninvasive ultrasound method, has proven to be valuable, offering several advantages over CT coronary artery calcium score. However, each CIMT examination includes several ultrasound videos, and interpreting each of these CIMT videos involves three operations: (1) select three end-diastolic ultrasound frames (EUF) in the video, (2) localize a region of interest (ROI) in each selected frame, and (3) trace the lumen-intima interface and the media-adventitia interface in each ROI to measure CIMT. These operations are tedious, laborious, and time consuming, a serious limitation that hinders the widespread utilization of CIMT in clinical practice. To overcome this limitation, this paper presents a new system to automate CIMT video interpretation. Our extensive experiments demonstrate that the suggested system significantly outperforms the state-of-the-art methods. The superior performance is attributable to our unified framework based on convolutional neural networks (CNNs) coupled with our informative image representation and effective post-processing of the CNN outputs, which are uniquely designed for each of the above three operations.Comment: J. Y. Shin, N. Tajbakhsh, R. T. Hurst, C. B. Kendall, and J. Liang. Automating carotid intima-media thickness video interpretation with convolutional neural networks. CVPR 2016, pp 2526-2535; N. Tajbakhsh, J. Y. Shin, R. T. Hurst, C. B. Kendall, and J. Liang. Automatic interpretation of CIMT videos using convolutional neural networks. Deep Learning for Medical Image Analysis, Academic Press, 201

Intima-Media Thickness: Setting a Standard for a Completely Automated Method of Ultrasound Measurement

The intima - media thickness (IMT) of the common carotid artery is a widely used clinical marker of severe cardiovascular diseases. IMT is usually manually measured on longitudinal B-Mode ultrasound images. Many computer-based techniques for IMT measurement have been proposed to overcome the limits of manual segmentation. Most of these, however, require a certain degree of user interaction. In this paper we describe a new completely automated layers extraction (CALEXia) technique for the segmentation and IMT measurement of carotid wall in ultrasound images. CALEXia is based on an integrated approach consisting of feature extraction, line fitting, and classification that enables the automated tracing of the carotid adventitial walls. IMT is then measured by relying on a fuzzy K-means classifier. We tested CALEXia on a database of 200 images. We compared CALEXia performances to those of a previously developed methodology that was based on signal analysis (CULEXsa). Three trained operators manually segmented the images and the average profiles were considered as the ground truth. The average error from CALEXia for lumen - intima (LI) and media - adventitia (MA) interface tracings were 1.46 ± 1.51 pixel (0.091 ± 0.093 mm) and 0.40 ± 0.87 pixel (0.025 ± 0.055 mm), respectively. The corresponding errors for CULEXsa were 0.55 ± 0.51 pixels (0.035 ± 0.032 mm) and 0.59 ± 0.46 pixels (0.037 ± 0.029 mm). The IMT measurement error was equal to 0.87 ± 0.56 pixel (0.054 ± 0.035 mm) for CALEXia and 0.12 ± 0.14 pixel (0.01 ± 0.01 mm) for CULEXsa. Thus, CALEXia showed limited performance in segmenting the LI interface, but outperformed CULEXsa in the MA interface and in the number of images correctly processed (10 for CALEXia and 16 for CULEXsa). Based on two complementary strategies, we anticipate fusing them for further IMT improvement

Ultrasound IMT measurement on a multi-ethnic and multi-institutional database: Our review and experience using four fully automated and one semi-automated methods

Automated and high performance carotid intima-media thickness (IMT) measurement is gaining increasing importance in clinical practice to assess the cardiovascular risk of patients. In this paper, we compare four fully automated IMT measurement techniques (CALEX, CAMES, CARES and CAUDLES) and one semi-automated technique (FOAM). We present our experience using these algorithms, whose lumen-intima and media-adventitia border estimation use different methods that can be: (a) edge-based; (b) training-based; (c) feature-based; or (d) directional Edge-Flow based. Our database (DB) consisted of 665 images that represented a multi-ethnic group and was acquired using four OEM scanners. The performance evaluation protocol adopted error measures, reproducibility measures, and Figure of Merit (FoM). FOAM showed the best performance, with an IMT bias equal to 0.025 ± 0.225 mm, and a FoM equal to 96.6%. Among the four automated methods, CARES showed the best results with a bias of 0.032 ± 0.279 mm, and a FoM to 95.6%, which was statistically comparable to that of FOAM performance in terms of accuracy and reproducibility. This is the first time that completely automated and user-driven techniques have been compared on a multi-ethnic dataset, acquired using multiple original equipment manufacturer (OEM) machines with different gain settings, representing normal and pathologic case

Cyclic variation of the common carotid artery structure in relation to prior atherosclerotic burden and physical activity

Background and aims: Cardiovascular disease (CVD) accounts for the most deaths of non-communicable diseases worldwide. It begins with structural and functional changes of the arterial system commonly known as the atherosclerotic process, starting asymptomatically in early childhood, adapting arterial structure and function with advancing age depending on genetic and environmental exposures and finally resulting in CVD events such as myocardial infarction or stroke. CVD risk prediction today is generally based on risk scores, but substantial disadvantages occur since they account only for specific risk factors at one time point. Carotid structure and function (also called carotid stiffness) parameters measured by ultrasound may overcome this disadvantage, since they can provide information on structural and elastic carotid properties and reflect therefore vascular damage accumulated over time. Thus, the aims of this thesis were to summarize the state of the art of ultrasound measurements, to validate the new developed ultrasound analysis system, to assess the variability and reproducibility within the study sample and to investigate the long- and short-term associations of cardiovascular risk factors and carotid stiffness with main focus on physical activity in elderly participants of the SAPALDIA cohort. Methods: The SAPALDIA cohort study is an ongoing multicenter study with a population-based random sample of adults from eight rural and urban areas started in 1991 (SAPALDIA 1), with a first follow-up in 2001-2003 (SAPALDIA 2) and a second follow-up in 2010-2011 (SAPALDIA 3). In SAPALDIA 3, sequential B-mode ultrasound images of the common carotid artery were examined in 3489 participants (51% women) aged between 50-81 years at the time of examination. Expert readers analyzed these ultrasound images with a new analysis system called DYARA (DYnamic ARtery Analysis) according to the state of the art assessed in the review. Thereof, carotid structure parameters were measured and carotid stiffness indices were derived considering blood pressure at time of ultrasound assessment. Validation of the ultrasound analysis program DYARA and reproducibility of carotid parameters were performed in subgroup within the SAPALDIA 3 survey. The presented studies within this thesis comprise cardiovascular risk factor data from the first and second follow-up and therefore, long- and short-term associations with carotid stiffness could be investigated. Results: The intra- and inter-reader results of the validation study were highly consistent with slightly higher bias for analyses with manual interactions compared to the automatic detection. Among the carotid structure parameters, average values across heart cycle showed lower variability than single images in diastole and systole, whereby the relative difference was smaller in lumen diameter values compared to the carotid intima media thickness (CIMT). Based on different statistical approaches, reproducibility values within SAPALDIA 3 were consistently good to excellent for carotid structure and function indices. Findings additionally revealed that subjects itself were the greatest source of variability between two measurements. Multivariate regression analyses suggested that most single cardiovascular risk factors in SAPALDIA 2 were long-termly associated with increased carotid stiffness in SAPALDIA 3 except physical activity and high-density lipoprotein cholesterol (HDL-C). HDL-C was the only protective vascular determinant and no relation was observed for physical activity. Most carotid stiffness parameters were similar strong associated within each cardiovascular risk factor (except compliance showed main deviances among several risk factors). Estimating sex-specific associations of atherosclerotic risk factors and carotid stiffness indicated that increased heart rate was more strongly associated with stiffer arteries across all carotid stiffness parameters in men than in women. Low-density lipoprotein cholesterol (LDL-C) was significantly associated with carotid stiffness only in men and triglyceride only in women. Multifactorial pathway analyses of cardiovascular risk factors in SAPALDIA 3 showed that age was the strongest predictor of carotid stiffness, followed by mean arterial blood pressure and heart rate. Age strongly confounded the association of physical activity and carotid stiffness in multiple regression analyses and therefore, only an univariate association of physical activity and carotid stiffness could be observed. Conclusion: DYARA tackles the challenge of being able to analyze varying ultrasound image qualities with high precision. The high reproducibility and the feasible application in a large sample size suggest that this program can be recommended for epidemiological research, diagnostics and clinical practice. Long- and short-term cardiovascular exposures have added important information to the overall vascular damage assessed by carotid stiffness for both sexes. Although age was the strongest predictor, sex-differences in long-term associations may indicate a certain differentiated susceptibility to cardiovascular risk factors among men and women, which should be investigated in more detail. The presented studies within this thesis provide an important basis towards future investigations targeting the early and late consequences of atherosclerosis, its progression and possible implementations of preventive and/or personalized interventions

Meta-analysis of genome-wide association studies from the CHARGE consortium identifies common variants associated with carotid intima media thickness and plaque

Carotid intima media thickness (cIMT) and plaque determined by ultrasonography are established measures of subclinical atherosclerosis that each predicts future cardiovascular disease events. We conducted a meta-analysis of genome-wide association data in 31,211 participants of European ancestry from nine large studies in the setting of the Cohorts for Heart and Aging Research in Genomic Epidemiology (CHARGE) Consortium. We then sought additional evidence to support our findings among 11,273 individuals using data from seven additional studies. In the combined meta-analysis, we identified three genomic regions associated with common carotid intima media thickness and two different regions associated with the presence of carotid plaque (P < 5 × 10 -8). The associated SNPs mapped in or near genes related to cellular signaling, lipid metabolism and blood pressure homeostasis, and two of the regions were associated with coronary artery disease (P < 0.006) in the Coronary Artery Disease Genome-Wide Replication and Meta-Analysis (CARDIoGRAM) consortium. Our findings may provide new insight into pathways leading to subclinical atherosclerosis and subsequent cardiovascular events

Vascular Health in American Football Players: Cardiovascular Risk Increased in Division III Players

Studies report that football players have high blood pressure (BP) and increased cardiovascular risk. There are over 70,000 NCAA football players and 450 Division III schools sponsor football programs, yet limited research exists on vascular health of athletes. This study aimed to compare vascular and cardiovascular health measures between football players and nonathlete controls. Twenty-three athletes and 19 nonathletes participated. Vascular health measures included flow-mediated dilation (FMD) and carotid artery intima-media thickness (IMT). Cardiovascular measures included clinic and 24 hr BP levels, body composition, VO2 max, and fasting glucose/cholesterol levels. Compared to controls, football players had a worse vascular and cardiovascular profile. Football players had thicker carotid artery IMT (0.49 ± 0.06 mm versus 0.46 ± 0.07 mm) and larger brachial artery diameter during FMD (4.3 ± 0.5 mm versus 3.7 ± 0.6 mm), but no difference in percent FMD. Systolic BP was significantly higher in football players at all measurements: resting (128.2 ± 6.4 mmHg versus 122.4 ± 6.8 mmHg), submaximal exercise (150.4 ± 18.8 mmHg versus 137.3 ± 9.5 mmHg), maximal exercise (211.3 ± 25.9 mmHg versus 191.4 ± 19.2 mmHg), and 24-hour BP (124.9 ± 6.3 mmHg versus 109.8 ± 3.7 mmHg). Football players also had higher fasting glucose (91.6 ± 6.5 mg/dL versus 86.6 ± 5.8 mg/dL), lower HDL (36.5±11.2 mg/dL versus 47.1±14.8 mg/dL), and higher body fat percentage (29.2±7.9% versus 23.2±7.0%). Division III collegiate football players remain an understudied population and may be at increased cardiovascular risk