Automating Carotid Intima-Media Thickness Video Interpretation with Convolutional Neural Networks

Cardiovascular disease (CVD) is the leading cause of mortality yet largely preventable, but the key to prevention is to identify at-risk individuals before adverse events. For predicting individual CVD risk, carotid intima-media thickness (CIMT), a noninvasive ultrasound method, has proven to be valuable, offering several advantages over CT coronary artery calcium score. However, each CIMT examination includes several ultrasound videos, and interpreting each of these CIMT videos involves three operations: (1) select three end-diastolic ultrasound frames (EUF) in the video, (2) localize a region of interest (ROI) in each selected frame, and (3) trace the lumen-intima interface and the media-adventitia interface in each ROI to measure CIMT. These operations are tedious, laborious, and time consuming, a serious limitation that hinders the widespread utilization of CIMT in clinical practice. To overcome this limitation, this paper presents a new system to automate CIMT video interpretation. Our extensive experiments demonstrate that the suggested system significantly outperforms the state-of-the-art methods. The superior performance is attributable to our unified framework based on convolutional neural networks (CNNs) coupled with our informative image representation and effective post-processing of the CNN outputs, which are uniquely designed for each of the above three operations.Comment: J. Y. Shin, N. Tajbakhsh, R. T. Hurst, C. B. Kendall, and J. Liang. Automating carotid intima-media thickness video interpretation with convolutional neural networks. CVPR 2016, pp 2526-2535; N. Tajbakhsh, J. Y. Shin, R. T. Hurst, C. B. Kendall, and J. Liang. Automatic interpretation of CIMT videos using convolutional neural networks. Deep Learning for Medical Image Analysis, Academic Press, 201

An Effective Ultrasound Video Communication System Using Despeckle Filtering and HEVC

The recent emergence of the high-efficiency video coding (HEVC) standard promises to deliver significant bitrate savings over current and prior video compression standards, while also supporting higher resolutions that can meet the clinical acquisition spatiotemporal settings. The effective application of HEVC to medical ultrasound necessitates a careful evaluation of strict clinical criteria that guarantee that clinical quality will not be sacrificed in the compression process. Furthermore, the potential use of despeckle filtering prior to compression provides for the possibility of significant additional bitrate savings that have not been previously considered. This paper provides a thorough comparison of the use of MPEG-2, H.263, MPEG-4, H.264/AVC, and HEVC for compressing atherosclerotic plaque ultrasound videos. For the comparisons, we use both subjective and objective criteria based on plaque structure and motion. For comparable clinical video quality, experimental evaluation on ten videos demonstrates that HEVC reduces bitrate requirements by as much as 33.2% compared to H.264/AVC and up to 71% compared to MPEG-2. The use of despeckle filtering prior to compression is also investigated as a method that can reduce bitrate requirements through the removal of higher frequency components without sacrificing clinical quality. Based on the use of three despeckle filtering methods with both H.264/AVC and HEVC, we find that prior filtering can yield additional significant bitrate savings. The best performing despeckle filter (DsFlsmv) achieves bitrate savings of 43.6% and 39.2% compared to standard nonfiltered HEVC and H.264/AVC encoding, respectively

Global optimization methods for full-reference and no-reference motion estimation with applications to atherosclerotic plaque motion and strain imaging

Pixel-based motion estimation using optical flow models has been extensively researched during the last two decades. The driving force of this research field is the amount of applications that can be developed with the motion estimates. Image segmentation, compression, activity detection, object tracking, pattern recognition, and more recently non-invasive biomedical applications like strain imaging make the estimation of accurate velocity fields necessary. The majority of the research in this area is focused on improving the theoretical and numerical framework of the optical flow models. This effort has resulted in increased method complexity with an increasing number of motion parameters. The standard approach of heuristically setting the motion parameters has become a major source of estimation error. This dissertation is focused in the development of reliable motion estimation based on global parameter optimization methods. Two strategies have been developed. In full-reference optimization, the assumption is that a video training set of realistic motion simulations (or ground truth) are available. Global optimization is used to calculate the best motion parameters that can then be used on a separate set of testing videos. This approach helps provide bounds on what motion estimation methods can achieve. In no-reference optimization, the true displacement field is not available. By optimizing for the agreement between different motion estimation techniques, the no-reference approach closely approximates the best (optimal) motion parameters. The results obtained with the newly developed global no-reference optimization approach agree closely with those produced with the full-reference approach. Moreover, the no-reference approach calculates velocity fields of superior quality than published results for benchmark video sequences. Unreliable velocity estimates are identified using new confidence maps that are associated with the disagreement between methods. Thus, the no-reference global optimization method can provide reliable motion estimation without the need for realistic simulations or access to ground truth. The methods developed in this dissertation are applied to ultrasound videos of carotid artery plaques. The velocity estimates are used to analyze plaque motion and produce novel non-invasive elasticity maps that can help in the identification of vulnerable atherosclerotic plaques

An integrated system for the segmentation of atherosclerotic carotid plaque

In this paper, we propose and evaluate an integrated system for the segmentation of atherosclerotic plaque in ultrasound imaging of the carotid artery based on normalization, speckle reduction filtering, and four different snakes segmentation methods. These methods are the Williams and Shah, Balloon, Lai and Chin, and the gradient vector flow (GVF) snake. The performance of the four different plaque snakes segmentation methods was tested on 80 longitudinal ultrasound images of the carotid artery using receiver operating characteristic (ROC) analysis and the manual delineations of an expert. All four methods were very satisfactory and similar in all measures evaluated, with no significant differences between them; however, the Lai and Chin snakes segmentation method gave slightly better results. Concluding, it is proposed that the integrated system investigated in this study could be used successfully for the automated segmentation of the carotid plaque

An integrated system for the segmentation of atherosclerotic carotid plaque ultrasound video

The robust border identification of atherosclerotic carotid plaque, the corresponding degree of stenosis of the common carotid artery (CCA), and also the characteristics of the arterial wall, including plaque size, composition, and elasticity, have significant clinical relevance for the assessment of future cardiovascular events. To facilitate the follow-up and analysis of the carotid stenosis in serial clinical investigations, we propose and evaluate an integrated system for the segmentation of atherosclerotic carotid plaque in ultrasound videos of the CCA based on video frame normalization, speckle reduction filtering, M-mode state-based identification, parametric active contours, and snake segmentation. Initially, the cardiac cycle in each video is identified and the video M-mode is generated, thus identifying systolic and diastolic states. The video is then segmented for a time period of at least one full cardiac cycle. The algorithm is initialized in the first video frame of the cardiac cycle, with human assistance if needed, and the moving atherosclerotic plaque borders are tracked and segmented in the subsequent frames. Two different initialization methods are investigated in which initial contours are estimated every 20 video frames. In the first initialization method, the initial snake contour is estimated using morphology operators; in the second initialization method, the Chan-Vese active contour model is used. The performance of the algorithm is evaluated on 43 real CCA digitized videos from B-mode longitudinal ultrasound segments and is compared with the manual segmentations of an expert, available every 20 frames in a time span of 3 to 5 s, covering, in general, 2 cardiac cycles. The segmentation results were very satisfactory, according to the expert objective evaluation, for the two different methods investigated, with true-negative fractions (TNF-specificity) of 83.7 ± 7.6% and 84.3 ± 7.5%; true-positive fractions (TPF-sensitivity) of 85.42 ± 8.1% and 86.1 ± 8.0%; and between the ground truth and the proposed segmentation method, kappa indices (KI) of 84.6% and 85.3% and overlap indices of 74.7% and 75.4%. The segmentation contours were also used to compute the cardiac state identification and radial, longitudinal, and shear strain indices for the CCA wall and plaque between the asymptomatic and symptomatic groups were investigated. The results of this study show that the integrated system investigated in this study can be successfully used for the automated video segmentation of the CCA plaque in ultrasound videos

Segmentation of atherosclerotic carotid plaque in ultrasound video

The degree of stenosis of the common carotid artery (CCA) but also the characteristics of the arterial wall including plaque size, composition and elasticity represent important predictors used in the assessment of the risk for future cardiovascular events. This paper proposes and evaluates an integrated system for the segmentation of atherosclerotic carotid plaque in ultrasound video of the CCA based on normalization, speckle reduction filtering (with the hybrid median filter) and parametric active contours. The algorithm is initialized in the first video frame of the cardiac cycle with human assistance and the moving atherosclerotic plaque borders are tracked and segmented in the subsequent frames. The algorithm is evaluated on 10 real CCA digitized videos from B-mode longitudinal ultrasound segments and is compared with the manual segmentations of an expert, for every 20 frames in a time span of 3-5 seconds, covering in general 2 cardiac cycles. The segmentation results are very satisfactory with a true negative fraction (TNF) of 79.3%, a true-positive fraction (TPF) of 78.12%, a false-positive fraction (FPF) of 6.7% and a false-negative fraction (FNF) of 19.6% between the ground truth and the presented plaque segmentations, a Williams index (KI) of 80.3%, an overlap index of 71.5%, a specificity of 0.88±0.09, a precision of 0.86±0.10 and an effectiveness measure of 0.77±0.09. The results show that integrated system investigated in this study could be successfully used for the automated video segmentation of the carotid plaque