Continuous Ultrasound Speckle Tracking with Gaussian Mixtures

Speckle tracking echocardiography (STE) is now widely used for measuring strain, deformations, and motion in cardiology. STE involves three successive steps: acquisition of individual frames, speckle detection, and image registration using speckles as landmarks. This work proposes to avoid explicit detection and registration by representing dynamic ultrasound images as sparse collections of moving Gaussian elements in the continuous joint space-time space. Individual speckles or local clusters of speckles are approximated by a single multivariate Gaussian kernel with associated linear trajectory over a short time span. A hierarchical tree-structured model is fitted to sampled input data such that predicted image estimates can be retrieved by regression after reconstruction, allowing a (bias-variance) trade-off between model complexity and image resolution. The inverse image reconstruction problem is solved with an online Bayesian statistical estimation algorithm. Experiments on clinical data could estimate subtle sub-pixel accurate motion that is difficult to capture with frame-to-frame elastic image registration techniques

Fully automated segmentation and tracking of the intima media thickness in ultrasound video sequences of the common carotid artery

Abstract—The robust identification and measurement of the intima media thickness (IMT) has a high clinical relevance because it represents one of the most precise predictors used in the assessment of potential future cardiovascular events. To facilitate the analysis of arterial wall thickening in serial clinical investigations, in this paper we have developed a novel fully automatic algorithm for the segmentation, measurement, and tracking of the intima media complex (IMC) in B-mode ultrasound video sequences. The proposed algorithm entails a two-stage image analysis process that initially addresses the segmentation of the IMC in the first frame of the ultrasound video sequence using a model-based approach; in the second step, a novel customized tracking procedure is applied to robustly detect the IMC in the subsequent frames. For the video tracking procedure, we introduce a spatially coherent algorithm called adaptive normalized correlation that prevents the tracking process from converging to wrong arterial interfaces. This represents the main contribution of this paper and was developed to deal with inconsistencies in the appearance of the IMC over the cardiac cycle. The quantitative evaluation has been carried out on 40 ultrasound video sequences of the common carotid artery (CCA) by comparing the results returned by the developed algorithm with respect to ground truth data that has been manually annotated by clinical experts. The measured IMTmean ± standard deviation recorded by the proposed algorithm is 0.60 mm ± 0.10, with a mean coefficient of variation (CV) of 2.05%, whereas the corresponding result obtained for the manually annotated ground truth data is 0.60 mm ± 0.11 with a mean CV equal to 5.60%. The numerical results reported in this paper indicate that the proposed algorithm is able to correctly segment and track the IMC in ultrasound CCA video sequences, and we were encouraged by the stability of our technique when applied to data captured under different imaging conditions. Future clinical studies will focus on the evaluation of patients that are affected by advanced cardiovascular conditions such as focal thickening and arterial plaques

Review on Colour Image Denoising using Wavelet Soft Thresholding Technique

In this modern age of communication the image and video is important as Visual information transmitted in the form of digital images, but after the transmission image is often ruined with noise. Therefore the received image needs to be processing before it can be used for further applications. Image denoising implicates the manipulation of the image data to produce a high quality of image without any noise. Most of the work which had done in color scale image is by filter domain approach, but we think that the transform domain approach give great result in the field of color image denoising.. This paper reviews the several types of noise which corrupted the color image and also the existing denoising algorithms based on wavelet threshodling technique. DOI: 10.17762/ijritcc2321-8169.15039

Machine Learning And Image Processing For Noise Removal And Robust Edge Detection In The Presence Of Mixed Noise

The central goal of this dissertation is to design and model a smoothing filter based on the random single and mixed noise distribution that would attenuate the effect of noise while preserving edge details. Only then could robust, integrated and resilient edge detection methods be deployed to overcome the ubiquitous presence of random noise in images. Random noise effects are modeled as those that could emanate from impulse noise, Gaussian noise and speckle noise. In the first step, evaluation of methods is performed based on an exhaustive review on the different types of denoising methods which focus on impulse noise, Gaussian noise and their related denoising filters. These include spatial filters (linear, non-linear and a combination of them), transform domain filters, neural network-based filters, numerical-based filters, fuzzy based filters, morphological filters, statistical filters, and supervised learning-based filters. In the second step, switching adaptive median and fixed weighted mean filter (SAMFWMF) which is a combination of linear and non-linear filters, is introduced in order to detect and remove impulse noise. Then, a robust edge detection method is applied which relies on an integrated process including non-maximum suppression, maximum sequence, thresholding and morphological operations. The results are obtained on MRI and natural images. In the third step, a combination of transform domain-based filter which is a combination of dual tree – complex wavelet transform (DT-CWT) and total variation, is introduced in order to detect and remove Gaussian noise as well as mixed Gaussian and Speckle noise. Then, a robust edge detection is applied in order to track the true edges. The results are obtained on medical ultrasound and natural images. In the fourth step, a smoothing filter, which is a feed-forward convolutional network (CNN) is introduced to assume a deep architecture, and supported through a specific learning algorithm, l2 loss function minimization, a regularization method, and batch normalization all integrated in order to detect and remove impulse noise as well as mixed impulse and Gaussian noise. Then, a robust edge detection is applied in order to track the true edges. The results are obtained on natural images for both specific and non-specific noise-level

An automatic 2D CAD algorithm for the segmentation of the IMT in ultrasound carotid artery images

Common carotid intima-media thickness (IMT) is a reliable measure of early atherosclerosis - its accurate measurement can be used in the process of evaluating the presence and tracking the progression of disease. The aim of this study is to introduce a novel unsupervised Computer Aided Detection (CAD) algorithm that is able to identify and measure the IMT in 2D ultrasound carotid images. The developed technique relies on a suite of image processing algorithms that embeds a statistical model to identify the two interfaces that form the IMT without any user intervention. The proposed image segmentation scheme is based on a spatially continuous vascular model and consists of several steps including data preprocessing, edge filtering, model selection, edge reconstruction and data refinement. To conduct a quantitative evaluation each image was manually segmented by clinical experts and performance metrics between the segmentation results obtained by the proposed method and the ground truth data were calculated. The experimental results show that the proposed CAD system is robust in accurately estimating the IMT in ultrasound carotid data

Neurosurgical Ultrasound Pose Estimation Using Image-Based Registration and Sensor Fusion - A Feasibility Study

Modern neurosurgical procedures often rely on computer-assisted real-time guidance using multiple medical imaging modalities. State-of-the-art commercial products enable the fusion of pre-operative with intra-operative images (e.g., magnetic resonance [MR] with ultrasound [US] images), as well as the on-screen visualization of procedures in progress. In so doing, US images can be employed as a template to which pre-operative images can be registered, to correct for anatomical changes, to provide live-image feedback, and consequently to improve confidence when making resection margin decisions near eloquent regions during tumour surgery. In spite of the potential for tracked ultrasound to improve many neurosurgical procedures, it is not widely used. State-of-the-art systems are handicapped by optical tracking’s need for consistent line-of-sight, keeping tracked rigid bodies clean and rigidly fixed, and requiring a calibration workflow. The goal of this work is to improve the value offered by co-registered ultrasound images without the workflow drawbacks of conventional systems. The novel work in this thesis includes: the exploration and development of a GPU-enabled 2D-3D multi-modal registration algorithm based on the existing LC2 metric; and the use of this registration algorithm in the context of a sensor and image-fusion algorithm. The work presented here is a motivating step in a vision towards a heterogeneous tracking framework for image-guided interventions where the knowledge from intraoperative imaging, pre-operative imaging, and (potentially disjoint) wireless sensors in the surgical field are seamlessly integrated for the benefit of the surgeon. The technology described in this thesis, inspired by advances in robot localization demonstrate how inaccurate pose data from disjoint sources can produce a localization system greater than the sum of its parts

Electromagnetic models for ultrasound image processing

Speckle noise appears when coherent illumination is employed, as for example Laser, Synthetic Aperture Radar (SAR), Sonar, Magnetic Resonance, X-ray and Ultrasound imagery. Backscattered echoes from the randomly distributed scatterers in the microscopic structure of the medium are the origin of speckle phenomenon, which characterizes coherent imaging with a granular appearance. It can be shown that speckle noise is of multiplicative nature, strongly correlated and more importantly, with non-Gaussian statistics. These characteristics differ greatly from the traditional assumption of white additive Gaussian noise, often taken in image segmentation, filtering, and in general, image processing; which leads to reduction of the methods effectiveness for final image information extraction; therefore, this kind of noise severely impairs human and machine ability to image interpretation. Statistical modeling is of particular relevance when dealing with speckled data in order to obtain efficient image processing algorithms; but, additionally, clinical ultrasound imaging systems employ nonlinear signal processing to reduce the dynamic range of the input echo signal to match the smaller dynamic range of the display device and to emphasize objects with weak backscatter. This reduction in dynamic range is normally achieved through a logarithmic amplifier i.e. logarithmic compression, which selectively compresses large input signals. This kind of nonlinear compression totally changes the statistics of the input envelope signal; and, a closed form expression for the density function of the logarithmic transformed data is usually hard to derive. This thesis is concerned with the statistical distributions of the Log-compressed amplitude signal in coherent imagery, and its main objective is to develop a general statistical model for log-compressed ultrasound B-scan images. The developed model is adapted, making the pertinent physical analogies, from the multiplicative model in Synthetic Aperture Radar (SAR) context. It is shown that the proposed model can successfully describe log-compressed data generated from different models proposed in the specialized ultrasound image processing literature. Also, the model is successfully applied to model in-vivo echo-cardiographic (ultrasound) B-scan images. Necessary theorems are established to account for a rigorous mathematical proof of the validity and generality of the model. Additionally, a physical interpretation of the parameters is given, and the connections between the generalized central limit theorems, the multiplicative model and the compound representations approaches for the different models proposed up-to-date, are established. It is shown that the log-amplifier parameters are included as model parameters and all the model parameters are estimated using moments and maximum likelihood methods. Finally, three applications are developed: speckle noise identification and filtering; segmentation of in vivo echo-cardiographic (ultrasound) B-scan images and a novel approach for heart ejection fraction evaluationEl ruido Speckle aparece cuando se utilizan sistemas de iluminación coherente, como por ejemplo Láser, Radar de Apertura Sintética (SAR), Sonar, Resonancia Magnética, rayos X y ultrasonidos. Los ecos dispersados por los centros dispersores distribuidos al azar en la estructura microscópica del medio son el origen de este fenómeno, que caracteriza las imágenes coherentes con un aspecto granular. Se puede demostrar que el ruido Speckle es de carácter multiplicativo, fuertemente correlacionados y lo más importante, con estadística no Gaussiana. Estas características son muy diferentes de la suposición tradicional de ruido aditivo gaussiano blanco, a menudo asumida en la segmentación de imágenes, filtrado, y en general, en el procesamiento de imágenes; lo cual se traduce en la reducción de la eficacia de los métodos para la extracción de información de la imagen final. La modelización estadística es de particular relevancia cuando se trata con datos Speckle, a fin de obtener algoritmos de procesamiento de imágenes eficientes. Además, el procesamiento no lineal de señales empleado en sistemas clínicos de imágenes por ultrasonido para reducir el rango dinámico de la señal de eco de entrada de manera que coincida con el rango dinámico más pequeño del dispositivo de visualización y resaltar así los objetos con dispersión más débil, modifica radicalmente la estadística de los datos. Esta reducción en el rango dinámico se logra normalmente a través de un amplificador logarítmico es decir, la compresión logarítmica, que comprime selectivamente las señales de entrada y una forma analítica para la expresión de la función de densidad de los datos transformados logarítmicamente es por lo general difícil de derivar. Esta tesis se centra en las distribuciones estadísticas de la amplitud de la señal comprimida logarítmicamente en las imágenes coherentes, y su principal objetivo es el desarrollo de un modelo estadístico general para las imágenes por ultrasonido comprimidas logarítmicamente en modo-B. El modelo desarrollado se adaptó, realizando las analogías físicas relevantes, del modelo multiplicativo en radares de apertura sintética (SAR). El Modelo propuesto puede describir correctamente los datos comprimidos logarítmicamente a partir datos generados con los diferentes modelos propuestos en la literatura especializada en procesamiento de imágenes por ultrasonido. Además, el modelo se aplica con éxito para modelar ecocardiografías en vivo. Se enuncian y demuestran los teoremas necesarios para dar cuenta de una demostración matemática rigurosa de la validez y generalidad del modelo. Además, se da una interpretación física de los parámetros y se establecen las conexiones entre el teorema central del límite generalizado, el modelo multiplicativo y la composición de distribuciones para los diferentes modelos propuestos hasta a la fecha. Se demuestra además que los parámetros del amplificador logarítmico se incluyen dentro de los parámetros del modelo y se estiman usando los métodos estándar de momentos y máxima verosimilitud. Por último, tres aplicaciones se desarrollan: filtrado de ruido Speckle, segmentación de ecocardiografías y un nuevo enfoque para la evaluación de la fracción de eyección cardiaca.Postprint (published version

Measurement of displacements in granular systems in response to penetration and compaction

The research reported in this thesis is concerned with the flow of granular systems in response to penetration and compaction. The technique of Digital Speckle Radiography (DSR), which involves analysis of flash X-ray images, has been applied to measure the internal displacement fields within large opaque granular samples. Large samples are desirable as the measured displacements are more representative of the bulk. Current DICC algorithms were found to be unsuitable for analysis of X-ray images of large samples. The large contrast variations present in such X-ray images, due to the X-ray beam profile, sample geometry and the high X-ray absorbance of metal penetrators, are shown to cause significant errors in the calculated displacement fields. A study of image normalisation techniques was carried out, and the effect of each technique on the accuracy of the measured displacements was investigated. A new DICC algorithm for use in DSR was produced which includes image normalisation techniques to correct for uneven contrast in the images. This new DICC algorithm was shown to be far more effective at analysing X-ray images of large samples. This improved DSR technique was applied to measure the internal displacements within a large sample of sand during penetration by projectiles with different nose-shapes (flat, ogive-2 and hemispherical) and at different rates (1.5 mm/min to 200 m/s). The improved technique was found to provide high-resolution displacement data illustrating the response of the material. The dominant material response at low rates (1.5 mm/min) was found to be splitting of the material ahead of the projectile tip, followed by bulk reverse-flow of material towards the penetration face. At the higher rates (200 m/s), the dominant response was compaction of the material ahead of the projectile tip. The transition between the two regimes was found to occur between velocities of 5 and 19 m/s. The streamlined ogive-2 projectile nose-shape was shown to be the most effective for penetration, in that it caused less disruption of the material ahead of the projectile, lost less energy during the early stages of penetration in the dynamic experiments and more effectively split the material ahead of the projectile tip, a process which was shown to be important at all rates of penetration. The compaction properties of a particulate mixture and a granular material, including the effect of factors such as porosity, initial particle arrangement and force chain formation, were investigated. Samples which were conducive to the formation of force chains spanning the whole sample were discovered to have anomalously high strengths. Small amounts of added water were shown to increase the compactability, by lubricating the grain contact points, but larger amounts of water decreased the compactability

Exploiting Temporal Image Information in Minimally Invasive Surgery

Minimally invasive procedures rely on medical imaging instead of the surgeons direct vision. While preoperative images can be used for surgical planning and navigation, once the surgeon arrives at the target site real-time intraoperative imaging is needed. However, acquiring and interpreting these images can be challenging and much of the rich temporal information present in these images is not visible. The goal of this thesis is to improve image guidance for minimally invasive surgery in two main areas. First, by showing how high-quality ultrasound video can be obtained by integrating an ultrasound transducer directly into delivery devices for beating heart valve surgery. Secondly, by extracting hidden temporal information through video processing methods to help the surgeon localize important anatomical structures. Prototypes of delivery tools, with integrated ultrasound imaging, were developed for both transcatheter aortic valve implantation and mitral valve repair. These tools provided an on-site view that shows the tool-tissue interactions during valve repair. Additionally, augmented reality environments were used to add more anatomical context that aids in navigation and in interpreting the on-site video. Other procedures can be improved by extracting hidden temporal information from the intraoperative video. In ultrasound guided epidural injections, dural pulsation provides a cue in finding a clear trajectory to the epidural space. By processing the video using extended Kalman filtering, subtle pulsations were automatically detected and visualized in real-time. A statistical framework for analyzing periodicity was developed based on dynamic linear modelling. In addition to detecting dural pulsation in lumbar spine ultrasound, this approach was used to image tissue perfusion in natural video and generate ventilation maps from free-breathing magnetic resonance imaging. A second statistical method, based on spectral analysis of pixel intensity values, allowed blood flow to be detected directly from high-frequency B-mode ultrasound video. Finally, pulsatile cues in endoscopic video were enhanced through Eulerian video magnification to help localize critical vasculature. This approach shows particular promise in identifying the basilar artery in endoscopic third ventriculostomy and the prostatic artery in nerve-sparing prostatectomy. A real-time implementation was developed which processed full-resolution stereoscopic video on the da Vinci Surgical System