An improved classification approach for echocardiograms embedding temporal information

Cardiovascular disease is an umbrella term for all diseases of the heart. At present, computer-aided echocardiogram diagnosis is becoming increasingly beneficial. For echocardiography, different cardiac views can be acquired depending on the location and angulations of the ultrasound transducer. Hence, the automatic echocardiogram view classification is the first step for echocardiogram diagnosis, especially for computer-aided system and even for automatic diagnosis in the future. In addition, heart views classification makes it possible to label images especially for large-scale echo videos, provide a facility for database management and collection. This thesis presents a framework for automatic cardiac viewpoints classification of echocardiogram video data. In this research, we aim to overcome the challenges facing this investigation while analyzing, recognizing and classifying echocardiogram videos from 3D (2D spatial and 1D temporal) space. Specifically, we extend 2D KAZE approach into 3D space for feature detection and propose a histogram of acceleration as feature descriptor. Subsequently, feature encoding follows before the application of SVM to classify echo videos. In addition, comparison with the state of the art methodologies also takes place, including 2D SIFT, 3D SIFT, and optical flow technique to extract temporal information sustained in the video images. As a result, the performance of 2D KAZE, 2D KAZE with Optical Flow, 3D KAZE, Optical Flow, 2D SIFT and 3D SIFT delivers accuracy rate of 89.4%, 84.3%, 87.9%, 79.4%, 83.8% and 73.8% respectively for the eight view classes of echo videos

Computer aided diagnosis of coronary artery disease, myocardial infarction and carotid atherosclerosis using ultrasound images: a review

The diagnosis of Coronary Artery Disease (CAD), Myocardial Infarction (MI) and carotid atherosclerosis is of paramount importance, as these cardiovascular diseases may cause medical complications and large number of death. Ultrasound (US) is a widely used imaging modality, as it captures moving images and image features correlate well with results obtained from other imaging methods. Furthermore, US does not use ionizing radiation and it is economical when compared to other imaging modalities. However, reading US images takes time and the relationship between image and tissue composition is complex. Therefore, the diagnostic accuracy depends on both time taken to read the images and experience of the screening practitioner. Computer support tools can reduce the inter-operator variability with lower subject specific expertise, when appropriate processing methods are used. In the current review, we analysed automatic detection methods for the diagnosis of CAD, MI and carotid atherosclerosis based on thoracic and Intravascular Ultrasound (IVUS). We found that IVUS is more often used than thoracic US for CAD. But for MI and carotid atherosclerosis IVUS is still in the experimental stage. Furthermore, thoracic US is more often used than IVUS for computer aided diagnosis systems

Artificial intelligence and echocardiography

Echocardiography plays a crucial role in the diagnosis and management of cardiovascular disease. However, interpretation remains largely reliant on the subjective expertise of the operator. As a result inter-operator variability and experience can lead to incorrect diagnoses. Artificial intelligence (AI) technologies provide new possibilities for echocardiography to generate accurate, consistent and automated interpretation of echocardiograms, thus potentially reducing the risk of human error. In this review, we discuss a subfield of AI relevant to image interpretation, called machine learning, and its potential to enhance the diagnostic performance of echocardiography. We discuss recent applications of these methods and future directions for AI-assisted interpretation of echocardiograms. The research suggests it is feasible to apply machine learning models to provide rapid, highly accurate and consistent assessment of echocardiograms, comparable to clinicians. These algorithms are capable of accurately quantifying a wide range of features, such as the severity of valvular heart disease or the ischaemic burden in patients with coronary artery disease. However, the applications and their use are still in their infancy within the field of echocardiography. Research to refine methods and validate their use for automation, quantification and diagnosis are in progress. Widespread adoption of robust AI tools in clinical echocardiography practice should follow and have the potential to deliver significant benefits for patient outcome

Automatic Assessment of Cardiac Left Ventricular Function Via Magnetic Resonance Images

Automating global and segmental (regional) assessments of cardiac Left Ventricle (LV) function in Magnetic Resonance Images (MRI) has recently sparked an impressive research effort, which has resulted a number of techniques delivering promising performances. However, despite such an effort, the problem is still acknowledged to be challenging, with substantial room for improvements in regard to accuracy. Furthermore, most of the existing techniques are labour intensive, requiring delineations of the endo- and/or epi-cardial boundaries in all frames of a cardiac sequence. On the one hand, global assessments of LV function focus on estimation of the Ejection Fraction (EF), which quantifies how much blood the heart is pumping within each beat. On the other hand, regional assessments focus on comprehensive analysis of the wall motions within each of the standardized segments of the myocardium, the muscle which contracts and sends the blood out of the LV. In clinical practice, the EF is often estimated via manual segmentations of several images in a cardiac sequence. This is prohibitively time consuming, or via automatic segmentations, which is a challenging and computationally expensive task that may result in high estimation errors. Additionally, the diagnosis of the segmental dysfunction is based on visual LV assessments, which are subject to high inter-observer variability. In this thesis, we propose accurate methods to estimate both global and regional LV function with minimal user inputs in real-time from statistics estimated in MRI. From a simple user input, we build image statistics for all the images in a subject dataset. We demonstrate that these statistics are correlated with regional as well as global LV function. Different machine learning techniques have been employed to find these correlations. The regional dysfunction is investigated in terms of a binary/multi-classification problem. A comprehensive evaluation over 20 subjects demonstrated that the estimated EFs correlated very well with those obtained from independent manual segmentations. Furthermore, comparisons with estimating EF with recent segmentation algorithms show that the proposed method yielded a very competitive performance. For regional binary classification, we report a comprehensive experimental evaluation of the proposed algorithm over 928 cardiac segments obtained from 58 subjects. Compared against ground-truth evaluations by experienced radiologists, the proposed algorithm performed competitively, with an overall classification accuracy of 86.09% and a kappa measure of 0.73. We also report a comprehensive experimental evaluation of the proposed multi-classification algorithm over the same dataset. Compared against ground-truth labels assessed by experienced radiologists, the proposed algorithm yielded an overall 4-class accuracy of 74.14%

Image-Based Cardiac Diagnosis With Machine Learning: A Review

Cardiac imaging plays an important role in the diagnosis of cardiovascular disease (CVD). Until now, its role has been limited to visual and quantitative assessment of cardiac structure and function. However, with the advent of big data and machine learning, new opportunities are emerging to build artificial intelligence tools that will directly assist the clinician in the diagnosis of CVDs. This paper presents a thorough review of recent works in this field and provide the reader with a detailed presentation of the machine learning methods that can be further exploited to enable more automated, precise and early diagnosis of most CVDs

Multidimensional embedded MEMS motion detectors for wearable mechanocardiography and 4D medical imaging

Background: Cardiovascular diseases are the number one cause of death. Of these deaths, almost 80% are due to coronary artery disease (CAD) and cerebrovascular disease. Multidimensional microelectromechanical systems (MEMS) sensors allow measuring the mechanical movement of the heart muscle offering an entirely new and innovative solution to evaluate cardiac rhythm and function. Recent advances in miniaturized motion sensors present an exciting opportunity to study novel device-driven and functional motion detection systems in the areas of both cardiac monitoring and biomedical imaging, for example, in computed tomography (CT) and positron emission tomography (PET). Methods: This Ph.D. work describes a new cardiac motion detection paradigm and measurement technology based on multimodal measuring tools — by tracking the heart’s kinetic activity using micro-sized MEMS sensors — and novel computational approaches — by deploying signal processing and machine learning techniques—for detecting cardiac pathological disorders. In particular, this study focuses on the capability of joint gyrocardiography (GCG) and seismocardiography (SCG) techniques that constitute the mechanocardiography (MCG) concept representing the mechanical characteristics of the cardiac precordial surface vibrations. Results: Experimental analyses showed that integrating multisource sensory data resulted in precise estimation of heart rate with an accuracy of 99% (healthy, n=29), detection of heart arrhythmia (n=435) with an accuracy of 95-97%, ischemic disease indication with approximately 75% accuracy (n=22), as well as significantly improved quality of four-dimensional (4D) cardiac PET images by eliminating motion related inaccuracies using MEMS dual gating approach. Tissue Doppler imaging (TDI) analysis of GCG (healthy, n=9) showed promising results for measuring the cardiac timing intervals and myocardial deformation changes. Conclusion: The findings of this study demonstrate clinical potential of MEMS motion sensors in cardiology that may facilitate in time diagnosis of cardiac abnormalities. Multidimensional MCG can effectively contribute to detecting atrial fibrillation (AFib), myocardial infarction (MI), and CAD. Additionally, MEMS motion sensing improves the reliability and quality of cardiac PET imaging.Moniulotteisten sulautettujen MEMS-liiketunnistimien käyttö sydänkardiografiassa sekä lääketieteellisessä 4D-kuvantamisessa Tausta: Sydän- ja verisuonitaudit ovat yleisin kuolinsyy. Näistä kuolemantapauksista lähes 80% johtuu sepelvaltimotaudista (CAD) ja aivoverenkierron häiriöistä. Moniulotteiset mikroelektromekaaniset järjestelmät (MEMS) mahdollistavat sydänlihaksen mekaanisen liikkeen mittaamisen, mikä puolestaan tarjoaa täysin uudenlaisen ja innovatiivisen ratkaisun sydämen rytmin ja toiminnan arvioimiseksi. Viimeaikaiset teknologiset edistysaskeleet mahdollistavat uusien pienikokoisten liiketunnistusjärjestelmien käyttämisen sydämen toiminnan tutkimuksessa sekä lääketieteellisen kuvantamisen, kuten esimerkiksi tietokonetomografian (CT) ja positroniemissiotomografian (PET), tarkkuuden parantamisessa. Menetelmät: Tämä väitöskirjatyö esittelee uuden sydämen kineettisen toiminnan mittaustekniikan, joka pohjautuu MEMS-anturien käyttöön. Uudet laskennalliset lähestymistavat, jotka perustuvat signaalinkäsittelyyn ja koneoppimiseen, mahdollistavat sydämen patologisten häiriöiden havaitsemisen MEMS-antureista saatavista signaaleista. Tässä tutkimuksessa keskitytään erityisesti mekanokardiografiaan (MCG), joihin kuuluvat gyrokardiografia (GCG) ja seismokardiografia (SCG). Näiden tekniikoiden avulla voidaan mitata kardiorespiratorisen järjestelmän mekaanisia ominaisuuksia. Tulokset: Kokeelliset analyysit osoittivat, että integroimalla usean sensorin dataa voidaan mitata syketiheyttä 99% (terveillä n=29) tarkkuudella, havaita sydämen rytmihäiriöt (n=435) 95-97%, tarkkuudella, sekä havaita iskeeminen sairaus noin 75% tarkkuudella (n=22). Lisäksi MEMS-kaksoistahdistuksen avulla voidaan parantaa sydämen 4D PET-kuvan laatua, kun liikeepätarkkuudet voidaan eliminoida paremmin. Doppler-kuvantamisessa (TDI, Tissue Doppler Imaging) GCG-analyysi (terveillä, n=9) osoitti lupaavia tuloksia sydänsykkeen ajoituksen ja intervallien sekä sydänlihasmuutosten mittaamisessa. Päätelmä: Tämän tutkimuksen tulokset osoittavat, että kardiologisilla MEMS-liikeantureilla on kliinistä potentiaalia sydämen toiminnallisten poikkeavuuksien diagnostisoinnissa. Moniuloitteinen MCG voi edistää eteisvärinän (AFib), sydäninfarktin (MI) ja CAD:n havaitsemista. Lisäksi MEMS-liiketunnistus parantaa sydämen PET-kuvantamisen luotettavuutta ja laatua

Automatic identification of ischemia using lightweight attention network in PET cardiac perfusion imaging

Ischemic disease, caused by inadequate blood supply to organs or tissues, poses a significant global health challenge. Early detection of ischemia is crucial for timely intervention and improved patient outcomes. Myocardial perfusion imaging with positron-emission tomography (PET) is a non-invasive technique used to identify ischemia. However, accurately interpreting PET images can be challenging, necessitating the development of reliable classification methods. In this study, we propose a novel approach using MS-DenseNet, a lightweight attention network, for the detection and classification of ischemia from myocardial polar maps. Our model incorporates the squeeze and excitation modules to emphasize relevant feature channels and suppress unnecessary ones. By effectively utilizing channel interdependencies, we achieve optimum reuse of interchannel interactions, enhancing the model's performance. To evaluate the efficacy and accuracy of our proposed model, we compare it with transfer learning models commonly used in medical image analysis. We conducted experiments using a dataset of 138 polar maps (JPEG) obtained from 15O_H2O stress perfusion studies, comprising patients with ischemic and non-ischemic condition. Our results demonstrate that MS-DenseNet outperforms the transfer learning models, highlighting its potential for accurate ischemia detection and classification. This research contributes to the field of ischemia diagnosis by introducing a lightweight attention network that effectively captures the relevant features from myocardial polar maps. The integration of the squeeze and excitation modules further enhances the model's discriminative capabilities. The proposed MS-DenseNet offers a promising solution for accurate and efficient ischemia detection, potentially improving the speed and accuracy of diagnosis and leading to better patient outcomes