Deep Learning in Cardiology

The medical field is creating large amount of data that physicians are unable to decipher and use efficiently. Moreover, rule-based expert systems are inefficient in solving complicated medical tasks or for creating insights using big data. Deep learning has emerged as a more accurate and effective technology in a wide range of medical problems such as diagnosis, prediction and intervention. Deep learning is a representation learning method that consists of layers that transform the data non-linearly, thus, revealing hierarchical relationships and structures. In this review we survey deep learning application papers that use structured data, signal and imaging modalities from cardiology. We discuss the advantages and limitations of applying deep learning in cardiology that also apply in medicine in general, while proposing certain directions as the most viable for clinical use.Comment: 27 pages, 2 figures, 10 table

Automatic analysis and classification of cardiac acoustic signals for long term monitoring

Objective: Cardiovascular diseases are the leading cause of death worldwide resulting in over 17.9 million deaths each year. Most of these diseases are preventable and treatable, but their progression and outcomes are significantly more positive with early-stage diagnosis and proper disease management. Among the approaches available to assist with the task of early-stage diagnosis and management of cardiac conditions, automatic analysis of auscultatory recordings is one of the most promising ones, since it could be particularly suitable for ambulatory/wearable monitoring. Thus, proper investigation of abnormalities present in cardiac acoustic signals can provide vital clinical information to assist long term monitoring. Cardiac acoustic signals, however, are very susceptible to noise and artifacts, and their characteristics vary largely with the recording conditions which makes the analysis challenging. Additionally, there are challenges in the steps used for automatic analysis and classification of cardiac acoustic signals. Broadly, these steps are the segmentation, feature extraction and subsequent classification of recorded signals using selected features. This thesis presents approaches using novel features with the aim to assist the automatic early-stage detection of cardiovascular diseases with improved performance, using cardiac acoustic signals collected in real-world conditions. Methods: Cardiac auscultatory recordings were studied to identify potential features to help in the classification of recordings from subjects with and without cardiac diseases. The diseases considered in this study for the identification of the symptoms and characteristics are the valvular heart diseases due to stenosis and regurgitation, atrial fibrillation, and splitting of fundamental heart sounds leading to additional lub/dub sounds in the systole or diastole interval of a cardiac cycle. The localisation of cardiac sounds of interest was performed using an adaptive wavelet-based filtering in combination with the Shannon energy envelope and prior information of fundamental heart sounds. This is a prerequisite step for the feature extraction and subsequent classification of recordings, leading to a more precise diagnosis. Localised segments of S1 and S2 sounds, and artifacts, were used to extract a set of perceptual and statistical features using wavelet transform, homomorphic filtering, Hilbert transform and mel-scale filtering, which were then fed to train an ensemble classifier to interpret S1 and S2 sounds. Once sound peaks of interest were identified, features extracted from these peaks, together with the features used for the identification of S1 and S2 sounds, were used to develop an algorithm to classify recorded signals. Overall, 99 features were extracted and statistically analysed using neighborhood component analysis (NCA) to identify the features which showed the greatest ability in classifying recordings. Selected features were then fed to train an ensemble classifier to classify abnormal recordings, and hyperparameters were optimized to evaluate the performance of the trained classifier. Thus, a machine learning-based approach for the automatic identification and classification of S1 and S2, and normal and abnormal recordings, in real-world noisy recordings using a novel feature set is presented. The validity of the proposed algorithm was tested using acoustic signals recorded in real-world, non-controlled environments at four auscultation sites (aortic valve, tricuspid valve, mitral valve, and pulmonary valve), from the subjects with and without cardiac diseases; together with recordings from the three large public databases. The performance metrics of the methodology in relation to classification accuracy (CA), sensitivity (SE), precision (P+), and F1 score, were evaluated. Results: This thesis proposes four different algorithms to automatically classify fundamental heart sounds – S1 and S2; normal fundamental sounds and abnormal additional lub/dub sounds recordings; normal and abnormal recordings; and recordings with heart valve disorders, namely the mitral stenosis (MS), mitral regurgitation (MR), mitral valve prolapse (MVP), aortic stenosis (AS) and murmurs, using cardiac acoustic signals. The results obtained from these algorithms were as follows: • The algorithm to classify S1 and S2 sounds achieved an average SE of 91.59% and 89.78%, and F1 score of 90.65% and 89.42%, in classifying S1 and S2, respectively. 87 features were extracted and statistically studied to identify the top 14 features which showed the best capabilities in classifying S1 and S2, and artifacts. The analysis showed that the most relevant features were those extracted using Maximum Overlap Discrete Wavelet Transform (MODWT) and Hilbert transform. • The algorithm to classify normal fundamental heart sounds and abnormal additional lub/dub sounds in the systole or diastole intervals of a cardiac cycle, achieved an average SE of 89.15%, P+ of 89.71%, F1 of 89.41%, and CA of 95.11% using the test dataset from the PASCAL database. The top 10 features that achieved the highest weights in classifying these recordings were also identified. • Normal and abnormal classification of recordings using the proposed algorithm achieved a mean CA of 94.172%, and SE of 92.38%, in classifying recordings from the different databases. Among the top 10 acoustic features identified, the deterministic energy of the sound peaks of interest and the instantaneous frequency extracted using the Hilbert Huang-transform, achieved the highest weights. • The machine learning-based approach proposed to classify recordings of heart valve disorders (AS, MS, MR, and MVP) achieved an average CA of 98.26% and SE of 95.83%. 99 acoustic features were extracted and their abilities to differentiate these abnormalities were examined using weights obtained from the neighborhood component analysis (NCA). The top 10 features which showed the greatest abilities in classifying these abnormalities using recordings from the different databases were also identified. The achieved results demonstrate the ability of the algorithms to automatically identify and classify cardiac sounds. This work provides the basis for measurements of many useful clinical attributes of cardiac acoustic signals and can potentially help in monitoring the overall cardiac health for longer duration. The work presented in this thesis is the first-of-its-kind to validate the results using both, normal and pathological cardiac acoustic signals, recorded for a long continuous duration of 5 minutes at four different auscultation sites in non-controlled real-world conditions.Open Acces

Multidimensional embedded MEMS motion detectors for wearable mechanocardiography and 4D medical imaging

Background: Cardiovascular diseases are the number one cause of death. Of these deaths, almost 80% are due to coronary artery disease (CAD) and cerebrovascular disease. Multidimensional microelectromechanical systems (MEMS) sensors allow measuring the mechanical movement of the heart muscle offering an entirely new and innovative solution to evaluate cardiac rhythm and function. Recent advances in miniaturized motion sensors present an exciting opportunity to study novel device-driven and functional motion detection systems in the areas of both cardiac monitoring and biomedical imaging, for example, in computed tomography (CT) and positron emission tomography (PET). Methods: This Ph.D. work describes a new cardiac motion detection paradigm and measurement technology based on multimodal measuring tools — by tracking the heart’s kinetic activity using micro-sized MEMS sensors — and novel computational approaches — by deploying signal processing and machine learning techniques—for detecting cardiac pathological disorders. In particular, this study focuses on the capability of joint gyrocardiography (GCG) and seismocardiography (SCG) techniques that constitute the mechanocardiography (MCG) concept representing the mechanical characteristics of the cardiac precordial surface vibrations. Results: Experimental analyses showed that integrating multisource sensory data resulted in precise estimation of heart rate with an accuracy of 99% (healthy, n=29), detection of heart arrhythmia (n=435) with an accuracy of 95-97%, ischemic disease indication with approximately 75% accuracy (n=22), as well as significantly improved quality of four-dimensional (4D) cardiac PET images by eliminating motion related inaccuracies using MEMS dual gating approach. Tissue Doppler imaging (TDI) analysis of GCG (healthy, n=9) showed promising results for measuring the cardiac timing intervals and myocardial deformation changes. Conclusion: The findings of this study demonstrate clinical potential of MEMS motion sensors in cardiology that may facilitate in time diagnosis of cardiac abnormalities. Multidimensional MCG can effectively contribute to detecting atrial fibrillation (AFib), myocardial infarction (MI), and CAD. Additionally, MEMS motion sensing improves the reliability and quality of cardiac PET imaging.Moniulotteisten sulautettujen MEMS-liiketunnistimien käyttö sydänkardiografiassa sekä lääketieteellisessä 4D-kuvantamisessa Tausta: Sydän- ja verisuonitaudit ovat yleisin kuolinsyy. Näistä kuolemantapauksista lähes 80% johtuu sepelvaltimotaudista (CAD) ja aivoverenkierron häiriöistä. Moniulotteiset mikroelektromekaaniset järjestelmät (MEMS) mahdollistavat sydänlihaksen mekaanisen liikkeen mittaamisen, mikä puolestaan tarjoaa täysin uudenlaisen ja innovatiivisen ratkaisun sydämen rytmin ja toiminnan arvioimiseksi. Viimeaikaiset teknologiset edistysaskeleet mahdollistavat uusien pienikokoisten liiketunnistusjärjestelmien käyttämisen sydämen toiminnan tutkimuksessa sekä lääketieteellisen kuvantamisen, kuten esimerkiksi tietokonetomografian (CT) ja positroniemissiotomografian (PET), tarkkuuden parantamisessa. Menetelmät: Tämä väitöskirjatyö esittelee uuden sydämen kineettisen toiminnan mittaustekniikan, joka pohjautuu MEMS-anturien käyttöön. Uudet laskennalliset lähestymistavat, jotka perustuvat signaalinkäsittelyyn ja koneoppimiseen, mahdollistavat sydämen patologisten häiriöiden havaitsemisen MEMS-antureista saatavista signaaleista. Tässä tutkimuksessa keskitytään erityisesti mekanokardiografiaan (MCG), joihin kuuluvat gyrokardiografia (GCG) ja seismokardiografia (SCG). Näiden tekniikoiden avulla voidaan mitata kardiorespiratorisen järjestelmän mekaanisia ominaisuuksia. Tulokset: Kokeelliset analyysit osoittivat, että integroimalla usean sensorin dataa voidaan mitata syketiheyttä 99% (terveillä n=29) tarkkuudella, havaita sydämen rytmihäiriöt (n=435) 95-97%, tarkkuudella, sekä havaita iskeeminen sairaus noin 75% tarkkuudella (n=22). Lisäksi MEMS-kaksoistahdistuksen avulla voidaan parantaa sydämen 4D PET-kuvan laatua, kun liikeepätarkkuudet voidaan eliminoida paremmin. Doppler-kuvantamisessa (TDI, Tissue Doppler Imaging) GCG-analyysi (terveillä, n=9) osoitti lupaavia tuloksia sydänsykkeen ajoituksen ja intervallien sekä sydänlihasmuutosten mittaamisessa. Päätelmä: Tämän tutkimuksen tulokset osoittavat, että kardiologisilla MEMS-liikeantureilla on kliinistä potentiaalia sydämen toiminnallisten poikkeavuuksien diagnostisoinnissa. Moniuloitteinen MCG voi edistää eteisvärinän (AFib), sydäninfarktin (MI) ja CAD:n havaitsemista. Lisäksi MEMS-liiketunnistus parantaa sydämen PET-kuvantamisen luotettavuutta ja laatua

Characterization and interpretation of cardiovascular and cardiorespiratory dynamics in cardiomyopathy patients

Aplicat embargament des de la data de defensa fins el dia 20/5/2022The main objective of this thesis was to study the variability of the cardiac, respiratory and vascular systems through electrocardiographic (ECG), respiratory flow (FLW) and blood pressure (BP) signals, in patients with idiopathic (IDC), dilated (DCM), or ischemic (ICM) disease. The aim of this work was to introduce new indices that could contribute to characterizing these diseases. With these new indices, we propose methods to classify cardiomyopathy patients (CMP) according to their cardiovascular risk or etiology. In addition, a new tool was proposed to reconstruct artifacts in biomedical signals. From the ECG, BP and FLW signals, different data series were extracted: beat to beat intervals (BBI - ECG), systolic and diastolic blood pressure (SBP and DBP - BP), and breathing duration (TT - FLW). -Firstly, we propose a novel artifact reconstruction method applied to biomedical signals. The reconstruction process makes use of information from neighboring events while maintaining the dynamics of the original signal. The method is based on detecting the cycles and artifacts, identifying the number of cycles to reconstruct, and predicting the cycles used to replace the artifact segments. The reconstruction results showed that most of the artifacts were correctly detected, and physiological cycles were incorrectly detected as artifacts in fewer than 1% of the cases. The second part is related to the cardiac death risk stratification of patients based on their left ventricular ejection (LVEF), using the Poincaré plot analysis, and classified as low (LVEF > 35%) or high (LVEF = 35%) risk. The BBI, SBP, and IT series of 46 CMP patients were applied. The linear discriminant analysis and support vector machines (SVM) classification methods were used. When comparing low risk vs high risk, an accuracy of 98 12% was obtained. Our results suggest that a dysfunction in the vagal activity could prevent the body from correctly maintaining circulatory homeostasis Next, we studied cardio-vascular couplings based on heart rate (HRV) and blood pressure (BPV) variability analyses in order to introduce new indices for noninvasive risk stratification in IDC patients. The ECG and BP signals of 91 IDC patients, and 49 healthy subjects were used. The patients were stratified by their sudden cardiac death risk as: high risk (IDCHR), when after two years the subject either died or suffered complications, or low risk (IDCLR) otherwise. Several indices were extracted from the BBI and SBP, and analyzed using the segmented Poincaré plot analysis, the high-resolution joint symbolic dynamics, and the normalized short time partial directed coherence methods. SVM models were built to classify these patients based on their sudden cardiac death risk. The SVM IDCLR vs IDCHR model achieved 98 9% accuracy with an area under the curve (AUC) of 0.96. Our results suggest that IDCHR patients have decreased HRV and increased BPV compared to both the IDCLR patients and the control subjects, suggesting a decrease in their vagal activity and the compensation of sympathetic activity. Lastly, we analyzed the cardiorespiratory interaction associated with the systems related to ICM and DCM disease. We propose an analysis based on vascular activity as the input and output of the baroreflex response. The aim was to analyze the suitability of cardiorespiratory and vascular interactions for the classification of ICM and DCM patients. We studied 41 CMP patients and 39 healthy subjects. Three new sub-spaces were defined: 'up' for increasing values, 'down' for decreasing values, and 'no change' otherwise, and a three-dimensional representation was created for each sub-space that was characterized statistically and morphologically. The resulting indices were used to classify the patients by their etiology through SVM models achieving 92.7% accuracy for ICM vs DCM patients comparison. The results reflected a more pronounced deterioration of the autonomous regulation in DCM patients.El objetivo de esta tesis fue estudiar la variabilidad de los sistemas cardíaco, respiratorio y vascular a través de señales electrocardiográficas (ECG), de flujo respiratorio (FLW) y de presión arterial (BP), en pacientes con cardiopatía idiopática (IDC). dilatada (DCM) o isquémica (ICM). El objetivo de este trabajo fue introducir nuevos indices que contribuyan a caracterizar estas enfermedades. Proponemos métodos para clasificar pacientes con cardiomiopatía (CMP) de acuerdo con su riesgo cardiovascular o etiología. Además, se propuso una nueva herramienta para reconstruir artefactos en señales biomédicas. De las señales de ECG, BP y FLW, se extrajeron diferentes series temporales: intervalos latido-a-latido (BBI - ECG), presión arterial sistólica y diastólica (SBP y DBP - BP) y la duración de la respiración (TT - FLW). En primer lugar, proponemos un método de reconstrucción de artefactos aplicado a señales biomédicas. El proceso de reconstrucción usa la información de eventos vecinos manteniendo la dinámica de la señal. El método se basa en detectar ciclos y artefactos, en identificar el número de ciclos a reconstruir y en predecir los ciclos utilizados para reemplazar los artefactos. La mayoría de los artefactos probados fueron detectados y reconstruidos correctamente y los ciclos fisiológicos fueron detectados incorrectamente como artefactos en menos del 1% de los casos, La segunda parte está relacionada con la estratificación de riesgo de muerte cardiovascular en función de la fracción de eyección ventricular izquierda (FEVI), mediante el análisis de Poincaré, en bajo (FEVI > 35%) y alto riesgo (FEVI 5 35%). Se utilizaron las series BBI, SBP y TT de 46 pacientes con CMP. Se utilizaron para la clasificación el análisis discriminante lineal y las máquinas de soporte vectorial (SVM). Al comparar los pacientes de bajo y alto riesgo, se obtuvo una exactitud del 98%. Los resultados sugieren la disfunción de la actividad vagal en pacientes de alto riesgo. A continuación, estudiamos los acoplamientos cardiovasculares basados en el análisis de la variabilidad de la frecuencia cardiaca (HRV) y la presión arterial (BPV) para introducir nuevos índices de estratificación de riesgo en pacientes con IDC. Se utilizaron las señales de ECG y BP de 91 pacientes con IDC y 49 sujetos sanos. Los pacientes fueron estratificados por su riesgo cardíaco como: alto riesgo (IDCHR), cuando después de dos años el sujeto murió, o bajo riesgo (IDCLR) en otro caso. Se extrajeron indices utilizando el análisis de Poincaré segmentado, la dinámica simbólica articulada de alta resolución y la coherencia parcial dirigida a corto plazo normalizada. Se construyeron modelos SVM para clasificar a estos pacientes en función de su riesgo cardiovascular. El modelo IDCLR vs IDCHR logró una exactitud del 98% con un área bajo la curva de 0.96. Los resultados sugieren que los pacientes IDCHR tienen sus HRV y BPV disminuidos en comparación con los pacientes IDCLR, lo que sugiere una disminución en su actividad vagal y la compensación de la actividad simpática. Finalmente, analizamos la interacción cardiorrespiratoria asociada con los sistemas relacionados con ICM y DCM. Proponemos un análisis basado en la actividad vascular como entrada y salida de la respuesta baroreflectora. El objetivo fue analizar la capacidad de las interacciones cardiorrespiratorias y vasculares para la clasificación de pacientes con ICM y DCM. Estudiamos 41 pacientes con CMP y 39 sujetos sanos. Se definieron tres sub-espacios: 'up' para valores crecientes, 'down' para los decrecientes, y 'no-change' en otro caso, y se creó una representación tridimensional que se caracterizó estadística y morfológicamente. Los indices resultantes se usaron para clasificar a los pacientes por su etiología con modelos SVM que lograron una exactitud de 92% cuando los pacientes ICM y DCM fueron comparados. Los resultados reflejaron un deterioro más pronunciado de la regulación autónoma en pacientes con DCM.Postprint (published version

Relationship between electrocardiogram‐based features and personality traits: Machine learning approach

Background: Based on the known relationship between the human emotion and standard surface electrocardiogram (ECG), we explored the relationship between features extracted from standard ECG recorded during relaxation and seven personality traits (Honesty/humility, Emotionality, eXtraversion, Agreeableness, Conscientiousness, Openness, and Disintegration) by using the machine learning (ML) approach which learns from the ECG-based features and predicts the appropriate personality trait by adopting an automated software algorithm. Methods: A total of 71 healthy university students participated in the study. For quantification of 62 ECG-based parameters (heart rate variability, as well as temporal and amplitude-based parameters) for each ECG record, we used computation procedures together with publicly available data and code. Among 62 parameters, 34 were segregated into separate features according to their diagnostic relevance in clinical practice. To examine the feature influence on personality trait classification and to perform classification, we used random forest ML algorithm. Results: Classification accuracy when clinically relevant ECG features were employed was high for Disintegration (81.3%) and Honesty/humility (75.0%) and moderate to high for Openness (73.3%) and Conscientiousness (70%), while it was low for Agreeableness (56.3%), eXtraversion (47.1%), and Emotionality (43.8%). When all calculated features were used, the classification accuracies were the same or lower, except for the eXtraversion (52.9%). Correlation analysis for selected features is presented. Conclusions: Results indicate that clinically relevant features might be applicable for personality traits prediction, although no remarkable differences were found among selected groups of parameters. Physiological associations of established relationships should be further explored.Ministry of Education, Science, and Technological Development, Republic of Serbia, Grant/Award Number: 179018 and TR33020; Abbott Laboratorie

Algorithms for automated diagnosis of cardiovascular diseases based on ECG data: A comprehensive systematic review

The prevalence of cardiovascular diseases is increasing around the world. However, the technology is evolving and can be monitored with low-cost sensors anywhere at any time. This subject is being researched, and different methods can automatically identify these diseases, helping patients and healthcare professionals with the treatments. This paper presents a systematic review of disease identification, classification, and recognition with ECG sensors. The review was focused on studies published between 2017 and 2022 in different scientific databases, including PubMed Central, Springer, Elsevier, Multidisciplinary Digital Publishing Institute (MDPI), IEEE Xplore, and Frontiers. It results in the quantitative and qualitative analysis of 103 scientific papers. The study demonstrated that different datasets are available online with data related to various diseases. Several ML/DP-based models were identified in the research, where Convolutional Neural Network and Support Vector Machine were the most applied algorithms. This review can allow us to identify the techniques that can be used in a system that promotes the patient’s autonomy.N/

A Morphological Approach To Identify Respiratory Phases Of Seismocardiogram

Respiration affects the cardiovascular system significantly and the morphology of signals relevant to the heart changes with respiration. Such changes have been used to extract respiration signal from electrocardiogram (ECG). It is also shown that accelerometers placed on the body can be used to extract respiration signals. It has been demonstrated that the signal morphology for seismocardiogram, the lower frequency band of chest accelerations, is different between inhale and exhale. For instance, systolic time intervals (STI), which provide a quantitative estimation of left ventricular performance, vary between inhale and exhale phases. In other words, heart beats happening in exhale phase are different compared to those in inhale phase. Thus, our main goal in this thesis is investigating feasibility of finding an automatic morphological based method to identify respiratory phases of heart cycles. In this thesis, forty signal recordings from twenty subjects were used. In each recording, the reference respiratory belt signal, three dimensional (3D) chest acceleration signals, and electrocardiogram signals were recorded. The first stage was is choosing a proper estimated respiratory signal. The second stage, was the automatic respiratory phase detection of heart cycles using the selected estimated respiratory signal. The result shows that among estimated respiratory signals, accelerometer-derived respiration (ADR), in z-direction, has a potential m to identify respiratory phase of heart cycles with total accuracy of about 77%

Synergy of Physics-based Reasoning and Machine Learning in Biomedical Applications: Towards Unlimited Deep Learning with Limited Data

Technological advancements enable collecting vast data, i.e., Big Data, in science and industry including biomedical field. Increased computational power allows expedient analysis of collected data using statistical and machine-learning approaches. Historical data incompleteness problem and curse of dimensionality diminish practical value of pure data-driven approaches, especially in biomedicine. Advancements in deep learning (DL) frameworks based on deep neural networks (DNN) improved accuracy in image recognition, natural language processing, and other applications yet severe data limitations and/or absence of transfer-learning-relevant problems drastically reduce advantages of DNN-based DL. Our earlier works demonstrate that hierarchical data representation can be alternatively implemented without NN, using boosting-like algorithms for utilization of existing domain knowledge, tolerating significant data incompleteness, and boosting accuracy of low-complexity models within the classifier ensemble, as illustrated in physiological-data analysis. Beyond obvious use in initial-factor selection, existing simplified models are effectively employed for generation of realistic synthetic data for later DNN pre-training. We review existing machine learning approaches, focusing on limitations caused by training-data incompleteness. We outline our hybrid framework that leverages existing domain-expert models/knowledge, boosting-like model combination, DNN-based DL and other machine learning algorithms for drastic reduction of training-data requirements. Applying this framework is illustrated in context of analyzing physiological data