Deep Learning in Cardiology

The medical field is creating large amount of data that physicians are unable to decipher and use efficiently. Moreover, rule-based expert systems are inefficient in solving complicated medical tasks or for creating insights using big data. Deep learning has emerged as a more accurate and effective technology in a wide range of medical problems such as diagnosis, prediction and intervention. Deep learning is a representation learning method that consists of layers that transform the data non-linearly, thus, revealing hierarchical relationships and structures. In this review we survey deep learning application papers that use structured data, signal and imaging modalities from cardiology. We discuss the advantages and limitations of applying deep learning in cardiology that also apply in medicine in general, while proposing certain directions as the most viable for clinical use.Comment: 27 pages, 2 figures, 10 table

An open access database for the evaluation of heart sound algorithms

This is an author-created, un-copyedited version of an article published in Physiological Measurement. IOP Publishing Ltd is not responsible for any errors or omissions in this version of the manuscript or any version derived from it. The Version of Record is available online at https://doi.org/10.1088/0967-3334/37/12/2181In the past few decades, analysis of heart sound signals (i.e. the phonocardiogram or PCG), especially for automated heart sound segmentation and classification, has been widely studied and has been reported to have the potential value to detect pathology accurately in clinical applications. However, comparative analyses of algorithms in the literature have been hindered by the lack of high-quality, rigorously validated, and standardized open databases of heart sound recordings. This paper describes a public heart sound database, assembled for an international competition, the PhysioNet/Computing in Cardiology (CinC) Challenge 2016. The archive comprises nine different heart sound databases sourced from multiple research groups around the world. It includes 2435 heart sound recordings in total collected from 1297 healthy subjects and patients with a variety of conditions, including heart valve disease and coronary artery disease. The recordings were collected from a variety of clinical or nonclinical (such as in-home visits) environments and equipment. The length of recording varied from several seconds to several minutes. This article reports detailed information about the subjects/patients including demographics (number, age, gender), recordings (number, location, state and time length), associated synchronously recorded signals, sampling frequency and sensor type used. We also provide a brief summary of the commonly used heart sound segmentation and classification methods, including open source code provided concurrently for the Challenge. A description of the PhysioNet/CinC Challenge 2016, including the main aims, the training and test sets, the hand corrected annotations for different heart sound states, the scoring mechanism, and associated open source code are provided. In addition, several potential benefits from the public heart sound database are discussed.This work was supported by the National Institutes of Health (NIH) grant R01-EB001659 from the National Institute of Biomedical Imaging and Bioengineering (NIBIB) and R01GM104987 from the National Institute of General Medical Sciences.Liu, C.; Springer, DC.; Li, Q.; Moody, B.; Abad Juan, RC.; Li, Q.; Moody, B.... (2016). An open access database for the evaluation of heart sound algorithms. Physiological Measurement. 37(12):2181-2213. doi:10.1088/0967-3334/37/12/2181S21812213371

The Relevance of Calibration in Machine Learning-Based Hypertension Risk Assessment Combining Photoplethysmography and Electrocardiography

[EN] The detection of hypertension (HT) is of great importance for the early diagnosis of cardiovascular diseases (CVDs), as subjects with high blood pressure (BP) are asymptomatic until advanced stages of the disease. The present study proposes a classification model to discriminate between normotensive (NTS) and hypertensive (HTS) subjects employing electrocardiographic (ECG) and photoplethysmographic (PPG) recordings as an alternative to traditional cuff-based methods. A total of 913 ECG, PPG and BP recordings from 69 subjects were analyzed. Then, signal preprocessing, fiducial points extraction and feature selection were performed, providing 17 discriminatory features, such as pulse arrival and transit times, that fed machine-learning-based classifiers. The main innovation proposed in this research uncovers the relevance of previous calibration to obtain accurate HT risk assessment. This aspect has been assessed using both close and distant time test measurements with respect to calibration. The k-nearest neighbors-classifier provided the best outcomes with an accuracy for new subjects before calibration of 51.48%. The inclusion of just one calibration measurement into the model improved classification accuracy by 30%, reaching gradually more than 96% with more than six calibration measurements. Accuracy decreased with distance to calibration, but remained outstanding even days after calibration. Thus, the use of PPG and ECG recordings combined with previous subject calibration can significantly improve discrimination between NTS and HTS individuals. This strategy could be implemented in wearable devices for HT risk assessment as well as to prevent CVDs.This research received financial support from grants PID2021-00X128525-IV0, PID2021123804OB-I00 and TED2021-129996B-I00 of the Spanish Government 10.13039/501100011033 jointly with the European Regional Development Fund (EU), SBPLY/17/180501/000411 from Junta de Comunidades de Castilla-La Mancha and AICO/2021/286 from Generalitat Valenciana.Cano, J.; Fácila, L.; Gracia-Baena, JM.; Zangróniz, R.; Alcaraz, R.; Rieta, JJ. (2022). The Relevance of Calibration in Machine Learning-Based Hypertension Risk Assessment Combining Photoplethysmography and Electrocardiography. Biosensors. 12(5):1-14. https://doi.org/10.3390/bios1205028911412

Data-driven methods for analyzing ballistocardiograms in longitudinal cardiovascular monitoring

Cardiovascular disease (CVD) is the leading cause of death in the US; about 48% of American adults have one or more types of CVD. The importance of continuous monitoring of the older population, for early detection of changes in health conditions, has been shown in the literature, as the key to a successful clinical intervention. We have been investigating environmentally-embedded in-home networks of non-invasive sensing modalities. This dissertation concentrates on the signal processing techniques required for the robust extraction of morphological features from the ballistocardiographs (BCG), and machine learning approaches to utilize these features in non-invasive monitoring of cardiovascular conditions. At first, enhancements in the time domain detection of the cardiac cycle are addressed due to its importance in the estimation of heart rate variability (HRV) and sleep stages. The proposed enhancements in the energy-based algorithm for BCG beat detection have shown at least 50% improvement in the root mean square error (RMSE) of the beat to beat heart rate estimations compared to the reference estimations from the electrocardiogram (ECG) R to R intervals. These results are still subject to some errors, primarily due to the contamination of noise and motion artifacts caused by floor vibration, unconstrained subject movements, or even the respiratory activities. Aging, diseases, breathing, and sleep disorders can also affect the quality of estimation as they slightly modify the morphology of the BCG waveform.Includes bibliographical reference

Multiclass Classifier based Cardiovascular Condition Detection Using Smartphone Mechanocardiography

Cardiac translational and rotational vibrations induced by left ventricular motions are measurable using joint seismocardiography (SCG) and gyrocardiography (GCG) techniques. Multi-dimensional non-invasive monitoring of the heart reveals relative information of cardiac wall motion. A single inertial measurement unit (IMU) allows capturing cardiac vibrations in sufficient details and enables us to perform patient screening for various heart conditions. We envision smartphone mechanocardiography (MCG) for the use of e-health or telemonitoring, which uses a multi-class classifier to detect various types of cardiovascular diseases (CVD) using only smartphone’s built-in internal sensors data. Such smartphone App/solution could be used by either a healthcare professional and/or the patient him/herself to take recordings from their heart. We suggest that smartphone could be used to separate heart conditions such as normal sinus rhythm (SR), atrial fibrillation (AFib), coronary artery disease (CAD), and possibly ST-segment elevated myocardial infarction (STEMI) in multiclass settings. An application could run the disease screening and immediately inform the user about the results. Widespread availability of IMUs within smartphones could enable the screening of patients globally in the future, however, we also discuss the possible challenges raised by the utilization of such self-monitoring systems.</p

The 2023 wearable photoplethysmography roadmap

Photoplethysmography is a key sensing technology which is used in wearable devices such as smartwatches and fitness trackers. Currently, photoplethysmography sensors are used to monitor physiological parameters including heart rate and heart rhythm, and to track activities like sleep and exercise. Yet, wearable photoplethysmography has potential to provide much more information on health and wellbeing, which could inform clinical decision making. This Roadmap outlines directions for research and development to realise the full potential of wearable photoplethysmography. Experts discuss key topics within the areas of sensor design, signal processing, clinical applications, and research directions. Their perspectives provide valuable guidance to researchers developing wearable photoplethysmography technology

Autonomic nervous system biomarkers from multi-modal and model-based signal processing in mental health and illness

Esta tesis se centra en técnicas de procesado multimodal y basado en modelos de señales para derivar parámetros fisiológicos, es decir, biomarcadores, relacionados con el sistema nervioso autónomo (ANS). El desarrollo de nuevos métodos para derivar biomarcadores de ANS no invasivos en la salud y la enfermedad mental ofrece la posibilidad de mejorar la evaluación del estrés y la monitorización de la depresión. Para este fin, el presente documento se estructura en tres partes principales. En la Parte I, se proporciona unaintroducción a la salud y la enfermedad mental (Cap. 1). Además, se presenta un marco teórico para investigar la etiología de los trastornos mentales y el papel del estrés en la enfermedad mental (Cap. 2). También se destaca la importancia de los biomarcadores no invasivos para la evaluación del ANS, prestando especial atención en la depresión clínica (Cap. 3, 4). En la Parte II, se proporciona el marco metodológico para derivar biomarcadores del ANS. Las técnicas de procesado de señales incluyen el análisis conjunto de la variabilidad del rítmo cardíaco (HRV) y la señal respiratoria (Cap. 6), técnicas novedosas para derivar la señal respiratoria del electrocardiograma (ECG) (Cap. 7) y un análisis robusto que se basa en modelar la forma de ondas del pulso del fotopletismograma (PPG) (Ch. 8). En la Parte III, los biomarcadores del ANS se evalúan en la quantificacióndel estrés (Cap. 9) y en la monitorización de la depresión (Ch. 10).Parte I: La salud mental no solo está relacionada con ese estado positivo de bienestar, en el que un individuo puede enfrentar a las situaciones estresantes de la vida, sino también con la ausencia de enfermedad mental. La enfermedad o trastorno mental se puede definir como un trastorno emocional, cognitivo o conductual que causa un deterioro funcional sustancial en una o más actividades importantes de la vida. Los trastornos mentales más comunes, que muchas veces coexisten, son la ansiedad y el trastorno depresivo mayor (MDD). La enfermedad mental tiene un impacto negativo en la calidad de vida, ya que se asocia con pérdidas considerables en la salud y el funcionamiento, y aumenta ignificativamente el riesgo de una persona de padecer enfermedades ardiovasculares.Un instigador común que subyace a la comorbilidad entre el MDD, la patologíacardiovascular y la ansiedad es el estrés mental. El estrés es común en nuestra vida de rítmo rapido e influye en nuestra salud mental. A corto plazo, ANS controla la respuesta cardiovascular a estímulos estresantes. La regulación de parámetros fisiológicos, como el rítmo cardíaco, la frecuencia respiratoria y la presión arterial, permite que el organismo responda a cambios repentinos en el entorno. Sin embargo, la adaptación fisiológica a un fenómeno ambiental que ocurre regularmente altera los sistemas biológicos involucrados en la respuesta al estrés. Las alteraciones neurobiológicas en el cerebro pueden alterar lafunción del ANS. La disfunción del ANS y los cambios cerebrales estructurales tienen un impacto negativo en los procesos cognitivos, emocionales y conductuales, lo que conduce al desarrollo de una enfermedad mental.Parte II: El desarrollo de métodos novedosos para derivar biomarcadores del ANS no invasivos ofrece la posibilidad de mejorar la evaluacón del estrés en individuos sanos y la disfunción del ANS en pacientes con MDD. El análisis conjunto de varias bioseñales (enfoquemultimodal) permite la cuantificación de interacciones entre sistemas biológicos asociados con ANS, mientras que el modelado de bioseãles y el análisis posterior de los parámetros del modelo (enfoque basado en modelos) permite la cuantificación robusta de cambios en mecanismos fisiológicos relacionados con el ANS. Un método novedoso, quetiene en cuenta los fenómenos de acoplo de fase y frecuencia entre la respiración y las señales de HRV para evaluar el acoplo cardiorrespiratorio no lineal cuadrático se propone en el Cap. 6.3. En el Cap. 7 se proponen nuevas técnicas paramejorar lamonitorización de la respiración. En el Cap. 8, para aumentar la robustez de algunas medidas morfológicas que reflejan cambios en el tonno arterial, se considera el modelado del pulso PPG como una onda principal superpuesta con varias ondas reflejadas.Parte III: Los biomarcadores del ANS se evalúan en la cuantificación de diferentes tipos de estrés, ya sea fisiológico o psicológico, en individuos sanos, y luego, en la monitorización de la depresión. En presencia de estrés mental (Cap. 9.1), inducido por tareas cognitivas, los sujetos sanos muestran un incremento en la frecuencia respiratoria y un mayor número de interacciones no lineales entre la respiración y la seãl de HRV. Esto podría estar asociado con una activación simpática, pero también con una respiración menos regular. En presencia de estrés hemodinámico (Cap. 9.2), inducido por un cambio postural, los sujetos sanos muestran una reducción en el acoplo cardiorrespiratoriono lineal cuadrático, que podría estar relacionado con una retracción vagal. En presencia de estrés térmico (Cap. 9.3), inducido por la exposición a emperaturas ambientales elevadas, los sujetos sanos muestran un aumento del equilibrio simpatovagal. Esto demuestra que los biomarcadores ANS son capaces de evaluar diferentes tipos de estrés y pueden explorarse más en el contexto de la monitorización de la depresión. En el Cap. 10, se evalúan las diferencias en la función del ANS entre elMDD y los sujetos sanos durante un protocolo de estrés mental, no solo con los valores brutos de los biomarcadores del ANS, sino también con los índices de reactividad autónoma, que reflejan la capacidad deun individuo para afrontar con una situación desafiante. Los resultados muestran que la depresión se asocia con un desequilibrio autonómico, que se caracteriza por una mayor actividad simpática y una reducción de la distensibilidad arterial. Los índices de reactividad autónoma cuantificados por cambios, entre etapas de estrés y de recuperación, en los sustitutos de la rigidez arterial, como la pérdida de amplitud de PPG en las ondas reflejadas, muestran el mejor rendimiento en términos de correlación con el grado de la depresión, con un coeficiente de correlación r = −0.5. La correlación negativa implicaque un mayor grado de depresión se asocia con una disminución de la reactividadautónoma. El poder discriminativo de los biomarcadores del ANS se aprecia también por su alto rendimiento diagnóstico para clasificar a los sujetos como MDD o sanos, con una precisión de 80.0%. Por lo tanto, se puede concluir que los biomarcadores del ANS pueden usarse para evaluar el estrés y que la distensibilidad arterial deteriorada podría constituir un biomarcador de salud mental útil en el seguimiento de la depresión.This dissertation is focused on multi-modal and model-based signal processing techniques for deriving physiological parameters, i.e. biomarkers, related to the autonomic nervous system (ANS). The development of novel approaches for deriving noninvasive ANS biomarkers in mental health and illness offers the possibility to improve the assessment of stress and the monitoring of depression. For this purpose, the present document is structured in three main parts. In Part I, an introduction to mental health and illness is provided (Ch. 1). Moreover, a theoretical framework for investigating the etiology of mental disorders and the role of stress in mental illness is presented (Ch. 2). The importance of noninvasive biomarkers for ANS assessment, paying particular attention in clinical depression, is also highlighted (Ch. 3, 4). In Part II, themethodological framework for deriving ANS biomarkers is provided. Signal processing techniques include the joint analysis of heart rate variability (HRV) and respiratory signals (Ch. 6), novel techniques for deriving the respiratory signal from electrocardiogram (ECG) (Ch. 7), and a robust photoplethysmogram(PPG)waveform analysis based on amodel-based approach (Ch. 8). In Part III, ANS biomarkers are evaluated in stress assessment (Ch. 9) and in the monitoring of depression (Ch. 10). Part I:Mental health is not only related to that positive state ofwell-being, inwhich an individual can cope with the normal stresses of life, but also to the absence of mental illness. Mental illness or disorder can be defined as an emotional, cognitive, or behavioural disturbance that causes substantial functional impairment in one or more major life activities. The most common mental disorders, which are often co-occurring, are anxiety and major depressive disorder (MDD). Mental illness has a negative impact on the quality of life, since it is associated with considerable losses in health and functioning, and increases significantly a person’s risk for cardiovascular diseases. A common instigator underlying the co-morbidity between MDD, cardiovascular pathology, and anxiety is mental stress. Stress is common in our fast-paced society and strongly influences our mental health. In the short term, ANS controls the cardiovascular response to stressful stimuli. Regulation of physiological parameters, such as heart rate, respiratory rate, and blood pressure, allows the organism to respond to sudden changes in the environment. However, physiological adaptation to a regularly occurring environmental phenomenon alters biological systems involved in stress response. Neurobiological alterations in the brain can disrupt the function of the ANS. ANS dysfunction and structural brain changes have a negative impact on cognitive, emotional, and behavioral processes, thereby leading to development of mental illness. Part II: The development of novel approaches for deriving noninvasive ANS biomarkers offers the possibility to improve the assessment of stress in healthy individuals and ANS dysfunction in MDD patients. Joint analysis of various biosignals (multi-modal approach) allows for the quantification of interactions among biological systems associated with ANS, while the modeling of biosignals and subsequent analysis of the model’s parameters (model-based approach) allows for the robust quantification of changes in physiological mechanisms related to the ANS. A novel method, which takes into account both phase and frequency locking phenomena between respiration and HRV signals, for assessing quadratic nonlinear cardiorespiratory coupling is proposed in Ch. 6.3. Novel techniques for improving the monitoring of respiration are proposed in Ch. 7. In Ch. 8, to increase the robustness for some morphological measurements reflecting arterial tone changes, the modeling of the PPG pulse as amain wave superposed with several reflected waves is considered. Part III: ANS biomarkers are evaluated in the assessment of different types of stress, either physiological or psychological, in healthy individuals, and then, in the monitoring of depression. In the presence of mental stress (Ch. 9.1), induced by cognitive tasks, healthy subjects show an increment in the respiratory rate and higher number of nonlinear interactions between respiration and HRV signal, which might be associated with a sympathetic activation, but also with a less regular breathing. In the presence of hemodynamic stress (Ch. 9.2), induced by a postural change, healthy subjects show a reduction in strength of the quadratic nonlinear cardiorespiratory coupling, whichmight be related to a vagal withdrawal. In the presence of heat stress (Ch. 9.3), induced by exposure to elevated environmental temperatures, healthy subjects show an increased sympathovagal balance. This demonstrates that ANS biomarkers are able to assess different types of stress and they can be further explored in the context of depression monitoring. In Ch. 10, differences in ANS function between MDD and healthy subjects during a mental stress protocol are assessed, not only with the raw values of ANS biomarkers but also with autonomic reactivity indices, which reflect the ability of an individual to copewith a challenging situation. Results show that depression is associated with autonomic imbalance, characterized by increased sympathetic activity and reduced arterial compliance. Autonomic reactivity indices quantified by changes, from stress to recovery, in arterial stiffness surrogates, such as the PPG amplitude loss in wave reflections, show the best performance in terms of correlation with depression severity, yielding to correlation coefficient r = −0.5. The negative correlation implies that a higher degree of depression is associated with a decreased autonomic reactivity. The discriminative power of ANS biomarkers is supported by their high diagnostic performance for classifying subjects as having MDD or not, yielding to accuracy of 80.0%. Therefore, it can be concluded that ANS biomarkers can be used for assessing stress and that impaired arterial compliance might constitute a biomarker of mental health useful in the monitoring of depression.<br /

The 2023 wearable photoplethysmography roadmap

Photoplethysmography is a key sensing technology which is used in wearable devices such as smartwatches and fitness trackers. Currently, photoplethysmography sensors are used to monitor physiological parameters including heart rate and heart rhythm, and to track activities like sleep and exercise. Yet, wearable photoplethysmography has potential to provide much more information on health and wellbeing, which could inform clinical decision making. This Roadmap outlines directions for research and development to realise the full potential of wearable photoplethysmography. Experts discuss key topics within the areas of sensor design, signal processing, clinical applications, and research directions. Their perspectives provide valuable guidance to researchers developing wearable photoplethysmography technology