Short-segment heart sound classification using an ensemble of deep convolutional neural networks

This paper proposes a framework based on deep convolutional neural networks (CNNs) for automatic heart sound classification using short-segments of individual heart beats. We design a 1D-CNN that directly learns features from raw heart-sound signals, and a 2D-CNN that takes inputs of two- dimensional time-frequency feature maps based on Mel-frequency cepstral coefficients (MFCC). We further develop a time-frequency CNN ensemble (TF-ECNN) combining the 1D-CNN and 2D-CNN based on score-level fusion of the class probabilities. On the large PhysioNet CinC challenge 2016 database, the proposed CNN models outperformed traditional classifiers based on support vector machine and hidden Markov models with various hand-crafted time- and frequency-domain features. Best classification scores with 89.22% accuracy and 89.94% sensitivity were achieved by the ECNN, and 91.55% specificity and 88.82% modified accuracy by the 2D-CNN alone on the test set.Comment: 8 pages, 1 figure, conferenc

NRC-Net: Automated noise robust cardio net for detecting valvular cardiac diseases using optimum transformation method with heart sound signals

Cardiovascular diseases (CVDs) can be effectively treated when detected early, reducing mortality rates significantly. Traditionally, phonocardiogram (PCG) signals have been utilized for detecting cardiovascular disease due to their cost-effectiveness and simplicity. Nevertheless, various environmental and physiological noises frequently affect the PCG signals, compromising their essential distinctive characteristics. The prevalence of this issue in overcrowded and resource-constrained hospitals can compromise the accuracy of medical diagnoses. Therefore, this study aims to discover the optimal transformation method for detecting CVDs using noisy heart sound signals and propose a noise robust network to improve the CVDs classification performance.For the identification of the optimal transformation method for noisy heart sound data mel-frequency cepstral coefficients (MFCCs), short-time Fourier transform (STFT), constant-Q nonstationary Gabor transform (CQT) and continuous wavelet transform (CWT) has been used with VGG16. Furthermore, we propose a novel convolutional recurrent neural network (CRNN) architecture called noise robust cardio net (NRC-Net), which is a lightweight model to classify mitral regurgitation, aortic stenosis, mitral stenosis, mitral valve prolapse, and normal heart sounds using PCG signals contaminated with respiratory and random noises. An attention block is included to extract important temporal and spatial features from the noisy corrupted heart sound.The results of this study indicate that,CWT is the optimal transformation method for noisy heart sound signals. When evaluated on the GitHub heart sound dataset, CWT demonstrates an accuracy of 95.69% for VGG16, which is 1.95% better than the second-best CQT transformation technique. Moreover, our proposed NRC-Net with CWT obtained an accuracy of 97.4%, which is 1.71% higher than the VGG16

Synthesis of normal and abnormal heart sounds using Generative Adversarial Networks

En esta tesis doctoral se presentan diferentes métodos propuestos para el análisis y síntesis de sonidos cardíacos normales y anormales, logrando los siguientes aportes al estado del arte: i) Se implementó un algoritmo basado en la transformada wavelet empírica (EWT) y la energía promedio normalizada de Shannon (NASE) para mejorar la etapa de segmentación automática de los sonidos cardíacos; ii) Se implementaron diferentes técnicas de extracción de características para las señales cardíacas utilizando los coeficientes cepstrales de frecuencia Mel (MFCC), los coeficientes de predicción lineal (LPC) y los valores de potencia. Además, se probaron varios modelos de Machine Learning para la clasificación automática de sonidos cardíacos normales y anormales; iii) Se diseñó un modelo basado en Redes Adversarias Generativas (GAN) para generar sonidos cardíacos sintéticos normales. Además, se implementa un algoritmo de eliminación de ruido utilizando EWT, lo que permite una disminución en la cantidad de épocas y el costo computacional que requiere el modelo GAN; iv) Finalmente, se propone un modelo basado en la arquitectura GAN, que consiste en refinar señales cardíacas sintéticas obtenidas por un modelo matemático con características de señales cardíacas reales. Este modelo se ha denominado FeaturesGAN y no requiere una gran base de datos para generar diferentes tipos de sonidos cardíacos. Cada uno de estos aportes fueron validados con diferentes métodos objetivos y comparados con trabajos publicados en el estado del arte, obteniendo resultados favorables.DoctoradoDoctor en Ingeniería Eléctrica y Electrónic

A survey on artificial intelligence-based acoustic source identification

The concept of Acoustic Source Identification (ASI), which refers to the process of identifying noise sources has attracted increasing attention in recent years. The ASI technology can be used for surveillance, monitoring, and maintenance applications in a wide range of sectors, such as defence, manufacturing, healthcare, and agriculture. Acoustic signature analysis and pattern recognition remain the core technologies for noise source identification. Manual identification of acoustic signatures, however, has become increasingly challenging as dataset sizes grow. As a result, the use of Artificial Intelligence (AI) techniques for identifying noise sources has become increasingly relevant and useful. In this paper, we provide a comprehensive review of AI-based acoustic source identification techniques. We analyze the strengths and weaknesses of AI-based ASI processes and associated methods proposed by researchers in the literature. Additionally, we did a detailed survey of ASI applications in machinery, underwater applications, environment/event source recognition, healthcare, and other fields. We also highlight relevant research directions

2D respiratory sound analysis to detect lung abnormalities

In this paper, we analyze deep visual features from 2D data representation(s) of the respiratory sound to detect evidence of lung abnormalities. The primary motivation behind this is that visual cues are more important in decision-making than raw data (lung sound). Early detection and prompt treatments are essential for any future possible respiratory disorders, and respiratory sound is proven to be one of the biomarkers. In contrast to state-of-the-art approaches, we aim at understanding/analyzing visual features using our Convolutional Neural Networks (CNN) tailored Deep Learning Models, where we consider all possible 2D data such as Spectrogram, Mel-frequency Cepstral Coefficients (MFCC), spectral centroid, and spectral roll-off. In our experiments, using the publicly available respiratory sound database named ICBHI 2017 (5.5 hours of recordings containing 6898 respiratory cycles from 126 subjects), we received the highest performance with the area under the curve of 0.79 from Spectrogram as opposed to 0.48 AUC from the raw data from a pre-trained deep learning model: VGG16. We also used machine learning algorithms using reliable data to improve Our study proved that 2D data representation could help better understand/analyze lung abnormalities as compared to 1D data. Our findings are also contrasted with those of earlier studies. For purposes of generality, we used the MFCC of neutrinos to determine if picture data or raw data produced superior results

Deteção de patologia cardíaca usando machine learning

Segundo a Organização Mundial da Saúde, as doenças cardiovasculares (DCV) representam 32% do número de mortes no mundo. A redução deste valor pode ser atingida através da deteção precoce que pode levar a um tratamento mais preciso, melhorando a expectativa de vida do paciente. A ausculta cardíaca é a principal técnica utilizada pelos profissionais de saúde para identificar muitas DCV. No entanto, a auscultação dos sons cardíacos é um procedimento difícil, já que muitos sons são fracos e difíceis de detetar, sendo necessário um processo de treino contínuo. Os estetoscópios modernos podem amplificar os sons cardíacos, reduzir o ruído de ambiente, melhorar a percepção do usuário e, mais importante, converter um sinal acústico em digital. Isto permitiu o desenvolvimento de sistemas de decisão assistidos por computador baseados na auscultação. Este documento apresenta uma metodologia que pode detectar automaticamente a existência de DCV através de sons cardíacos obtidos de diferentes partes do coração. Diversas tecnologias foram analisadas, assim como projetos que tentam resolver parte do problema em questão e a partir deles, três alternativas diferentes foram elaboradas e documentadas, assim como a divisão do dataset e métricas a serem usadas nos testes. Essas alternativas visam classificar anomalias na auscultação cardíaca dos pacientes. Vários modelos das duas primeiras alternativas foram implementados e seus resultados apresentados. Também é feita uma comparação entre as experiências desenvolvidas entre si, também com experiências básicas que não utilizam mecanismos inteligentes e com outros trabalhos que tenham o mesmo objetivo. O melhor resultado obtido foi pela primeira abordagem com uma exatidão de 94%, precisão de 81% e recall de 67%.According to World Health Organization, the cardiovascular diseases (CVD) represent 32% of the number of deaths worldwide. Early detection leads to a more accurate treatment plan and improves the patient’s life expectancy. Cardiac auscultation is the main technique used by health professionals to identify many CVD. Nevertheless, heart sound auscultation is a difficult procedure, since it requires continuous training and many heart sounds are faint and hard to detect. However, modern stethoscopes can amplify heart sounds, reduce the environment noise, improve the user’s perception and, more importantly, convert an acoustic signal to a digital one. This allowed, the development of computer assisted decision systems based on auscultation. This document presents a methodology that can automatically detect the existence of CVD through cardiac sounds obtained from different parts of the heart. Several technologies were analysed, as well as projects that try to solve part of the problem in question and from them, three different alternatives were elaborated and documented, as well as the division of test data and the metrics for their evaluation. These alternatives are intended to classify anomalies in patients' cardiac auscultation. Several models of the first two alternatives were implemented and their results presented. A comparison is also made between the experiences developed among themselves, also with basic experiments that do not use intelligent mechanisms and with other works that have the same objective. The best result obtained was by the first approach with an accuracy of 94%, precision of 81% and recall of 67%