Variation of Korotkoff stethoscope sounds during blood pressure measurement: Analysis using a convolutional neural network

Korotkoff sounds are known to change their characteristics during blood pressure (BP) measurement, resulting in some uncertainties for systolic and diastolic pressure (SBP and DBP) determinations. The aim of this study was to assess the variation of Korotkoff sounds during BP measurement by examining all stethoscope sounds associated with each heartbeat from above systole to below diastole during linear cuff deflation. Three repeat BP measurements were taken from 140 healthy subjects (age 21 to 73 years; 62 female and 78 male) by a trained observer, giving 420 measurements. During the BP measurements, the cuff pressure and stethoscope signals were simultaneously recorded digitally to a computer for subsequent analysis. Heart beats were identified from the oscillometric cuff pressure pulses. The presence of each beat was used to create a time window (1s, 2000 samples) centered on the oscillometric pulse peak for extracting beat-by-beat stethoscope sounds. A time-frequency two-dimensional matrix was obtained for the stethoscope sounds associated with each beat, and all beats between the manually determined SBPs and DBPs were labeled as ‘Korotkoff’. A convolutional neural network was then used to analyze consistency in sound patterns that were associated with Korotkoff sounds. A 10-fold cross-validation strategy was applied to the stethoscope sounds from all 140 subjects, with the data from ten groups of 14 subjects being analysed separately, allowing consistency to be evaluated between groups. Next, within-subject variation of the Korotkoff sounds analysed from the three repeats was quantified, separately for each stethoscope sound beat. There was consistency between folds with no significant differences between groups of 14 subjects (P = 0.09 to P = 0.62). Our results showed that 80.7% beats at SBP and 69.5% at DBP were analysed as Korotkoff sounds, with significant differences between adjacent beats at systole (13.1%, P = 0.001) and diastole (17.4%, P < 0.001). Results reached stability for SBP (97.8%, at 6th beats below SBP) and DBP (98.1%, at 6th beat above DBP) with no significant differences between adjacent beats (SBP P = 0.74; DBP P = 0.88). There were no significant differences at high cuff pressures, but at low pressures close to diastole there was a small difference (3.3%, P = 0.02). In addition, greater within subject variability was observed at SBP (21.4%) and DBP (28.9%), with a significant difference between both (P < 0.02). In conclusion, this study has demonstrated that Korotkoff sounds can be consistently identified during the period below SBP and above DBP, but that at systole and diastole there can be substantial variations that are associated with high variation in the three repeat measurements in each subject

Blood Pressure Estimation from Electrocardiogram and Photoplethysmography Signals Using Continuous Wavelet Transform and Convolutional Neural Network

Cuff-less and continuous blood pressure (BP) measurement has recently become an active research area in the field of remote healthcare monitoring. There is a growing demand for automated BP estimation and monitoring for various long-term and chronic conditions. Automated BP monitoring can produce a good amount of rich health data, which increases the chance of early diagnosis and treatments that are critical for a long-term condition such as hypertension and Cardiovascular diseases (CVDs). However, mining and processing this vast amount of data is challenging, which is aimed to address in this research. We employed a continuous wavelet transform (CWT) and a deep convolutional neural network (CNN) to estimate the BP. The electrocardiogram (ECG), photoplethysmography (PPG) and arterial blood pressure (ABP) signals were extracted from the online Medical Information Mart for Intensive Care (MIMIC III) database. The scalogram of each signal was created and used for training and testing our proposed CNN model that can implicitly learn to extract the descriptive features from the training data. This study achieved a promising BP estimation approach has been achieved without employing engineered feature extraction that is comparable with previous works. Experimental results demonstrated a low root mean squere error (RMSE) rate of 3.36 mmHg and a high accuracy of 86.3% for BP estimations. The proposed CNN-based model can be considered as a reliable and feasible approach to estimate BP for continuous remote healthcare monitoring

딥러닝 기반 혈압 예측 기법

학위논문 (박사) -- 서울대학교 대학원 : 공과대학 전기·정보공학부, 2020. 8. 윤성로.While COVID-19 is changing the world's social profile, it is expected that the telemedicine sector, which has not been activated due to low regulation and reliability, will also undergo a major change. As COVID-19 spreads in the United States, the US Department of Health \& Human Services temporarily loosens the standards for telemedicine, while enabling telemedicine using Facebook, Facebook Messenger-based video chat, Hangouts, and Skype. The expansion of the telemedicine market is expected to quickly transform the existing treatment-oriented hospital-led medical market into a digital healthcare service market focused on prevention and management through wearables, big data, and health records analysis. In this prevention and management-oriented digital healthcare service, it is very important to develop a technology that can easily monitor a person's health status. One of the vital signs that can be used for personal health monitoring is blood pressure. High BP is a common and dangerous condition. About 1 out of 3 adults in the U.S. (about 75 million people) have high BP. This common condition increases the risk of heart disease and stroke, two of the leading causes of death for Americans. High BP is called the silent killer because it often has no warning signs or symptoms, and many people are not aware they have it. For these reasons, it is important to develop a technology that can easily and conveniently check BP regularly. In biomedical data analysis, various studies are being attempted to effectively analyze by applying machine learning to biomedical big data accumulated in large quantities. However, collecting blood pressure-related data at the level of big data is very difficult and very expensive because it takes a lot of manpower and time. So in this dissertation, we proposed a three-step strategy to overcome these issues. First, we describe a BP prediction model with extraction and concentration CNN architecture, to process publicly disclosed sequential ECG and PPG dataset. Second, we evaluate the performance of the developed model by applying the developed model to privately measured data. To address the third issue, we propose the knowledge distillation method and input pre-processing method to improve the accuracy of the blood pressure prediction model. All the methods proposed in this dissertation are based on a deep convolutional neural network (CNN). Unlike other studies based on manual recognition of the features, by utilizing the advantage of deep learning which automatically extracts features, raw biomedical signals are used intact to reflect the inherent characteristics of the signals themselves.코로나 19에 의한 전 세계의 사회적 프로필 변화로, 규제와 신뢰성이 낮기 때문에 활성화 되지 않은 원격 의료 분야도 큰 변화를 겪을 것으로 예상됩니다. 코로나 19가 미국에 퍼짐에 따라 미국 보건복지부는 원격 진료의 표준을 일시적으로 완화하면서 페이스북, 페이스북 메신저 기반 화상 채팅, 행아웃, 스카이프를 사용한 원격 진료를 가능하게 했습니다. 원격의료 시장의 확장은 기존의 치료중심 병원주도의 의료시장을 웨어러블, 빅 데이터 및 건강기록 분석을 통한 예방 및 관리에 중점을 둔 디지털 의료 서비스 시장으로 빠르게 변화시킬 것으로 예상됩니다. 이러한 예방 및 관리 중심의 디지털 헬스케어 서비스에서는 사람의 건강 상태를 쉽게 모니터링 할 수 있는 기술 개발이 매우 중요한데 혈압은 개인 건강 모니터링에 사용될 수 있는 필수 징후 중 하나 입니다. 고혈압은 아주 흔하고 위험한 질환입니다. 미국 성인 3명중 1명(약 7,500만명)이 고혈압을 가지고 있습니다. 이는 미국인의 주요 사망 원인 중 두가지인 심장질환과 뇌졸중의 위험을 증가 시킵니다. 고혈압은 신체에 경고 신호나 자각 증상이 없어 많은 사람들이 자신이 고혈압인 것을 인지하지 못하기 때문에 "사일런트 킬러"라 불리웁니다. 이러한 이유로 정기적으로 쉽고 편리하게 혈압을 확인할 수 있는 기술의 개발이 매우 중요합니다. 생체의학 데이터 분석 분야에서는 머신 러닝을 대량으로 수집된 생체의학 빅 데이터에 적용하는 다양한 연구가 효과적으로 이루어지고 있습니다. 그러나 빅 데이터 수준으로 다량의 혈압 관련 데이터를 수집하는 것은 많은 전문적인 인력들이 오랜시간을 필요로 하기 때문에 매우 어렵고 비용 또한 많이 필요합니다. 따라서 본 학위논문에서는 이러한 문제를 극복하기 위한 3단계 전략을 제안했습니다. 먼저 누구나 시용할 수 있도록 공개되어 있는 심전도, 광용적맥파 데이터셋을 이용, 순차적인 심전도, 광용적맥파 신호에서 혈압을 잘 예측하도록 고안된 추출 및 농축 작업을 반복하는 함성곱 신경망 구조를 제안했습니다. 두번째로 제안된 합성곱 신경망 모델을 개인에게서 측정한 광용적맥파 신호를 이용해 제안된 함성곱 신경망 모델의 성능을 평가했습니다. 세번째로 혈압예측 모델의 정확성을 높이기 위해 지식 증류법과 입력신호 전처리 방법을 제안했습니다. 이 논문에서 제안된 모든 혈압예측 방법은 합성곱 신경망을 기반으로 합니다. 혈압 예측에 필요한 특징들을 수동으로 추출해야 하는 다른 연구들과 다르게 특징을 자동으로 추출하는 딥러닝의 장점을 활용, 아무런 처리도 하지 않은 원래 그대로의 생체 신호에서 신호 자체의 고유한 특징을 반영할 수 있습니다.1 Introduction 1 2 Background 5 2.1 Cuff-based BP measurement methods 9 2.1.1 Auscultatory method 9 2.1.2 Oscillometric method 10 2.1.3 Tonometric method 11 2.2 Biomedical signals used in cuffless BP prediction methods 13 2.2.1 Electrocardiography (ECG) 13 2.2.2 Photoplethysmography (PPG) 20 2.3 Cuffless BP measurement methods 21 2.3.1 PWV based BP prediction methods 25 2.3.2 Machine learning based pulse wave analysis methods 26 2.4 Deep learning for sequential biomedical data 30 2.4.1 Convolutional neural networks 31 2.4.2 Recurrent neural networks 32 3 End-to-end blood pressure prediction via fully convolutional networks 33 3.1 Introduction 35 3.2 Method 38 3.2.1 Data preparation 38 3.2.2 CNN based prediction model 41 3.2.3 Detailed architecture 45 3.3 Experimental results 47 3.3.1 Setup 47 3.3.2 Model evaluation & selection 48 3.3.3 Calibration-based method 51 3.3.4 Performance comparison 52 3.3.5 Verification using international standards for BP measurement grading criteria 54 3.3.6 Performance comparison by the input signal combinations 56 3.3.7 An ablation study of each architectural component of extraction-concentration blocks 58 3.3.8 Preprocessing of input signal to improve blood pressure prediction performance 59 3.4 Discussion 61 3.5 Summary 63 4 Blood pressure prediction by a smartphone sensor using fully convolutional networks 64 4.1 Introduction 66 4.2 Method 69 4.2.1 Data acquisition 71 4.2.2 Preprocessing of the PPG signals 71 4.2.3 PPG signal selection 71 4.2.4 Data preparation for CNN model training 72 4.2.5 Network architectures 72 4.3 Experimental results 75 4.3.1 Implementation details 75 4.3.2 Effect of PPG combination on BP prediction 75 4.3.3 Performance comparison with other related works 76 4.3.4 Verification using international standards for BP measurement grading criteria 77 4.3.5 Preprocessing of input signal to improve blood pressure prediction performance 79 4.4 Discussion 81 4.5 Summary 83 5 Improving accuracy of blood pressure prediction by distilling the knowledge of neural networks 84 5.1 Introduction 85 5.2 Methods 87 5.3 Experimental results 88 5.4 Discussion & Summary 89 6 Conclusion 90 6.1 Future work 92 Bibliography 93 Abstract (In Korean) 106Docto

A Comparison of Deep Learning Techniques for Arterial Blood Pressure Prediction

Continuous vital signal monitoring is becoming more relevant in preventing diseases that afflict a large part of the world’s population; for this reason, healthcare equipment should be easy to wear and simple to use. Non-intrusive and non-invasive detection methods are a basic requirement for wearable medical devices, especially when these are used in sports applications or by the elderly for self-monitoring. Arterial blood pressure (ABP) is an essential physiological parameter for health monitoring. Most blood pressure measurement devices determine the systolic and diastolic arterial blood pressure through the inflation and the deflation of a cuff. This technique is uncomfortable for the user and may result in anxiety, and consequently affect the blood pressure and its measurement. The purpose of this paper is the continuous measurement of the ABP through a cuffless, non-intrusive approach. The approach of this paper is based on deep learning techniques where several neural networks are used to infer ABP, starting from photoplethysmogram (PPG) and electrocardiogram (ECG) signals. The ABP was predicted first by utilizing only PPG and then by using both PPG and ECG. Convolutional neural networks (ResNet and WaveNet) and recurrent neural networks (LSTM) were compared and analyzed for the regression task. Results show that the use of the ECG has resulted in improved performance for every proposed configuration. The best performing configuration was obtained with a ResNet followed by three LSTM layers: this led to a mean absolute error (MAE) of 4.118 mmHg on and 2.228 mmHg on systolic and diastolic blood pressures, respectively. The results comply with the American National Standards of the Association for the Advancement of Medical Instrumentation. ECG, PPG, and ABP measurements were extracted from the MIMIC database, which contains clinical signal data reflecting real measurements. The results were validated on a custom dataset created at Neuronica Lab, Politecnico di Torino

PPG2ABP: Translating Photoplethysmogram (PPG) Signals to Arterial Blood Pressure (ABP) Waveforms using Fully Convolutional Neural Networks

Cardiovascular diseases are one of the most severe causes of mortality, taking a heavy toll of lives annually throughout the world. The continuous monitoring of blood pressure seems to be the most viable option, but this demands an invasive process, bringing about several layers of complexities. This motivates us to develop a method to predict the continuous arterial blood pressure (ABP) waveform through a non-invasive approach using photoplethysmogram (PPG) signals. In addition we explore the advantage of deep learning as it would free us from sticking to ideally shaped PPG signals only, by making handcrafted feature computation irrelevant, which is a shortcoming of the existing approaches. Thus, we present, PPG2ABP, a deep learning based method, that manages to predict the continuous ABP waveform from the input PPG signal, with a mean absolute error of 4.604 mmHg, preserving the shape, magnitude and phase in unison. However, the more astounding success of PPG2ABP turns out to be that the computed values of DBP, MAP and SBP from the predicted ABP waveform outperforms the existing works under several metrics, despite that PPG2ABP is not explicitly trained to do so

A hybrid neural network for continuous and non-invasive estimation of blood pressure from raw electrocardiogram and photoplethysmogram waveforms

Background and objectives: Continuous and non-invasive blood pressure monitoring would revolutionize healthcare. Currently, blood pressure (BP) can only be accurately monitored using obtrusive cuff-based devices or invasive intra-arterial monitoring. In this work, we propose a novel hybrid neural network for the accurate estimation of blood pressure (BP) using only non-invasive electrocardiogram (ECG) and photoplethysmogram (PPG) waveforms as inputs. Methods: This work proposes a hybrid neural network combines the feature detection abilities of temporal convolutional layers with the strong performance on sequential data offered by long short-term memory layers. Raw electrocardiogram and photoplethysmogram waveforms are concatenated and used as network inputs. The network was developed using the TensorFlow framework. Our scheme is analysed and compared to the literature in terms of well known standards set by the British Hypertension Society (BHS) and the Association for the Advancement of Medical Instrumentation (AAMI). Results: Our scheme achieves extremely low mean absolute errors (MAEs) of 4.41 mmHg for SBP, 2.91 mmHg for DBP, and 2.77 mmHg for MAP. A strong level of agreement between our scheme and the gold-standard intra-arterial monitoring is shown through Bland Altman and regression plots. Additionally, the standard for BP devices established by AAMI is met by our scheme. We also achieve a grade of 'A' based on the criteria outlined by the BHS protocol for BP devices. Conclusions: Our CNN-LSTM network outperforms current state-of-the-art schemes for non-invasive BP measurement from PPG and ECG waveforms. These results provide an effective machine learning approach that could readily be implemented into non-invasive wearable devices for use in continuous clinical and at-home monitoring

Assessment of Non-Invasive Blood Pressure Prediction from PPG and rPPG Signals Using Deep Learning

Exploiting photoplethysmography signals (PPG) for non-invasive blood pressure (BP) measurement is interesting for various reasons. First, PPG can easily be measured using fingerclip sensors. Second, camera based approaches allow to derive remote PPG (rPPG) signals similar to PPG and therefore provide the opportunity for non-invasive measurements of BP. Various methods relying on machine learning techniques have recently been published. Performances are often reported as the mean average error (MAE) on the data which is problematic. This work aims to analyze the PPG- and rPPG based BP prediction error with respect to the underlying data distribution. First, we train established neural network (NN) architectures and derive an appropriate parameterization of input segments drawn from continuous PPG signals. Second, we use this parameterization to train NNs with a larger PPG dataset and carry out a systematic evaluation of the predicted blood pressure. The analysis revealed a strong systematic increase of the prediction error towards less frequent BP values across NN architectures. Moreover, we tested different train/test set split configurations which underpin the importance of a careful subject-aware dataset assignment to prevent overly optimistic results. Third, we use transfer learning to train the NNs for rPPG based BP prediction. The resulting performances are similar to the PPG-only case. Finally, we apply different personalization techniques and retrain our NNs with subject-specific data for both the PPG-only and rPPG case. Whilst the particular technique is less important, personalization reduces the prediction errors significantly

Application of Deep Neural Network Models for Blood Pressure Classification based on Photoplethysmograpic Recordings

[EN] The measurement of blood pressure (BP) in an uninterrupted and comfortable way for the subject is essential for early diagnosis and monitoring of cardiovascular diseases (CVD). In fact, hypertension is the main risk factor for CVD because, being a hidden health problem with no symptoms until late stages of the disease are reached. This work investigates whether deep neural network models are able to discriminate between healthy and hypertensive subjects based on photoplethysmographic (PPG) recordings, without the need of electrocardiographic (ECG) recordings as well as avoiding manual morphological feature extraction, as has been popularly used in many previous studies. Recordings analyzed consisted of 635 simultaneous PPG and arterial blood pressure (ABP) signals from 50 different patients. The classification was performed with GoogLeNet, ResNet-18 and ResNet-50 pretrained convolutional neural networks (CNN) using as input images the scalogram of PPG segments obtained by continuous wavelet transformation (CWT). Additionally, Adam and SGDM training solvers were used to compare classification performance. After applying early stopping to avoid overfitting, training was performed with more than half of the epochs using Adam optimizer. ResNet-18 CNN provided the highest classification performance with sensitivity of 95.68%, specificity of 93.65%, F1-score of 95.61% an Area under the Roc area of 98.77%. Hence, the application of deep neural network classification models using time frequency transformation of PPG recordings has been able to provide outstanding results in blood pressure classification without requiring neither morphological feature extraction nor ECG features.Research supported by grants DPI2017-83952-C3 from MINECO/AEI/FEDER UE, SBPLY/17/180501/000411 from JCCLM and AICO/2021/286 from GVA.Cano, J.; Fácila, L.; Langley, P.; Zangróniz, R.; Alcaraz, R.; Rieta, JJ. (2021). Application of Deep Neural Network Models for Blood Pressure Classification based on Photoplethysmograpic Recordings. IEEE. 1-4. https://doi.org/10.1109/EHB52898.2021.96576581