BioInsights: Extracting personal data from "Still" wearable motion sensors

During recent years a large variety of wearable devices have become commercially available. As these devices are in close contact with the body, they have the potential to capture sensitive and unexpected personal data even when the wearer is not moving. This work demonstrates that wearable motion sensors such as accelerometers and gyroscopes embedded in head-mounted and wrist-worn wearable devices can be used to identify the wearer (among 12 participants) and his/her body posture (among 3 positions) from only 10 seconds of “still” motion data. Instead of focusing on large and apparent motions such as steps or gait, the proposed methods amplify and analyze very subtle body motions associated with the beating of the heart. Our findings have the potential to increase the value of pervasive wearable motion sensors but also raise important privacy concerns that need to be considered.National Science Foundation (U.S.). (CCF-1029585

Wearable Inertial Devices in Duchenne Muscular Dystrophy: A Scoping Review

In clinical practice and research, innovative digital technologies have been proposed for the characterization of neuromuscular and movement disorders through objective measures. Among these, wearable devices prove to be a suitable solution for tele-monitoring, tele-rehabilitation, and daily activities monitoring. Inertial Measurement Units (IMUs) are low-cost, compact, and easy-to-use wearable devices that evaluate kinematics during different movements. Kinematic variables could support the clinical evaluation of the progression of some neuromuscular diseases and could be used as outcome measures. The current review describes the use of IMUs for the biomechanical assessment of meaningful outcome measures in individuals affected by Duchenne muscular dystrophy (DMD). The PRISMA methodology was used and the search was conducted in different databases (Scopus, Web of Science, PubMed). A total of 23 articles were examined and classified according to year of publication, ambulatory/non-ambulatory subjects, and IMU positioning on human body. The analysis points out the recent regulatory identification of Stride Velocity 95th Centile as a new endpoint in therapeutic DMD trials when measured continuously from a wearable device, while only a few studies proposed the use of IMUs in non-ambulatory patients. Clinical recognition of reliable and accurate outcome measures for the upper body is still a challeng

Multidimensional embedded MEMS motion detectors for wearable mechanocardiography and 4D medical imaging

Background: Cardiovascular diseases are the number one cause of death. Of these deaths, almost 80% are due to coronary artery disease (CAD) and cerebrovascular disease. Multidimensional microelectromechanical systems (MEMS) sensors allow measuring the mechanical movement of the heart muscle offering an entirely new and innovative solution to evaluate cardiac rhythm and function. Recent advances in miniaturized motion sensors present an exciting opportunity to study novel device-driven and functional motion detection systems in the areas of both cardiac monitoring and biomedical imaging, for example, in computed tomography (CT) and positron emission tomography (PET). Methods: This Ph.D. work describes a new cardiac motion detection paradigm and measurement technology based on multimodal measuring tools — by tracking the heart’s kinetic activity using micro-sized MEMS sensors — and novel computational approaches — by deploying signal processing and machine learning techniques—for detecting cardiac pathological disorders. In particular, this study focuses on the capability of joint gyrocardiography (GCG) and seismocardiography (SCG) techniques that constitute the mechanocardiography (MCG) concept representing the mechanical characteristics of the cardiac precordial surface vibrations. Results: Experimental analyses showed that integrating multisource sensory data resulted in precise estimation of heart rate with an accuracy of 99% (healthy, n=29), detection of heart arrhythmia (n=435) with an accuracy of 95-97%, ischemic disease indication with approximately 75% accuracy (n=22), as well as significantly improved quality of four-dimensional (4D) cardiac PET images by eliminating motion related inaccuracies using MEMS dual gating approach. Tissue Doppler imaging (TDI) analysis of GCG (healthy, n=9) showed promising results for measuring the cardiac timing intervals and myocardial deformation changes. Conclusion: The findings of this study demonstrate clinical potential of MEMS motion sensors in cardiology that may facilitate in time diagnosis of cardiac abnormalities. Multidimensional MCG can effectively contribute to detecting atrial fibrillation (AFib), myocardial infarction (MI), and CAD. Additionally, MEMS motion sensing improves the reliability and quality of cardiac PET imaging.Moniulotteisten sulautettujen MEMS-liiketunnistimien käyttö sydänkardiografiassa sekä lääketieteellisessä 4D-kuvantamisessa Tausta: Sydän- ja verisuonitaudit ovat yleisin kuolinsyy. Näistä kuolemantapauksista lähes 80% johtuu sepelvaltimotaudista (CAD) ja aivoverenkierron häiriöistä. Moniulotteiset mikroelektromekaaniset järjestelmät (MEMS) mahdollistavat sydänlihaksen mekaanisen liikkeen mittaamisen, mikä puolestaan tarjoaa täysin uudenlaisen ja innovatiivisen ratkaisun sydämen rytmin ja toiminnan arvioimiseksi. Viimeaikaiset teknologiset edistysaskeleet mahdollistavat uusien pienikokoisten liiketunnistusjärjestelmien käyttämisen sydämen toiminnan tutkimuksessa sekä lääketieteellisen kuvantamisen, kuten esimerkiksi tietokonetomografian (CT) ja positroniemissiotomografian (PET), tarkkuuden parantamisessa. Menetelmät: Tämä väitöskirjatyö esittelee uuden sydämen kineettisen toiminnan mittaustekniikan, joka pohjautuu MEMS-anturien käyttöön. Uudet laskennalliset lähestymistavat, jotka perustuvat signaalinkäsittelyyn ja koneoppimiseen, mahdollistavat sydämen patologisten häiriöiden havaitsemisen MEMS-antureista saatavista signaaleista. Tässä tutkimuksessa keskitytään erityisesti mekanokardiografiaan (MCG), joihin kuuluvat gyrokardiografia (GCG) ja seismokardiografia (SCG). Näiden tekniikoiden avulla voidaan mitata kardiorespiratorisen järjestelmän mekaanisia ominaisuuksia. Tulokset: Kokeelliset analyysit osoittivat, että integroimalla usean sensorin dataa voidaan mitata syketiheyttä 99% (terveillä n=29) tarkkuudella, havaita sydämen rytmihäiriöt (n=435) 95-97%, tarkkuudella, sekä havaita iskeeminen sairaus noin 75% tarkkuudella (n=22). Lisäksi MEMS-kaksoistahdistuksen avulla voidaan parantaa sydämen 4D PET-kuvan laatua, kun liikeepätarkkuudet voidaan eliminoida paremmin. Doppler-kuvantamisessa (TDI, Tissue Doppler Imaging) GCG-analyysi (terveillä, n=9) osoitti lupaavia tuloksia sydänsykkeen ajoituksen ja intervallien sekä sydänlihasmuutosten mittaamisessa. Päätelmä: Tämän tutkimuksen tulokset osoittavat, että kardiologisilla MEMS-liikeantureilla on kliinistä potentiaalia sydämen toiminnallisten poikkeavuuksien diagnostisoinnissa. Moniuloitteinen MCG voi edistää eteisvärinän (AFib), sydäninfarktin (MI) ja CAD:n havaitsemista. Lisäksi MEMS-liiketunnistus parantaa sydämen PET-kuvantamisen luotettavuutta ja laatua

Activity-Aware Electrocardiogram-based Passive Ongoing Biometric Verification

Identity fraud due to lost, stolen or shared information or tokens that represent an individual\u27s identity is becoming a growing security concern. Biometric recognition - the identification or verification of claimed identity, shows great potential in bridging some of the existing security gaps. It has been shown that the human Electrocardiogram (ECG) exhibits sufficiently unique patterns for use in biometric recognition. But it also exhibits significant variability due to stress or activity, and signal artifacts due to movement. In this thesis, we develop a novel activity-aware ECG-based biometric recognition scheme that can verify/identify under different activity conditions. From a pattern recognition standpoint, we develop algorithms for preprocessing, feature extraction and probabilistic classification. We pay particular attention to the applicability of the proposed scheme in ongoing biometric verification of claimed identity. Finally we propose a wearable prototype architecture of our scheme

커프리스 방식의 착용형 연속 혈압 모니터링 시스템에 관한 연구

학위논문 (박사)-- 서울대학교 대학원 : 공과대학 협동과정 바이오엔지니어링전공, 2019. 2. 김희찬.고혈압의 조기 진단과 고혈압 환자의 혈압 관리를 위해서는 일상생활에서의 지속적인 혈압 모니터링이 중요하다. 맥파전달시간 (Pulse transit time, PTT) 기반의 혈압 추정 방식이 이를 가능케 하는 방법으로 가장 각광 받고 있지만, 맥파전달시간을 측정하기 위해서는 여러 측정 장치들이 필요하여 일상 생활에서의 사용에 제약이 있으며, 또한 맥파전달시간 만을 이용한 수축기 혈압(Systolic blood pressure, SBP) 추정 능력은 부족함이 있는 것으로 알려져 있다. 본 학위 논문의 첫 번째 목적은 맥파전달시간 측정 시스템을 착용형으로 개발하여 간편하게 맥파전달시간을 측정할 수 있도록 함으로써 일상 생활 중 맥파전달시간을 이용한 연속적인 혈압 모니터링이 가능케 하는 것이다. 이를 위해 광용적맥파 (Photoplethysmogram, PPG) 와 심진도 (Seismocardiogram, SCG)를 동시에 측정하는 가슴 착용형 단일 장치를 개발하여, 심진도로부터 대동맥 판막의 열리는 시점을, 광용적맥파로부터 맥파의 도착 시점을 특정하여 맥파 전달 시간을 측정하였다. 개발된 시스템은 낮은 전력 소모와 소형의 간편한 디자인을 통해 24시간 동안 연속적으로 사용할 수 있도록 설계되었다. 측정된 생체신호로부터 추출된 맥파전달시간 및 기타 혈압 관련 변수들이 기기의 반복 착용에도 변하지 않음을 급간내상관계수(Intra-class correlation, ICC) 분석을 통해 확인하였고 (ICC >0.8), 또한 본 시스템에서 사용된 심진도가 대동맥 판막의 열리는 시점의 레퍼런스가 될 수 있는지도 심저항신호(Impedancecardiogram, ICG)와의 비교를 통해 검증하였다(r=0.79±0.14). 둘째로, 개발된 시스템을 이용하여 기존의 맥파 전달 시간만을 이용한 혈압 추정 방식을 보완하여 수축기 혈압의 추정 능력이 향상된 알고리즘을 개발하였다. 이를 위해, 심진도의 진폭과 맥파 전달 시간을 같이 사용하는 다변수 모델을 수축기 혈압 추정을 위해 제안하였고, 다양한 방법으로 유도된 혈압 변화 상황에서, 기존의 맥파전달시간 혹은 맥파도달시간 (Pulse arrival time, PAT) 만을 이용한 모델과 그 성능을 비교하였다. 또한, 제안된 모델이 간단한 교정절차를 통해 여러 사람에게 적용될 수 있는 가능성을 살펴보았고 더 나아가 일상 생활에서의 사용 가능성에 대해서도 검증하였다. 그 결과로 제안된 모델은 (1) 기존의 맥파전달시간 혹은 맥파도달시간 만을 이용한 모델보다 수축기 혈압 추정 능력 측면에서 더 우수하였고, (각각의 평균절대오차는 4.57, 6.01, 6,11 mmHg 였다.) (2) 간단한 교정절차만을 통해서 여러 사람에게 적용 되었을 때의 추정 능력이 국제 기준에 부합하였으며, (3) 일상 생활에서도 사용자의 아무런 개입이나 제약 없이 지속적인 혈압 모니터링이 가능함을 확인하였다. 결론적으로 본 연구에서 제안하는 착용형 연속 혈압 측정 시스템은 가슴에 부착하는 단일 기기 형태로 그 사용이 간편할 뿐 아니라 일상생활 중에서 맥파전달시간과 심진도의 진폭을 이용하여 향상된 수준의 연속 혈압 모니터링 성능을 제공하였는바, 이를 이용한 모바일 헬스케어 서비스의 가능성을 확인하였다.Continuous blood pressure (BP) monitoring is needed in daily life to enable early detection of hypertension and improve control of BP for hypertensive patients. Although the pulse transit time (PTT)-based BP estimation represents one of most promising approaches, its use in daily life is limited owing to the requirement of multi systems to measure PTT, and its performance in systolic blood pressure (SBP) estimation is not yet satisfactory. The first goal of this study is to develop a wearable system providing convenient measurement of the PTT, which facilitates continuous BP monitoring based on PTT in daily life. A single chest-worn device was developed measuring a photoplethysmogram (PPG) and a seismocardiogram (SCG) simultaneously, thereby obtaining PTT by using the SCG as timing reference of the aortic valve opening and the PPG as timing reference of pulse arrival. The presented device was designed to be compact and convenient to use, and to last for 24h by reducing power consumption of the system. The consistency of BP related parameters extracted from the system including PTT between repetitive measurements was verified by an intra-class correlation analysis, and it was over 0.8 for all parameters. In addition, the use of SCG as timing reference of the aortic valve opening was verified by comparing it with an impedance cardiogram (r = 0.79 ± 0.14). Secondly, the algorithm improving the performance of the SBP estimation was developed by using the presented system. A multivariate model using SCG amplitude (SA) in conjunction with PTT was proposed for SBP estimation, and was compared with conventional models using only PTT or pulse arrival time (PAT) in various interventions inducing BP changes. Furthermore, we validated the proposed model against the general population with a simple calibration process and verified its potential for daily use. The results suggested that (1) the proposed model, which employed SA in conjunction with PTT for SBP estimation, outperformed the conventional univariate model using PTT or PAT (the mean absolute errors were of 4.57, 6.01, and 6.11 for the proposed, PTT, and PAT models, respectively)(2) for practical use, the proposed model showed potential to be generalized with a simple calibrationand (3) the proposed model and system demonstrated the potential for continuous BP monitoring in daily life without any intervention of users or regulations. In conclusion, the presented system provides an improved performance of continuous BP monitoring in daily life by using a combination of PTT and SA with a convenient and compact single chest-worn device, and thus, it can contribute to mobile healthcare services.CONTENTS Abstract i Contents v List of Tables ix List of Figures xi List of Abbreviations xvi Chapter 1 1 General Introduction 1.1. Blood pressure 2 1.2. Pulse transit time 6 1.3. Thesis objective 12 Chapter 2 14 Development of the Wearable Blood Pressure Monitoring System 2.1. Introduction 15 2.2. System overview 17 2.3. Bio-signal instrumentation 21 2.4. Power management 24 2.5. PCB and case design 25 2.6. Software Design 27 2.7. Signal Processing 30 2.8. Experimental setup 34 2.8.1. Repeatability test 34 2.8.2. Verification of SCG-based PEP 35 2.9. Results and Discussion 38 2.9.1. Repeatability test 38 2.9.2. Verification of SCG-based PEP 40 Chapter 3 43 Enhancement of PTT based BP estimation 3.1. Introduction 44 3.2. Method 47 3.2.1. Principle of BP estimation 47 3.2.2. Subjects 49 3.2.3. Study protocol 50 3.2.4. Data collection 56 3.2.5. Data analysis 60 3.2.6. Evaluation standard 64 3.3. Results 67 3.4. Discussion 96 Chapter 4 113 Conclusion 4.1. Thesis Summary and Contributions 114 4.2. Future Direction 116 Bibliography 118 Abstract in Korean 128Docto

CardioCam: Leveraging Camera on Mobile Devices to Verify Users While Their Heart is Pumping

With the increasing prevalence of mobile and IoT devices (e.g., smartphones, tablets, smart-home appliances), massive private and sensitive information are stored on these devices. To prevent unauthorized access on these devices, existing user verification solutions either rely on the complexity of user-defined secrets (e.g., password) or resort to specialized biometric sensors (e.g., fingerprint reader), but the users may still suffer from various attacks, such as password theft, shoulder surfing, smudge, and forged biometrics attacks. In this paper, we propose, CardioCam, a low-cost, general, hard-to-forge user verification system leveraging the unique cardiac biometrics extracted from the readily available built-in cameras in mobile and IoT devices. We demonstrate that the unique cardiac features can be extracted from the cardiac motion patterns in fingertips, by pressing on the built-in camera. To mitigate the impacts of various ambient lighting conditions and human movements under practical scenarios, CardioCam develops a gradient-based technique to optimize the camera configuration, and dynamically selects the most sensitive pixels in a camera frame to extract reliable cardiac motion patterns. Furthermore, the morphological characteristic analysis is deployed to derive user-specific cardiac features, and a feature transformation scheme grounded on Principle Component Analysis (PCA) is developed to enhance the robustness of cardiac biometrics for effective user verification. With the prototyped system, extensive experiments involving 25 subjects are conducted to demonstrate that CardioCam can achieve effective and reliable user verification with over 99% average true positive rate (TPR) while maintaining the false positive rate (FPR) as low as 4%

High-Performance Accelerometer Based On Asymmetric Gapped Cantilevers For Physiological Acoustic Sensing

Continuous or mobile monitoring of physiological sounds is expected to play important role in the emerging mobile healthcare field. Because of the miniature size, low cost, and easy installation, accelerometer is an excellent choice for continuous physiological acoustic signal monitoring. However, in order to capture the detailed information in the physiological signals for clinical diagnostic purpose, there are more demanding requirements on the sensitivity/noise performance of accelerometers. In this thesis, a unique piezoelectric accelerometer based on the asymmetric gapped cantilever which exhibits significantly improved sensitivity is extensively studied. A meso-scale prototype is developed for capturing the high quality cardio and respiratory sounds on healthy people as well as on heart failure patients. A cascaded gapped cantilever based accelerometer is also explored for low frequency vibration sensing applications such as ballistocardiogram monitoring. Finally, to address the power issues of wireless sensors such as wireless wearable health monitors, a wide band vibration energy harvester based on a folded gapped cantilever is developed and demonstrated on a ceiling air condition unit