Multidimensional embedded MEMS motion detectors for wearable mechanocardiography and 4D medical imaging

Background: Cardiovascular diseases are the number one cause of death. Of these deaths, almost 80% are due to coronary artery disease (CAD) and cerebrovascular disease. Multidimensional microelectromechanical systems (MEMS) sensors allow measuring the mechanical movement of the heart muscle offering an entirely new and innovative solution to evaluate cardiac rhythm and function. Recent advances in miniaturized motion sensors present an exciting opportunity to study novel device-driven and functional motion detection systems in the areas of both cardiac monitoring and biomedical imaging, for example, in computed tomography (CT) and positron emission tomography (PET). Methods: This Ph.D. work describes a new cardiac motion detection paradigm and measurement technology based on multimodal measuring tools — by tracking the heart’s kinetic activity using micro-sized MEMS sensors — and novel computational approaches — by deploying signal processing and machine learning techniques—for detecting cardiac pathological disorders. In particular, this study focuses on the capability of joint gyrocardiography (GCG) and seismocardiography (SCG) techniques that constitute the mechanocardiography (MCG) concept representing the mechanical characteristics of the cardiac precordial surface vibrations. Results: Experimental analyses showed that integrating multisource sensory data resulted in precise estimation of heart rate with an accuracy of 99% (healthy, n=29), detection of heart arrhythmia (n=435) with an accuracy of 95-97%, ischemic disease indication with approximately 75% accuracy (n=22), as well as significantly improved quality of four-dimensional (4D) cardiac PET images by eliminating motion related inaccuracies using MEMS dual gating approach. Tissue Doppler imaging (TDI) analysis of GCG (healthy, n=9) showed promising results for measuring the cardiac timing intervals and myocardial deformation changes. Conclusion: The findings of this study demonstrate clinical potential of MEMS motion sensors in cardiology that may facilitate in time diagnosis of cardiac abnormalities. Multidimensional MCG can effectively contribute to detecting atrial fibrillation (AFib), myocardial infarction (MI), and CAD. Additionally, MEMS motion sensing improves the reliability and quality of cardiac PET imaging.Moniulotteisten sulautettujen MEMS-liiketunnistimien käyttö sydänkardiografiassa sekä lääketieteellisessä 4D-kuvantamisessa Tausta: Sydän- ja verisuonitaudit ovat yleisin kuolinsyy. Näistä kuolemantapauksista lähes 80% johtuu sepelvaltimotaudista (CAD) ja aivoverenkierron häiriöistä. Moniulotteiset mikroelektromekaaniset järjestelmät (MEMS) mahdollistavat sydänlihaksen mekaanisen liikkeen mittaamisen, mikä puolestaan tarjoaa täysin uudenlaisen ja innovatiivisen ratkaisun sydämen rytmin ja toiminnan arvioimiseksi. Viimeaikaiset teknologiset edistysaskeleet mahdollistavat uusien pienikokoisten liiketunnistusjärjestelmien käyttämisen sydämen toiminnan tutkimuksessa sekä lääketieteellisen kuvantamisen, kuten esimerkiksi tietokonetomografian (CT) ja positroniemissiotomografian (PET), tarkkuuden parantamisessa. Menetelmät: Tämä väitöskirjatyö esittelee uuden sydämen kineettisen toiminnan mittaustekniikan, joka pohjautuu MEMS-anturien käyttöön. Uudet laskennalliset lähestymistavat, jotka perustuvat signaalinkäsittelyyn ja koneoppimiseen, mahdollistavat sydämen patologisten häiriöiden havaitsemisen MEMS-antureista saatavista signaaleista. Tässä tutkimuksessa keskitytään erityisesti mekanokardiografiaan (MCG), joihin kuuluvat gyrokardiografia (GCG) ja seismokardiografia (SCG). Näiden tekniikoiden avulla voidaan mitata kardiorespiratorisen järjestelmän mekaanisia ominaisuuksia. Tulokset: Kokeelliset analyysit osoittivat, että integroimalla usean sensorin dataa voidaan mitata syketiheyttä 99% (terveillä n=29) tarkkuudella, havaita sydämen rytmihäiriöt (n=435) 95-97%, tarkkuudella, sekä havaita iskeeminen sairaus noin 75% tarkkuudella (n=22). Lisäksi MEMS-kaksoistahdistuksen avulla voidaan parantaa sydämen 4D PET-kuvan laatua, kun liikeepätarkkuudet voidaan eliminoida paremmin. Doppler-kuvantamisessa (TDI, Tissue Doppler Imaging) GCG-analyysi (terveillä, n=9) osoitti lupaavia tuloksia sydänsykkeen ajoituksen ja intervallien sekä sydänlihasmuutosten mittaamisessa. Päätelmä: Tämän tutkimuksen tulokset osoittavat, että kardiologisilla MEMS-liikeantureilla on kliinistä potentiaalia sydämen toiminnallisten poikkeavuuksien diagnostisoinnissa. Moniuloitteinen MCG voi edistää eteisvärinän (AFib), sydäninfarktin (MI) ja CAD:n havaitsemista. Lisäksi MEMS-liiketunnistus parantaa sydämen PET-kuvantamisen luotettavuutta ja laatua

A model to enhance the atrial fibrillations’ risk detection using deep learning

Atrial fibrillation (AF) is a complex arrhythmia linked to a variety of common cardiovascular illnesses and conventional cardiovascular risk factors. Although awareness and improved detection of AF have improved over the last decade as the incidence and prevalence of AF has increased, current trends in using machine learning approaches to diagnose AF are still lacking in precision. To determine the true nature of the Electrocardiography (ECG) signal segments, a Convolutional Neural Network (CNN) model was employed to discover hidden information. Fully Connected (FC) layers were then utilized to categorize the ECG data segments as normal or abnormal. The suggested algorithm's findings were compared to state-of-the-art arrhythmia identification algorithms in the literature for the MIT-BIH ECG database. The methodology proved not only to yield high classification performance (98.5%) but also low processing computational advantage where the CNN was the most accurate algorithm used for atrial fibrillation detection hence. To conclude the findings of the research, a model was prepared to test the accuracy of the most common ML algorithms used for AF detection. After comparing the results of the experiment, it was clear that CNN algorithm is the best approach compared to Support Vector Machine (SVM) and K-Nearest Neighbor (KNN)

Non-invasive monitoring of cardiac function through Ballistocardiogram: an algorithm integrating short-time Fourier transform and ensemble empirical mode decomposition

The Ballistocardiogram (BCG) is a vibration signal that is generated by the displacement of the entire body due to the injection of blood during each heartbeat. It has been extensively utilized to monitor heart rate. The morphological features of the BCG signal serve as effective indicators for the identification of atrial fibrillation and heart failure, holding great significance for BCG signal analysis. The IJK-complex identification allows for the estimation of inter-beat intervals (IBI) and enables a more detailed analysis of BCG amplitude and interval waves. This study presents a novel algorithm for identifying the IJK-complex in BCG signals, which is an improvement over most existing algorithms that only perform IBI estimation. The proposed algorithm employs a short-time Fourier transform and summation across frequencies to initially estimate the occurrence of the J wave using peak finding, followed by Ensemble Empirical Mode Decomposition and a regional search to precisely identify the J wave. The algorithm’s ability to detect the morphological features of BCG signals and estimate heart rates was validated through experiments conducted on 10 healthy subjects and 2 patients with coronary heart disease. In comparison to commonly used methods, the presented scheme ensures accurate heart rate estimation and exhibits superior capability in detecting BCG morphological features. This advancement holds significant value for future applications involving BCG signals

Cardiac monitoring of dogs via smartphone mechanocardiography : a feasibility study

Abstract Background In the context of monitoring dogs, usually, accelerometers have been used to measure the dog’s movement activity. Here, we study another application of the accelerometers (and gyroscopes)—seismocardiography (SCG) and gyrocardiography (GCG)—to monitor the dog’s heart. Together, 3-axis SCG and 3-axis GCG constitute of 6-axis mechanocardiography (MCG), which is inbuilt to most modern smartphones. Thus, the objective of this study is to assess the feasibility of using a smartphone-only solution to studying dog’s heart. Methods A clinical trial (CT) was conducted at the University Small Animal Hospital, University of Helsinki, Finland. 14 dogs (3 breeds) including 18 measurements (about one half of all) where the dog’s status was such that it was still and not panting were further selected for the heart rate (HR) analysis (each signal with a duration of 1 min). The measurement device in the CT was a custom Holter monitor including synchronized 6-axis MCG and ECG. In addition, 16 dogs (9 breeds, one mixed-breed) were measured at home settings by the dog owners themselves using Sony Xperia Android smartphone sensor to further validate the applicability of the method. Results The developed algorithm was able to select 10 good-quality signals from the 18 CT measurements, and for 7 of these, the automated algorithm was able to detect HR with deviation below or equal to 5 bpm (compared to ECG). Further visual analysis verified that, for approximately half of the dogs, the signal quality at home environment was sufficient for HR extraction at least in some signal locations, while the motion artifacts due to dog’s movements are the main challenges of the method. Conclusion With improved data analysis techniques for managing noisy measurements, the proposed approach could be useful in home use. The advantage of the method is that it can operate as a stand-alone application without requiring any extra equipment (such as smart collar or ECG patch)

Multiclass Classifier based Cardiovascular Condition Detection Using Smartphone Mechanocardiography

Cardiac translational and rotational vibrations induced by left ventricular motions are measurable using joint seismocardiography (SCG) and gyrocardiography (GCG) techniques. Multi-dimensional non-invasive monitoring of the heart reveals relative information of cardiac wall motion. A single inertial measurement unit (IMU) allows capturing cardiac vibrations in sufficient details and enables us to perform patient screening for various heart conditions. We envision smartphone mechanocardiography (MCG) for the use of e-health or telemonitoring, which uses a multi-class classifier to detect various types of cardiovascular diseases (CVD) using only smartphone’s built-in internal sensors data. Such smartphone App/solution could be used by either a healthcare professional and/or the patient him/herself to take recordings from their heart. We suggest that smartphone could be used to separate heart conditions such as normal sinus rhythm (SR), atrial fibrillation (AFib), coronary artery disease (CAD), and possibly ST-segment elevated myocardial infarction (STEMI) in multiclass settings. An application could run the disease screening and immediately inform the user about the results. Widespread availability of IMUs within smartphones could enable the screening of patients globally in the future, however, we also discuss the possible challenges raised by the utilization of such self-monitoring systems.</p

Detection of heart rate using smartphone gyroscope data: a scoping review

Heart rate (HR) is closely related to heart rhythm patterns, and its irregularity can imply serious health problems. Therefore, HR is used in the diagnosis of many health conditions. Traditionally, HR has been measured through an electrocardiograph (ECG), which is subject to several practical limitations when applied in everyday settings. In recent years, the emergence of smartphones and microelectromechanical systems has allowed innovative solutions for conveniently measuring HR, such as smartphone ECG, smartphone photoplethysmography (PPG), and seismocardiography (SCG). However, these measurements generally rely on external sensor hardware or are highly susceptible to inaccuracies due to the presence of significant levels of motion artifact. Data from gyrocardiography (GCG), however, while largely overlooked for this application, has the potential to overcome the limitations of other forms of measurements. For this scoping review, we performed a literature search on HR measurement using smartphone gyroscope data. In this review, from among the 114 articles that we identified, we include seven relevant articles from the last decade (December 2012 to January 2023) for further analysis of their respective methods for data collection, signal pre-processing, and HR estimation. The seven selected articles’ sample sizes varied from 11 to 435 participants. Two articles used a sample size of less than 40, and three articles used a sample size of 300 or more. We provide elaborations about the algorithms used in the studies and discuss the advantages and disadvantages of these methods. Across the articles, we noticed an inconsistency in the algorithms used and a lack of established standardization for performance evaluation for HR estimation using smartphone GCG data. Among the seven articles included, five did not perform any performance evaluation, while the other two used different reference signals (HR and PPG respectively) and metrics for accuracy evaluation. We conclude the review with a discussion of challenges and future directions for the application of GCG technology

Advanced Signal Processing in Wearable Sensors for Health Monitoring

Smart, wearables devices on a miniature scale are becoming increasingly widely available, typically in the form of smart watches and other connected devices. Consequently, devices to assist in measurements such as electroencephalography (EEG), electrocardiogram (ECG), electromyography (EMG), blood pressure (BP), photoplethysmography (PPG), heart rhythm, respiration rate, apnoea, and motion detection are becoming more available, and play a significant role in healthcare monitoring. The industry is placing great emphasis on making these devices and technologies available on smart devices such as phones and watches. Such measurements are clinically and scientifically useful for real-time monitoring, long-term care, and diagnosis and therapeutic techniques. However, a pertaining issue is that recorded data are usually noisy, contain many artefacts, and are affected by external factors such as movements and physical conditions. In order to obtain accurate and meaningful indicators, the signal has to be processed and conditioned such that the measurements are accurate and free from noise and disturbances. In this context, many researchers have utilized recent technological advances in wearable sensors and signal processing to develop smart and accurate wearable devices for clinical applications. The processing and analysis of physiological signals is a key issue for these smart wearable devices. Consequently, ongoing work in this field of study includes research on filtration, quality checking, signal transformation and decomposition, feature extraction and, most recently, machine learning-based methods

Blind Source Separation for the Processing of Contact-Less Biosignals

(Spatio-temporale) Blind Source Separation (BSS) eignet sich für die Verarbeitung von Multikanal-Messungen im Bereich der kontaktlosen Biosignalerfassung. Ziel der BSS ist dabei die Trennung von (z.B. kardialen) Nutzsignalen und Störsignalen typisch für die kontaktlosen Messtechniken. Das Potential der BSS kann praktisch nur ausgeschöpft werden, wenn (1) ein geeignetes BSS-Modell verwendet wird, welches der Komplexität der Multikanal-Messung gerecht wird und (2) die unbestimmte Permutation unter den BSS-Ausgangssignalen gelöst wird, d.h. das Nutzsignal praktisch automatisiert identifiziert werden kann. Die vorliegende Arbeit entwirft ein Framework, mit dessen Hilfe die Effizienz von BSS-Algorithmen im Kontext des kamera-basierten Photoplethysmogramms bewertet werden kann. Empfehlungen zur Auswahl bestimmter Algorithmen im Zusammenhang mit spezifischen Signal-Charakteristiken werden abgeleitet. Außerdem werden im Rahmen der Arbeit Konzepte für die automatisierte Kanalauswahl nach BSS im Bereich der kontaktlosen Messung des Elektrokardiogramms entwickelt und bewertet. Neuartige Algorithmen basierend auf Sparse Coding erwiesen sich dabei als besonders effizient im Vergleich zu Standard-Methoden.(Spatio-temporal) Blind Source Separation (BSS) provides a large potential to process distorted multichannel biosignal measurements in the context of novel contact-less recording techniques for separating distortions from the cardiac signal of interest. This potential can only be practically utilized (1) if a BSS model is applied that matches the complexity of the measurement, i.e. the signal mixture and (2) if permutation indeterminacy is solved among the BSS output components, i.e the component of interest can be practically selected. The present work, first, designs a framework to assess the efficacy of BSS algorithms in the context of the camera-based photoplethysmogram (cbPPG) and characterizes multiple BSS algorithms, accordingly. Algorithm selection recommendations for certain mixture characteristics are derived. Second, the present work develops and evaluates concepts to solve permutation indeterminacy for BSS outputs of contact-less electrocardiogram (ECG) recordings. The novel approach based on sparse coding is shown to outperform the existing concepts of higher order moments and frequency-domain features