Self-Aware Wearable Systems in Epileptic Seizure Detection

Today, wearable systems are facing fundamental barriers in terms of battery lifetime and quality of their results. The main challenge in wearable systems is to increase the battery lifetime, while maintaining the machine-learning performance of the system. A recently proposed concept for overcoming this challenge is self-awareness, which increases system's knowledge of itself and the surrounding environment. This is precisely what health monitoring wearable systems require to adapt to different situations. To demonstrate the impact of introducing self-awareness in wearable technologies, we consider the epileptic seizure detection problem, as a case study. Epilepsy affects around 1% of the world's population, which can dramatically degrade the quality of life and represents a major public health issue. As a result, detection of epileptic seizures has become more important over the past decades. In this paper, we aim to introduce a new generation of self-aware wearable systems to decrease energy consumption and improve their seizures detection capabilities by introducing the notion of self-awareness in such systems. These techniques include switching to low-power mode to reduce the energy consumption and machine-learning model enhancement to improve detection quality. We incorporated our proposed techniques in the machine learning module, which detects epileptic seizures by monitoring the cardiac and respiratory systems. We evaluated the performance of our approach based on an epilepsy database of more than 141 hours, provided by the Lausanne University Hospital (CHUV). Our self-aware wearable system achieves 36% reduction in computational complexity and 10.51% improvement in detection performance

Assessing Variability of EEG and ECG/HRV Time Series Signals Using a Variety of Non-Linear Methods

Time series signals, such as Electroencephalogram (EEG) and Electrocardiogram (ECG) represent the complex dynamic behaviours of biological systems. The analysis of these signals using variety of nonlinear methods is essential for understanding variability within EEG and ECG, which potentially could help unveiling hidden patterns related to underlying physiological mechanisms. EEG is a time varying signal, and electrodes for recording EEG at different positions on the scalp give different time varying signals. There might be correlation between these signals. It is important to know the correlation between EEG signals because it might tell whether or not brain activities from different areas are related. EEG and ECG might be related to each other because both of them are generated from one co-ordinately working body. Investigating this relationship is of interest because it may reveal information about the correlation between EEG and ECG signals. This thesis is about assessing variability of time series data, EEG and ECG, using variety of nonlinear measures. Although other research has looked into the correlation between EEGs using a limited number of electrodes and a limited number of combinations of electrode pairs, no research has investigated the correlation between EEG signals and distance between electrodes. Furthermore, no one has compared the correlation performance for participants with and without medical conditions. In my research, I have filled up these gaps by using a full range of electrodes and all possible combinations of electrode pairs analysed in Time Domain (TD). Cross-Correlation method is calculated on the processed EEG signals for different number unique electrode pairs from each datasets. In order to obtain the distance in centimetres (cm) between electrodes, a measuring tape was used. For most of our participants the head circumference range was 54-58cm, for which a medium-sized I have discovered that the correlation between EEG signals measured through electrodes is linearly dependent on the physical distance (straight-line) distance between them for datasets without medical condition, but not for datasets with medical conditions. Some research has investigated correlation between EEG and Heart Rate Variability (HRV) within limited brain areas and demonstrated the existence of correlation between EEG and HRV. But no research has indicated whether or not the correlation changes with brain area. Although Wavelet Transformations (WT) have been performed on time series data including EEG and HRV signals to extract certain features respectively by other research, so far correlation between WT signals of EEG and HRV has not been analysed. My research covers these gaps by conducting a thorough investigation of all electrodes on the human scalp in Frequency Domain (FD) as well as TD. For the reason of different sample rates of EEG and HRV, two different approaches (named as Method 1 and Method 2) are utilised to segment EEG signals and to calculate Pearson’s Correlation Coefficient for each of the EEG frequencies with each of the HRV frequencies in FD. I have demonstrated that EEG at the front area of the brain has a stronger correlation with HRV than that at the other area in a frequency domain. These findings are independent of both participants and brain hemispheres. Sample Entropy (SE) is used to predict complexity of time series data. Recent research has proposed new calculation methods for SE, aiming to improve the accuracy. To my knowledge, no one has attempted to reduce the computational time of SE calculation. I have developed a new calculation method for time series complexity which could improve computational time significantly in the context of calculating a correlation between EEG and HRV. The results have a parsimonious outcome of SE calculation by exploiting a new method of SE implementation. In addition, it is found that the electrical activity in the frontal lobe of the brain appears to be correlated with the HRV in a time domain. Time series analysis method has been utilised to study complex systems that appear ubiquitous in nature, but limited to certain dynamic systems (e.g. analysing variables affecting stock values). In this thesis, I have also investigated the nature of the dynamic system of HRV. I have disclosed that Embedding Dimension could unveil two variables that determined HRV

Nonlinear dynamics and modeling of heart and brain signals

Ph.DDOCTOR OF PHILOSOPH

Intelligent Biosignal Processing in Wearable and Implantable Sensors

This reprint provides a collection of papers illustrating the state-of-the-art of smart processing of data coming from wearable, implantable or portable sensors. Each paper presents the design, databases used, methodological background, obtained results, and their interpretation for biomedical applications. Revealing examples are brain–machine interfaces for medical rehabilitation, the evaluation of sympathetic nerve activity, a novel automated diagnostic tool based on ECG data to diagnose COVID-19, machine learning-based hypertension risk assessment by means of photoplethysmography and electrocardiography signals, Parkinsonian gait assessment using machine learning tools, thorough analysis of compressive sensing of ECG signals, development of a nanotechnology application for decoding vagus-nerve activity, detection of liver dysfunction using a wearable electronic nose system, prosthetic hand control using surface electromyography, epileptic seizure detection using a CNN, and premature ventricular contraction detection using deep metric learning. Thus, this reprint presents significant clinical applications as well as valuable new research issues, providing current illustrations of this new field of research by addressing the promises, challenges, and hurdles associated with the synergy of biosignal processing and AI through 16 different pertinent studies. Covering a wide range of research and application areas, this book is an excellent resource for researchers, physicians, academics, and PhD or master students working on (bio)signal and image processing, AI, biomaterials, biomechanics, and biotechnology with applications in medicine

Ultra-Short Window Length and Feature Importance Analysis for Cognitive Load Detection from Wearable Sensors

Human cognitive capabilities are under constant pressure in the modern information society. Cognitive load detection would be beneficial in several applications of human–computer interaction, including attention management and user interface adaptation. However, current research into accurate and real-time biosignal-based cognitive load detection lacks understanding of the optimal and minimal window length in data segmentation which would allow for more timely, continuous state detection. This study presents a comparative analysis of ultra-short (30 s or less) window lengths in cognitive load detection with a wearable device. Heart rate, heart rate variability, galvanic skin response, and skin temperature features are extracted at six different window lengths and used to train an Extreme Gradient Boosting classifier to detect between cognitive load and rest. A 25 s window showed the highest accury (67.6%), which is similar to earlier studies using the same dataset. Overall, model accuracy tended to decrease as the window length decreased, and lowest performance (60.0%) was observed with a 5 s window. The contribution of different physiological features to the classification performance and the most useful features that react in short windows are also discussed. The analysis provides a promising basis for future real-time applications with wearable sensors

Tunteiden Havaitseminen Arkielämässä Koneoppimisen ja Puettavien Laitteiden Avulla

Tavoitteet. Tämän tutkimuksen tavoitteena on arvioida tunteiden havaitsemisen mahdollisuutta arkielämässä puettavien laitteiden ja koneoppimismallien avulla. Tunnetiloilla on tärkeä rooli päätöksenteossa, havaitsemisessa ja käyttäytymisessä, mikä tekee objektiivisesta tunnetilojen havaitsemisesta arvokkaan tavoitteen, sekä mahdollisten sovellusten että tunnetiloja koskevan ymmärryksen syventämisen kannalta. Tunnetiloihin usein liittyy mitattavissa olevia fysiologisia ja käyttäymisen muutoksia, mikä mahdollistaa koneoppimismallien kouluttamisen muutoksia aiheuttaneen tunnetilan havaitsemiseksi. Suurin osa tunteiden havaitsemiseen liittyvästä tutkimuksesta on toteutettu laboratorio-olosuhteissa käyttämällä tunteita herättäviä ärsykkeitä tai tehtäviä, mikä herättää kysymyksen siitä että yleistyvätkö näissä olosuhteissa saadut tulokset arkielämään. Vaikka puettavien laitteiden ja kännykkäkyselyiden kehittyminen on helpottanut aiheen tutkimista arkielämässä, tutkimusta tässä ympäristössä on vielä niukasti. Tässä tutkimuksessa itseraportoituja tunnetiloja ennustetaan koneoppimismallien avulla arkielämässä havaittavissa olevien tunnetilojen selvittämiseksi. Lisäksi tutkimuksessa käytetään mallintulkintamenetelmiä mallien hyödyntämien yhteyksien tunnistamiseksi. Metodit. Aineisto tätä tutkielmaa varten on peräisin tutkimuksesta joka suoritettiin osana Helsingin Yliopiston ja VTT:n Sisu at Work projektia, missä 82:ta tietotyöläistä neljästä suomalaisesta organisaatiosta tutkittiin kolmen viikon ajan. Osallistujilla oli jakson aikana käytettävissään mittalaitteet jotka mittasivat fotoplethysmografiaa (PPG), ihon sähkönjohtavuutta (EDA) ja kiihtyvyysanturi (ACC) signaaleita, lisäksi heille esitettiin kysymyksiä koetuista tunnetiloista kolmesti päivässä puhelinsovelluksen avulla. Signaalinkäsittelymenetelmiä sovellettiin signaaleissa esiintyvien liikeartefaktien ja muiden ongelmien korjaamiseksi. Sykettä (HR) ja sykevälinvaihtelua (HRV) kuvaavia piirteitä irroitettiin PPG signaalista, fysiologista aktivaatiota kuvaavia piirteitä EDA signaalista, sekä liikettä kuvaavia piirteitä ACC signaalista. Seuraavaksi koneoppimismalleja koulutettiin ennustamaan raportoituja tunnetiloja irroitetujen piirteiden avulla. Mallien suoriutumista vertailtiin suhteessa odotusarvoihin havaittavissa olevien tunnetilojen määrittämiseksi. Lisäksi permutaatiotärkeyttä sekä Shapley additive explanations (SHAP) arvoja hyödynnettiin malleille tärkeiden yhteyksien selvittämiseksi. Tulokset ja johtopäätökset. Mallit tunnetiloille virkeä, keskittynyt ja innostunut paransivat suoriutumistaan yli odotusarvon, joista mallit tunnetilalle virkeä paransivat suoriutumista tilastollisesti merkitsevästi. Permutaatiotärkeys korosti liike- ja HRV-piirteiden merkitystä, kun SHAP arvojen tarkastelu nosti esiin matalan liikkeen, matalan EDA:n, sekä korkean HRV:n merkityksen mallien ennusteille. Nämä tulokset ovat lupaavia korkean aktivaation positiivisten tunnetilojen havaitsemiselle arkielämässä, sekä nostavat esiin mahdollisia yhteyksiä jatkotutkimusta varten.Objectives. This study aims to evaluate feasibility of affect detection in daily life using wearable devices and machine learning models. Affective states play an important role in decision making, perception and behaviour, making objective detection of affective states a desirable goal both for potential applications and as a way to gain insight into affective phenomena. Affective states have been found to have measurable physiological and behavioral changes, which allows training of machine learning models for detecting the underlying affects. Majority of affect detection studies have been conducted in laboratory conditions using affect elicitation stimuli or tasks, raising the question whether results from these studies will generalize to daily life. Although development of wearable devices and mobile surveys have facilitated evaluation in the context of daily life, research here remains sparse. In this study, self-reported affective states are predicted using machine learning models to identify which affective states can be detected in daily life. Additionally, model interpretation methods will be used to identify which relationships the models found important for their predictions. Methods. Data for this thesis came from a study conducted as a part of Sisu at Work project between University of Helsinki and VTT, where 82 knowledge workers from four Finnish organizations were studied for a period of three weeks. During this period, the participants were queried by mobile surveys about their affective states thrice a day, while they also used wearable devices to record photoplethysmography (PPG), electrodermal activity (EDA) and accelerometry (ACC) signals. A signal processing pipeline was implemented to deal with movement artefacts and other issues with the data. Features describing heart rate (HR) and heart rate variation (HRV) were extraced from PPG, physiological activation from EDA and movement from ACC signals. Models were then fitted to predict the reported affective states using the extracted features. Model performance was compared against a baseline to identify which affects could be reliably detected, while permutation importance and Shapley additive explanations (SHAP) values were used to identify important relationships established by the models. Results and conclusions. Models for affective state vigor showed improvements over baseline with statistical significance, while improvements were also noted for affects focused and enthusiastic. Permutation importance highlighted the significance of movement and HRV features, while examination of SHAP values indicated that low movement, low EDA and high HRV impacted model predictions the most. These results indicate potential for detecting high activation affective states in daily life and propose potential relationships for future research