ECG Biometrics using Deep Neural Networks

Biometrics is a rapidly growing field, with applications in personal identification and security. The Electrocardiogram (ECG) has the potential to be used as a physiological signature for biometric systems. However, current methods still lack in performance across different recording sessions. In this thesis, it is shown that Deep Learning can be applied successfully in the analysis of physiological signals for biometric purposes. This is accomplished in two different experiments by formulating novel approaches based on Convolutional Neural Networks and Recurrent Neural Networks, which may receive heartbeats, signal segments or spectrograms as input. These methods are compared in tasks implying the recognition of subjects from four public databases: Fantasia, ECG-ID, MIT-BIH and CYBHi. This work obtained state-of-the-art results for across-session authentication tasks on the CYBHi dataset, reaching Equal Error Rates of 10.57% and 10.01% for the best model, with corresponding identification accuracy rates of 55.58% and 58.91%. It also demonstrates that using spectrograms as input to the classifier is a promising approach for biometric identification, achieving accuracy values of 99.79% and 96.88%, respectively for Fantasia and ECG-ID databases. Further, it is shown empirically that for ECG biometric systems, the ability of a model to generalize is crucial, not only its capacity to relate and store information. These contributions represent another step towards real-world application of ECGbased biometric systems, closing the gap between intra and inter-session performance and providing some guidelines that can be applied in future work

Biometric Systems

Because of the accelerating progress in biometrics research and the latest nation-state threats to security, this book's publication is not only timely but also much needed. This volume contains seventeen peer-reviewed chapters reporting the state of the art in biometrics research: security issues, signature verification, fingerprint identification, wrist vascular biometrics, ear detection, face detection and identification (including a new survey of face recognition), person re-identification, electrocardiogram (ECT) recognition, and several multi-modal systems. This book will be a valuable resource for graduate students, engineers, and researchers interested in understanding and investigating this important field of study

Autonomic nervous system biomarkers from multi-modal and model-based signal processing in mental health and illness

Esta tesis se centra en técnicas de procesado multimodal y basado en modelos de señales para derivar parámetros fisiológicos, es decir, biomarcadores, relacionados con el sistema nervioso autónomo (ANS). El desarrollo de nuevos métodos para derivar biomarcadores de ANS no invasivos en la salud y la enfermedad mental ofrece la posibilidad de mejorar la evaluación del estrés y la monitorización de la depresión. Para este fin, el presente documento se estructura en tres partes principales. En la Parte I, se proporciona unaintroducción a la salud y la enfermedad mental (Cap. 1). Además, se presenta un marco teórico para investigar la etiología de los trastornos mentales y el papel del estrés en la enfermedad mental (Cap. 2). También se destaca la importancia de los biomarcadores no invasivos para la evaluación del ANS, prestando especial atención en la depresión clínica (Cap. 3, 4). En la Parte II, se proporciona el marco metodológico para derivar biomarcadores del ANS. Las técnicas de procesado de señales incluyen el análisis conjunto de la variabilidad del rítmo cardíaco (HRV) y la señal respiratoria (Cap. 6), técnicas novedosas para derivar la señal respiratoria del electrocardiograma (ECG) (Cap. 7) y un análisis robusto que se basa en modelar la forma de ondas del pulso del fotopletismograma (PPG) (Ch. 8). En la Parte III, los biomarcadores del ANS se evalúan en la quantificacióndel estrés (Cap. 9) y en la monitorización de la depresión (Ch. 10).Parte I: La salud mental no solo está relacionada con ese estado positivo de bienestar, en el que un individuo puede enfrentar a las situaciones estresantes de la vida, sino también con la ausencia de enfermedad mental. La enfermedad o trastorno mental se puede definir como un trastorno emocional, cognitivo o conductual que causa un deterioro funcional sustancial en una o más actividades importantes de la vida. Los trastornos mentales más comunes, que muchas veces coexisten, son la ansiedad y el trastorno depresivo mayor (MDD). La enfermedad mental tiene un impacto negativo en la calidad de vida, ya que se asocia con pérdidas considerables en la salud y el funcionamiento, y aumenta ignificativamente el riesgo de una persona de padecer enfermedades ardiovasculares.Un instigador común que subyace a la comorbilidad entre el MDD, la patologíacardiovascular y la ansiedad es el estrés mental. El estrés es común en nuestra vida de rítmo rapido e influye en nuestra salud mental. A corto plazo, ANS controla la respuesta cardiovascular a estímulos estresantes. La regulación de parámetros fisiológicos, como el rítmo cardíaco, la frecuencia respiratoria y la presión arterial, permite que el organismo responda a cambios repentinos en el entorno. Sin embargo, la adaptación fisiológica a un fenómeno ambiental que ocurre regularmente altera los sistemas biológicos involucrados en la respuesta al estrés. Las alteraciones neurobiológicas en el cerebro pueden alterar lafunción del ANS. La disfunción del ANS y los cambios cerebrales estructurales tienen un impacto negativo en los procesos cognitivos, emocionales y conductuales, lo que conduce al desarrollo de una enfermedad mental.Parte II: El desarrollo de métodos novedosos para derivar biomarcadores del ANS no invasivos ofrece la posibilidad de mejorar la evaluacón del estrés en individuos sanos y la disfunción del ANS en pacientes con MDD. El análisis conjunto de varias bioseñales (enfoquemultimodal) permite la cuantificación de interacciones entre sistemas biológicos asociados con ANS, mientras que el modelado de bioseãles y el análisis posterior de los parámetros del modelo (enfoque basado en modelos) permite la cuantificación robusta de cambios en mecanismos fisiológicos relacionados con el ANS. Un método novedoso, quetiene en cuenta los fenómenos de acoplo de fase y frecuencia entre la respiración y las señales de HRV para evaluar el acoplo cardiorrespiratorio no lineal cuadrático se propone en el Cap. 6.3. En el Cap. 7 se proponen nuevas técnicas paramejorar lamonitorización de la respiración. En el Cap. 8, para aumentar la robustez de algunas medidas morfológicas que reflejan cambios en el tonno arterial, se considera el modelado del pulso PPG como una onda principal superpuesta con varias ondas reflejadas.Parte III: Los biomarcadores del ANS se evalúan en la cuantificación de diferentes tipos de estrés, ya sea fisiológico o psicológico, en individuos sanos, y luego, en la monitorización de la depresión. En presencia de estrés mental (Cap. 9.1), inducido por tareas cognitivas, los sujetos sanos muestran un incremento en la frecuencia respiratoria y un mayor número de interacciones no lineales entre la respiración y la seãl de HRV. Esto podría estar asociado con una activación simpática, pero también con una respiración menos regular. En presencia de estrés hemodinámico (Cap. 9.2), inducido por un cambio postural, los sujetos sanos muestran una reducción en el acoplo cardiorrespiratoriono lineal cuadrático, que podría estar relacionado con una retracción vagal. En presencia de estrés térmico (Cap. 9.3), inducido por la exposición a emperaturas ambientales elevadas, los sujetos sanos muestran un aumento del equilibrio simpatovagal. Esto demuestra que los biomarcadores ANS son capaces de evaluar diferentes tipos de estrés y pueden explorarse más en el contexto de la monitorización de la depresión. En el Cap. 10, se evalúan las diferencias en la función del ANS entre elMDD y los sujetos sanos durante un protocolo de estrés mental, no solo con los valores brutos de los biomarcadores del ANS, sino también con los índices de reactividad autónoma, que reflejan la capacidad deun individuo para afrontar con una situación desafiante. Los resultados muestran que la depresión se asocia con un desequilibrio autonómico, que se caracteriza por una mayor actividad simpática y una reducción de la distensibilidad arterial. Los índices de reactividad autónoma cuantificados por cambios, entre etapas de estrés y de recuperación, en los sustitutos de la rigidez arterial, como la pérdida de amplitud de PPG en las ondas reflejadas, muestran el mejor rendimiento en términos de correlación con el grado de la depresión, con un coeficiente de correlación r = −0.5. La correlación negativa implicaque un mayor grado de depresión se asocia con una disminución de la reactividadautónoma. El poder discriminativo de los biomarcadores del ANS se aprecia también por su alto rendimiento diagnóstico para clasificar a los sujetos como MDD o sanos, con una precisión de 80.0%. Por lo tanto, se puede concluir que los biomarcadores del ANS pueden usarse para evaluar el estrés y que la distensibilidad arterial deteriorada podría constituir un biomarcador de salud mental útil en el seguimiento de la depresión.This dissertation is focused on multi-modal and model-based signal processing techniques for deriving physiological parameters, i.e. biomarkers, related to the autonomic nervous system (ANS). The development of novel approaches for deriving noninvasive ANS biomarkers in mental health and illness offers the possibility to improve the assessment of stress and the monitoring of depression. For this purpose, the present document is structured in three main parts. In Part I, an introduction to mental health and illness is provided (Ch. 1). Moreover, a theoretical framework for investigating the etiology of mental disorders and the role of stress in mental illness is presented (Ch. 2). The importance of noninvasive biomarkers for ANS assessment, paying particular attention in clinical depression, is also highlighted (Ch. 3, 4). In Part II, themethodological framework for deriving ANS biomarkers is provided. Signal processing techniques include the joint analysis of heart rate variability (HRV) and respiratory signals (Ch. 6), novel techniques for deriving the respiratory signal from electrocardiogram (ECG) (Ch. 7), and a robust photoplethysmogram(PPG)waveform analysis based on amodel-based approach (Ch. 8). In Part III, ANS biomarkers are evaluated in stress assessment (Ch. 9) and in the monitoring of depression (Ch. 10). Part I:Mental health is not only related to that positive state ofwell-being, inwhich an individual can cope with the normal stresses of life, but also to the absence of mental illness. Mental illness or disorder can be defined as an emotional, cognitive, or behavioural disturbance that causes substantial functional impairment in one or more major life activities. The most common mental disorders, which are often co-occurring, are anxiety and major depressive disorder (MDD). Mental illness has a negative impact on the quality of life, since it is associated with considerable losses in health and functioning, and increases significantly a person’s risk for cardiovascular diseases. A common instigator underlying the co-morbidity between MDD, cardiovascular pathology, and anxiety is mental stress. Stress is common in our fast-paced society and strongly influences our mental health. In the short term, ANS controls the cardiovascular response to stressful stimuli. Regulation of physiological parameters, such as heart rate, respiratory rate, and blood pressure, allows the organism to respond to sudden changes in the environment. However, physiological adaptation to a regularly occurring environmental phenomenon alters biological systems involved in stress response. Neurobiological alterations in the brain can disrupt the function of the ANS. ANS dysfunction and structural brain changes have a negative impact on cognitive, emotional, and behavioral processes, thereby leading to development of mental illness. Part II: The development of novel approaches for deriving noninvasive ANS biomarkers offers the possibility to improve the assessment of stress in healthy individuals and ANS dysfunction in MDD patients. Joint analysis of various biosignals (multi-modal approach) allows for the quantification of interactions among biological systems associated with ANS, while the modeling of biosignals and subsequent analysis of the model’s parameters (model-based approach) allows for the robust quantification of changes in physiological mechanisms related to the ANS. A novel method, which takes into account both phase and frequency locking phenomena between respiration and HRV signals, for assessing quadratic nonlinear cardiorespiratory coupling is proposed in Ch. 6.3. Novel techniques for improving the monitoring of respiration are proposed in Ch. 7. In Ch. 8, to increase the robustness for some morphological measurements reflecting arterial tone changes, the modeling of the PPG pulse as amain wave superposed with several reflected waves is considered. Part III: ANS biomarkers are evaluated in the assessment of different types of stress, either physiological or psychological, in healthy individuals, and then, in the monitoring of depression. In the presence of mental stress (Ch. 9.1), induced by cognitive tasks, healthy subjects show an increment in the respiratory rate and higher number of nonlinear interactions between respiration and HRV signal, which might be associated with a sympathetic activation, but also with a less regular breathing. In the presence of hemodynamic stress (Ch. 9.2), induced by a postural change, healthy subjects show a reduction in strength of the quadratic nonlinear cardiorespiratory coupling, whichmight be related to a vagal withdrawal. In the presence of heat stress (Ch. 9.3), induced by exposure to elevated environmental temperatures, healthy subjects show an increased sympathovagal balance. This demonstrates that ANS biomarkers are able to assess different types of stress and they can be further explored in the context of depression monitoring. In Ch. 10, differences in ANS function between MDD and healthy subjects during a mental stress protocol are assessed, not only with the raw values of ANS biomarkers but also with autonomic reactivity indices, which reflect the ability of an individual to copewith a challenging situation. Results show that depression is associated with autonomic imbalance, characterized by increased sympathetic activity and reduced arterial compliance. Autonomic reactivity indices quantified by changes, from stress to recovery, in arterial stiffness surrogates, such as the PPG amplitude loss in wave reflections, show the best performance in terms of correlation with depression severity, yielding to correlation coefficient r = −0.5. The negative correlation implies that a higher degree of depression is associated with a decreased autonomic reactivity. The discriminative power of ANS biomarkers is supported by their high diagnostic performance for classifying subjects as having MDD or not, yielding to accuracy of 80.0%. Therefore, it can be concluded that ANS biomarkers can be used for assessing stress and that impaired arterial compliance might constitute a biomarker of mental health useful in the monitoring of depression.<br /

JUST BREATHE: MINDFULNESS, SELF-REGULATION, AND CARDIAC REACTIVITY

Dispositional mindfulness is the non-judgmental moment-to-moment awareness of transient thoughts, feelings, and sensations as they arise in the attentional field (Kabat-Zinn, 1990). This phenomenon has been a primary element of various clinical interventions for many years. However, little is known about the active ingredients of mindfulness that promote emotional self-regulation and coping. The aim of this dissertation was to address this gap through three related studies which utilized an undergraduate sample. The first study used a laboratory protocol that required participants to perform several mildly stressful tasks related to emotional recall, mindful breathing, and a recovery condition. The hypothesis that high self-ratings of mindfulness correspond to more adaptive sympathetic and parasympathetic self-regulation relative to these tasks was tested. The second study examined the associations among self-rated emotional regulation strategies, ruminative tendencies, and mindfulness skills to test the hypothesis that mindfulness is negatively related to rumination and emotional dysregulation. Finally, the third study tested the hypothesis that mindfulness skills are associated with more benign perceptions of environmental stress, as well as a more adaptive estimation of the resources available to cope with stress, such as perceived social support and academic self-efficacy. Results suggested that self-rated mindfulness was associated with adaptive emotional self-regulation across task conditions. Results of this triad of studies suggest that mindfulness is associated with a lower likelihood of maintaining a prolonged fight or flight response after the stressor has been removed, and that specific mindful skills may work synergistically to promote effective coping and resilience. Implications for the development of future mindfulness interventions are discussed

Gene-environment interplay in adolescent sexual health and externalizing behaviors : a critical examination of context

The correlates of adolescent sexual behavior and externalizing spectrum behaviors have been documented across a range of disciplines and include both genetic and environmental factors. Over the last 15 years, the dynamic interplay between genes and the environment has garnered increasing interest among researchers who study risk-taking behavior. In spite of this popularity, the racial and socioeconomic composition of much behavioral genetic research to date has been largely homogenous, based on middle- to upper-middle-class Caucasian samples. Consequently, the universality of many findings remains unclear, and the roles of key contextual factors related to race and social privilege remain largely unexamined. To address these gaps, my dissertation will include three empirical studies, leveraging a range of biometric and structural equation modeling techniques to address three research questions. Each question builds in succession toward the overarching objective to better understand the contextual roles of racial stratification, social class, and chronic stress and trauma in relation to individual differences in adolescent sexual health and externalizing spectrum behaviors.Psycholog

Electrophysiological Signatures of Fear Conditioning: From Methodological Considerations to Catecholaminergic Mechanisms and Translational Perspectives

Fear conditioning describes a learning mechanism during which a specific stimulus gets associated with an aversive event (i.e., an unconditioned stimulus; US). Thereby, this initially neutral or arbitrary stimulus becomes a so-called “conditioned” stimulus (CS), which elicits a conditioned threat response. Fear extinction refers to the decrease in conditioned threat responses as soon as the CS is repeatedly presented in the absence of the US. While fear conditioning is an important learning model for understanding the etiology and maintenance of anxiety and fear-related disorders, extinction learning is considered to reflect the most important learning process of exposure therapy. Neurophysiological signatures of fear conditioning have been widely studied in rodents, leading to the development of groundbreaking neurobiological models, including brain regions such as the amygdala, insula, and prefrontal areas. These models aim to explain neural mechanisms of threat processing, with the ultimate goal to improve treatment strategies for pathological fear. Recording intracranial electrical activity of single units in animals offers the opportunity to uncover neural processes involved in threat processing with excellent spatial and temporal resolution. A large body of functional magnetic resonance imaging (fMRI) studies have helped to translate this knowledge about the anatomy of fear conditioning into the human realm. fMRI is an imaging technique with a high spatial resolution that is well suited to study slower brain processes. However, the temporal resolution of fMRI is relatively poor. By contrast, electroencephalography (EEG) is a neuroscientific method to capture fast and transient cortical processes. While EEG offers promising opportunities to unravel the speed of neural threat processing, it also provides the possibility to study oscillatory brain activity (e.g., prefrontal theta oscillations). The present thesis contains six research manuscripts, describing fear conditioning studies that mainly applied EEG methods in combination with other central (fMRI) and peripheral (skin conductance, heart rate, and fear-potentiated startle) measures. A special focus of this thesis lies in methodological considerations for EEG fear conditioning research. In addition, catecholaminergic mechanisms are studied, with the ultimate goal of opening up new translational perspectives. Taken together, the present thesis addresses several methodological challenges for neuroscientific (in particular, EEG) fear conditioning research (e.g., appropriate US types and experimental designs, signal-to-noise ratio, simultaneous EEG-fMRI). Furthermore, this thesis gives critical insight into catecholaminergic (noradrenaline and dopamine) mechanisms. A variety of neuroscientific methods (e.g., EEG, fMRI, peripheral physiology, pharmacological manipulation, genetic associations) have been combined, an approach that allowed us (a) to translate knowledge from animal studies to human research, and (b) to stimulate novel clinical directions

Assessing Variability of EEG and ECG/HRV Time Series Signals Using a Variety of Non-Linear Methods

Time series signals, such as Electroencephalogram (EEG) and Electrocardiogram (ECG) represent the complex dynamic behaviours of biological systems. The analysis of these signals using variety of nonlinear methods is essential for understanding variability within EEG and ECG, which potentially could help unveiling hidden patterns related to underlying physiological mechanisms. EEG is a time varying signal, and electrodes for recording EEG at different positions on the scalp give different time varying signals. There might be correlation between these signals. It is important to know the correlation between EEG signals because it might tell whether or not brain activities from different areas are related. EEG and ECG might be related to each other because both of them are generated from one co-ordinately working body. Investigating this relationship is of interest because it may reveal information about the correlation between EEG and ECG signals. This thesis is about assessing variability of time series data, EEG and ECG, using variety of nonlinear measures. Although other research has looked into the correlation between EEGs using a limited number of electrodes and a limited number of combinations of electrode pairs, no research has investigated the correlation between EEG signals and distance between electrodes. Furthermore, no one has compared the correlation performance for participants with and without medical conditions. In my research, I have filled up these gaps by using a full range of electrodes and all possible combinations of electrode pairs analysed in Time Domain (TD). Cross-Correlation method is calculated on the processed EEG signals for different number unique electrode pairs from each datasets. In order to obtain the distance in centimetres (cm) between electrodes, a measuring tape was used. For most of our participants the head circumference range was 54-58cm, for which a medium-sized I have discovered that the correlation between EEG signals measured through electrodes is linearly dependent on the physical distance (straight-line) distance between them for datasets without medical condition, but not for datasets with medical conditions. Some research has investigated correlation between EEG and Heart Rate Variability (HRV) within limited brain areas and demonstrated the existence of correlation between EEG and HRV. But no research has indicated whether or not the correlation changes with brain area. Although Wavelet Transformations (WT) have been performed on time series data including EEG and HRV signals to extract certain features respectively by other research, so far correlation between WT signals of EEG and HRV has not been analysed. My research covers these gaps by conducting a thorough investigation of all electrodes on the human scalp in Frequency Domain (FD) as well as TD. For the reason of different sample rates of EEG and HRV, two different approaches (named as Method 1 and Method 2) are utilised to segment EEG signals and to calculate Pearson’s Correlation Coefficient for each of the EEG frequencies with each of the HRV frequencies in FD. I have demonstrated that EEG at the front area of the brain has a stronger correlation with HRV than that at the other area in a frequency domain. These findings are independent of both participants and brain hemispheres. Sample Entropy (SE) is used to predict complexity of time series data. Recent research has proposed new calculation methods for SE, aiming to improve the accuracy. To my knowledge, no one has attempted to reduce the computational time of SE calculation. I have developed a new calculation method for time series complexity which could improve computational time significantly in the context of calculating a correlation between EEG and HRV. The results have a parsimonious outcome of SE calculation by exploiting a new method of SE implementation. In addition, it is found that the electrical activity in the frontal lobe of the brain appears to be correlated with the HRV in a time domain. Time series analysis method has been utilised to study complex systems that appear ubiquitous in nature, but limited to certain dynamic systems (e.g. analysing variables affecting stock values). In this thesis, I have also investigated the nature of the dynamic system of HRV. I have disclosed that Embedding Dimension could unveil two variables that determined HRV

Pattern Recognition

A wealth of advanced pattern recognition algorithms are emerging from the interdiscipline between technologies of effective visual features and the human-brain cognition process. Effective visual features are made possible through the rapid developments in appropriate sensor equipments, novel filter designs, and viable information processing architectures. While the understanding of human-brain cognition process broadens the way in which the computer can perform pattern recognition tasks. The present book is intended to collect representative researches around the globe focusing on low-level vision, filter design, features and image descriptors, data mining and analysis, and biologically inspired algorithms. The 27 chapters coved in this book disclose recent advances and new ideas in promoting the techniques, technology and applications of pattern recognition

Analyzing Granger causality in climate data with time series classification methods

Attribution studies in climate science aim for scientifically ascertaining the influence of climatic variations on natural or anthropogenic factors. Many of those studies adopt the concept of Granger causality to infer statistical cause-effect relationships, while utilizing traditional autoregressive models. In this article, we investigate the potential of state-of-the-art time series classification techniques to enhance causal inference in climate science. We conduct a comparative experimental study of different types of algorithms on a large test suite that comprises a unique collection of datasets from the area of climate-vegetation dynamics. The results indicate that specialized time series classification methods are able to improve existing inference procedures. Substantial differences are observed among the methods that were tested