Combining Synthesis of Cardiorespiratory Signals and Artifacts with Deep Learning for Robust Vital Sign Estimation

Healthcare has been remarkably morphing on the account of Big Data. As Machine Learning (ML) consolidates its place in simpler clinical chores, more complex Deep Learning (DL) algorithms have struggled to keep up, despite their superior capabilities. This is mainly attributed to the need for large amounts of data for training, which the scientific community is unable to satisfy. The number of promising DL algorithms is considerable, although solutions directly targeting the shortage of data lack. Currently, dynamical generative models are the best bet, but focus on single, classical modalities and tend to complicate significantly with the amount of physiological effects they can simulate. This thesis aims at providing and validating a framework, specifically addressing the data deficit in the scope of cardiorespiratory signals. Firstly, a multimodal statistical synthesizer was designed to generate large, annotated artificial signals. By expressing data through coefficients of pre-defined, fitted functions and describing their dependence with Gaussian copulas, inter- and intra-modality associations were learned. Thereafter, new coefficients are sampled to generate artificial, multimodal signals with the original physiological dynamics. Moreover, normal and pathological beats along with artifacts were included by employing Markov models. Secondly, a convolutional neural network (CNN) was conceived with a novel sensor-fusion architecture and trained with synthesized data under real-world experimental conditions to evaluate how its performance is affected. Both the synthesizer and the CNN not only performed at state of the art level but also innovated with multiple types of generated data and detection error improvements, respectively. Cardiorespiratory data augmentation corrected performance drops when not enough data is available, enhanced the CNN’s ability to perform on noisy signals and to carry out new tasks when introduced to, otherwise unavailable, types of data. Ultimately, the framework was successfully validated showing potential to leverage future DL research on Cardiology into clinical standards

Time Series Cluster Kernel for Learning Similarities between Multivariate Time Series with Missing Data

Similarity-based approaches represent a promising direction for time series analysis. However, many such methods rely on parameter tuning, and some have shortcomings if the time series are multivariate (MTS), due to dependencies between attributes, or the time series contain missing data. In this paper, we address these challenges within the powerful context of kernel methods by proposing the robust \emph{time series cluster kernel} (TCK). The approach taken leverages the missing data handling properties of Gaussian mixture models (GMM) augmented with informative prior distributions. An ensemble learning approach is exploited to ensure robustness to parameters by combining the clustering results of many GMM to form the final kernel. We evaluate the TCK on synthetic and real data and compare to other state-of-the-art techniques. The experimental results demonstrate that the TCK is robust to parameter choices, provides competitive results for MTS without missing data and outstanding results for missing data.Comment: 23 pages, 6 figure

Assessing Variability of EEG and ECG/HRV Time Series Signals Using a Variety of Non-Linear Methods

Time series signals, such as Electroencephalogram (EEG) and Electrocardiogram (ECG) represent the complex dynamic behaviours of biological systems. The analysis of these signals using variety of nonlinear methods is essential for understanding variability within EEG and ECG, which potentially could help unveiling hidden patterns related to underlying physiological mechanisms. EEG is a time varying signal, and electrodes for recording EEG at different positions on the scalp give different time varying signals. There might be correlation between these signals. It is important to know the correlation between EEG signals because it might tell whether or not brain activities from different areas are related. EEG and ECG might be related to each other because both of them are generated from one co-ordinately working body. Investigating this relationship is of interest because it may reveal information about the correlation between EEG and ECG signals. This thesis is about assessing variability of time series data, EEG and ECG, using variety of nonlinear measures. Although other research has looked into the correlation between EEGs using a limited number of electrodes and a limited number of combinations of electrode pairs, no research has investigated the correlation between EEG signals and distance between electrodes. Furthermore, no one has compared the correlation performance for participants with and without medical conditions. In my research, I have filled up these gaps by using a full range of electrodes and all possible combinations of electrode pairs analysed in Time Domain (TD). Cross-Correlation method is calculated on the processed EEG signals for different number unique electrode pairs from each datasets. In order to obtain the distance in centimetres (cm) between electrodes, a measuring tape was used. For most of our participants the head circumference range was 54-58cm, for which a medium-sized I have discovered that the correlation between EEG signals measured through electrodes is linearly dependent on the physical distance (straight-line) distance between them for datasets without medical condition, but not for datasets with medical conditions. Some research has investigated correlation between EEG and Heart Rate Variability (HRV) within limited brain areas and demonstrated the existence of correlation between EEG and HRV. But no research has indicated whether or not the correlation changes with brain area. Although Wavelet Transformations (WT) have been performed on time series data including EEG and HRV signals to extract certain features respectively by other research, so far correlation between WT signals of EEG and HRV has not been analysed. My research covers these gaps by conducting a thorough investigation of all electrodes on the human scalp in Frequency Domain (FD) as well as TD. For the reason of different sample rates of EEG and HRV, two different approaches (named as Method 1 and Method 2) are utilised to segment EEG signals and to calculate Pearson’s Correlation Coefficient for each of the EEG frequencies with each of the HRV frequencies in FD. I have demonstrated that EEG at the front area of the brain has a stronger correlation with HRV than that at the other area in a frequency domain. These findings are independent of both participants and brain hemispheres. Sample Entropy (SE) is used to predict complexity of time series data. Recent research has proposed new calculation methods for SE, aiming to improve the accuracy. To my knowledge, no one has attempted to reduce the computational time of SE calculation. I have developed a new calculation method for time series complexity which could improve computational time significantly in the context of calculating a correlation between EEG and HRV. The results have a parsimonious outcome of SE calculation by exploiting a new method of SE implementation. In addition, it is found that the electrical activity in the frontal lobe of the brain appears to be correlated with the HRV in a time domain. Time series analysis method has been utilised to study complex systems that appear ubiquitous in nature, but limited to certain dynamic systems (e.g. analysing variables affecting stock values). In this thesis, I have also investigated the nature of the dynamic system of HRV. I have disclosed that Embedding Dimension could unveil two variables that determined HRV

Characterization of the Substrate Modification in Patients Undergoing Catheter Ablation of Atrial Fibrillation

Tesis por compendio[ES] La fibrilación auricular (FA) es la arritmia cardíaca más común. A pesar de la gran popularidad de la ablación con catéter (AC) como tratamiento principal, todavía hay margen de mejora. Aunque las venas pulmonares (VPs) son los principales focos de FA, muchos sitios pueden contribuir a su propagación, formando el sustrato de la FA (SFA). El mapeo preciso del SFA y el registro de la modificación del SFA, como marcador positivo después de AC, son fundamentales. Los electrocardiogramas (ECG) y los electrogramas (EGM) se reclutan para este propósito. Los EGM se utilizan para detectar candidatos de AC como áreas que provocan o perpetúan la FA. Por lo tanto, el análisis de EGM es una parte indispensable de AC. Con la capacidad de observar las aurículas globalmente, la principal aplicación de los ECG es evaluar la modificación del SFA analizando las ondas f o P. A pesar del extenso análisis de cualquiera de los tipos de registro, existen algunas brechas. La AC no-VP aumenta el tiempo en quirófano, provocando mayores riesgos y costos. En cuanto al análisis de la modificación del SFA, se utilizan varios umbrales para definir una onda P prolongada. El principal objetivo de la presente Tesis es contribuir al esfuerzo de análisis de SFA y de modificación de SFA. Para ello, la presente Tesis se desarrolló bajo dos hipótesis principales. Que la calidad de la información extraída durante el SFA y el análisis de modificación del SFA se puede mejorar mediante la introducción de pasos innovadores. Además, la combinación de análisis de ECG y EGM puede aumentar la resolución del mapeo y revelar nueva información sobre los mecanismos de FA. Para cumplir con el objetivo principal, el análisis se divide en 4 partes, conformando los 4 capítulos del Compendio de articulos. En primer lugar, se reclutó la dimensión de correlación de grano grueso (DCGG). DCGG localizó de manera confiable EGM complejos y la clasificación por tipos de FA arrojó una precisión del 84 %. Luego, se adoptó un análisis alternativo de la onda P, estudiando por separado su primera y su segunda parte, correspondientes a la aurícula derecha (AD) e izquierda (AI). Los resultados indicaron LA como la principal fuente de modificación del SFA y subrayaron la importancia de estudiar partes integrales de ECG. Los hallazgos de este estudio también sugieren la implementación de partes integrales de ondas P como un posible alivio de las discrepancias en los umbrales de ondas P para definir el tejido fibrótico. Posteriormente, se estudió el efecto diferente del aislamiento de la VP izquierda (AVPI) y derecha (AVPD) sobre la modificación del SFA. AVPI fue la parte crítica, siendo la fuente exclusiva de acortamiento de onda P. El análisis de los registros durante la AC también permitió una observación más cercana de las fluctuaciones de la variabilidad de la frecuencia cardíaca (VFC) a lo largo del procedimiento de CA, lo que reveló información sobre el efecto de la energía de radiofrecuencia (RF) en el tejido auricular. La última parte se centró en el seno coronario (SC), una estructura fundamental en el mapeo de FA para aumentar la resolución de la información. Se definieron los canales más y menos robustos durante el ritmo sinusal (RS) y se investigó la utilidad de SC en la evaluación de la modificación del SFA. Aunque CS no proporcionó una imagen global de la alteración del SFA, pudo registrar con mayor sensibilidad las fluctuaciones en la respuesta auricular durante la AC. Los hallazgos presentados en esta Tesis Doctoral ofrecen una perspectiva alternativa sobre la modificación del SFA y contribuyen al esfuerzo general sobre el mapeo de FA y la evaluación del sustrato posterior a la CAAC, abriendo futuras líneas de investigación hacia una resolución más alta y un mapeo más eficiente de los mecanismos desencadenantes de la FA.[CA] La fibril·lació auricular (FA) és l'arítmia cardíaca més comú. Tot i la gran popularitat de l'ablació amb catèter (AC) com a tractament principal, encara hi ha marge de millora. Tot i que les venes pulmonars (VPs) són els principals focus de FA, molts llocs poden contribuir a la seva propagació, formant el substrat de la FA (SFA). El mapatge precís de l'SFA i el registre de la modificació de l'SFA, com a marcador positiu després d'AC, són fonamentals. Els electrocardiogrames (ECG) i els electrogrames (EGM) es recluten per a aquest propòsit. Els EGM es fan servir per detectar candidats d'AC com a àrees que provoquen o perpetuen la FA. Per tant, lanàlisi dEGM és una part indispensable dAC. Amb la capacitat d'observar les aurícules globalment, la principal aplicació dels ECG és avaluar la modificació de l'SFA analitzant les ones f o P. Tot i l'extensa anàlisi de qualsevol dels tipus de registre, hi ha algunes bretxes. L'AC no-VP augmenta el temps a quiròfan, provocant majors riscos i costos. Pel que fa a l'anàlisi de la modificació de l'SFA, s'utilitzen diversos llindars per definir una ona P perllongada. L'objectiu principal d'aquesta Tesi és contribuir a l'esforç d'anàlisi de SFA i de modificació de SFA. Per això, aquesta Tesi es va desenvolupar sota dues hipòtesis principals. Que la qualitat de la informació extreta durant el SFA i lanàlisi de modificació de lSFA es pot millorar mitjançant la introducció de passos innovadors. A més, la combinació d'anàlisi d'ECG i EGM pot augmentar la resolució del mapatge i revelar informació nova sobre els mecanismes de FA. Per complir amb l'objectiu principal, l'anàlisi es divideix en 4 parts i es conforma els 4 capítols del Compendi d'articles. En primer lloc, es va reclutar la dimensió de correlació de gra gruixut (DCGG). DCGG va localitzar de manera fiable EGM complexos i la classificació per tipus de FA va donar una precisió del 84%. Després, es va adoptar una anàlisi alternativa de l'ona P, estudiant per separat la primera i la segona part corresponents a l'aurícula dreta (AD) i esquerra (AI). Els resultats van indicar LA com la font principal de modificació de l'SFA i van subratllar la importància d'estudiar parts integrals d'ECG. Les troballes d'aquest estudi també suggereixen la implementació de parts integrals d'ones P com a possible alleugeriment de les discrepàncies als llindars d'ones P per definir el teixit fibròtic. Posteriorment, es va estudiar l'efecte diferent de l'aïllament de la VP esquerra (AVPI) i la dreta (AVPD) sobre la modificació de l'SFA. AVPI va ser la part crítica, sent la font exclusiva d'escurçament d'ona P. L'anàlisi dels registres durant l'AC també va permetre una observació més propera de les fluctuacions de la variabilitat de la freqüència cardíaca (VFC) al llarg del procediment de CA , cosa que va revelar informació sobre l'efecte de l'energia de radiofreqüència (RF) en el teixit auricular. L'última part es va centrar al si coronari (SC), una estructura fonamental al mapeig de FA per augmentar la resolució de la informació. Es van definir els canals més i menys robustos durant el ritme sinusal (RS) i es va investigar la utilitat de SC a l'avaluació de la modificació de l'SFA. Tot i que CS no va proporcionar una imatge global de l'alteració de l'SFA, va poder registrar amb més sensibilitat les fluctuacions a la resposta auricular durant l'AC. Les troballes presentades en aquesta Tesi Doctoral ofereixen una perspectiva alternativa sobre la modificació de l'SFA i contribueixen a l'esforç general sobre el mapeig de FA i l'avaluació del substrat posterior a la CAAC, obrint futures línies de recerca cap a una resolució més alta i un mapeig més eficient dels mecanismes desencadenants de la FA.[EN] Atrial fibrillation (AF) is the commonest cardiac arrhythmia. Despite the high popularity of catheter ablation (CA) as the main treatment, there is still room for improvement. Time spent in AF affects the AF confrontation and evolution, with 1,15% of paroxysmal AF patients progressing to persistent annually. Therefore, from diagnosis to follow-up, every aspect that contributes to the AF confrontation is of utmost importance. Although pulmonary veins (PVs) are the main AF foci, many sites may contribute to the AF propagation, by triggering or sustaining the AF, forming the AF substrate. Precise AF substrate mapping and recording of the AF substrate modification, as a positive marker after CA sessions, are critical. Electrocardiograms (ECGs) and electrograms (EGMs) are vastly recruited for this purpose. EGMs are used to detect candidate CA targets as areas that provoke or perpetuate AF. Hence, EGMs analysis is an indispensable part of the CA procedure. With the ability to observe the atria globally, ECGs' main application is to assess the AF substrate modification by analyzing f- or P-waves from recordings before and after CA. Despite the extensive analysis on either recording types, some gaps exist. Non-PV CA increases the time in operation room, provoking higher risks and costs. Furthermore, whether non-PV CA is beneficial is under dispute. As for the AF substrate modification analysis, various thresholds are used to define a prolonged P-wave, related with poor CA prognostics. The main objective of the present Thesis is to contribute to the effort of AF substrate and AF substrate modification analysis. For this purpose, the present Thesis was developed under two main hypotheses. That the information quality extracted during AF substrate and AF substrate modification analysis can be improved by introducing innovative steps. Also, that combining ECG and EGM analysis can augment the mapping resolution and reveal new information regarding AF mechanisms. To accomplish the main objective, the analysis is split in 4 parts, forming the 4 chapters of the Compendium of publications. Firstly, coarse-grained correlation dimension (CGCD) was recruited. CGCD reliably localized highly complex EGMs and classification by AF types yielded 84% accuracy. Then, an alternative P-wave analysis was suggested, studying separately the first and second P-wave parts, corresponding to the right (RA) and left (LA) atrium. The findings indicated LA as the main AF substrate modification source and underlined the importance of studying integral ECG parts. The findings of this study additionally suggest the implementation of integral P-wave parts as a possible alleviation for the discrepancies in P-wave thresholds to define fibrotic tissue. Afterwards, the different effect of left (LPVI) and right pulmonary vein isolation (RPVI) on the AF substrate modification was studied. LPVI was the critical part, being the exclusive source of P-wave shortening. Analysis of recordings during CA also allowed a closer observation of the heart rate variability (HRV) fluctuations throughout the CA procedure, revealing information on the effect of radiofrequency (RF) energy on the atrial tissue. The last part was focused on coronary sinus (CS), a fundamental structure in AF mapping to increase the information resolution. The most and least robust channels during sinus rhythm (SR) were defined and the utility of CS in AF substrate modification evaluation was investigated. Although CS did not provide a global picture of the AF substrate alteration, it was able to record with higher sensitivity the fluctuations in the atrial response during the application of RF energy. The findings presented in this Doctoral Thesis offer an alternative perspective on the AF substrate modification and contribute to the overall effort on AF mapping and post-CA substrate evaluation, opening future lines of research towards a higher resolution and more efficient mapping of the AF drivers.Vraka, A. (2022). Characterization of the Substrate Modification in Patients Undergoing Catheter Ablation of Atrial Fibrillation [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/191410Compendi