Deep Learning in Cardiology

The medical field is creating large amount of data that physicians are unable to decipher and use efficiently. Moreover, rule-based expert systems are inefficient in solving complicated medical tasks or for creating insights using big data. Deep learning has emerged as a more accurate and effective technology in a wide range of medical problems such as diagnosis, prediction and intervention. Deep learning is a representation learning method that consists of layers that transform the data non-linearly, thus, revealing hierarchical relationships and structures. In this review we survey deep learning application papers that use structured data, signal and imaging modalities from cardiology. We discuss the advantages and limitations of applying deep learning in cardiology that also apply in medicine in general, while proposing certain directions as the most viable for clinical use.Comment: 27 pages, 2 figures, 10 table

Bits from Biology for Computational Intelligence

Computational intelligence is broadly defined as biologically-inspired computing. Usually, inspiration is drawn from neural systems. This article shows how to analyze neural systems using information theory to obtain constraints that help identify the algorithms run by such systems and the information they represent. Algorithms and representations identified information-theoretically may then guide the design of biologically inspired computing systems (BICS). The material covered includes the necessary introduction to information theory and the estimation of information theoretic quantities from neural data. We then show how to analyze the information encoded in a system about its environment, and also discuss recent methodological developments on the question of how much information each agent carries about the environment either uniquely, or redundantly or synergistically together with others. Last, we introduce the framework of local information dynamics, where information processing is decomposed into component processes of information storage, transfer, and modification -- locally in space and time. We close by discussing example applications of these measures to neural data and other complex systems

Multivariate assessment of linear and non-linear causal coupling pathways within the central-autonomic-network in patients suffering from schizophrenia

Im Bereich der Zeitreihenanalyse richtet sich das Interesse zunehmend darauf, wie Einblicke in die Interaktions- und Regulationsprozesse von pathophysiologischen- und physiologischen Zuständen erlangt werden können. Neuste Fortschritte in der nichtlinearen Dynamik, der Informationstheorie und der Netzwerktheorie liefern dabei fundiertes Wissen über Kopplungswege innerhalb (patho)physiologischer (Sub)Systeme. Kopplungsanalysen zielen darauf ab, ein besseres Verständnis dafür zu erlangen, wie die verschiedenen integrierten regulatorischen (Sub)Systeme mit ihren komplexen Strukturen und Regulationsmechanismen das globale Verhalten und die unterschiedlichen physiologischen Funktionen auf der Ebene des Organismus beschreiben. Insbesondere die Erfassung und Quantifizierung der Kopplungsstärke und -richtung sind wesentliche Aspekte für ein detaillierteres Verständnis physiologischer Regulationsprozesse. Ziel dieser Arbeit war die Charakterisierung kurzfristiger unmittelbarer zentral-autonomer Kopplungspfade (top-to-bottom und bottom to top) durch die Kopplungsanalysen der Herzfrequenz, des systolischen Blutdrucks, der Atmung und zentraler Aktivität (EEG) bei schizophrenen Patienten und Gesunden. Dafür wurden in dieser Arbeit neue multivariate kausale und nicht-kausale, lineare und nicht-lineare Kopplungsanalyseverfahren (HRJSD, mHRJSD, NSTPDC) entwickelt, die in der Lage sind, die Kopplungsstärke und -richtung, sowie deterministische regulatorische Kopplungsmuster innerhalb des zentralen-autonomen Netzwerks zu quantifizieren und zu klassifizieren. Diese Kopplungsanalyseverfahren haben ihre eigenen Besonderheiten, die sie einzigartig machen, auch im Vergleich zu etablierten Kopplungsverfahren. Sie erweitern das Spektrum neuartiger Kopplungsansätze für die Biosignalanalyse und tragen auf ihre Weise zur Gewinnung detaillierter Informationen und damit zu einer verbesserten Diagnostik/Therapie bei. Die Hauptergebnisse dieser Arbeit zeigen signifikant schwächere nichtlineare zentral-kardiovaskuläre und zentral-kardiorespiratorische Kopplungswege und einen signifikant stärkeren linearen zentralen Informationsfluss in Richtung des Herzkreislaufsystems auf, sowie einen signifikant stärkeren linearen respiratorischen Informationsfluss in Richtung des zentralen Nervensystems in der Schizophrenie im Vergleich zu Gesunden. Die detaillierten Erkenntnisse darüber, wie die verschiedenen zentral-autonomen Netzwerke mit paranoider Schizophrenie assoziiert sind, können zu einem besseren Verständnis darüber führen, wie zentrale Aktivierung und autonome Reaktionen und/oder Aktivierung in physiologischen Netzwerken unter pathophysiologischen Bedingungen zusammenhängen.In the field of time series analysis, increasing interest focuses on insights gained how the coupling pathways of regulatory mechanisms work in healthy and ill states. Recent advances in non-linear dynamics, information theory and network theory lead to a new sophisticated body of knowledge about coupling pathways within (patho)physiological (sub)systems. Coupling analyses aim to provide a better understanding of how the different integrated physiological (sub)systems, with their complex structures and regulatory mechanisms, describe the global behaviour and distinct physiological functions at the organism level. In particular, the detection and quantification of the coupling strength and direction are important aspects for a more detailed understanding of physiological regulatory processes. This thesis aimed to characterize short-term instantaneous central-autonomic-network coupling pathways (top-to-bottom and bottom to top) by analysing the coupling of heart rate, systolic blood pressure, respiration and central activity (EEG) in schizophrenic patients and healthy participants. Therefore, new multivariate causal and non-causal linear and non-linear coupling approaches (HRJSD, mHRJSD, NSTPDC) that are able to determine the coupling strength and direction were developed. Whereby, the HRJSD and mHRJSD approaches allow the quantification and classification of deterministic regulatory coupling patterns within and between the cardiovascular- the cardiorespiratory system and the central-autonomic-network were developed. These coupling approaches have their own unique features, even as compared to well-established coupling approaches. They expand the spectrum of novel coupling approaches for biosignal analysis and thus contribute in their own way to detailed information obtained, and thereby contribute to improved diagnostics/therapy. The main findings of this thesis revealed significantly weaker non-linear central-cardiovascular and central-cardiorespiratory coupling pathways, and significantly stronger linear central information flow in the direction of the cardiac- and vascular system, and a significantly stronger linear respiratory information transfer towards the central nervous system in schizophrenia in comparison to healthy participants. This thesis provides an enhanced understanding of the interrelationship of central and autonomic regulatory mechanisms in schizophrenia. The detailed findings on how variously-pronounced, central-autonomic-network pathways are associated with paranoid schizophrenia may enable a better understanding on how central activation and autonomic responses and/or activation are connected in physiology networks under pathophysiological conditions

Comparison of discretization strategies for the model-free information-theoretic assessment of short-term physiological interactions

This work presents a comparison between different approaches for the model-free estimation of information-theoretic measures of the dynamic coupling between short realizations of random processes. The measures considered are the mutual information rate (MIR) between two random processes X and Y and the terms of its decomposition evidencing either the individual entropy rates of X and Y and their joint entropy rate, or the transfer entropies from X to Y and from Y to X and the instantaneous information shared by X and Y. All measures are estimated through discretization of the random variables forming the processes, performed either via uniform quantization (binning approach) or rank ordering (permutation approach). The binning and permutation approaches are compared on simulations of two coupled non-identical Hènon systems and on three datasets, including short realizations of cardiorespiratory (CR, heart period and respiration flow), cardiovascular (CV, heart period and systolic arterial pressure), and cerebrovascular (CB, mean arterial pressure and cerebral blood flow velocity) measured in different physiological conditions, i.e., spontaneous vs paced breathing or supine vs upright positions. Our results show that, with careful selection of the estimation parameters (i.e., the embedding dimension and the number of quantization levels for the binning approach), meaningful patterns of the MIR and of its components can be achieved in the analyzed systems. On physiological time series, we found that paced breathing at slow breathing rates induces less complex and more coupled CR dynamics, while postural stress leads to unbalancing of CV interactions with prevalent baroreflex coupling and to less complex pressure dynamics with preserved CB interactions. These results are better highlighted by the permutation approach, thanks to its more parsimonious representation of the discretized dynamic patterns, which allows one to explore interactions with longer memory while limiting the curse of dimensionality

Review and classification of variability analysis techniques with clinical applications

Analysis of patterns of variation of time-series, termed variability analysis, represents a rapidly evolving discipline with increasing applications in different fields of science. In medicine and in particular critical care, efforts have focussed on evaluating the clinical utility of variability. However, the growth and complexity of techniques applicable to this field have made interpretation and understanding of variability more challenging. Our objective is to provide an updated review of variability analysis techniques suitable for clinical applications. We review more than 70 variability techniques, providing for each technique a brief description of the underlying theory and assumptions, together with a summary of clinical applications. We propose a revised classification for the domains of variability techniques, which include statistical, geometric, energetic, informational, and invariant. We discuss the process of calculation, often necessitating a mathematical transform of the time-series. Our aims are to summarize a broad literature, promote a shared vocabulary that would improve the exchange of ideas, and the analyses of the results between different studies. We conclude with challenges for the evolving science of variability analysis

Measuring information-transfer delays

In complex networks such as gene networks, traffic systems or brain circuits it is important to understand how long it takes for the different parts of the network to effectively influence one another. In the brain, for example, axonal delays between brain areas can amount to several tens of milliseconds, adding an intrinsic component to any timing-based processing of information. Inferring neural interaction delays is thus needed to interpret the information transfer revealed by any analysis of directed interactions across brain structures. However, a robust estimation of interaction delays from neural activity faces several challenges if modeling assumptions on interaction mechanisms are wrong or cannot be made. Here, we propose a robust estimator for neuronal interaction delays rooted in an information-theoretic framework, which allows a model-free exploration of interactions. In particular, we extend transfer entropy to account for delayed source-target interactions, while crucially retaining the conditioning on the embedded target state at the immediately previous time step. We prove that this particular extension is indeed guaranteed to identify interaction delays between two coupled systems and is the only relevant option in keeping with Wiener’s principle of causality. We demonstrate the performance of our approach in detecting interaction delays on finite data by numerical simulations of stochastic and deterministic processes, as well as on local field potential recordings. We also show the ability of the extended transfer entropy to detect the presence of multiple delays, as well as feedback loops. While evaluated on neuroscience data, we expect the estimator to be useful in other fields dealing with network dynamics

Feasibility of Ultra-short Term Complexity Analysis of Heart Rate Variability in Resting State and During Orthostatic Stress

In this work, we study ultra-short term (UST) complexity of Heart Rate Variability (HRV) and its agreement with analysis of standard short-term (ST) HRV recordings obtained at rest and during orthostatic stress. Conditional Entropy (CE) measures have been computed using both a linear Gaussian approximation and a more accurate model-free approach based on nearest neighbors. The agreement between UST and ST indices has been compared via statistical tests and correlation analysis, suggesting the feasibility of exploiting faster algorithms and shorter time series for detecting changes in cardiovascular control during various states