Bayesian Inference with Combined Dynamic and Sparsity Models: Application in 3D Electrophysiological Imaging

Data-driven inference is widely encountered in various scientific domains to convert the observed measurements into information that cannot be directly observed about a system. Despite the quickly-developing sensor and imaging technologies, in many domains, data collection remains an expensive endeavor due to financial and physical constraints. To overcome the limits in data and to reduce the demand on expensive data collection, it is important to incorporate prior information in order to place the data-driven inference in a domain-relevant context and to improve its accuracy. Two sources of assumptions have been used successfully in many inverse problem applications. One is the temporal dynamics of the system (dynamic structure). The other is the low-dimensional structure of a system (sparsity structure). In existing work, these two structures have often been explored separately, while in most high-dimensional dynamic system they are commonly co-existing and contain complementary information. In this work, our main focus is to build a robustness inference framework to combine dynamic and sparsity constraints. The driving application in this work is a biomedical inverse problem of electrophysiological (EP) imaging, which noninvasively and quantitatively reconstruct transmural action potentials from body-surface voltage data with the goal to improve cardiac disease prevention, diagnosis, and treatment. The general framework can be extended to a variety of applications that deal with the inference of high-dimensional dynamic systems

Uncertainty Quantification and Reduction in Cardiac Electrophysiological Imaging

Cardiac electrophysiological (EP) imaging involves solving an inverse problem that infers cardiac electrical activity from body-surface electrocardiography data on a physical domain defined by the body torso. To avoid unreasonable solutions that may fit the data, this inference is often guided by data-independent prior assumptions about different properties of cardiac electrical sources as well as the physical domain. However, these prior assumptions may involve errors and uncertainties that could affect the inference accuracy. For example, common prior assumptions on the source properties, such as fixed spatial and/or temporal smoothness or sparseness assumptions, may not necessarily match the true source property at different conditions, leading to uncertainties in the inference. Furthermore, prior assumptions on the physical domain, such as the anatomy and tissue conductivity of different organs in the thorax model, represent an approximation of the physical domain, introducing errors to the inference. To determine the robustness of the EP imaging systems for future clinical practice, it is important to identify these errors/uncertainties and assess their impact on the solution. This dissertation focuses on the quantification and reduction of the impact of uncertainties caused by prior assumptions/models on cardiac source properties as well as anatomical modeling uncertainties on the EP imaging solution. To assess the effect of fixed prior assumptions/models about cardiac source properties on the solution of EP imaging, we propose a novel yet simple Lp-norm regularization method for volumetric cardiac EP imaging. This study reports the necessity of an adaptive prior model (rather than fixed model) for constraining the complex spatiotemporally changing properties of the cardiac sources. We then propose a multiple-model Bayesian approach to cardiac EP imaging that employs a continuous combination of prior models, each re-effecting a specific spatial property for volumetric sources. The 3D source estimation is then obtained as a weighted combination of solutions across all models. Including a continuous combination of prior models, our proposed method reduces the chance of mismatch between prior models and true source properties, which in turn enhances the robustness of the EP imaging solution. To quantify the impact of anatomical modeling uncertainties on the EP imaging solution, we propose a systematic statistical framework. Founded based on statistical shape modeling and unscented transform, our method quantifies anatomical modeling uncertainties and establish their relation to the EP imaging solution. Applied on anatomical models generated from different image resolutions and different segmentations, it reports the robustness of EP imaging solution to these anatomical shape-detail variations. We then propose a simplified anatomical model for the heart that only incorporates certain subject-specific anatomical parameters, while discarding local shape details. Exploiting less resources and processing for successful EP imaging, this simplified model provides a simple clinically-compatible anatomical modeling experience for EP imaging systems. Different components of our proposed methods are validated through a comprehensive set of synthetic and real-data experiments, including various typical pathological conditions and/or diagnostic procedures, such as myocardial infarction and pacing. Overall, the methods presented in this dissertation for the quantification and reduction of uncertainties in cardiac EP imaging enhance the robustness of EP imaging, helping to close the gap between EP imaging in research and its clinical application

Bayesian Active Learning for Personalization and Uncertainty Quantification in Cardiac Electrophysiological Model

Cardiacvascular disease is the top death causing disease worldwide. In recent years, high-fidelity personalized models of the heart have shown an increasing capability to supplement clinical cardiology for improved patient-specific diagnosis, prediction, and treatment planning. In addition, they have shown promise to improve scientific understanding of a variety of disease mechanisms. However, model personalization by estimating the patient-specific tissue properties that are in the form of parameters of a physiological model is challenging. This is because tissue properties, in general, cannot be directly measured and they need to be estimated from measurements that are indirectly related to them through a physiological model. Moreover, these unknown tissue properties are heterogeneous and spatially varying throughout the heart volume presenting a difficulty of high-dimensional (HD) estimation from indirect and limited measurement data. The challenge in model personalization, therefore, summarizes to solving an ill-posed inverse problem where the unknown parameters are HD and the forward model is complex with a non-linear and computationally expensive physiological model. In this dissertation, we address the above challenge with following contributions. First, to address the concern of a complex forward model, we propose the surrogate modeling of the complex target function containing the forward model – an objective function in deterministic estimation or a posterior probability density function in probabilistic estimation – by actively selecting a set of training samples and a Bayesian update of the prior over the target function. The efficient and accurate surrogate of the expensive target function obtained in this manner is then utilized to accelerate either deterministic or probabilistic parameter estimation. Next, within the framework of Bayesian active learning we enable active surrogate learning over a HD parameter space with two novel approaches: 1) a multi-scale optimization that can adaptively allocate higher resolution to heterogeneous tissue regions and lower resolution to homogeneous tissue regions; and 2) a generative model from low-dimensional (LD) latent code to HD tissue properties. Both of these approaches are independently developed and tested within a parameter optimization framework. Furthermore, we devise a novel method that utilizes the surrogate pdf learned on an estimated LD parameter space to improve the proposal distribution of Metropolis Hastings for an accelerated sampling of the exact posterior pdf. We evaluate the presented methods on estimating local tissue excitability of a cardiac electrophysiological model in both synthetic data experiments and real data experiments. Results demonstrate that the presented methods are able to improve the accuracy and efficiency in patient-specific model parameter estimation in comparison to the existing approaches used for model personalization

On Learning and Generalization to Solve Inverse Problem of Electrophysiological Imaging

In this dissertation, we are interested in solving a linear inverse problem: inverse electrophysiological (EP) imaging, where our objective is to computationally reconstruct personalized cardiac electrical signals based on body surface electrocardiogram (ECG) signals. EP imaging has shown promise in the diagnosis and treatment planning of cardiac dysfunctions such as atrial flutter, atrial fibrillation, ischemia, infarction and ventricular arrhythmia. Towards this goal, we frame it as a problem of learning a function from the domain of measurements to signals. Depending upon the assumptions, we present two classes of solutions: 1) Bayesian inference in a probabilistic graphical model, 2) Learning from samples using deep networks. In both of these approaches, we emphasize on learning the inverse function with good generalization ability, which becomes a main theme of the dissertation. In a Bayesian framework, we argue that this translates to appropriately integrating different sources of knowledge into a common probabilistic graphical model framework and using it for patient specific signal estimation through Bayesian inference. In learning from samples setting, this translates to designing a deep network with good generalization ability, where good generalization refers to the ability to reconstruct inverse EP signals in a distribution of interest (which could very well be outside the sample distribution used during training). By drawing ideas from different areas like functional analysis (e.g. Fenchel duality), variational inference (e.g. Variational Bayes) and deep generative modeling (e.g. variational autoencoder), we show how we can incorporate different prior knowledge in a principled manner in a probabilistic graphical model framework to obtain a good inverse solution with generalization ability. Similarly, to improve generalization of deep networks learning from samples, we use ideas from information theory (e.g. information bottleneck), learning theory (e.g. analytical learning theory), adversarial training, complexity theory and functional analysis (e.g. RKHS). We test our algorithms on synthetic data and real data of the patients who had undergone through catheter ablation in clinics and show that our approach yields significant improvement over existing methods. Towards the end of the dissertation, we investigate general questions on generalization and stabilization of adversarial training of deep networks and try to understand the role of smoothness and function space complexity in answering those questions. We conclude by identifying limitations of the proposed methods, areas of further improvement and open questions that are specific to inverse electrophysiological imaging as well as broader, encompassing theory of learning and generalization

Towards enabling cardiac digital twins of myocardial infarction using deep computational models for inverse inference

Cardiac digital twins (CDTs) have the potential to offer individualized evaluation of cardiac function in a non-invasive manner, making them a promising approach for personalized diagnosis and treatment planning of myocardial infarction (MI). The inference of accurate myocardial tissue properties is crucial in creating a reliable CDT of MI. In this work, we investigate the feasibility of inferring myocardial tissue properties from the electrocardiogram (ECG) within a CDT platform. The platform integrates multi-modal data, such as cardiac MRI and ECG, to enhance the accuracy and reliability of the inferred tissue properties. We perform a sensitivity analysis based on computer simulations, systematically exploring the effects of infarct location, size, degree of transmurality, and electrical activity alteration on the simulated QRS complex of ECG, to establish the limits of the approach. We subsequently present a novel deep computational model, comprising a dual-branch variational autoencoder and an inference model, to infer infarct location and distribution from the simulated QRS. The proposed model achieves mean Dice scores of 0.457 ± 0.317 and 0.302 ± 0.273 for the inference of left ventricle scars and border zone, respectively. The sensitivity analysis enhances our understanding of the complex relationship between infarct characteristics and electrophysiological features. The in silico experimental results show that the model can effectively capture the relationship for the inverse inference, with promising potential for clinical application in the future. The code is available at https: //github.com/lileitech/MI_inverse_inference

Personalized noninvasive imaging of volumetric cardiac electrophysiology

Three-dimensionally distributed electrical functioning is the trigger of mechanical contraction of the heart. Disturbance of this electrical flow is known to predispose to mechanical catastrophe but, due to its amenability to certain intervention techniques, a detailed understanding of subject-specific cardiac electrophysiological conditions is of great medical interest. In current clinical practice, body surface potential recording is the standard tool for diagnosing cardiac electrical dysfunctions. However, successful treatments normally require invasive catheter mapping for a more detailed observation of these dysfunctions. In this dissertation, we take a system approach to pursue personalized noninvasive imaging of volumetric cardiac electrophysiology. Under the guidance of existing scientific knowledge of the cardiac electrophysiological system, we extract the subject specific cardiac electrical information from noninvasive body surface potential mapping and tomographic imaging data of individual subjects. In this way, a priori knowledge of system physiology leads the physiologically meaningful interpretation of personal data; at the same time, subject-specific information contained in the data identifies parameters in individual systems that differ from prior knowledge. Based on this perspective, we develop a physiological model-constrained statistical framework for the quantitative reconstruction of the electrical dynamics and inherent electrophysiological property of each individual cardiac system. To accomplish this, we first develop a coupled meshfree-BE (boundary element) modeling approach to represent existing physiological knowledge of the cardiac electrophysiological system on personalized heart-torso structures. Through a state space system approach and sequential data assimilation techniques, we then develop statistical model-data coupling algorithms for quantitative reconstruction of volumetric transmembrane potential dynamics and tissue property of 3D myocardium from body surface potential recoding of individual subjects. We also introduce a data integration component to build personalized cardiac electrophysiology by fusing tomographic image and BSP sequence of the same subject. In addition, we develop a computational reduction strategy that improves the efficiency and stability of the framework. Phantom experiments and real-data human studies are performed for validating each of the framework’s major components. These experiments demonstrate the potential of our framework in providing quantitative understanding of volumetric cardiac electrophysiology for individual subjects and in identifying latent threats in individual’s heart. This may aid in personalized diagnose, treatment planning, and fundamentally, prevention of fatal cardiac arrhythmia

Non-invasive identification of atrial fibrillation drivers

Atrial fibrillation (AF) is one of the most common cardiac arrhythmias. Nowadays the fibrillatory process is known to be provoked by the high-frequency reentrant activity of certain atrial regions that propagates the fibrillatory activity to the rest of the atrial tissue, and the electrical isolation of these key regions has demonstrated its effectiveness in terminating the fibrillatory process. The location of the dominant regions represents a major challenge in the diagnosis and treatment of this arrhythmia. With the aim to detect and locate the fibrillatory sources prior to surgical procedure, non-invasive methods have been developed such as body surface electrical mapping (BSPM) which allows to record with high spatial resolution the electrical activity on the torso surface or the electrocardiographic imaging (ECGI) which allows to non-invasively reconstruct the electrical activity in the atrial surface. Given the novelty of these systems, both technologies suffer from a lack of scientific knowledge about the physical and technical mechanisms that support their operation. Therefore, the aim of this thesis is to increase that knowledge, as well as studying the effectiveness of these technologies for the localization of dominant regions in patients with AF. First, it has been shown that BSPM systems are able to noninvasively identify atrial rotors by recognizing surface rotors after band-pass filtering. Furthermore, the position of such surface rotors is related to the atrial rotor location, allowing the distinction between left or right atrial rotors. Moreover, it has been found that the surface electrical maps in AF suffer a spatial smoothing effect by the torso conductor volume, so the surface electrical activity can be studied with a relatively small number of electrodes. Specifically, it has been seen that 12 uniformly distributed electrodes are sufficient for the correct identification of atrial dominant frequencies, while at least 32 leads are needed for non-invasive identification of atrial rotors. Secondly, the effect of narrowband filtering on the effectiveness of the location of reentrant patterns was studied. It has been found that this procedure allows isolating the reentrant electrical activity caused by the rotor, increasing the detection rate for both invasive and surface maps. However, the spatial smoothing caused by the regularization of the ECGI added to the temporal filtering causes a large increase in the spurious reentrant activity, making it difficult to detect real reentrant patterns. However, it has been found that maps provided by the ECGI without temporal filtering allow the correct detection of reentrant activity, so narrowband filtering should be applied for intracavitary or surface signal only. Finally, we studied the stability of the markers used to detect dominant regions in ECGI, such as frequency maps or the rotor presence. It has been found that in the presence of alterations in the conditions of the inverse problem, such as electrical or geometrical noise, these markers are significantly more stable than the ECGI signal morphology from which they are extracted. In addition, a new methodology for error reduction in the atrial spatial location based on the curvature of the curve L has been proposed. The results presented in this thesis showed that BSPM and ECGI systems allows to non-invasively locate the presence of high-frequency rotors, responsible for the maintenance of AF. This detection has been proven to be unambiguous and robust, and the physical and technical mechanisms that support this behavior have been studied. These results indicate that both non-invasive systems provide information of great clinical value in the treatment of AF, so their use can be helpful for selecting and planning atrial ablation procedures.La fibrilación auricular (FA) es una de las arritmias cardiacas más frecuentes. Hoy en día se sabe que el proceso fibrilatorio está provocado por la actividad reentrante a alta frecuencia de ciertas regiones auriculares que propagan la actividad fibrilatoria en el resto del tejido auricular, y se ha demostrado que el aislamiento eléctrico de estas regiones dominantes permite detener el proceso fibrilatorio. La localización de las regiones dominantes supone un gran reto en el diagnóstico y tratamiento de la FA. Con el objetivo de poder localizar las fuentes fibrilatorias con anterioridad al procedimiento quirúrgico, se han desarrollado métodos no invasivos como la cartografía eléctrica de superficie (CES) que registra con gran resolución espacial la actividad eléctrica en la superficie del torso o la electrocardiografía por imagen (ECGI) que permite reconstruir la actividad eléctrica en la superficie auricular. Dada la novedad de estos sistemas, existe una falta de conocimiento científico sobre los mecanismos físicos y técnicos que sustentan su funcionamiento. Por lo tanto, el objetivo de esta tesis es aumentar dicho conocimiento, así como estudiar la eficacia de ambas tecnologías para la localización de regiones dominantes en pacientes con FA. En primer lugar, ha visto que los sistemas CES permiten identificar rotores auriculares mediante el reconocimiento de rotores superficiales tras el filtrado en banda estrecha. Además, la posición de los rotores superficiales está relacionada con la localización de dichos rotores, permitiendo la distinción entre rotores de aurícula derecha o izquierda. Por otra parte, se ha visto que los mapas eléctricos superficiales durante FA sufren una gran suavizado espacial por el efecto del volumen conductor del torso, lo que permite que la actividad eléctrica superficial pueda ser estudiada con un número relativamente reducido de electrodos. Concretamente, se ha visto que 12 electrodos uniformemente distribuidos son suficientes para una correcta identificación de frecuencias dominantes, mientras que son necesarios al menos 32 para una correcta identificación de rotores auriculares. Por otra parte, también se ha estudiado el efecto del filtrado en banda estrecha sobre la eficacia de la localización de patrones reentrantes. Así, se ha visto que este procedimiento permite aislar la actividad eléctrica reentrante provocada por el rotor, aumentando la tasa de detección tanto para señal obtenida de manera invasiva como para los mapas superficiales. No obstante, este filtrado temporal sobre la señal de ECGI provoca un gran aumento de la actividad reentrante espúrea que dificulta la detección de patrones reentrantes reales. Sin embargo, los mapas ECGI sin filtrado temporal permiten la detección correcta de la actividad reentrante, por lo el filtrado debería ser aplicado únicamente para señal intracavitaria o superficial. Por último, se ha estudiado la estabilidad de los marcadores utilizados en ECGI para detectar regiones dominantes, como son los mapas de frecuencia o la presencia de rotores. Se ha visto que en presencia de alteraciones en las condiciones del problema inverso, como ruido eléctrico o geométrico, estos marcadores son significativamente más estables que la morfología de la propia señal ECGI. Además, se ha propuesto una nueva metodología para la reducción del error en la localización espacial de la aurícula basado en la curvatura de la curva L. Los resultados presentados en esta tesis revelan que los sistemas de CES y ECGI permiten localizar de manera no invasiva la presencia de rotores de alta frecuencia. Esta detección es univoca y robusta, y se han estudiado los mecanismos físicos y técnicos que sustentan dicho comportamiento. Estos resultados indican que ambos sistemas no invasivos proporcionan información de gran valor clínico en el tratamiento de la FA, por lo que su uso puede ser de gran ayuda para la selección y planificaciLa fibril·lació auricular (FA) és una de les arítmies cardíaques més freqüents. Hui en dia es sabut que el procés fibrilatori està provocat per l'activitat reentrant de certes regions auriculars que propaguen l'activitat fibril·latoria a la resta del teixit auricular, i s'ha demostrat que l'aïllament elèctric d'aquestes regions dominants permet aturar el procés fibrilatori. La localització de les regions dominants suposa un gran repte en el diagnòstic i tractament d'aquesta arítmia. Amb l'objectiu de poder localitzar fonts fibril·latories amb anterioritat al procediment quirúrgic s'han desenvolupat mètodes no invasius com la cartografia elèctrica de superfície (CES) que registra amb gran resolució espacial l'activitat elèctrica en la superfície del tors o l'electrocardiografia per imatge (ECGI) que permet obtenir de manera no invasiva l'activitat elèctrica en la superfície auricular. Donada la relativa novetat d'aquests sistemes, existeix una manca de coneixement científic sobre els mecanismes físics i tècnics que sustenten el seu funcionament. Per tant, l'objectiu d'aquesta tesi és augmentar aquest coneixement, així com estudiar l'eficàcia d'aquestes tecnologies per a la localització de regions dominants en pacients amb FA. En primer lloc, s'ha vist que els sistemes CES permeten identificar rotors auriculars mitjançant el reconeixement de rotors superficials després del filtrat en banda estreta. A més, la posició dels rotors superficials està relacionada amb la localització d'aquests rotors, permetent la distinció entre rotors de aurícula dreta o esquerra. També s'ha vist que els mapes elèctrics superficials durant FA pateixen un gran suavitzat espacial per l'efecte del volum conductor del tors, el que permet que l'activitat elèctrica superficial pugui ser estudiada amb un nombre relativament reduït d'elèctrodes. Concretament, s'ha vist que 12 elèctrodes uniformement distribuïts són suficients per a una correcta identificació de freqüències dominants auriculars, mentre que són necessaris almenys 32 per a una correcta identificació de rotors auriculars. D'altra banda, també s'ha estudiat l'efecte del filtrat en banda estreta sobre l'eficàcia de la localització de patrons reentrants. Així, s'ha vist que aquest procediment permet aïllar l'activitat elèctrica reentrant provocada pel rotor, augmentant la taxa de detecció tant pel senyal obtingut de manera invasiva com per als mapes superficials. No obstant això, aquest filtrat temporal sobre el senyal de ECGI provoca un gran augment de l'activitat reentrant espúria que dificulta la detecció de patrons reentrants reals. A més, els mapes proporcionats per la ECGI sense filtrat temporal permeten la detecció correcta de l'activitat reentrant, per la qual cosa el filtrat hauria de ser aplicat únicament per a senyal intracavitària o superficial. Per últim, s'ha estudiat l'estabilitat dels marcadors utilitzats en ECGI per a detectar regions auriculars dominants, com són els mapes de freqüència o la presència de rotors. S'ha vist que en presència d'alteracions en les condicions del problema invers, com soroll elèctric o geomètric, aquests marcadors són significativament més estables que la morfologia del mateix senyal ECGI. A més, s'ha proposat una nova metodologia per a la reducció de l'error en la localització espacial de l'aurícula basat en la curvatura de la corba L. Els resultats presentats en aquesta tesi revelen que els sistemes de CES i ECGI permeten localitzar de manera no invasiva la presència de rotors d'alta freqüència. Aquesta detecció és unívoca i robusta, i s'han estudiat els mecanismes físics i tècnics que sustenten aquest comportament. Aquests resultats indiquen que els dos sistemes no invasius proporcionen informació de gran valor clínic en el tractament de la FA, pel que el seu ús pot ser de gran ajuda per a la selecció i planificació de procediments d'ablació auricular.Rodrigo Bort, M. (2016). Non-invasive identification of atrial fibrillation drivers [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/75346TESISPremios Extraordinarios de tesis doctorale

Transferring Generalized Knowledge from Physics-based Simulation to Clinical Domain

A primary factor for the success of machine learning is the quality of labeled training data. However, in many fields, labeled data can be costly, difficult, or even impossible to acquire. In comparison, computer simulation data can now be generated at a much higher abundance with a much lower cost. These simulation data could potentially solve the problem of data deficiency in many machine learning tasks. Nevertheless, due to model assumptions, simplifications and possible errors, there is always a discrepancy between simulated and real data. This discrepancy needs to be addressed when transferring the knowledge from simulation to real data. Furthermore, simulation data is always tied to specific settings of models parameters, many of which have a considerable range of variations yet not necessarily relevant to the machine learning task of interest. The knowledge extracted from simulation data must thus be generalizable across these parameter variations before being transferred. In this dissertation, we address the two outlined challenges in leveraging simulation data to overcome the shortage of labeled real data, . We do so in a clinical task of localizing the origin of ventricular activation from 12 lead electrocardiograms (ECGs), where the clinical ECG data with labeled sites of origin in the heart can only be invasively available. By adopting the concept of domain adaptation, we address the discrepancy between simulated and clinical ECG data by learning the shift between the two domains using a large amount of simulation data and a small amount of clinical data. By adopting the concept of domain generalization, we then address the reliance of simulated ECG data on patient-specific geometrical models by learning to generalize simulated ECG data across subjects, before transferring them to clinical data. Evaluated on in-vivo premature ventricular contraction (PVC) patients, we demonstrate the feasibility of utilizing a large number of offline simulated ECG datasets to enable the prediction of the origin of arrhythmia with only a small number of clinical ECG data on a new patient

Calibration of ionic and cellular cardiac electrophysiology models

© 2020 The Authors. WIREs Systems Biology and Medicine published by Wiley Periodicals, Inc. Cardiac electrophysiology models are among the most mature and well-studied mathematical models of biological systems. This maturity is bringing new challenges as models are being used increasingly to make quantitative rather than qualitative predictions. As such, calibrating the parameters within ion current and action potential (AP) models to experimental data sets is a crucial step in constructing a predictive model. This review highlights some of the fundamental concepts in cardiac model calibration and is intended to be readily understood by computational and mathematical modelers working in other fields of biology. We discuss the classic and latest approaches to calibration in the electrophysiology field, at both the ion channel and cellular AP scales. We end with a discussion of the many challenges that work to date has raised and the need for reproducible descriptions of the calibration process to enable models to be recalibrated to new data sets and built upon for new studies. This article is categorized under: Analytical and Computational Methods > Computational Methods Physiology > Mammalian Physiology in Health and Disease Models of Systems Properties and Processes > Cellular Models