Inferring Geodesic Cerebrovascular Graphs: Image Processing, Topological Alignment and Biomarkers Extraction

A vectorial representation of the vascular network that embodies quantitative features - location, direction, scale, and bifurcations - has many potential neuro-vascular applications. Patient-specific models support computer-assisted surgical procedures in neurovascular interventions, while analyses on multiple subjects are essential for group-level studies on which clinical prediction and therapeutic inference ultimately depend. This first motivated the development of a variety of methods to segment the cerebrovascular system. Nonetheless, a number of limitations, ranging from data-driven inhomogeneities, the anatomical intra- and inter-subject variability, the lack of exhaustive ground-truth, the need for operator-dependent processing pipelines, and the highly non-linear vascular domain, still make the automatic inference of the cerebrovascular topology an open problem. In this thesis, brain vessels’ topology is inferred by focusing on their connectedness. With a novel framework, the brain vasculature is recovered from 3D angiographies by solving a connectivity-optimised anisotropic level-set over a voxel-wise tensor field representing the orientation of the underlying vasculature. Assuming vessels joining by minimal paths, a connectivity paradigm is formulated to automatically determine the vascular topology as an over-connected geodesic graph. Ultimately, deep-brain vascular structures are extracted with geodesic minimum spanning trees. The inferred topologies are then aligned with similar ones for labelling and propagating information over a non-linear vectorial domain, where the branching pattern of a set of vessels transcends a subject-specific quantized grid. Using a multi-source embedding of a vascular graph, the pairwise registration of topologies is performed with the state-of-the-art graph matching techniques employed in computer vision. Functional biomarkers are determined over the neurovascular graphs with two complementary approaches. Efficient approximations of blood flow and pressure drop account for autoregulation and compensation mechanisms in the whole network in presence of perturbations, using lumped-parameters analog-equivalents from clinical angiographies. Also, a localised NURBS-based parametrisation of bifurcations is introduced to model fluid-solid interactions by means of hemodynamic simulations using an isogeometric analysis framework, where both geometry and solution profile at the interface share the same homogeneous domain. Experimental results on synthetic and clinical angiographies validated the proposed formulations. Perspectives and future works are discussed for the group-wise alignment of cerebrovascular topologies over a population, towards defining cerebrovascular atlases, and for further topological optimisation strategies and risk prediction models for therapeutic inference. Most of the algorithms presented in this work are available as part of the open-source package VTrails

Digital Twin of Cardiovascular Systems

Patient specific modelling using numerical methods is widely used in understanding diseases and disorders. It produces medical analysis based on the current state of patient’s health. Concurrently, as a parallel development, emerging data driven Artificial Intelligence (AI) has accelerated patient care. It provides medical analysis using algorithms that rely upon knowledge from larger human population data. AI systems are also known to have the capacity to provide a prognosis with overallaccuracy levels that are better than those provided by trained professionals. When these two independent and robust methods are combined, the concept of human digital twins arise. A Digital Twin is a digital replica of any given system or process. They combine knowledge from general data with subject oriented knowledge for past, current and future analyses and predictions. Assumptions made during numerical modelling are compensated using knowledge from general data. For humans, they can provide an accurate current diagnosis as well as possible future outcomes. This allows forprecautions to be taken so as to avoid further degradation of patient’s health.In this thesis, we explore primary forms of human digital twins for the cardiovascular system, that are capable of replicating various aspects of the cardiovascular system using different types of data. Since different types of medical data are available, such as images, videos and waveforms, and the kinds of analysis required may be offline or online in nature, digital twin systems should be uniquely designed to capture each type of data for different kinds of analysis. Therefore, passive, active and semi-active digital twins, as the three primary forms of digital twins, for different kinds of applications are proposed in this thesis. By the virtue of applications and the kind of data involved ineach of these applications, the performance and importance of human digital twins for the cardiovascular system are demonstrated. The idea behind these twins is to allow for the application of the digital twin concept for online analysis, offline analysis or a combination of the two in healthcare. In active digital twins active data, such as signals, is analysed online in real-time; in semi-active digital twin some of the components being analysed are active but the analysis itself is carried out offline; and finally, passive digital twins perform offline analysis of data that involves no active component.For passive digital twin, an automatic workflow to calculate Fractional Flow Reserve (FFR) is proposed and tested on a cohort of 25 patients with acceptable results. For semi-active digital twin, detection of carotid stenosis and its severity using face videos is proposed and tested with satisfactory results from one carotid stenosis patient and a small cohort of healthy adults. Finally, for the active digital twin, an enabling model is proposed using inverse analysis and its application in the detection of Abdominal Aortic Aneurysm (AAA) and its severity, with the help of a virtual patient database. This enabling model detected artificially generated AAA with an accuracy as high as 99.91% and classified its severity with acceptable accuracy of 97.79%. Further, for active digital twin, a truly active model is proposed for continuous cardiovascular state monitoring. It is tested on a small cohort of five patients from a publicly available database for three 10-minute periods, wherein this model satisfactorily replicated and forecasted patients’ cardiovascular state. In addition to the three forms of human digital twins for the cardiovascular system, an additional work on patient prioritisation in pneumonia patients for ITU care using data-driven digital twin is also proposed. The severity indices calculated by these models are assessed using the standard benchmark of Area Under Receiving Operating Characteristic Curve (AUROC). The results indicate that using these models, the ITU and mechanical ventilation can be prioritised correctly to an AUROC value as high as 0.89

Magnetic resonance imaging in cardiovascular disease

Background Superparamagnetic particles of iron oxide (SPIO) are part of a novel and exciting class of ‘smart’ magnetic resonance imaging (MRI) contrast agents that are taken up by inflammatory cells. Ultrasmall SPIO (USPIO; ~30 nm diameter) can be used to assess cellular tissue inflammation and SPIO (80-150 nm) have the potential to be used to label cells ex vivo for in vivo cell tracking studies. Objectives The aims of the thesis were therefore (i) to develop and validate quantitative MRI methodology for assessing SPIO uptake within tissues, (ii) to demonstrate USPIO accumulation within the aortic wall and its implications in patients with abdominal aortic aneurysms (AAA), and (iii) to develop and apply a Good Manufacturing Practice (GMP) compliant method of SPIO cell labelling in healthy volunteers. Methods Patients with asymptomatic AAA >4.0 cm in diameter were recruited. Imaging sequences were optimised in eight patients using a 3 tesla MRI scanner. Data were analysed using the decay constant for multi echo T2* weighted (T2*W) sequences (T2*) or its inverse (R2*) and the repeatability of these measurements was established. A further twenty-nine patients underwent MRI scanning before and 24- 36 hours after administration of USPIO. T2 and multi echo T2*W sequences were performed and ultrasound-based growth rate data were collected. Operative aortic wall tissue samples were obtained from patients undergoing open surgical aneurysm repair. A GMP compliant protocol was developed for labelling cells with SPIO for clinical cell tracking studies. The effects of SPIO-labelling on cell viability and function were assessed in vitro. A phased-dosing protocol was used to establish the safety of intravenous administration of SPIO-labelled cells in healthy volunteers. The feasibility of imaging cells at a target site in vivo following local or systemic administration was assessed. Tracking of SPIO-labelled cells to a target site was investigated by inducing an iatrogenic inflammatory focus in the skin of the anterior thigh of healthy volunteers, following which autologous SPIO-labelled cells were administered and their accumulation was assessed using MRI scanning and histology of skin biopsies. Results Robust and semi-quantitative data acquisition and image analysis methodology was developed for the assessment of SPIO accumulation in tissues. In patients with AAA, histological analysis of aortic wall tissue samples confirmed USPIO accumulation in areas of cellular inflammation. USPIO-enhanced MRI detected aortic wall inflammation and mural USPIO uptake was associated with a 3-fold higher aneurysm expansion rate. Human mononuclear cells were labelled with SPIO under GMP compliant conditions without affecting cell viability or function. Both local and intravenous administration of SPIO-labelled cells was safe and cells were detectable in vitro and in vivo using a clinical MRI scanner. SPIO-labelled cells tracked to a focal iatrogenic inflammatory focus following intravenous administration in humans and were detectable on MRI scanning and histological examination of skin biopsies. Conclusions SPIO contrast agents have an extensive range of potential clinical applications. USPIO uptake in the wall of AAA appears to identify cellular inflammation and predict accelerated aneurysm expansion. This is therefore a promising investigative tool for stratifying the risk of disease progression in patients with AAA, and may also be considered as a biomarker for response to novel pharmacological agents. The ability to label cells for non-invasive cell tracking studies would facilitate the further development of novel cell-based therapies and would enable assessment of dynamic inflammatory processes through inflammatory cell tracking

Coronary Artery Segmentation and Motion Modelling

Conventional coronary artery bypass surgery requires invasive sternotomy and the use of a cardiopulmonary bypass, which leads to long recovery period and has high infectious potential. Totally endoscopic coronary artery bypass (TECAB) surgery based on image guided robotic surgical approaches have been developed to allow the clinicians to conduct the bypass surgery off-pump with only three pin holes incisions in the chest cavity, through which two robotic arms and one stereo endoscopic camera are inserted. However, the restricted field of view of the stereo endoscopic images leads to possible vessel misidentification and coronary artery mis-localization. This results in 20-30% conversion rates from TECAB surgery to the conventional approach. We have constructed patient-specific 3D + time coronary artery and left ventricle motion models from preoperative 4D Computed Tomography Angiography (CTA) scans. Through temporally and spatially aligning this model with the intraoperative endoscopic views of the patient's beating heart, this work assists the surgeon to identify and locate the correct coronaries during the TECAB precedures. Thus this work has the prospect of reducing the conversion rate from TECAB to conventional coronary bypass procedures. This thesis mainly focus on designing segmentation and motion tracking methods of the coronary arteries in order to build pre-operative patient-specific motion models. Various vessel centreline extraction and lumen segmentation algorithms are presented, including intensity based approaches, geometric model matching method and morphology-based method. A probabilistic atlas of the coronary arteries is formed from a group of subjects to facilitate the vascular segmentation and registration procedures. Non-rigid registration framework based on a free-form deformation model and multi-level multi-channel large deformation diffeomorphic metric mapping are proposed to track the coronary motion. The methods are applied to 4D CTA images acquired from various groups of patients and quantitatively evaluated

Computational fluid dynamics indicators to improve cardiovascular pathologies

In recent years, the study of computational hemodynamics within anatomically complex vascular regions has generated great interest among clinicians. The progress in computational fluid dynamics, image processing and high-performance computing haveallowed us to identify the candidate vascular regions for the appearance of cardiovascular diseases and to predict how this disease may evolve. Medicine currently uses a paradigm called diagnosis. In this thesis we attempt to introduce into medicine the predictive paradigm that has been used in engineering for many years. The objective of this thesis is therefore to develop predictive models based on diagnostic indicators for cardiovascular pathologies. We try to predict the evolution of aortic abdominal aneurysm, aortic coarctation and coronary artery disease in a personalized way for each patient. To understand how the cardiovascular pathology will evolve and when it will become a health risk, it is necessary to develop new technologies by merging medical imaging and computational science. We propose diagnostic indicators that can improve the diagnosis and predict the evolution of the disease more efficiently than the methods used until now. In particular, a new methodology for computing diagnostic indicators based on computational hemodynamics and medical imaging is proposed. We have worked with data of anonymous patients to create real predictive technology that will allow us to continue advancing in personalized medicine and generate more sustainable health systems. However, our final aim is to achieve an impact at a clinical level. Several groups have tried to create predictive models for cardiovascular pathologies, but they have not yet begun to use them in clinical practice. Our objective is to go further and obtain predictive variables to be used practically in the clinical field. It is to be hoped that in the future extremely precise databases of all of our anatomy and physiology will be available to doctors. These data can be used for predictive models to improve diagnosis or to improve therapies or personalized treatments.En els últims anys, l'estudi de l'hemodinàmica computacional en regions vasculars anatòmicament complexes ha generat un gran interès entre els clínics. El progrés obtingut en la dinàmica de fluids computacional, en el processament d'imatges i en la computació d'alt rendiment ha permès identificar regions vasculars on poden aparèixer malalties cardiovasculars, així com predir-ne l'evolució. Actualment, la medicina utilitza un paradigma anomenat diagnòstic. En aquesta tesi s'intenta introduir en la medicina el paradigma predictiu utilitzat des de fa molts anys en l'enginyeria. Per tant, aquesta tesi té com a objectiu desenvolupar models predictius basats en indicadors de diagnòstic de patologies cardiovasculars. Tractem de predir l'evolució de l'aneurisma d'aorta abdominal, la coartació aòrtica i la malaltia coronària de forma personalitzada per a cada pacient. Per entendre com la patologia cardiovascular evolucionarà i quan suposarà un risc per a la salut, cal desenvolupar noves tecnologies mitjançant la combinació de les imatges mèdiques i la ciència computacional. Proposem uns indicadors que poden millorar el diagnòstic i predir l'evolució de la malaltia de manera més eficient que els mètodes utilitzats fins ara. En particular, es proposa una nova metodologia per al càlcul dels indicadors de diagnòstic basada en l'hemodinàmica computacional i les imatges mèdiques. Hem treballat amb dades de pacients anònims per crear una tecnologia predictiva real que ens permetrà seguir avançant en la medicina personalitzada i generar sistemes de salut més sostenibles. Però el nostre objectiu final és aconseguir un impacte en l¿àmbit clínic. Diversos grups han tractat de crear models predictius per a les patologies cardiovasculars, però encara no han començat a utilitzar-les en la pràctica clínica. El nostre objectiu és anar més enllà i obtenir variables predictives que es puguin utilitzar de forma pràctica en el camp clínic. Es pot preveure que en el futur tots els metges disposaran de bases de dades molt precises de tota la nostra anatomia i fisiologia. Aquestes dades es poden utilitzar en els models predictius per millorar el diagnòstic o per millorar teràpies o tractaments personalitzats.Postprint (published version

Human treelike tubular structure segmentation: A comprehensive review and future perspectives

Various structures in human physiology follow a treelike morphology, which often expresses complexity at very fine scales. Examples of such structures are intrathoracic airways, retinal blood vessels, and hepatic blood vessels. Large collections of 2D and 3D images have been made available by medical imaging modalities such as magnetic resonance imaging (MRI), computed tomography (CT), Optical coherence tomography (OCT) and ultrasound in which the spatial arrangement can be observed. Segmentation of these structures in medical imaging is of great importance since the analysis of the structure provides insights into disease diagnosis, treatment planning, and prognosis. Manually labelling extensive data by radiologists is often time-consuming and error-prone. As a result, automated or semi-automated computational models have become a popular research field of medical imaging in the past two decades, and many have been developed to date. In this survey, we aim to provide a comprehensive review of currently publicly available datasets, segmentation algorithms, and evaluation metrics. In addition, current challenges and future research directions are discussed

Development of registration methods for cardiovascular anatomy and function using advanced 3T MRI, 320-slice CT and PET imaging

Different medical imaging modalities provide complementary anatomical and functional information. One increasingly important use of such information is in the clinical management of cardiovascular disease. Multi-modality data is helping improve diagnosis accuracy, and individualize treatment. The Clinical Research Imaging Centre at the University of Edinburgh, has been involved in a number of cardiovascular clinical trials using longitudinal computed tomography (CT) and multi-parametric magnetic resonance (MR) imaging. The critical image processing technique that combines the information from all these different datasets is known as image registration, which is the topic of this thesis. Image registration, especially multi-modality and multi-parametric registration, remains a challenging field in medical image analysis. The new registration methods described in this work were all developed in response to genuine challenges in on-going clinical studies. These methods have been evaluated using data from these studies. In order to gain an insight into the building blocks of image registration methods, the thesis begins with a comprehensive literature review of state-of-the-art algorithms. This is followed by a description of the first registration method I developed to help track inflammation in aortic abdominal aneurysms. It registers multi-modality and multi-parametric images, with new contrast agents. The registration framework uses a semi-automatically generated region of interest around the aorta. The aorta is aligned based on a combination of the centres of the regions of interest and intensity matching. The method achieved sub-voxel accuracy. The second clinical study involved cardiac data. The first framework failed to register many of these datasets, because the cardiac data suffers from a common artefact of magnetic resonance images, namely intensity inhomogeneity. Thus I developed a new preprocessing technique that is able to correct the artefacts in the functional data using data from the anatomical scans. The registration framework, with this preprocessing step and new particle swarm optimizer, achieved significantly improved registration results on the cardiac data, and was validated quantitatively using neuro images from a clinical study of neonates. Although on average the new framework achieved accurate results, when processing data corrupted by severe artefacts and noise, premature convergence of the optimizer is still a common problem. To overcome this, I invented a new optimization method, that achieves more robust convergence by encoding prior knowledge of registration. The registration results from this new registration-oriented optimizer are more accurate than other general-purpose particle swarm optimization methods commonly applied to registration problems. In summary, this thesis describes a series of novel developments to an image registration framework, aimed to improve accuracy, robustness and speed. The resulting registration framework was applied to, and validated by, different types of images taken from several ongoing clinical trials. In the future, this framework could be extended to include more diverse transformation models, aided by new machine learning techniques. It may also be applied to the registration of other types and modalities of imaging data

Machine learning approaches for early prediction of hypertension.

Hypertension afflicts one in every three adults and is a leading cause of mortality in 516, 955 patients in USA. The chronic elevation of cerebral perfusion pressure (CPP) changes the cerebrovasculature of the brain and disrupts its vasoregulation mechanisms. Reported correlations between changes in smaller cerebrovascular vessels and hypertension may be used to diagnose hypertension in its early stages, 10-15 years before the appearance of symptoms such as cognitive impairment and memory loss. Specifically, recent studies hypothesized that changes in the cerebrovasculature and CPP precede the systemic elevation of blood pressure. Currently, sphygmomanometers are used to measure repeated brachial artery pressure to diagnose hypertension after its onset. However, this method cannot detect cerebrovascular alterations that lead to adverse events which may occur prior to the onset of hypertension. The early detection and quantification of these cerebral vascular structural changes could help in predicting patients who are at a high risk of developing hypertension as well as other cerebral adverse events. This may enable early medical intervention prior to the onset of hypertension, potentially mitigating vascular-initiated end-organ damage. The goal of this dissertation is to develop a novel efficient noninvasive computer-aided diagnosis (CAD) system for the early prediction of hypertension. The developed CAD system analyzes magnetic resonance angiography (MRA) data of human brains gathered over years to detect and track cerebral vascular alterations correlated with hypertension development. This CAD system can make decisions based on available data to help physicians on predicting potential hypertensive patients before the onset of the disease

Augmented Image-Guidance for Transcatheter Aortic Valve Implantation

The introduction of transcatheter aortic valve implantation (TAVI), an innovative stent-based technique for delivery of a bioprosthetic valve, has resulted in a paradigm shift in treatment options for elderly patients with aortic stenosis. While there have been major advancements in valve design and access routes, TAVI still relies largely on single-plane fluoroscopy for intraoperative navigation and guidance, which provides only gross imaging of anatomical structures. Inadequate imaging leading to suboptimal valve positioning contributes to many of the early complications experienced by TAVI patients, including valve embolism, coronary ostia obstruction, paravalvular leak, heart block, and secondary nephrotoxicity from contrast use. A potential method of providing improved image-guidance for TAVI is to combine the information derived from intra-operative fluoroscopy and TEE with pre-operative CT data. This would allow the 3D anatomy of the aortic root to be visualized along with real-time information about valve and prosthesis motion. The combined information can be visualized as a `merged\u27 image where the different imaging modalities are overlaid upon each other, or as an `augmented\u27 image, where the location of key target features identified on one image are displayed on a different imaging modality. This research develops image registration techniques to bring fluoroscopy, TEE, and CT models into a common coordinate frame with an image processing workflow that is compatible with the TAVI procedure. The techniques are designed to be fast enough to allow for real-time image fusion and visualization during the procedure, with an intra-procedural set-up requiring only a few minutes. TEE to fluoroscopy registration was achieved using a single-perspective TEE probe pose estimation technique. The alignment of CT and TEE images was achieved using custom-designed algorithms to extract aortic root contours from XPlane TEE images, and matching the shape of these contours to a CT-derived surface model. Registration accuracy was assessed on porcine and human images by identifying targets (such as guidewires or coronary ostia) on the different imaging modalities and measuring the correspondence of these targets after registration. The merged images demonstrated good visual alignment of aortic root structures, and quantitative assessment measured an accuracy of less than 1.5mm error for TEE-fluoroscopy registration and less than 6mm error for CT-TEE registration. These results suggest that the image processing techniques presented have potential for development into a clinical tool to guide TAVI. Such a tool could potentially reduce TAVI complications, reducing morbidity and mortality and allowing for a safer procedure