A novel real-time computational framework for detecting catheters and rigid guidewires in cardiac catheterization procedures

Purpose: Catheters and guidewires are used extensively in cardiac catheterization procedures such as heart arrhythmia treatment (ablation), angioplasty and congenital heart disease treatment. Detecting their positions in fluoroscopic X-ray images is important for several clinical applications, for example, motion compensation, co-registration between 2D and 3D imaging modalities and 3D object reconstruction. Methods: For the generalized framework, a multiscale vessel enhancement filter is first used to enhance the visibility of wire-like structures in the X-ray images. After applying adaptive binarization method, the centerlines of wire-like objects were extracted. Finally, the catheters and guidewires were detected as a smooth path which is reconstructed from centerlines of target wire-like objects. In order to classify electrode catheters which are mainly used in electrophysiology procedures, additional steps were proposed. First, a blob detection method, which is embedded in vessel enhancement filter with no additional computational cost, localizes electrode positions on catheters. Then the type of electrode catheters can be recognized by detecting the number of electrodes and also the shape created by a series of electrodes. Furthermore, for detecting guiding catheters or guidewires, a localized machine learning algorithm is added into the framework to distinguish between target wire objects and other wire-like artifacts. The proposed framework were tested on total 10,624 images which are from 102 image sequences acquired from 63 clinical cases. Results: Detection errors for the coronary sinus (CS) catheter, lasso catheter ring and lasso catheter body are 0.56 ± 0.28 mm, 0.64 ± 0.36 mm and 0.66 ± 0.32 mm, respectively, as well as success rates of 91.4%, 86.3% and 84.8% were achieved. Detection errors for guidewires and guiding catheters are 0.62 ± 0.48 mm and success rates are 83.5%. Conclusion: The proposed computational framework do not require any user interaction or prior models and it can detect multiple catheters or guidewires simultaneously and in real-time. The accuracy of the proposed framework is sub-mm and the methods are robust toward low-dose X-ray fluoroscopic images, which are mainly used during procedures to maintain low radiation dose

A statistical method for retrospective cardiac and respiratory motion gating of interventional cardiac x-ray images

Purpose: Image-guided cardiac interventions involve the use of fluoroscopic images to guide the insertion and movement of interventional devices. Cardiorespiratory gating can be useful for 3D reconstruction from multiple x-ray views and for reducing misalignments between 3D anatomical models overlaid onto fluoroscopy. Methods: The authors propose a novel and potentially clinically useful retrospective cardiorespiratory gating technique. The principal component analysis (PCA) statistical method is used in combination with other image processing operations to make our proposed masked-PCA technique suitable for cardiorespiratory gating. Unlike many previously proposed techniques, our technique is robust to varying image-content, thus it does not require specific catheters or any other optically opaque structures to be visible. Therefore, it works without any knowledge of catheter geometry. The authors demonstrate the application of our technique for the purposes of retrospective cardiorespiratory gating of normal and very low dose x-ray fluoroscopy images. Results: For normal dose x-ray images, the algorithm was validated using 28 clinical electrophysiology x-ray fluoroscopy sequences (2168 frames), from patients who underwent radiofrequency ablation (RFA) procedures for the treatment of atrial fibrillation and cardiac resynchronization therapy procedures for heart failure. The authors established end-systole, end-expiration, and end-inspiration success rates of 97.0%, 97.9%, and 97.0%, respectively. For very low dose applications, the technique was tested on ten x-ray sequences from the RFA procedures with added noise at signal to noise ratio (SNR) values of √50, √10, √8, √6, √5, √2 and √1 to simulate the image quality of increasingly lower dose x-ray images. Even at the low SNR value of √2, representing a dose reduction of more than 25 times, gating success rates of 89.1%, 88.8%, and 86.8% were established. Conclusions: The proposed technique can therefore extract useful information from interventional x-ray images while minimizing exposure to ionizing radiation. © 2014 American Association of Physicists in Medicine

Characterization of Respiratory and Cardiac Motion from Electro-Anatomical Mapping Data for Improved Fusion of MRI to Left Ventricular Electrograms

Accurate fusion of late gadolinium enhancement magnetic resonance imaging (MRI) and electro-anatomical voltage mapping (EAM) is required to evaluate the potential of MRI to identify the substrate of ventricular tachycardia. However, both datasets are not acquired at the same cardiac phase and EAM data is corrupted with respiratory motion limiting the accuracy of current rigid fusion techniques. Knowledge of cardiac and respiratory motion during EAM is thus required to enhance the fusion process. In this study, we propose a novel approach to characterize both cardiac and respiratory motion from EAM data using the temporal evolution of the 3D catheter location recorded from clinical EAM systems. Cardiac and respiratory motion components are extracted from the recorded catheter location using multi-band filters. Filters are calibrated for each EAM point using estimates of heart rate and respiratory rate. The method was first evaluated in numerical simulations using 3D models of cardiac and respiratory motions of the heart generated from real time MRI data acquired in 5 healthy subjects. An accuracy of 0.6–0.7 mm was found for both cardiac and respiratory motion estimates in numerical simulations. Cardiac and respiratory motions were then characterized in 27 patients who underwent LV mapping for treatment of ventricular tachycardia. Mean maximum amplitude of cardiac and respiratory motion was 10.2±2.7 mm (min = 5.5, max = 16.9) and 8.8±2.3 mm (min = 4.3, max = 14.8), respectively. 3D Cardiac and respiratory motions could be estimated from the recorded catheter location and the method does not rely on additional imaging modality such as X-ray fluoroscopy and can be used in conventional electrophysiology laboratory setting

Dynamic Analysis of X-ray Angiography for Image-Guided Coronary Interventions

Percutaneous coronary intervention (PCI) is a minimally-invasive procedure for treating patients with coronary artery disease. PCI is typically performed with image guidance using X-ray angiograms (XA) in which coronary arter

Development of a Surgical Assistance System for Guiding Transcatheter Aortic Valve Implantation

Development of image-guided interventional systems is growing up rapidly in the recent years. These new systems become an essential part of the modern minimally invasive surgical procedures, especially for the cardiac surgery. Transcatheter aortic valve implantation (TAVI) is a recently developed surgical technique to treat severe aortic valve stenosis in elderly and high-risk patients. The placement of stented aortic valve prosthesis is crucial and typically performed under live 2D fluoroscopy guidance. To assist the placement of the prosthesis during the surgical procedure, a new fluoroscopy-based TAVI assistance system has been developed. The developed assistance system integrates a 3D geometrical aortic mesh model and anatomical valve landmarks with live 2D fluoroscopic images. The 3D aortic mesh model and landmarks are reconstructed from interventional angiographic and fluoroscopic C-arm CT system, and a target area of valve implantation is automatically estimated using these aortic mesh models. Based on template-based tracking approach, the overlay of visualized 3D aortic mesh model, landmarks and target area of implantation onto fluoroscopic images is updated by approximating the aortic root motion from a pigtail catheter motion without contrast agent. A rigid intensity-based registration method is also used to track continuously the aortic root motion in the presence of contrast agent. Moreover, the aortic valve prosthesis is tracked in fluoroscopic images to guide the surgeon to perform the appropriate placement of prosthesis into the estimated target area of implantation. An interactive graphical user interface for the surgeon is developed to initialize the system algorithms, control the visualization view of the guidance results, and correct manually overlay errors if needed. Retrospective experiments were carried out on several patient datasets from the clinical routine of the TAVI in a hybrid operating room. The maximum displacement errors were small for both the dynamic overlay of aortic mesh models and tracking the prosthesis, and within the clinically accepted ranges. High success rates of the developed assistance system were obtained for all tested patient datasets. The results show that the developed surgical assistance system provides a helpful tool for the surgeon by automatically defining the desired placement position of the prosthesis during the surgical procedure of the TAVI.Die Entwicklung bildgeführter interventioneller Systeme wächst rasant in den letzten Jahren. Diese neuen Systeme werden zunehmend ein wesentlicher Bestandteil der technischen Ausstattung bei modernen minimal-invasiven chirurgischen Eingriffen. Diese Entwicklung gilt besonders für die Herzchirurgie. Transkatheter Aortenklappen-Implantation (TAKI) ist eine neue entwickelte Operationstechnik zur Behandlung der schweren Aortenklappen-Stenose bei alten und Hochrisiko-Patienten. Die Platzierung der Aortenklappenprothese ist entscheidend und wird in der Regel unter live-2D-fluoroskopischen Bildgebung durchgeführt. Zur Unterstützung der Platzierung der Prothese während des chirurgischen Eingriffs wurde in dieser Arbeit ein neues Fluoroskopie-basiertes TAKI Assistenzsystem entwickelt. Das entwickelte Assistenzsystem überlagert eine 3D-Geometrie des Aorten-Netzmodells und anatomischen Landmarken auf live-2D-fluoroskopische Bilder. Das 3D-Aorten-Netzmodell und die Landmarken werden auf Basis der interventionellen Angiographie und Fluoroskopie mittels eines C-Arm-CT-Systems rekonstruiert. Unter Verwendung dieser Aorten-Netzmodelle wird das Zielgebiet der Klappen-Implantation automatisch geschätzt. Mit Hilfe eines auf Template Matching basierenden Tracking-Ansatzes wird die Überlagerung des visualisierten 3D-Aorten-Netzmodells, der berechneten Landmarken und der Zielbereich der Implantation auf fluoroskopischen Bildern korrekt überlagert. Eine kompensation der Aortenwurzelbewegung erfolgt durch Bewegungsverfolgung eines Pigtail-Katheters in Bildsequenzen ohne Kontrastmittel. Eine starrere Intensitätsbasierte Registrierungsmethode wurde verwendet, um kontinuierlich die Aortenwurzelbewegung in Bildsequenzen mit Kontrastmittelgabe zu detektieren. Die Aortenklappenprothese wird in die fluoroskopischen Bilder eingeblendet und dient dem Chirurg als Leitfaden für die richtige Platzierung der realen Prothese. Eine interaktive Benutzerschnittstelle für den Chirurg wurde zur Initialisierung der Systemsalgorithmen, zur Steuerung der Visualisierung und für manuelle Korrektur eventueller Überlagerungsfehler entwickelt. Retrospektive Experimente wurden an mehreren Patienten-Datensätze aus der klinischen Routine der TAKI in einem Hybrid-OP durchgeführt. Hohe Erfolgsraten des entwickelten Assistenzsystems wurden für alle getesteten Patienten-Datensätze erzielt. Die Ergebnisse zeigen, dass das entwickelte chirurgische Assistenzsystem ein hilfreiches Werkzeug für den Chirurg bei der Platzierung Position der Prothese während des chirurgischen Eingriffs der TAKI bietet

Intracardiac Ultrasound Guided Systems for Transcatheter Cardiac Interventions

Transcatheter cardiac interventions are characterized by their percutaneous nature, increased patient safety, and low hospitalization times. Transcatheter procedures involve two major stages: navigation towards the target site and the positioning of tools to deliver the therapy, during which the interventionalists face the challenge of visualizing the anatomy and the relative position of the tools such as a guidewire. Fluoroscopic and transesophageal ultrasound (TEE) imaging are the most used techniques in cardiac procedures; however, they possess the disadvantage of radiation exposure and suboptimal imaging. This work explores the potential of intracardiac ultrasound (ICE) within an image guidance system (IGS) to facilitate the two stages of cardiac interventions. First, a novel 2.5D side-firing, conical Foresight ICE probe (Conavi Medical Inc., Toronto) is characterized, calibrated, and tracked using an electromagnetic sensor. The results indicate an acceptable tracking accuracy within some limitations. Next, an IGS is developed for navigating the vessels without fluoroscopy. A forward-looking, tracked ICE probe is used to reconstruct the vessel on a phantom which mimics the ultrasound imaging of an animal vena cava. Deep learning methods are employed to segment the complex vessel geometry from ICE imaging for the first time. The ICE-reconstructed vessel showed a clinically acceptable range of accuracy. Finally, a guidance system was developed to facilitate the positioning of tools during a tricuspid valve repair. The designed system potentially facilitates the positioning of the TriClip at the coaptation gap by pre-mapping the corresponding site of regurgitation in 3D tracking space

Image-Guided Robot-Assisted Techniques with Applications in Minimally Invasive Therapy and Cell Biology

There are several situations where tasks can be performed better robotically rather than manually. Among these are situations (a) where high accuracy and robustness are required, (b) where difficult or hazardous working conditions exist, and (c) where very large or very small motions or forces are involved. Recent advances in technology have resulted in smaller size robots with higher accuracy and reliability. As a result, robotics is fi nding more and more applications in Biomedical Engineering. Medical Robotics and Cell Micro-Manipulation are two of these applications involving interaction with delicate living organs at very di fferent scales.Availability of a wide range of imaging modalities from ultrasound and X-ray fluoroscopy to high magni cation optical microscopes, makes it possible to use imaging as a powerful means to guide and control robot manipulators. This thesis includes three parts focusing on three applications of Image-Guided Robotics in biomedical engineering, including: Vascular Catheterization: a robotic system was developed to insert a catheter through the vasculature and guide it to a desired point via visual servoing. The system provides shared control with the operator to perform a task semi-automatically or through master-slave control. The system provides control of a catheter tip with high accuracy while reducing X-ray exposure to the clinicians and providing a more ergonomic situation for the cardiologists. Cardiac Catheterization: a master-slave robotic system was developed to perform accurate control of a steerable catheter to touch and ablate faulty regions on the inner walls of a beating heart in order to treat arrhythmia. The system facilitates touching and making contact with a target point in a beating heart chamber through master-slave control with coordinated visual feedback. Live Neuron Micro-Manipulation: a microscope image-guided robotic system was developed to provide shared control over multiple micro-manipulators to touch cell membranes in order to perform patch clamp electrophysiology. Image-guided robot-assisted techniques with master-slave control were implemented for each case to provide shared control between a human operator and a robot. The results show increased accuracy and reduced operation time in all three cases

Design and clinical validation of novel imaging strategies for analysis of arrhythmogenic substrate

_CURRENT CHALLENGES IN ELECTROPHYSIOLOGY_ Technical advances in cardiovascular electrophysiology have resulted in an increasing number of catheter ablation procedures reaching 200 000 in Europe for the year 2013. These advanced interventions are often complex and time consuming and may cause significant radiation exposure. Furthermore, a substantial number of ablation procedures remain associated with poor (initial) outcomes and frequently require ≥1 redo procedures. Innovations in modalities for substrate imaging could facilitate our understanding of the arrhythmogenic substrate, improve the design of patient-specific ablation strategies and improve the results of ablation procedures. _NOVEL SUBSTRATE IMAGING MODALITIES_ __Cardiac magnetic resonance__ Cardiac magnetic resonance imaging (CMR) can be considered the most comprehensive and suitable modality for the complete electrophysiology and catheter ablation workup (including patient selection, procedural guidance, and [procedural] follow-up). Utilizing inversion recovery CMR, fibrotic myocardium can be visualized and quantified 10–15 min after intravenous administration of Gadolinium contrast. This imaging technique is known as late Gadolinium enhancement (LGE) imaging. Experimental models have shown excellent agreement between size and shape in LGE CMR and areas of myocardial infarction by histopathology. Recent studies have also demonstrated how scar size, shape and location from pre-procedural LGE can be useful in guiding ventricular tachycardia’s (VT) ablation or atrial fibrillation (AF) ablation. These procedures are often time-consuming due to the preceding electrophysiological mapping study required to identify slow conduction zones involved in re-entry circuits. Post-processed LGE images provide scar maps, which could be integrated with electroanatomic mapping systems to facilitate these procedures. __Inverse potential mapping__ Through the years, various noninvasive electrocardiographic imaging techniques have emerged that estimate epicardial potentials or myocardial activation times from potentials recorded on the thorax. Utilizing an inverse procedure, the potentials on the heart surface or activation times of the myocardium are estimated with the recorded body surface potentials as source data. Although this procedure only estimates the time course of unipolar epicardial electrograms, several studies have demonstrated that the epicardial potentials and electrograms provide substantial information about intramyocardial activity and have great potential to facilitate risk-stratification and generate personalized ablation strategies. __Objectives of this thesis__ 1. To evaluate the utility of cardiac magnetic resonance derived geometrical and tissue characteristic information for patient stratification and guidance of AF ablation. 2. To design and evaluate the performance of a finite element model based inverse potential mapping in predicting the arrhythmogenic focus in idiopathic ventricular tachycardia using invasive electro-anatomical activation mapping as a reference standard