Virtual and Augmented Reality Techniques for Minimally Invasive Cardiac Interventions: Concept, Design, Evaluation and Pre-clinical Implementation

While less invasive techniques have been employed for some procedures, most intracardiac interventions are still performed under cardiopulmonary bypass, on the drained, arrested heart. The progress toward off-pump intracardiac interventions has been hampered by the lack of adequate visualization inside the beating heart. This thesis describes the development, assessment, and pre-clinical implementation of a mixed reality environment that integrates pre-operative imaging and modeling with surgical tracking technologies and real-time ultrasound imaging. The intra-operative echo images are augmented with pre-operative representations of the cardiac anatomy and virtual models of the delivery instruments tracked in real time using magnetic tracking technologies. As a result, the otherwise context-less images can now be interpreted within the anatomical context provided by the anatomical models. The virtual models assist the user with the tool-to-target navigation, while real-time ultrasound ensures accurate positioning of the tool on target, providing the surgeon with sufficient information to ``see\u27\u27 and manipulate instruments in absence of direct vision. Several pre-clinical acute evaluation studies have been conducted in vivo on swine models to assess the feasibility of the proposed environment in a clinical context. Following direct access inside the beating heart using the UCI, the proposed mixed reality environment was used to provide the necessary visualization and navigation to position a prosthetic mitral valve on the the native annulus, or to place a repair patch on a created septal defect in vivo in porcine models. Following further development and seamless integration into the clinical workflow, we hope that the proposed mixed reality guidance environment may become a significant milestone toward enabling minimally invasive therapy on the beating heart

Ultrasound-Guided Mechatronic System for Targeted Delivery of Cell-Based Cancer Vaccine Immunotherapy in Preclinical Models

Injection of dendritic cell (DC) vaccines into lymph nodes (LN) is a promising strategy for eliciting immune responses against cancer, but these injections in mouse cancer models are challenging due to the small target scale (~ 1 mm × 2 mm). Direct manual intranodal injection is difficult and can cause architectural damage to the LN, potentially disrupting crucial interactions between DC and T cells. Therefore, a second-generation ultrasound-guided mechatronic device has been developed to perform this intervention. A targeting accuracy of \u3c 500 μm will enable targeted delivery of the DCs specifically to a LN subcapsular space. The device was redesigned from its original CT-guided edition, which used a remote centre of motion architecture, to be easily integrated onto a commercially available VisualSonics imaging rail system. Subtle modifications were made to ensure simple workflow that allows for live-animal interventions that fall within the knockout periods stated in study protocols. Several calibration and registration techniques were developed in order to achieve an overall targeting accuracy appropriate for the intended application. A variety of methods to quantify the positioning accuracy of the device were investigated. The method chosen involved validating a guided injection into a tissue-mimicking phantom using ultrasound imaging post-operatively to localize the end-point position of the needle tip in the track left behind by the needle. Ultrasound-guided injections into a tissue-mimicking phantom revealed a targeting accuracy of 285 ± 94 μm for the developed robot compared to 508 ± 166 μm for a commercial-available manually-actuated injection device from VisuailSonics. The utility of the robot was also demonstrated by performing in vivo injections into the lymph nodes of mice

Advancements and Breakthroughs in Ultrasound Imaging

Ultrasonic imaging is a powerful diagnostic tool available to medical practitioners, engineers and researchers today. Due to the relative safety, and the non-invasive nature, ultrasonic imaging has become one of the most rapidly advancing technologies. These rapid advances are directly related to the parallel advancements in electronics, computing, and transducer technology together with sophisticated signal processing techniques. This book focuses on state of the art developments in ultrasonic imaging applications and underlying technologies presented by leading practitioners and researchers from many parts of the world

Intravascular Ultrasound

Intravascular ultrasound (IVUS) is a cardiovascular imaging technology using a specially designed catheter with a miniaturized ultrasound probe for the assessment of vascular anatomy with detailed visualization of arterial layers. Over the past two decades, this technology has developed into an indispensable tool for research and clinical practice in cardiovascular medicine, offering the opportunity to gather diagnostic information about the process of atherosclerosis in vivo, and to directly observe the effects of various interventions on the plaque and arterial wall. This book aims to give a comprehensive overview of this rapidly evolving technique from basic principles and instrumentation to research and clinical applications with future perspectives

Image guided robotic assistance for the diagnosis and treatment of tumor

The aim of this thesis is to demonstrate the feasibility and the potentiality of introduction of robotics and image guidance in the overall oncologic workflow, from the diagnosis to the treatment phase. The popularity of robotics in the operating room has grown in recent years. Currently the most popular systems is the da Vinci telemanipulator (Intuitive Surgical), it is based on a master-slave control, for minimally invasive surgery and it is used in several surgical fields such us urology, general, gynecology, cardiothoracic. An accurate study of this system, from a technological field of view, has been conducted addressing all drawbacks and advantages of this system. The da Vinci System creates an immersive operating environment for the surgeon by providing both high quality stereo visualization and a human-machine interface that directly connects the surgeon’s hands to the motion of the surgical tool tips inside the patient’s body. It has undoubted advantages for the surgeon work and for the patient health, at least for some interventions, while its very high costs leaves many doubts on its price benefit ratio. In the robotic surgery field many researchers are working on the optimization and miniaturization robots mechanic, while others are trying to obtain smart functionalities to realize robotic systems, that, “knowing” the patient anatomy from radiological images, can assists the surgeon in an active way. Regarding the second point, image guided systems can be useful to plan and to control medical robots motion and to provide the surgeon pre-operative and intra-operative images with augmented reality visualization to enhance his/her perceptual capacities and, as a consequence, to improve the quality of treatments. To demonstrate this thesis some prototypes has been designed, implemented and tested. The development of image guided medical devices, comprehensive of augmented reality, virtual navigation and robotic surgical features, requires to address several problems. The first ones are the choosing of the robotic platform and of the image source to employ. An industrial anthropomorphic arm has been used as testing platform. The idea of integrating industrial robot components in the clinical workflow has been supported by the da Vinci technical analysis. The algorithms and methods developed, regarding in particular robot calibration, based on literature theories and on an easily integration in the clinical scenario, can be adapted to each anthropomorphic arm. In this way this work can be integrated with light-weight robots, for industrial or clinical use, able to work in close contact to humans, which will become numerous in the early future. Regarding the medical image source, it has been decided to work with ultrasound imaging. Two-dimensional ultrasound imaging is widely used in clinical practice because is not dangerous for the patient, inexpensive, compact and it is a highly flexible imaging that allows users to study many anatomic structures. It is routinely used for diagnosis and as guidance in percutaneous treatments. However the use of 2D ultrasound imaging presents some disadvantages that require great ability of the user: it requires that the clinician mentally integrates many images to reconstruct a complete idea of the anatomy in 3D. Furthermore the freehand control of the probe make it difficult to individuate anatomic positions and orientations and probe repositioning to reach a particular location. To overcome these problems it has been developed an image guided system that fuse 2D US real time images with routinely CT or MRI 3D images, previously acquired from the patient, to enhance clinician orientation and probe guidance. The implemented algorithms for robot calibration and US image guidance has been used to realize two applications responding to specific clinical needs. The first one to speed up the execution of routinely and very recurrently procedures like percutaneous biopsy or ablation. The second one to improve a new completely non invasive type of treatment for solid tumors, the HIFU (High Intensity Focused Ultrasound). An ultrasound guided robotic system has been developed to assist the clinician to execute complicated biopsies, or percutaneous ablations, in particular for deep abdominal organs. It was developed an integrated system that provides the clinician two types of assistance: a mixed reality visualization allows accurate and easy planning of needle trajectory and target reaching verification; the robot arm equipped with a six-degree-of-freedom force sensor allows the precise positioning of the needle holder and allows the clinician to adjust, by means of a cooperative control, the planned trajectory to overcome needle deflection and target motion. The second application consists in an augmented reality navigation system for HIFU treatment. HIFU represents a completely non invasive method for treatment of solid tumors, hemostasis and other vascular features in human tissues. The technology for HIFU treatments is still evolving and the systems available on the market have some limitations and drawbacks. A disadvantage resulting from our experience with the machinery available in our hospital (JC200 therapeutic system Haifu (HIFU) by Tech Co., Ltd, Chongqing), which is similar to other analogous machines, is the long time required to perform the procedure due to the difficulty to find the target, using the remote motion of an ultrasound probe under the patient. This problem has been addressed developing an augmented reality navigation system to enhance US guidance during HIFU treatments allowing an easy target localization. The system was implemented using an additional free hand ultrasound probe coupled with a localizer and CT fused imaging. It offers a simple and an economic solution to an easy HIFU target localization. This thesis demonstrates the utility and usability of robots for diagnosis and treatment of the tumor, in particular the combination of automatic positioning and cooperative control allows the surgeon and the robot to work in synergy. Further the work demonstrates the feasibility and the potentiality of the use of a mixed reality navigation system to facilitate the target localization and consequently to reduce the times of sittings, to increase the number of possible diagnosis/treatments and to decrease the risk of potential errors. The proposed solutions for the integration of robotics and image guidance in the overall oncologic workflow, take into account current available technologies, traditional clinical procedures and cost minimization

From Concept to Market: Surgical Robot Development

Surgical robotics and supporting technologies have really become a prime example of modern applied information technology infiltrating our everyday lives. The development of these systems spans across four decades, and only the last few years brought the market value and saw the rising customer base imagined already by the early developers. This chapter guides through the historical development of the most important systems, and provide references and lessons learnt for current engineers facing similar challenges. A special emphasis is put on system validation, assessment and clearance, as the most commonly cited barrier hindering the wider deployment of a system

A Clinician's Contribution to Biomedical Engineering in Experimental Echocardiography

The research of this thesis has been focused on the biomedical engineering aspects of new techniques of echocardiography. In close collaboration with the engineers of the Experimental Echocardiography Department of the Thoraxcentre, Erasmus University, Rotterdam, new methods to measure coronary blood flow and arterial wall elasticity with intravascular ultrasound (IVUS) have been developed. We have also investigated the clinical application of these measurements and have tried to improve traditional techniques based on intracoronary Doppler wires. In another field, we have developed a method to determine the radiation dose delivered in the wall of coronary arteries treated with brachytherapy. in collaboration with the Emory University, Atlanta, GA. This method utilizes 3-dimensional IVUS reconstruction combined with radiotherapy treatment planning. Finally, the tools developed for the recording of the signals of intracoronary Doppler wires have been adapted, during a stay at the Cleveland Clinic Foundation, OK for the study of left ventricular mechanics and the compliance of the large arteries. This has been achieved by simultaneous acquisition of non-invasive pressure (with tonometry) and flow (with transthoracic Doppler echocardiography) signals. The fruits of an old and close collaboration with the Institute Biomedical Technology of the Ghent University can also be found in different chapters. This work is subdivided in five major parts, and a detailed introductory chapter precedes each one

Magnetic navigation in percutaneous coronary and non-coronary interventions

There is no question that Percutaneous Coronary Intervention has revolutionized the way we manage coronary artery disease. Over the past two decades we have witnessed maturity in several techniques and equipment enabling the interventional cardiologist to manage lesions that have previously been entirely in the domain of the cardiac surgeon. Despite these remarkable achievements there still remain lesions that are complex enough to create a challenge in the most experienced hands.The inherent tortuosity in complex vascular anatomies, branching segments and chronically occluded vessel have been all associated with lower procedural success and higher complication rates when compared to the “straight forward vessels”. The Magnetic Navigation System (MNS) is a novel and versatile technology that allows the re-orientation of a wire within the patient’s body. This unique ability means that the “trial and error” method of externally re-shaping the tip of the wire and re-engaging the vessel can be effectively eliminated. As such previously “unreachable areas” in the heart or within the vascul