Preparing for the future of cardiothoracic surgery with virtual reality simulation and surgical planning:a narrative review

Background and Objective: Virtual reality (VR) technology in cardiothoracic surgery has been an area of interest for almost three decades, but computational limitations had restricted its implementation. Recent advances in computing power have facilitated the creation of high-fidelity VR simulations and anatomy visualisation tools. We undertook a non-systematic narrative review of literature on VR simulations and preoperative planning tools in cardiothoracic surgery and present the state-of-the-art, and a future outlook. Methods: A comprehensive search through MEDLINE database was performed in November 2022 for all publications that describe the use of VR in cardiothoracic surgery regarding training purposes, education, simulation, and procedural planning. We excluded papers that were not in English or Dutch, and that used two-dimensional (2D) screens, augmented, and simulated reality. Key Content and Findings: Results were categorised as simulators and preoperative planning tools. Current surgical simulators include the lobectomy module in the LapSim for video assisted thorascopic surgery which has been extensively validated, and the more recent robotic assisted lobectomy simulators from Robotix Mentor and Da Vinci SimNow, which are increasingly becoming integrated into the robotic surgery curriculum. Other perioperative simulators include the CardioPulmonary VR Resuscitation simulator for advanced life support after cardiac surgery, and the VR Extracorporeal Circulation (ECC) simulator for perfusionists to simulate the use of a heart-lung machine (HLM). For surgical planning, there are many small-scale tools available, and many case/pilot studies have been published utilising the visualisation possibilities provided by VR, including congenital cardiac, congenital thoracic, adult cardiac, and adult thoracic diseases. Conclusions: There are many promising tools becoming available to leverage the immersive power of VR in cardiothoracic surgery. The path to validate these simulators is well described, but large-scale trials producing high-level evidence for their efficacy are absent as of yet. Our view is that these tools will become increasingly integral parts of daily practice in this field in the coming decade.</p

Use of extended realities in cardiology

Recent miniaturization of electronic components and advances in image processing software have facilitated the entry of extended reality technology into clinical practice. In the last several years, the number of applications in cardiology has multiplied, with many promising to become standard of care. We review many of these applications in the areas of patient and physician education, cardiac rehabilitation, pre-procedural planning and intraprocedural use. The rapid integration of these approaches into the many facets of cardiology suggests that they will one day become an every-day part of physician practice

A Patient-Specific Cardiac Phantom for Training and Pre-Procedure Surgical Planning

Minimally invasive cardiac procedures requiring a transseptal puncture are becoming increasingly common. For cases of complex or diseased anatomy, clinicians may benefit from using a patient-specific cardiac phantom for training, surgical planning, and the validation of devices or techniques. An imaging compatible cardiac phantom was developed to simulate a MitraClip ® procedure. The phantom contained a patient-specific cardiac model manufactured using tissue mimicking materials. To evaluate accuracy, the patient-specific model was imaged using CT, segmented, and the resulting point cloud data set was compared using absolute distance to the original patient data. The phantom was validated using a MitraClip ® device to ensure anatomical features and tools are identifiable under image guidance. Patient-specific cardiac phantoms may allow for surgical complications to be accounted for in pre-operative planning. The information gained by clinicians involved in planning and performing the procedure should lead to shorter procedural times and better outcomes for patients

Imaging-Based, Patient-Specific Three-Dimensional Printing to Plan, Train, and Guide Cardiovascular Interventions: A Systematic Review and Meta-Analysis.

BACKGROUND To tailor cardiovascular interventions, the use of three-dimensional (3D), patient-specific phantoms (3DPSP) encompasses patient education, training, simulation, procedure planning, and outcome-prediction. AIM This systematic review and meta-analysis aims to investigate the current and future perspective of 3D printing for cardiovascular interventions. METHODS We systematically screened articles on Medline and EMBASE reporting the prospective use of 3DPSP in cardiovascular interventions by using combined search terms. Studies that compared intervention time depending on 3DPSP utilisation were included into a meta-analysis. RESULTS We identified 107 studies that prospectively investigated a total of 814 3DPSP in cardiovascular interventions. Most common settings were congenital heart disease (CHD) (38 articles, 6 comparative studies), left atrial appendage (LAA) occlusion (11 articles, 5 comparative, 1 randomised controlled trial [RCT]), and aortic disease (10 articles). All authors described 3DPSP as helpful in assessing complex anatomic conditions, whereas poor tissue mimicry and the non-consideration of physiological properties were cited as limitations. Compared to controls, meta-analysis of six studies showed a significant reduction of intervention time in LAA occlusion (n=3 studies), and surgery due to CHD (n=3) if 3DPSPs were used (Cohen's d=0.54; 95% confidence interval, 0.13 to 0.95; p=0.001), however heterogeneity across studies should be taken into account. CONCLUSIONS 3DPSP are helpful to plan, train, and guide interventions in patients with complex cardiovascular anatomy. Benefits for patients include reduced intervention time with the potential for lower radiation exposure and shorter mechanical ventilation times. More evidence and RCTs including clinical endpoints are needed to warrant adoption of 3DPSP into routine clinical practice

Virtual and Augmented Reality Techniques for Minimally Invasive Cardiac Interventions: Concept, Design, Evaluation and Pre-clinical Implementation

While less invasive techniques have been employed for some procedures, most intracardiac interventions are still performed under cardiopulmonary bypass, on the drained, arrested heart. The progress toward off-pump intracardiac interventions has been hampered by the lack of adequate visualization inside the beating heart. This thesis describes the development, assessment, and pre-clinical implementation of a mixed reality environment that integrates pre-operative imaging and modeling with surgical tracking technologies and real-time ultrasound imaging. The intra-operative echo images are augmented with pre-operative representations of the cardiac anatomy and virtual models of the delivery instruments tracked in real time using magnetic tracking technologies. As a result, the otherwise context-less images can now be interpreted within the anatomical context provided by the anatomical models. The virtual models assist the user with the tool-to-target navigation, while real-time ultrasound ensures accurate positioning of the tool on target, providing the surgeon with sufficient information to ``see\u27\u27 and manipulate instruments in absence of direct vision. Several pre-clinical acute evaluation studies have been conducted in vivo on swine models to assess the feasibility of the proposed environment in a clinical context. Following direct access inside the beating heart using the UCI, the proposed mixed reality environment was used to provide the necessary visualization and navigation to position a prosthetic mitral valve on the the native annulus, or to place a repair patch on a created septal defect in vivo in porcine models. Following further development and seamless integration into the clinical workflow, we hope that the proposed mixed reality guidance environment may become a significant milestone toward enabling minimally invasive therapy on the beating heart

Advances in Minimally Invasive Surgery

The minimally invasive approach in medicine is one of the most common areas of interest in surgery.Advances in Minimally Invasive Surgery describes the latest trends, indications, techniques, and approaches in minimally invasive surgery. It provides step-by-step instructions for both routine and diagnostic procedures via illustrations and video collection

Dynamic Image Processing for Guidance of Off-pump Beating Heart Mitral Valve Repair

Compared to conventional open heart procedures, minimally invasive off-pump beating heart mitral valve repair aims to deliver equivalent treatment for mitral regurgitation with reduced trauma and side effects. However, minimally invasive approaches are often limited by the lack of a direct view to surgical targets and/or tools, a challenge that is compounded by potential movement of the target during the cardiac cycle. For this reason, sophisticated image guidance systems are required in achieving procedural efficiency and therapeutic success. The development of such guidance systems is associated with many challenges. For example, the system should be able to provide high quality visualization of both cardiac anatomy and motion, as well as augmenting it with virtual models of tracked tools and targets. It should have the capability of integrating pre-operative images to the intra-operative scenario through registration techniques. The computation speed must be sufficiently fast to capture the rapid cardiac motion. Meanwhile, the system should be cost effective and easily integrated into standard clinical workflow. This thesis develops image processing techniques to address these challenges, aiming to achieve a safe and efficient guidance system for off-pump beating heart mitral valve repair. These techniques can be divided into two categories, using 3D and 2D image data respectively. When 3D images are accessible, a rapid multi-modal registration approach is proposed to link the pre-operative CT images to the intra-operative ultrasound images. The ultrasound images are used to display the real time cardiac motion, enhanced by CT data serving as high quality 3D context with annotated features. I also developed a method to generate synthetic dynamic CT images, aiming to replace real dynamic CT data in such a guidance system to reduce the radiation dose applied to the patients. When only 2D images are available, an approach is developed to track the feature of interest, i.e. the mitral annulus, based on bi-plane ultrasound images and a magnetic tracking system. The concept of modern GPU-based parallel computing is employed in most of these approaches to accelerate the computation in order to capture the rapid cardiac motion with desired accuracy. Validation experiments were performed on phantom, animal and human data. The overall accuracy of registration and feature tracking with respect to the mitral annulus was about 2-3mm with computation time of 60-400ms per frame, sufficient for one update per cardiac cycle. It was also demonstrated in the results that the synthetic CT images can provide very similar anatomical representations and registration accuracy compared to that of the real dynamic CT images. These results suggest that the approaches developed in the thesis have good potential for a safer and more effective guidance system for off-pump beating heart mitral valve repair