Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-opera- tive morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon’s navigation capabilites by observ- ing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted in- struments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D opti- cal imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions

Performance of image guided navigation in laparoscopic liver surgery – A systematic review

Background: Compared to open surgery, minimally invasive liver resection has improved short term outcomes. It is however technically more challenging. Navigated image guidance systems (IGS) are being developed to overcome these challenges. The aim of this systematic review is to provide an overview of their current capabilities and limitations. Methods: Medline, Embase and Cochrane databases were searched using free text terms and corresponding controlled vocabulary. Titles and abstracts of retrieved articles were screened for inclusion criteria. Due to the heterogeneity of the retrieved data it was not possible to conduct a meta-analysis. Therefore results are presented in tabulated and narrative format. Results: Out of 2015 articles, 17 pre-clinical and 33 clinical papers met inclusion criteria. Data from 24 articles that reported on accuracy indicates that in recent years navigation accuracy has been in the range of 8–15 mm. Due to discrepancies in evaluation methods it is difficult to compare accuracy metrics between different systems. Surgeon feedback suggests that current state of the art IGS may be useful as a supplementary navigation tool, especially in small liver lesions that are difficult to locate. They are however not able to reliably localise all relevant anatomical structures. Only one article investigated IGS impact on clinical outcomes. Conclusions: Further improvements in navigation accuracy are needed to enable reliable visualisation of tumour margins with the precision required for oncological resections. To enhance comparability between different IGS it is crucial to find a consensus on the assessment of navigation accuracy as a minimum reporting standard

The value of Augmented Reality in surgery — A usability study on laparoscopic liver surgery

Augmented Reality (AR) is considered to be a promising technology for the guidance of laparoscopic liver surgery. By overlaying pre-operative 3D information of the liver and internal blood vessels on the laparoscopic view, surgeons can better understand the location of critical structures. In an effort to enable AR, several authors have focused on the development of methods to obtain an accurate alignment between the laparoscopic video image and the pre-operative 3D data of the liver, without assessing the benefit that the resulting overlay can provide during surgery. In this paper, we present a study that aims to assess quantitatively and qualitatively the value of an AR overlay in laparoscopic surgery during a simulated surgical task on a phantom setup. We design a study where participants are asked to physically localise pre-operative tumours in a liver phantom using three image guidance conditions — a baseline condition without any image guidance, a condition where the 3D surfaces of the liver are aligned to the video and displayed on a black background, and a condition where video see-through AR is displayed on the laparoscopic video. Using data collected from a cohort of 24 participants which include 12 surgeons, we observe that compared to the baseline, AR decreases the median localisation error of surgeons on non-peripheral targets from 25.8 mm to 9.2 mm. Using subjective feedback, we also identify that AR introduces usability improvements in the surgical task and increases the perceived confidence of the users. Between the two tested displays, the majority of participants preferred to use the AR overlay instead of navigated view of the 3D surfaces on a separate screen. We conclude that AR has the potential to improve performance and decision making in laparoscopic surgery, and that improvements in overlay alignment accuracy and depth perception should be pursued in the future

Precise navigation surgery of tumours in the lung in mouse models enabled by in situ fluorescence labelling with a killer-reporter adenovirus.

BackgroundCurrent methods of image-guided surgery of tumours of the lung mostly rely on CT. A sensitive procedure of selective tumour fluorescence labelling would allow simple and high-resolution visualisation of the tumour for precise surgical navigation.MethodsHuman lung cancer cell lines H460 and A549 were genetically transformed to express red fluorescent protein (RFP). Tumours were grown subcutaneously for each cell line and harvested and minced for surgical orthotopic implantation on the left lung of nude mice. Tumour growth was measured by fluorescence imaging. After the tumours reached 5 mm in diameter, they were injected under fluorescence guidance with the telomerase-dependent green fluorescent protein (GFP)-containing adenovirus, OBP-401. Viral labelling of the lung tumours with GFP precisely colocalised with tumour RFP expression. Three days after administration of OBP-401, fluorescence-guided surgery (FGS) was performed.ResultsFGS of tumours in the lung was enabled by labelling with a telomerase-dependent adenovirus containing the GFP gene. Tumours in the lung were selectively and brightly labelled. FGS enabled complete lung tumour resection with no residual fluorescent tumour.ConclusionsFGS of tumours in the lung is feasible and more effective than bright-light surgery

Assistance strategies for robotized laparoscopy

Robotizing laparoscopic surgery not only allows achieving better accuracy to operate when a scale factor is applied between master and slave or thanks to the use of tools with 3 DoF, which cannot be used in conventional manual surgery, but also due to additional informatic support. Relying on computer assistance different strategies that facilitate the task of the surgeon can be incorporated, either in the form of autonomous navigation or cooperative guidance, providing sensory or visual feedback, or introducing certain limitations of movements. This paper describes different ways of assistance aimed at improving the work capacity of the surgeon and achieving more safety for the patient, and the results obtained with the prototype developed at UPC.Peer ReviewedPostprint (author's final draft

Laparoscopic Pancreas Surgery: Image Guidance Solutions

Pancreatic ductal adenocarcinoma (PDA) is the fourth leading cause of cancer-related deaths. Surgery is the only viable treatment, but irradical resection rates are still high. Laparoscopic pancreatic surgery has some technical limitations for surgeons and tumor identification may be challenging. Image-guided techniques provide intraoperative margin assessment and visualization methods, which may be advantageous in guiding the surgeon to achieve curative resections and therefore improve the surgical outcomes. In this chapter, current available laparoscopic surgical approaches and image-guided techniques for pancreatic surgery are reviewed. Surgical outcomes of pancreaticoduodenectomy and distal pancreatectomy performed by laparoscopy, laparoendoscopic single-site surgery (LESS), and robotic surgery are included and analyzed. Besides, image-guided techniques such as intraoperative near-infrared fluorescence imaging and surgical navigation are presented as emerging techniques. Results show that minimally invasive procedures reported a reduction of blood loss, reduced length of hospital stay, and positive resection margins, as well as an improvement in spleen-preserving rates, when compared to open surgery. Studies reported that fluorescence-guided pancreatic surgery might be beneficial in cases where the pancreatic anatomy is difficult to identify. The first approach of a surgical navigation system for guidance during pancreatic resection procedures is presented, combining preoperative images (CT and MRI) with intraoperative laparoscopic ultrasound imaging

Recent Developments and Future Challenges in Medical Mixed Reality

As AR technology matures, we have seen many applicationsemerge in entertainment, education and training. However, the useof AR is not yet common in medical practice, despite the great po-tential of this technology to help not only learning and training inmedicine, but also in assisting diagnosis and surgical guidance. Inthis paper, we present recent trends in the use of AR across all med-ical specialties and identify challenges that must be overcome tonarrow the gap between academic research and practical use of ARin medicine. A database of 1403 relevant research papers publishedover the last two decades has been reviewed by using a novel re-search trend analysis method based on text mining algorithm. Wesemantically identified 10 topics including varies of technologiesand applications based on the non-biased and in-personal cluster-ing results from the Latent Dirichlet Allocatio (LDA) model andanalysed the trend of each topic from 1995 to 2015. The statisticresults reveal a taxonomy that can best describes the developmentof the medical AR research during the two decades. And the trendanalysis provide a higher level of view of how the taxonomy haschanged and where the focus will goes. Finally, based on the valu-able results, we provide a insightful discussion to the current limi-tations, challenges and future directions in the field. Our objectiveis to aid researchers to focus on the application areas in medicalAR that are most needed, as well as providing medical practitioners with latest technology advancements