Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-opera- tive morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon’s navigation capabilites by observ- ing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted in- struments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D opti- cal imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions

Towards automated visual flexible endoscope navigation

Background:\ud The design of flexible endoscopes has not changed significantly in the past 50 years. A trend is observed towards a wider application of flexible endoscopes with an increasing role in complex intraluminal therapeutic procedures. The nonintuitive and nonergonomical steering mechanism now forms a barrier in the extension of flexible endoscope applications. Automating the navigation of endoscopes could be a solution for this problem. This paper summarizes the current state of the art in image-based navigation algorithms. The objectives are to find the most promising navigation system(s) to date and to indicate fields for further research.\ud Methods:\ud A systematic literature search was performed using three general search terms in two medical–technological literature databases. Papers were included according to the inclusion criteria. A total of 135 papers were analyzed. Ultimately, 26 were included.\ud Results:\ud Navigation often is based on visual information, which means steering the endoscope using the images that the endoscope produces. Two main techniques are described: lumen centralization and visual odometry. Although the research results are promising, no successful, commercially available automated flexible endoscopy system exists to date.\ud Conclusions:\ud Automated systems that employ conventional flexible endoscopes show the most promising prospects in terms of cost and applicability. To produce such a system, the research focus should lie on finding low-cost mechatronics and technologically robust steering algorithms. Additional functionality and increased efficiency can be obtained through software development. The first priority is to find real-time, robust steering algorithms. These algorithms need to handle bubbles, motion blur, and other image artifacts without disrupting the steering process

Automated pick-up of suturing needles for robotic surgical assistance

Robot-assisted laparoscopic prostatectomy (RALP) is a treatment for prostate cancer that involves complete or nerve sparing removal prostate tissue that contains cancer. After removal the bladder neck is successively sutured directly with the urethra. The procedure is called urethrovesical anastomosis and is one of the most dexterity demanding tasks during RALP. Two suturing instruments and a pair of needles are used in combination to perform a running stitch during urethrovesical anastomosis. While robotic instruments provide enhanced dexterity to perform the anastomosis, it is still highly challenging and difficult to learn. In this paper, we presents a vision-guided needle grasping method for automatically grasping the needle that has been inserted into the patient prior to anastomosis. We aim to automatically grasp the suturing needle in a position that avoids hand-offs and immediately enables the start of suturing. The full grasping process can be broken down into: a needle detection algorithm; an approach phase where the surgical tool moves closer to the needle based on visual feedback; and a grasping phase through path planning based on observed surgical practice. Our experimental results show examples of successful autonomous grasping that has the potential to simplify and decrease the operational time in RALP by assisting a small component of urethrovesical anastomosis

25th International Congress of the European Association for Endoscopic Surgery (EAES) Frankfurt, Germany, 14-17 June 2017 : Oral Presentations

Introduction: Ouyang has recently proposed hiatal surface area (HSA) calculation by multiplanar multislice computer tomography (MDCT) scan as a useful tool for planning treatment of hiatus defects with hiatal hernia (HH), with or without gastroesophageal reflux (MRGE). Preoperative upper endoscopy or barium swallow cannot predict the HSA and pillars conditions. Aim to asses the efficacy of MDCT’s calculation of HSA for planning the best approach for the hiatal defects treatment. Methods: We retrospectively analyzed 25 patients, candidates to laparoscopic antireflux surgery as primary surgery or hiatus repair concomitant with or after bariatric surgery. Patients were analyzed preoperatively and after one-year follow-up by MDCT scan measurement of esophageal hiatus surface. Five normal patients were enrolled as control group. The HSA’s intraoperative calculation was performed after complete dissection of the area considered a triangle. Postoperative CT-scan was done after 12 months or any time reflux symptoms appeared. Results: (1) Mean HSA in control patients with no HH, no MRGE was cm2 and similar in non-complicated patients with previous LSG and cruroplasty. (2) Mean HSA in patients candidates to cruroplasty was 7.40 cm2. (3) Mean HSA in patients candidates to redo cruroplasty for recurrence was 10.11 cm2. Discussion. MDCT scan offer the possibility to obtain an objective measurement of the HSA and the correlation with endoscopic findings and symptoms. The preoperative information allow to discuss with patients the proper technique when a HSA[5 cm2 is detected. During the follow-up a correlation between symptoms and failure of cruroplasty can be assessed. Conclusions: MDCT scan seems to be an effective non-invasive method to plan hiatal defect treatment and to check during the follow-up the potential recurrence. Future research should correlate in larger series imaging data with intraoperative findings

Laparoscopic Video Analysis for Training and Image Guided Surgery

Automatic analysis of Minimally Invasive Surgical video has the potential to drive new solutions for alleviating needs of safe and reproducible training programs, objective and transparent evaluation systems and navigation tools to assist surgeons and improve patient safety. Surgical video is an always available source of information, which can be used without any additional intrusive hardware in the operating room. This paper is focused on surgical video analysis methods and techniques. It describes authors' contributions in two key aspects, the 3D reconstruction of the surgical field and the segmentation and tracking of tools and organs based on laparoscopic video images. Results are given to illustrate the potential of this field of research, like the calculi of the 3D position and orientation of a tool from its 2D image, or the translation of a preoperative resection plan into a hepatectomy surgical procedure using the shading information of the image. Research efforts are required to further develop these technologies in order to harness all the valuable information available in any video-based surgery

Miniaturized force-indentation depth sensor for tissue abnormality identification during laparoscopic surgery

Proceedings of: 2010 IEEE International Conference on Robotics and Automation (ICRA'10), May 3-8, 2010, Anchorage (Alaska, USA)This paper presents a novel miniaturized force-indentation depth (FID) sensor designed to conduct indentation on soft tissue during minimally invasive surgery. It can intra-operatively aid the surgeon to rapidly identify the tissue abnormalities within the tissue. The FID sensor can measure the indentation depth of a semi-spherical indenter and the tissue reaction force simultaneously. It make use of with fiber optical fiber sensing method measure indentation depth and force and is small enough to fit through a standard trocar port with a diameter of 11 mm. The created FID sensor was calibrated and tested on silicone block simulating soft tissue. The results show that the sensor can measure the indentation depth accurately and also the orientation of the sensor with respect to the tissue surface whilst performing indentation.European Community's Seventh Framework Progra

Spectrally encoded fiber-based structured lighting probe for intraoperative 3D imaging

Three dimensional quantification of organ shape and structure during minimally invasive surgery (MIS) could enhance precision by allowing the registration of multi-modal or pre-operative image data (US/MRI/CT) with the live optical image. Structured illumination is one technique to obtain 3D information through the projection of a known pattern onto the tissue, although currently these systems tend to be used only for macroscopic imaging or open procedures rather than in endoscopy. To account for occlusions, where a projected feature may be hidden from view and/or confused with a neighboring point, a flexible multispectral structured illumination probe has been developed that labels each projected point with a specific wavelength using a supercontinuum laser. When imaged by a standard endoscope camera they can then be segmented using their RGB values, and their 3D coordinates calculated after camera calibration. The probe itself is sufficiently small (1.7 mm diameter) to allow it to be used in the biopsy channel of commonly used medical endoscopes. Surgical robots could therefore also employ this technology to solve navigation and visualization problems in MIS, and help to develop advanced surgical procedures such as natural orifice translumenal endoscopic surgery