Medical image computing and computer-aided medical interventions applied to soft tissues. Work in progress in urology

Until recently, Computer-Aided Medical Interventions (CAMI) and Medical Robotics have focused on rigid and non deformable anatomical structures. Nowadays, special attention is paid to soft tissues, raising complex issues due to their mobility and deformation. Mini-invasive digestive surgery was probably one of the first fields where soft tissues were handled through the development of simulators, tracking of anatomical structures and specific assistance robots. However, other clinical domains, for instance urology, are concerned. Indeed, laparoscopic surgery, new tumour destruction techniques (e.g. HIFU, radiofrequency, or cryoablation), increasingly early detection of cancer, and use of interventional and diagnostic imaging modalities, recently opened new challenges to the urologist and scientists involved in CAMI. This resulted in the last five years in a very significant increase of research and developments of computer-aided urology systems. In this paper, we propose a description of the main problems related to computer-aided diagnostic and therapy of soft tissues and give a survey of the different types of assistance offered to the urologist: robotization, image fusion, surgical navigation. Both research projects and operational industrial systems are discussed

Biomechanical Modeling and Inverse Problem Based Elasticity Imaging for Prostate Cancer Diagnosis

Early detection of prostate cancer plays an important role in successful prostate cancer treatment. This requires screening the prostate periodically after the age of 50. If screening tests lead to prostate cancer suspicion, prostate needle biopsy is administered which is still considered as the clinical gold standard for prostate cancer diagnosis. Given that needle biopsy is invasive and is associated with issues including discomfort and infection, it is desirable to develop a prostate cancer diagnosis system that has high sensitivity and specificity for early detection with a potential to improve needle biopsy outcome. Given the complexity and variability of prostate cancer pathologies, many research groups have been pursuing multi-parametric imaging approach as no single modality imaging technique has proven to be adequate. While imaging additional tissue properties increases the chance of reliable prostate cancer detection and diagnosis, selecting an additional property needs to be done carefully by considering clinical acceptability and cost. Clinical acceptability entails ease with respect to both operating by the radiologist and patient comfort. In this work, effective tissue biomechanics based diagnostic techniques are proposed for prostate cancer assessment with the aim of early detection and minimizing the numbers of prostate biopsies. The techniques take advantage of the low cost, widely available and well established TRUS imaging method. The proposed techniques include novel elastography methods which were formulated based on an inverse finite element frame work. Conventional finite element analysis is known to have high computational complexity, hence computation time demanding. This renders the proposed elastography methods not suitable for real-time applications. To address this issue, an accelerated finite element method was proposed which proved to be suitable for prostate elasticity reconstruction. In this method, accurate finite element analysis of a large number of prostates undergoing TRUS probe loadings was performed. Geometry input and displacement and stress fields output obtained from the analysis were used to train a neural network mapping function to be used for elastopgraphy imaging of prostate cancer patients. The last part of the research presented in this thesis tackles an issue with the current 3D TRUS prostate needle biopsy. Current 3D TRUS prostate needle biopsy systems require registering preoperative 3D TRUS to intra-operative 2D TRUS images. Such image registration is time-consuming while its real-time implementation is yet to be developed. To bypass this registration step, concept of a robotic system was proposed which can reliably determine the preoperative TRUS probe position relative to the prostate to place at the same position relative to the prostate intra-operatively. For this purpose, a contact pressure feedback system is proposed to ensure similar prostate deformation during 3D and 2D image acquisition in order to bypass the registration step

Biomechanical modelling of the pelvic system: improving the accuracy of the location of neoplasms in MRI-TRUS fusion prostate biopsy

Background An accurate knowledge of the relocation of prostate neoplasms during biopsy is of great importance to reduce the number of false negative results. Prostate neoplasms are visible in magnetic resonance images (MRI) but it is difficult for the practitioner to locate them at the time of performing a transrectal ultrasound (TRUS) guided biopsy. In this study, we present a new methodology, based on simulation, that predicts both prostate deformation and lesion migration during the biopsy. Methods A three-dimensional (3-D) anatomy model of the pelvic region, based on medical images, is constructed. A finite element (FE) numerical simulation of the organs motion and deformation as a result of the pressure exerted by the TRUS probe is carried out using the Code-Aster open-source computer software. Initial positions of potential prostate lesions prior to biopsy are taken into consideration and the final location of each lesion is targeted in the FE simulation output. Results Our 3-D FE simulations show that the effect of the pressure exerted by the TRUS probe is twofold as the prostate experiences both a motion and a deformation of its original shape. We targeted the relocation of five small prostate lesions when the TRUS probe exerts a force of 30 N on the rectum inner wall. The distance travelled by these lesions ranged between 5.6 and 13.9 mm. Conclusions Our new methodology can help to predict the location of neoplasms during a prostate biopsy but further studies are needed to validate our results. Moreover, the new methodology is completely developed on open-source software, which means that its implementation would be affordable to all healthcare providers

Analysis of uncertainty and variability in finite element computational models for biomedical engineering: characterization and propagation

Computational modeling has become a powerful tool in biomedical engineering thanks to its potential to simulate coupled systems. However, real parameters are usually not accurately known, and variability is inherent in living organisms. To cope with this, probabilistic tools, statistical analysis and stochastic approaches have been used. This article aims to review the analysis of uncertainty and variability in the context of finite element modeling in biomedical engineering. Characterization techniques and propagation methods are presented, as well as examples of their applications in biomedical finite element simulations. Uncertainty propagation methods, both non-intrusive and intrusive, are described. Finally, pros and cons of the different approaches and their use in the scientific community are presented. This leads us to identify future directions for research and methodological development of uncertainty modeling in biomedical engineering

Technologies for Biomechanically-Informed Image Guidance of Laparoscopic Liver Surgery

Laparoscopic surgery for liver resection has a number medical advantages over open surgery, but also comes with inherent technical challenges. The surgeon only has a very limited field of view through the imaging modalities routinely employed intra-operatively, laparoscopic video and ultrasound, and the pneumoperitoneum required to create the operating space and gaining access to the organ can significantly deform and displace the liver from its pre-operative configuration. This can make relating what is visible intra-operatively to the pre-operative plan and inferring the location of sub-surface anatomy a very challenging task. Image guidance systems can help overcome these challenges by updating the pre-operative plan to the situation in theatre and visualising it in relation to the position of surgical instruments. In this thesis, I present a series of contributions to a biomechanically-informed image-guidance system made during my PhD. The most recent one is work on a pipeline for the estimation of the post-insufflation configuration of the liver by means of an algorithm that uses a database of segmented training images of patient abdomens where the post-insufflation configuration of the liver is known. The pipeline comprises an algorithm for inter and intra-subject registration of liver meshes by means of non-rigid spectral point-correspondence finding. My other contributions are more fundamental and less application specific, and are all contained and made available to the public in the NiftySim open-source finite element modelling package. Two of my contributions to NiftySim are of particular interest with regards to image guidance of laparoscopic liver surgery: 1) a novel general purpose contact modelling algorithm that can be used to simulate contact interactions between, e.g., the liver and surrounding anatomy; 2) membrane and shell elements that can be used to, e.g., simulate the Glisson capsule that has been shown to significantly influence the organ’s measured stiffness

Development of a Novel Robot for Transperineal Needle Based Interventions: Focal Therapy, Brachytherapy and Prostate Biopsies

Purpose: We report what is to our knowledge the initial experience with a new 3-dimensional ultrasound robotic system for prostate brachytherapy assistance, focal therapy and prostate biopsies. Its ability to track prostate motion intraoperatively allows it to manage motions and guide needles to predefined targets. Materials and Methods: A robotic system was created for transrectal ultrasound guided needle implantation combined with intraoperative prostate tracking. Experiments were done on 90 targets embedded in a total of 9 mobile, deformable, synthetic prostate phantoms. Experiments involved trying to insert glass beads as close as possible to targets in multimodal anthropomorphic imaging phantoms. Results were measured by segmenting the inserted beads in computerized tomography volumes of the phantoms. Results: The robot reached the chosen targets in phantoms with a median accuracy of 2.73 mm and a median prostate motion of 5.46 mm. Accuracy was better at the apex than at the base (2.28 vs 3.83 mm, p <0.001), and similar for horizontal and angled needle inclinations (2.7 vs 2.82 mm, p = 0.18). Conclusions: To our knowledge this robot for prostate focal therapy, brachytherapy and targeted prostate biopsies is the first system to use intraoperative prostate motion tracking to guide needles into the prostate. Preliminary experiments show its ability to reach targets despite prostate motion

Biomechanical Modeling for Lung Tumor Motion Prediction during Brachytherapy and Radiotherapy

A novel technique is proposed to develop a biomechanical model for estimating lung’s tumor position as a function of respiration cycle time. Continuous tumor motion is a major challenge in lung cancer treatment techniques where the tumor needs to be targeted; e.g. in external beam radiotherapy and brachytherapy. If not accounted for, this motion leads to areas of radiation over and/or under dosage for normal tissue and tumors. In this thesis, biomechanical models were developed for lung tumor motion predication in two distinct cases of lung brachytherapy and lung external beam radiotherapy. The lung and other relevant surrounding organs geometries, loading, boundary conditions and mechanical properties were considered and incorporated properly for each case. While using material model with constant incompressibility is sufficient to model the lung tissue in the brachytherapy case, in external beam radiation therapy the tissue incompressibility varies significantly due to normal breathing. One of the main issues tackled in this research is characterizing lung tissue incompressibility variations and measuring its corresponding parameters as a function of respiration cycle time. Results obtained from an ex-vivo porcine deflated lung indicated feasibility and reliability of using the developed biomechanical model to predict tumor motion during brachytherapy. For external beam radiotherapy, in-silico studies indicated very significant impact of considering the lung tissue incompressibility on the accuracy of predicting tumor motion. Furthermore, ex-vivo porcine lung experiments demonstrated the capability and reliability of the proposed approach for predicting tumor motion as a function of cyclic time. As such, the proposed models have a good potential to be incorporated effectively in computer assisted lung radiotherapy treatment systems

Patient-specific simulation environment for surgical planning and preoperative rehearsal

Surgical simulation is common practice in the fields of surgical education and training. Numerous surgical simulators are available from commercial and academic organisations for the generic modelling of surgical tasks. However, a simulation platform is still yet to be found that fulfils the key requirements expected for patient-specific surgical simulation of soft tissue, with an effective translation into clinical practice. Patient-specific modelling is possible, but to date has been time-consuming, and consequently costly, because data preparation can be technically demanding. This motivated the research developed herein, which addresses the main challenges of biomechanical modelling for patient-specific surgical simulation. A novel implementation of soft tissue deformation and estimation of the patient-specific intraoperative environment is achieved using a position-based dynamics approach. This modelling approach overcomes the limitations derived from traditional physically-based approaches, by providing a simulation for patient-specific models with visual and physical accuracy, stability and real-time interaction. As a geometrically- based method, a calibration of the simulation parameters is performed and the simulation framework is successfully validated through experimental studies. The capabilities of the simulation platform are demonstrated by the integration of different surgical planning applications that are found relevant in the context of kidney cancer surgery. The simulation of pneumoperitoneum facilitates trocar placement planning and intraoperative surgical navigation. The implementation of deformable ultrasound simulation can assist surgeons in improving their scanning technique and definition of an optimal procedural strategy. Furthermore, the simulation framework has the potential to support the development and assessment of hypotheses that cannot be tested in vivo. Specifically, the evaluation of feedback modalities, as a response to user-model interaction, demonstrates improved performance and justifies the need to integrate a feedback framework in the robot-assisted surgical setting.Open Acces

Multimodal image fusion of anatomical structures for diagnosis, therapy planning and assistance

This paper provides an overview of work done in recent years by our research group to fuse multimodal images of the trunk of patients with Adolescent Idiopathic Scoliosis (AIS) treated at Sainte-Justine University Hospital Center (CHU). We first describe our surface acquisition system and introduce a set of clinical measurements (indices) based on the trunk's external shape, to quantify its degree of asymmetry. We then describe our 3D reconstruction system of the spine and rib cage from biplanar radiographs and present our methodology for multimodal fusion of MRI, X-ray and external surface images of the trunk We finally present a physical model of the human trunk including bone and soft tissue for the simulation of the surgical outcome on the external trunk shape in AIS.CIHR / IRS

Medical SLAM in an autonomous robotic system

One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-operative morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon’s navigation capabilities by observing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted instruments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This thesis addresses the ambitious goal of achieving surgical autonomy, through the study of the anatomical environment by Initially studying the technology present and what is needed to analyze the scene: vision sensors. A novel endoscope for autonomous surgical task execution is presented in the first part of this thesis. Which combines a standard stereo camera with a depth sensor. This solution introduces several key advantages, such as the possibility of reconstructing the 3D at a greater distance than traditional endoscopes. Then the problem of hand-eye calibration is tackled, which unites the vision system and the robot in a single reference system. Increasing the accuracy in the surgical work plan. In the second part of the thesis the problem of the 3D reconstruction and the algorithms currently in use were addressed. In MIS, simultaneous localization and mapping (SLAM) can be used to localize the pose of the endoscopic camera and build ta 3D model of the tissue surface. Another key element for MIS is to have real-time knowledge of the pose of surgical tools with respect to the surgical camera and underlying anatomy. Starting from the ORB-SLAM algorithm we have modified the architecture to make it usable in an anatomical environment by adding the registration of the pre-operative information of the intervention to the map obtained from the SLAM. Once it has been proven that the slam algorithm is usable in an anatomical environment, it has been improved by adding semantic segmentation to be able to distinguish dynamic features from static ones. All the results in this thesis are validated on training setups, which mimics some of the challenges of real surgery and on setups that simulate the human body within Autonomous Robotic Surgery (ARS) and Smart Autonomous Robotic Assistant Surgeon (SARAS) projects