A Novel Minimally Invasive Tumour Localization Device

Lung cancer is one of the leading causes of death, by cancer. The usual treatment is surgical resection of tumours. However, patients who are weak or have poor pulmonary function are deemed unfit for surgery. For these patients, a minimally-invasive approach is desired. A major problem associated with minimally-invasive approaches is tumour localization in real time and accurate measurement of tool--tissue forces. This thesis describes the design, analysis, manufacturing and validation of a minimally-invasive instrument for tumour localization, named Palpatron. The instrument has an end effector that is able to support two previously designed jaws, one containing an ultrasound sensor and the other a tactile sensor. The jaws can move with two degrees of freedom to palpate tissue and rotate about the central axis of the instrument. The Palpatron has uncoupled jaw motion that allows for optimal alignment of sensors to improve data acquisition. The instrument can be easily assembled and disassembled allowing it to be cleaned and sterilized. The mechanism is articulated using push rods, each actuated by a motor. A semi-automatic control system was created for palpation. It is composed of a microcontroller that controls four motors via serial communication. In addition, the Palpatron has the ability to prevent tissue damage by measuring tool--tissue forces. Finite element analysis was used to guide material selection for designed components. Grade 5 titanium was selected for end effector links to provide a factor of safety of 1.2 against yielding under a 10 N point load at the tip of a jaw. The design was fabricated and validated by conducting experiments to test articulation and load carrying capacity. An 8-N force was applied to the instrument, which was successfully supported. The semi-automatic control system was used to perform basic maneuvering tasks to verify jaw motion capabilities. With positive testing results, the Palpatron forms the next step towards a comprehensive robotic-assisted palpation technology

Medical Robotics

The first generation of surgical robots are already being installed in a number of operating rooms around the world. Robotics is being introduced to medicine because it allows for unprecedented control and precision of surgical instruments in minimally invasive procedures. So far, robots have been used to position an endoscope, perform gallbladder surgery and correct gastroesophogeal reflux and heartburn. The ultimate goal of the robotic surgery field is to design a robot that can be used to perform closed-chest, beating-heart surgery. The use of robotics in surgery will expand over the next decades without any doubt. Minimally Invasive Surgery (MIS) is a revolutionary approach in surgery. In MIS, the operation is performed with instruments and viewing equipment inserted into the body through small incisions created by the surgeon, in contrast to open surgery with large incisions. This minimizes surgical trauma and damage to healthy tissue, resulting in shorter patient recovery time. The aim of this book is to provide an overview of the state-of-art, to present new ideas, original results and practical experiences in this expanding area. Nevertheless, many chapters in the book concern advanced research on this growing area. The book provides critical analysis of clinical trials, assessment of the benefits and risks of the application of these technologies. This book is certainly a small sample of the research activity on Medical Robotics going on around the globe as you read it, but it surely covers a good deal of what has been done in the field recently, and as such it works as a valuable source for researchers interested in the involved subjects, whether they are currently “medical roboticists” or not

Design of Novel Sensors and Instruments for Minimally Invasive Lung Tumour Localization via Palpation

Minimally Invasive Thoracoscopic Surgery (MITS) has become the treatment of choice for lung cancer. However, MITS prevents the surgeons from using manual palpation, thereby often making it challenging to reliably locate the tumours for resection. This thesis presents the design, analysis and validation of novel tactile sensors, a novel miniature force sensor, a robotic instrument, and a wireless hand-held instrument to address this limitation. The low-cost, disposable tactile sensors have been shown to easily detect a 5 mm tumour located 10 mm deep in soft tissue. The force sensor can measure six degrees of freedom forces and torques with temperature compensation using a single optical fiber. The robotic instrument is compatible with the da Vinci surgical robot and allows the use of tactile sensing, force sensing and ultrasound to localize the tumours. The wireless hand-held instrument allows the use of tactile sensing in procedures where a robot is not available

Soft Biomimetic Finger with Tactile Sensing and Sensory Feedback Capabilities

The compliant nature of soft fingers allows for safe and dexterous manipulation of objects by humans in an unstructured environment. A soft prosthetic finger design with tactile sensing capabilities for texture discrimination and subsequent sensory stimulation has the potential to create a more natural experience for an amputee. In this work, a pneumatically actuated soft biomimetic finger is integrated with a textile neuromorphic tactile sensor array for a texture discrimination task. The tactile sensor outputs were converted into neuromorphic spike trains, which emulate the firing pattern of biological mechanoreceptors. Spike-based features from each taxel compressed the information and were then used as inputs for the support vector machine (SVM) classifier to differentiate the textures. Our soft biomimetic finger with neuromorphic encoding was able to achieve an average overall classification accuracy of 99.57% over sixteen independent parameters when tested on thirteen standardized textured surfaces. The sixteen parameters were the combination of four angles of flexion of the soft finger and four speeds of palpation. To aid in the perception of more natural objects and their manipulation, subjects were provided with transcutaneous electrical nerve stimulation (TENS) to convey a subset of four textures with varied textural information. Three able-bodied subjects successfully distinguished two or three textures with the applied stimuli. This work paves the way for a more human-like prosthesis through a soft biomimetic finger with texture discrimination capabilities using neuromorphic techniques that provides sensory feedback; furthermore, texture feedback has the potential to enhance the user experience when interacting with their surroundings. Additionally, this work showed that an inexpensive, soft biomimetic finger combined with a flexible tactile sensor array can potentially help users perceive their environment better

AUGMENTED REALITY AND INTRAOPERATIVE C-ARM CONE-BEAM COMPUTED TOMOGRAPHY FOR IMAGE-GUIDED ROBOTIC SURGERY

Minimally-invasive robotic-assisted surgery is a rapidly-growing alternative to traditionally open and laparoscopic procedures; nevertheless, challenges remain. Standard of care derives surgical strategies from preoperative volumetric data (i.e., computed tomography (CT) and magnetic resonance (MR) images) that benefit from the ability of multiple modalities to delineate different anatomical boundaries. However, preoperative images may not reflect a possibly highly deformed perioperative setup or intraoperative deformation. Additionally, in current clinical practice, the correspondence of preoperative plans to the surgical scene is conducted as a mental exercise; thus, the accuracy of this practice is highly dependent on the surgeon’s experience and therefore subject to inconsistencies. In order to address these fundamental limitations in minimally-invasive robotic surgery, this dissertation combines a high-end robotic C-arm imaging system and a modern robotic surgical platform as an integrated intraoperative image-guided system. We performed deformable registration of preoperative plans to a perioperative cone-beam computed tomography (CBCT), acquired after the patient is positioned for intervention. From the registered surgical plans, we overlaid critical information onto the primary intraoperative visual source, the robotic endoscope, by using augmented reality. Guidance afforded by this system not only uses augmented reality to fuse virtual medical information, but also provides tool localization and other dynamic intraoperative updated behavior in order to present enhanced depth feedback and information to the surgeon. These techniques in guided robotic surgery required a streamlined approach to creating intuitive and effective human-machine interferences, especially in visualization. Our software design principles create an inherently information-driven modular architecture incorporating robotics and intraoperative imaging through augmented reality. The system's performance is evaluated using phantoms and preclinical in-vivo experiments for multiple applications, including transoral robotic surgery, robot-assisted thoracic interventions, and cocheostomy for cochlear implantation. The resulting functionality, proposed architecture, and implemented methodologies can be further generalized to other C-arm-based image guidance for additional extensions in robotic surgery

Interfaces for Modular Surgical Planning and Assistance Systems

Modern surgery of the 21st century relies in many aspects on computers or, in a wider sense, digital data processing. Department administration, OR scheduling, billing, and - with increasing pervasion - patient data management are performed with the aid of so called Surgical Information Systems (SIS) or, more general, Hospital Information Systems (HIS). Computer Assisted Surgery (CAS) summarizes techniques which assist a surgeon in the preparation and conduction of surgical interventions. Today still predominantly based on radiology images, these techniques include the preoperative determination of an optimal surgical strategy and intraoperative systems which aim at increasing the accuracy of surgical manipulations. CAS is a relatively young field of computer science. One of the unsolved "teething troubles" of CAS is the absence of technical standards for the interconnectivity of CAS system. Current CAS systems are usually "islands of information" with no connection to other devices within the operating room or hospital-wide information systems. Several workshop reports and individual publications point out that this situation leads to ergonomic, logistic, and economic limitations in hospital work. Perioperative processes are prolonged by the manual installation and configuration of an increasing amount of technical devices. Intraoperatively, a large amount of the surgeons'' attention is absorbed by the requirement to monitor and operate systems. The need for open infrastructures which enable the integration of CAS devices from different vendors in order to exchange information as well as commands among these devices through a network has been identified by numerous experts with backgrounds in medicine as well as engineering. This thesis contains two approaches to the integration of CAS systems: - For perioperative data exchange, the specification of new data structures as an amendment to the existing DICOM standard for radiology image management is presented. The extension of DICOM towards surgical application allows for the seamless integration of surgical planning and reporting systems into DICOM-based Picture Archiving and Communication Systems (PACS) as they are installed in most hospitals for the exchange and long-term archival of patient images and image-related patient data. - For the integration of intraoperatively used CAS devices, such as, e.g., navigation systems, video image sources, or biosensors, the concept of a surgical middleware is presented. A c++ class library, the TiCoLi, is presented which facilitates the configuration of ad-hoc networks among the modules of a distributed CAS system as well as the exchange of data streams, singular data objects, and commands between these modules. The TiCoLi is the first software library for a surgical field of application to implement all of these services. To demonstrate the suitability of the presented specifications and their implementation, two modular CAS applications are presented which utilize the proposed DICOM extensions for perioperative exchange of surgical planning data as well as the TiCoLi for establishing an intraoperative network of autonomous, yet not independent, CAS modules.Die moderne Hochleistungschirurgie des 21. Jahrhunderts ist auf vielerlei Weise abhängig von Computern oder, im weiteren Sinne, der digitalen Datenverarbeitung. Administrative Abläufe, wie die Erstellung von Nutzungsplänen für die verfügbaren technischen, räumlichen und personellen Ressourcen, die Rechnungsstellung und - in zunehmendem Maße - die Verwaltung und Archivierung von Patientendaten werden mit Hilfe von digitalen Informationssystemen rationell und effizient durchgeführt. Innerhalb der Krankenhausinformationssysteme (KIS, oder englisch HIS) stehen für die speziellen Bedürfnisse der einzelnen Fachabteilungen oft spezifische Informationssysteme zur Verfügung. Chirurgieinformationssysteme (CIS, oder englisch SIS) decken hierbei vor allen Dingen die Bereiche Operationsplanung sowie Materialwirtschaft für spezifisch chirurgische Verbrauchsmaterialien ab. Während die genannten HIS und SIS vornehmlich der Optimierung administrativer Aufgaben dienen, stehen die Systeme der Computerassistierten Chirugie (CAS) wesentlich direkter im Dienste der eigentlichen chirugischen Behandlungsplanung und Therapie. Die CAS verwendet Methoden der Robotik, digitalen Bild- und Signalverarbeitung, künstlichen Intelligenz, numerischen Simulation, um nur einige zu nennen, zur patientenspezifischen Behandlungsplanung und zur intraoperativen Unterstützung des OP-Teams, allen voran des Chirurgen. Vor allen Dingen Fortschritte in der räumlichen Verfolgung von Werkzeugen und Patienten ("Tracking"), die Verfügbarkeit dreidimensionaler radiologischer Aufnahmen (CT, MRT, ...) und der Einsatz verschiedener Robotersysteme haben in den vergangenen Jahrzehnten den Einzug des Computers in den Operationssaal - medienwirksam - ermöglicht. Weniger prominent, jedoch keinesfalls von untergeordnetem praktischen Nutzen, sind Beispiele zur automatisierten Überwachung klinischer Messwerte, wie etwa Blutdruck oder Sauerstoffsättigung. Im Gegensatz zu den meist hochgradig verteilten und gut miteinander verwobenen Informationssystemen für die Krankenhausadministration und Patientendatenverwaltung, sind die Systeme der CAS heutzutage meist wenig oder überhaupt nicht miteinander und mit Hintergrundsdatenspeichern vernetzt. Eine Reihe wissenschaftlicher Publikationen und interdisziplinärer Workshops hat sich in den vergangen ein bis zwei Jahrzehnten mit den Problemen des Alltagseinsatzes von CAS Systemen befasst. Mit steigender Intensität wurde hierbei auf den Mangel an infrastrukturiellen Grundlagen für die Vernetzung intraoperativ eingesetzter CAS Systeme miteinander und mit den perioperativ eingesetzten Planungs-, Dokumentations- und Archivierungssystemen hingewiesen. Die sich daraus ergebenden negativen Einflüsse auf die Effizienz perioperativer Abläufe - jedes Gerät muss manuell in Betrieb genommen und mit den spezifischen Daten des nächsten Patienten gefüttert werden - sowie die zunehmende Aufmerksamkeit, welche der Operateur und sein Team auf die Überwachung und dem Betrieb der einzelnen Geräte verwenden muss, werden als eine der "Kinderkrankheiten" dieser relativ jungen Technologie betrachtet und stehen einer Verbreitung über die Grenzen einer engagierten technophilen Nutzergruppe hinaus im Wege. Die vorliegende Arbeit zeigt zwei parallel von einander (jedoch, im Sinne der Schnittstellenkompatibilität, nicht gänzlich unabhängig voneinander) zu betreibende Ansätze zur Integration von CAS Systemen. - Für den perioperativen Datenaustausch wird die Spezifikation zusätzlicher Datenstrukturen zum Transfer chirurgischer Planungsdaten im Rahmen des in radiologischen Bildverarbeitungssystemen weit verbreiteten DICOM Standards vorgeschlagen und an zwei Beispielen vorgeführt. Die Erweiterung des DICOM Standards für den perioperativen Einsatz ermöglicht hierbei die nahtlose Integration chirurgischer Planungssysteme in existierende "Picture Archiving and Communication Systems" (PACS), welche in den meisten Fällen auf dem DICOM Standard basieren oder zumindest damit kompatibel sind. Dadurch ist einerseits der Tatsache Rechnung getragen, dass die patientenspezifische OP-Planung in hohem Masse auf radiologischen Bildern basiert und andererseits sicher gestellt, dass die Planungsergebnisse entsprechend der geltenden Bestimmungen langfristig archiviert und gegen unbefugten Zugriff geschützt sind - PACS Server liefern hier bereits wohlerprobte Lösungen. - Für die integration intraoperativer CAS Systeme, wie etwa Navigationssysteme, Videobildquellen oder Sensoren zur Überwachung der Vitalparameter, wird das Konzept einer "chirurgischen Middleware" vorgestellt. Unter dem Namen TiCoLi wurde eine c++ Klassenbibliothek entwickelt, auf deren Grundlage die Konfiguration von ad-hoc Netzwerken während der OP-Vorbereitung mittels plug-and-play Mechanismen erleichtert wird. Nach erfolgter Konfiguration ermöglicht die TiCoLi den Austausch kontinuierlicher Datenströme sowie einzelner Datenpakete und Kommandos zwischen den Modulen einer verteilten CAS Anwendung durch ein Ethernet-basiertes Netzwerk. Die TiCoLi ist die erste frei verfügbare Klassenbibliothek welche diese Funktionalitäten dediziert für einen Einsatz im chirurgischen Umfeld vereinigt. Zum Nachweis der Tauglichkeit der gezeigten Spezifikationen und deren Implementierungen, werden zwei modulare CAS Anwendungen präsentiert, welche die vorgeschlagenen DICOM Erweiterungen zum perioperativen Austausch von Planungsergebnissen sowie die TiCoLi zum intraoperativen Datenaustausch von Messdaten unter echzeitnahen Anforderungen verwenden

MRI-Based Communication with Untethered Intelligent Medical Microrobots

RESUME Les champs magnétiques présent dans un système clinique d’Imagerie par Résonance Magnétique (IRM) peuvent être exploités non seulement, afin d’induire une force de déplacement sur des microrobots magnétiques tout en permettant l’asservissement de leur position - une technique connue sous le nom de Navigation par Résonance Magnétique (NRM), mais aussi pour mettre en œuvre un procédé de communication. Pour des microrobots autonomes équipés de senseurs ayant un certain niveau d'intelligence et opérant à l'intérieur du corps humain, la puissance de transmission nécessaire pour communiquer des informations à un ordinateur externe par des méthodes présentement connues est insuffisante. Dans ce travail, une technique est décrite où une telle perte de puissance d'émission en raison de la mise à l'échelle de ces microrobots peut être compensée par le scanner IRM agissant aussi comme un récepteur très sensible. La technique de communication prend la forme d'une modification de la fréquence du courant électrique circulant le long d'une bobine miniature incorporé dans un microrobot. La fréquence du courant électrique peut être réglée à partir d'une entrée de seuil prédéterminée du senseur mis en place sur le microrobot. La fréquence devient alors corrélée à l’information de l’état du senseur recueilli par le microrobot et elle est déterminée en utilisant l'IRM. La méthode proposée est indépendante de la position et l'orientation du microrobot et peut être étendue à un grand nombre de microrobots pour surveiller et cartographier les conditions physiologiques spécifiques dans une région plus vaste à n’importe quelle profondeur à l'intérieur du corps.----------ABSTRACT The magnetic environment provided by a clinical Magnetic Resonance Imaging (MRI) scanner can be exploited to not only induce a displacement force on magnetic microrobots while allowing MR-tracking for serving control purpose or positional assessment - a technique known as Magnetic Resonance Navigation (MRN), but also for implementing a method of communication with intelligent microrobots. For untethered sensory microrobots having some level of intelligence and operating inside the body, the transmission power necessary to communicate information to an external computer via known methods is insufficient. In this work, a technique is described where such loss of transmission power due to the scaling of these microrobots can be compensated by the same MRI scanner acting as a more sensitive receiver. A communication scheme is implemented in the form of a frequency alteration in the electrical current circulating along a miniature coil embedded in a microrobot. The frequency of the electrical current could be regulated from a predetermined sensory threshold input implemented on the microrobot. Such a frequency provides information on the level of sensory information gathered by the microrobot, and it is determined using MR imaging. The proposed method is independent of the microrobot's position and orientation and can be extended to a larger number of microrobots for monitoring and mapping specific physiological conditions inside a larger region at any depths within the body

Enabling technologies for MRI guided interventional procedures

This dissertation addresses topics related to developing interventional assistant devices for Magnetic Resonance Imaging (MRI). MRI can provide high-quality 3D visualization of target anatomy and surrounding tissue, but the benefits can not be readily harnessed for interventional procedures due to difficulties associated with the use of high-field (1.5T or greater) MRI. Discussed are potential solutions to the inability to use conventional mecha- tronics and the confined physical space in the scanner bore. This work describes the development of two apparently dissimilar systems that repre- sent different approaches to the same surgical problem - coupling information and action to perform percutaneous (through the skin) needle placement with MR imaging. The first system addressed takes MR images and projects them along with a surgical plan directly on the interventional site, thus providing in-situ imaging. With anatomical images and a corresponding plan visible in the appropriate pose, the clinician can use this information to perform the surgical action. My primary research effort has focused on a robotic assistant system that overcomes the difficulties inherent to MR-guided procedures, and promises safe and reliable intra-prostatic needle placement inside closed high-field MRI scanners. The robot is a servo pneumatically operated automatic needle guide, and effectively guides needles under real- time MR imaging. This thesis describes development of the robotic system including requirements, workspace analysis, mechanism design and optimization, and evaluation of MR compatibility. Further, a generally applicable MR-compatible robot controller is de- veloped, the pneumatic control system is implemented and evaluated, and the system is deployed in pre-clinical trials. The dissertation concludes with future work and lessons learned from this endeavor

Design and Modeling of Multi-Arm Continuum Robots

Continuum robots are snake-like systems able to deliver optimal therapies to pathologies deep inside the human cavity by following 3D complex paths. They show promise when anatomical pathways need to be traversed thanks to their enhanced flexibility and dexterity and show advantages when deployed in the field of single-port surgery. This PhD thesis concerns the development and modelling of multi-arm and hybrid continuum robots for medical interventions. The flexibility and steerability of the robot’s end-effector are achieved through concentric tube technology and push/pull technology. Medical robotic prototypes have been designed as proof of concepts and testbeds of the proposed theoretical works.System design considers the limitations and constraints that occur in the surgical procedures for which the systems were proposed for. Specifically, two surgical applications are considered. Our first prototype was designed to deliver multiple tools to the eye cavity for deep orbital interventions focusing on a currently invasive intervention named Optic Nerve Sheath Fenestration (ONSF). This thesis presents the end-to-end design, engineering and modelling of the prototype. The developed prototype is the first suggested system to tackle the challenges (limited workspace, need for enhanced flexibility and dexterity, danger for harming tissue with rigid instruments, extensive manipulation of the eye) arising in ONSF. It was designed taking into account the clinical requirements and constraints while theoretical works employing the Cosserat rod theory predict the shape of the continuum end-effector. Experimental runs including ex vivo experimental evaluations, mock-up surgical scenarios and tests with and without loading conditions prove the concept of accessing the eye cavity. Moreover, a continuum robot for thoracic interventions employing push/pull technology was designed and manufactured. The developed system can reach deep seated pathologies in the lungs and access regions in the bronchial tree that are inaccessible with rigid and straight instruments either robotically or manually actuated. A geometrically exact model of the robot that considers both the geometry of the robot and mechanical properties of the backbones is presented. It can predict the shape of the bronchoscope without the constant curvature assumption. The proposed model can also predict the robot shape and micro-scale movements accurately in contrast to the classic geometric model which provides an accurate description of the robot’s differential kinematics for large scale movements