Mobile locally operated detachable end-effector manipulator for endoscopic surgery

Purpose\n Local surgery is safer than remote surgery because emergencies can be more easily addressed. Although many locally operated surgical robots and devices have been developed, none can safely grasp organs and provide traction. A new manipulator with a detachable commercial forceps was developed that can act as a third arm for a surgeon situated in a sterile area near the patient. This mechanism can be disassembled into compact parts that enable mobile use.Methods\n A mobile locally operated detachable end-effector manipulator (LODEM) was developed and tested. This device uses crank-slider and cable-rod mechanisms to achieve 5 degrees of freedom and an acting force of more than 5 N. The total mass is less than 15 kg. The positional accuracy and speed of the prototype device were evaluated while performing simulated in vivo surgery.Results\n The accuracy of the mobile LODEM was 0.4 mm, sufficient for handling organs. The manipulator could be assembled and disassembled in 8 min, making it highly mobile. The manipulator could successfully handle the target organs with the required level of dexterity during an in vivo laparoscopic surgical procedure.Conclusions\n A mobile LODEM was designed that allows minimally invasive robotically assisted endoscopic surgery by a surgeon working near the patient. This device is highly promising for robotic surgery applications.ArticleINTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY. 10(2):161-169 (2015)journal articl

Medical robots with potential applications in participatory and opportunistic remote sensing: A review

Among numerous applications of medical robotics, this paper concentrates on the design, optimal use and maintenance of the related technologies in the context of healthcare, rehabilitation and assistive robotics, and provides a comprehensive review of the latest advancements in the foregoing field of science and technology, while extensively dealing with the possible applications of participatory and opportunistic mobile sensing in the aforementioned domains. The main motivation for the latter choice is the variety of such applications in the settings having partial contributions to functionalities such as artery, radiosurgery, neurosurgery and vascular intervention. From a broad perspective, the aforementioned applications can be realized via various strategies and devices benefiting from detachable drives, intelligent robots, human-centric sensing and computing, miniature and micro-robots. Throughout the paper tens of subjects, including sensor-fusion, kinematic, dynamic and 3D tissue models are discussed based on the existing literature on the state-of-the-art technologies. In addition, from a managerial perspective, topics such as safety monitoring, security, privacy and evolutionary optimization of the operational efficiency are reviewed

A continuum robotic platform for endoscopic non-contact laser surgery: design, control, and preclinical evaluation

The application of laser technologies in surgical interventions has been accepted in the clinical domain due to their atraumatic properties. In addition to manual application of fibre-guided lasers with tissue contact, non-contact transoral laser microsurgery (TLM) of laryngeal tumours has been prevailed in ENT surgery. However, TLM requires many years of surgical training for tumour resection in order to preserve the function of adjacent organs and thus preserve the patient’s quality of life. The positioning of the microscopic laser applicator outside the patient can also impede a direct line-of-sight to the target area due to anatomical variability and limit the working space. Further clinical challenges include positioning the laser focus on the tissue surface, imaging, planning and performing laser ablation, and motion of the target area during surgery. This dissertation aims to address the limitations of TLM through robotic approaches and intraoperative assistance. Although a trend towards minimally invasive surgery is apparent, no highly integrated platform for endoscopic delivery of focused laser radiation is available to date. Likewise, there are no known devices that incorporate scene information from endoscopic imaging into ablation planning and execution. For focusing of the laser beam close to the target tissue, this work first presents miniaturised focusing optics that can be integrated into endoscopic systems. Experimental trials characterise the optical properties and the ablation performance. A robotic platform is realised for manipulation of the focusing optics. This is based on a variable-length continuum manipulator. The latter enables movements of the endoscopic end effector in five degrees of freedom with a mechatronic actuation unit. The kinematic modelling and control of the robot are integrated into a modular framework that is evaluated experimentally. The manipulation of focused laser radiation also requires precise adjustment of the focal position on the tissue. For this purpose, visual, haptic and visual-haptic assistance functions are presented. These support the operator during teleoperation to set an optimal working distance. Advantages of visual-haptic assistance are demonstrated in a user study. The system performance and usability of the overall robotic system are assessed in an additional user study. Analogous to a clinical scenario, the subjects follow predefined target patterns with a laser spot. The mean positioning accuracy of the spot is 0.5 mm. Finally, methods of image-guided robot control are introduced to automate laser ablation. Experiments confirm a positive effect of proposed automation concepts on non-contact laser surgery.Die Anwendung von Lasertechnologien in chirurgischen Interventionen hat sich aufgrund der atraumatischen Eigenschaften in der Klinik etabliert. Neben manueller Applikation von fasergeführten Lasern mit Gewebekontakt hat sich die kontaktfreie transorale Lasermikrochirurgie (TLM) von Tumoren des Larynx in der HNO-Chirurgie durchgesetzt. Die TLM erfordert zur Tumorresektion jedoch ein langjähriges chirurgisches Training, um die Funktion der angrenzenden Organe zu sichern und damit die Lebensqualität der Patienten zu erhalten. Die Positionierung des mikroskopis chen Laserapplikators außerhalb des Patienten kann zudem die direkte Sicht auf das Zielgebiet durch anatomische Variabilität erschweren und den Arbeitsraum einschränken. Weitere klinische Herausforderungen betreffen die Positionierung des Laserfokus auf der Gewebeoberfläche, die Bildgebung, die Planung und Ausführung der Laserablation sowie intraoperative Bewegungen des Zielgebietes. Die vorliegende Dissertation zielt darauf ab, die Limitierungen der TLM durch robotische Ansätze und intraoperative Assistenz zu adressieren. Obwohl ein Trend zur minimal invasiven Chirurgie besteht, sind bislang keine hochintegrierten Plattformen für die endoskopische Applikation fokussierter Laserstrahlung verfügbar. Ebenfalls sind keine Systeme bekannt, die Szeneninformationen aus der endoskopischen Bildgebung in die Ablationsplanung und -ausführung einbeziehen. Für eine situsnahe Fokussierung des Laserstrahls wird in dieser Arbeit zunächst eine miniaturisierte Fokussieroptik zur Integration in endoskopische Systeme vorgestellt. Experimentelle Versuche charakterisieren die optischen Eigenschaften und das Ablationsverhalten. Zur Manipulation der Fokussieroptik wird eine robotische Plattform realisiert. Diese basiert auf einem längenveränderlichen Kontinuumsmanipulator. Letzterer ermöglicht in Kombination mit einer mechatronischen Aktuierungseinheit Bewegungen des Endoskopkopfes in fünf Freiheitsgraden. Die kinematische Modellierung und Regelung des Systems werden in ein modulares Framework eingebunden und evaluiert. Die Manipulation fokussierter Laserstrahlung erfordert zudem eine präzise Anpassung der Fokuslage auf das Gewebe. Dafür werden visuelle, haptische und visuell haptische Assistenzfunktionen eingeführt. Diese unterstützen den Anwender bei Teleoperation zur Einstellung eines optimalen Arbeitsabstandes. In einer Anwenderstudie werden Vorteile der visuell-haptischen Assistenz nachgewiesen. Die Systemperformanz und Gebrauchstauglichkeit des robotischen Gesamtsystems werden in einer weiteren Anwenderstudie untersucht. Analog zu einem klinischen Einsatz verfolgen die Probanden mit einem Laserspot vorgegebene Sollpfade. Die mittlere Positioniergenauigkeit des Spots beträgt dabei 0,5 mm. Zur Automatisierung der Ablation werden abschließend Methoden der bildgestützten Regelung vorgestellt. Experimente bestätigen einen positiven Effekt der Automationskonzepte für die kontaktfreie Laserchirurgie

Phase Change Materials for Controllable Stiffness of Robotic Joints

Snake-like manipulators are well suited for operation in restricted and confined environments where the manipulator body can bend around obstacles to place an end effector at a difficult to access location. They require high stiffness when self-supporting weight against gravity and undertake precision manipulation task, but also require soft properties when operating in complex and delicate environments. A controllable stiffness manipulator has the potential to meet the application demands as it can switch between rigid and soft state. This thesis experimentally investigates the properties of four materials, (low melting point solder, hot-melt adhesive, low melting point alloy and granular material) as candidates for mechanically altering the stiffness of the joints/modules in snake-like manipulators. These materials were evaluated for bonding strength, repeatability, and activation time. Modules for a snake-like manipulator were fabricated using 3D printing and silicone casting techniques including, for the first time, variable stiffness joints that use hot-melt adhesive and low melting point alloy. These modules were evaluated for stiffness properties and low melting point solder based module was found to achieve a stiffness change 150X greater than the state of the art granular material approach. In addition, the proposed modules were able to support 25X of their own weight

Parallel Manipulators

In recent years, parallel kinematics mechanisms have attracted a lot of attention from the academic and industrial communities due to potential applications not only as robot manipulators but also as machine tools. Generally, the criteria used to compare the performance of traditional serial robots and parallel robots are the workspace, the ratio between the payload and the robot mass, accuracy, and dynamic behaviour. In addition to the reduced coupling effect between joints, parallel robots bring the benefits of much higher payload-robot mass ratios, superior accuracy and greater stiffness; qualities which lead to better dynamic performance. The main drawback with parallel robots is the relatively small workspace. A great deal of research on parallel robots has been carried out worldwide, and a large number of parallel mechanism systems have been built for various applications, such as remote handling, machine tools, medical robots, simulators, micro-robots, and humanoid robots. This book opens a window to exceptional research and development work on parallel mechanisms contributed by authors from around the world. Through this window the reader can get a good view of current parallel robot research and applications

A flexible access platform for robot-assisted minimally invasive surgery

Advances in Minimally Invasive Surgery (MIS) are driven by the clinical demand to reduce the invasiveness of surgical procedures so patients undergo less trauma and experience faster recoveries. These well documented benefits of MIS have been achieved through parallel advances in the technology and instrumentation used during procedures. The new and evolving field of Flexible Access Surgery (FAS), where surgeons access the operative site through a single incision or a natural orifice incision, is being promoted as the next potential step in the evolution of surgery. In order to achieve similar levels of success and adoption as MIS, technology again has its role to play in developing new instruments to solve the unmet clinical challenges of FAS. As procedures become less invasive, these instruments should not just address the challenges presented by the complex access routes of FAS, but should also build on the recent advances in pre- and intraoperative imaging techniques to provide surgeons with new diagnostic and interventional decision making capabilities. The main focus of this thesis is the development and applications of a flexible robotic device that is capable of providing controlled flexibility along curved pathways inside the body. The principal component of the device is its modular mechatronic joint design which utilises an embedded micromotor-tendon actuation scheme to provide independently addressable degrees of freedom and three internal working channels. Connecting multiple modules together allows a seven degree-of-freedom (DoF) flexible access platform to be constructed. The platform is intended for use as a research test-bed to explore engineering and surgical challenges of FAS. Navigation of the platform is realised using a handheld controller optimised for functionality and ergonomics, or in a "hands-free" manner via a gaze contingent control framework. Under this framework, the operator's gaze fixation point is used as feedback to close the servo control loop. The feasibility and potential of integrating multi-spectral imaging capabilities into flexible robotic devices is also demonstrated. A force adaptive servoing mechanism is developed to simplify the deployment, and improve the consistency of probe-based optical imaging techniques by automatically controlling the contact force between the probe tip and target tissue. The thesis concludes with the description of two FAS case studies performed with the platform during in-vivo porcine experiments. These studies demonstrate the ability of the platform to perform large area explorations within the peritoneal cavity and to provide a stable base for the deployment of interventional instruments and imaging probes

Using the Fringe Field of MRI Scanner for the Navigation of Microguidewires in the Vascular System

Le traitement du cancer, la prévention des accidents vasculaires cérébraux et le diagnostic ou le traitement des maladies vasculaires périphériques sont tous des cas d'application d'interventions à base de cathéter par le biais d'un traitement invasif minimal. Cependant, la pratique du cathétérisme est généralement pratiquée manuellement et dépend fortement de l'expérience et des compétences de l'interventionniste. La robotisation du cathétérisme a été étudiée pour faciliter la procédure en augmentant les niveaux d’autonomie par rapport à cette pratique clinique. En ce qui concerne ce problème, un des problèmes concerne le placement super sélectif du cathéter dans les artères plus étroites nécessitant une miniaturisation de l'instrument cathéter / fil de guidage attaché. Un microguide qui fonctionne dans des vaisseaux sanguins étroits et tortueux subit différentes forces mécaniques telles que le frottement avec la paroi du vaisseau. Ces forces peuvent empêcher la progression de la pointe du fil de guidage dans les vaisseaux. Une méthode proposée consiste à appliquer une force de traction à la pointe du microguide pour diriger et insérer le dispositif tout en poussant l’instrument attaché à partir de l’autre extrémité n’est plus pratique, et à exploiter le gradient du champ de franges IRM surnommé Fringe Field Navigation (FFN ) est proposée comme solution pour assurer cet actionnement. Le concept de FFN repose sur le positionnement d'un patient sur six DOF dans le champ périphérique du scanner IRM afin de permettre un actionnement directionnel pour la navigation du fil-guide. Ce travail rend compte des développements requis pour la mise en oeuvre de la FFN et l’étude du potentiel et des possibilités qu’elle offre au cathétérisme, en veillant au renforcement de l’autonomie. La cartographie du champ de franges d'un scanner IRM 3T est effectuée et la structure du champ de franges en ce qui concerne son uniformité locale est examinée. Une méthode pour la navigation d'un fil de guidage le long d'un chemin vasculaire souhaité basée sur le positionnement robotique du patient à six DOF est développée. Des expériences de FFN guidées par rayons X in vitro et in vivo sur un modèle porcin sont effectuées pour naviguer dans un fil de guidage dans la multibifurcation et les vaisseaux étroits. Une caractéristique unique de FFN est le haut gradient du champ magnétique. Il est démontré in vitro et in vivo que cette force surmonte le problème de l'insertion d'un fil microguide dans des vaisseaux tortueux et étroits pour permettre de faire avancer le fil-guide avec une distale douce au-delà de la limite d'insertion manuelle. La robustesse de FFN contre les erreurs de positionnement du patient est étudiée en relation avec l'uniformité locale dans le champ périphérique. La force élevée du champ magnétique disponible dans le champ de franges IRM peut amener les matériaux magnétiques doux à son état de saturation. Ici, le concept d'utilisation d'un ressort est présenté comme une alternative vi déformable aux aimants permanents solides pour la pointe du fil-guide. La navigation d'un microguide avec une pointe de ressort en structure vasculaire complexe est également réalisée in vitro. L'autonomie de FFN en ce qui concerne la planification d'une procédure avec autonomie de tâche obtenue dans ce travail augmente le potentiel de FFN en automatisant certaines étapes d'une procédure. En conclusion, FFN pour naviguer dans les microguides dans la structure vasculaire complexe avec autonomie pour effectuer le positionnement du patient et contrôler l'insertion du fil de guidage - avec démonstration in vivo dans un modèle porcin - peut être considéré comme un nouvel outil robotique facilitant le cathétérisme vasculaire. tout en aidant à cibler les vaisseaux lointains dans le système vasculaire.----------ABSTRACT Treatment of cancer, prevention of stroke, and diagnosis or treatment of peripheral vascular diseases are all the cases of application of catheter-based interventions through a minimal-invasive treatment. However, performing catheterization is generally practiced manually, and it highly depends on the experience and the skills of the interventionist. Robotization of catheterization has been investigated to facilitate the procedure by increasing the levels of autonomy to this clinical practice. Regarding it, one issue is the super selective placement of the catheter in the narrower arteries that require miniaturization of the tethered catheter/guidewire instrument. A microguidewire that operates in narrow and tortuous blood vessels experiences different mechanical forces like friction with the vessel wall. These forces can prevent the advancement of the tip of the guidewire in the vessels. A proposed method is applying a pulling force at the tip of the microguidewire to steer and insert the device while pushing the tethered instrument from the other end is no longer practical, and exploiting the gradient of the MRI fringe field dubbed as Fringe Field Navigation (FFN) is proposed as a solution to provide this actuation. The concept of FFN is based on six DOF positioning of a patient in the fringe field of the MRI scanner to enable directional actuation for the navigation of the guidewire. This work reports on the required developments for implementing FFN and investigating the potential and the possibilities that FFN introduces to the catheterization, with attention to enhancing the autonomy. Mapping the fringe field of a 3T MRI scanner is performed, and the structure of the fringe field regarding its local uniformity is investigated. A method for the navigation of a guidewire along a desired vascular path based on six DOF robotic patient positioning is developed. In vitro and in vivo x-ray Guided FFN experiments on a swine model of are performed to navigate a guidewire in the multibifurcation and narrow vessels. A unique feature of FFN is the high gradient of the magnetic field. It is demonstrated in vitro and in vivo that this force overcomes the issue of insertion of a microguidewire in tortuous and narrow vessels to enable advancing the guidewire with a soft distal beyond the limit of manual insertion. Robustness of FFN against the error in the positioning of the patient is investigated in relation to the local uniformity in the fringe field. The high strength of the magnetic field available in MRI fringe field can bring soft magnetic materials to its saturation state. Here, the concept of using a spring is introduced as a deformable alternative to solid permanent magnets for the tip of the guidewire. Navigation of a microguidewire with a viii spring tip in complex vascular structure is also performed in vitro. The autonomy of FFN regarding planning a procedure with Task Autonomy achieved in this work enhances the potential of FFN by automatization of certain steps of a procedure. As a conclusion, FFN to navigate microguidewires in the complex vascular structure with autonomy in performing tasks of patient positioning and controlling the insertion of the guidewire – with in vivo demonstration in swine model – can be considered as a novel robotic tool for facilitating the vascular catheterization while helping to target remote vessels in the vascular system

Haptics Rendering and Applications

There has been significant progress in haptic technologies but the incorporation of haptics into virtual environments is still in its infancy. A wide range of the new society's human activities including communication, education, art, entertainment, commerce and science would forever change if we learned how to capture, manipulate and reproduce haptic sensory stimuli that are nearly indistinguishable from reality. For the field to move forward, many commercial and technological barriers need to be overcome. By rendering how objects feel through haptic technology, we communicate information that might reflect a desire to speak a physically- based language that has never been explored before. Due to constant improvement in haptics technology and increasing levels of research into and development of haptics-related algorithms, protocols and devices, there is a belief that haptics technology has a promising future