GPU-based proximity query processing on unstructured triangular mesh model

This paper presents a novel proximity query (PQ) approach capable to detect the collision and calculate the minimal Euclidean distance between two non-convex objects in 3D, namely the robot and the environment. Such approaches are often considered as computationally demanding problems, but are of importance to many applications such as online simulation of haptic feedback and robot collision-free trajectory. Our approach enables to preserve the representation of unstructured environment in the form of triangular meshes. The proposed PQ algorithm is computationally parallel so that it can be effectively implemented on graphics processing units (GPUs). A GPU-based computation scheme is also developed and customized, which shows >200 times faster than an optimized CPU with single core. Comprehensive validation is also conducted on two simulated scenarios in order to demonstrate the practical values of its potential application in image-guided surgical robotics and humanoid robotic control.published_or_final_versio

A Contact Force Sensor based on S-shaped Beams and Optoelectronic Sensors for Flexible Manipulators for Minimally Invasive Surgery (MIS)

Flexible, highly articulated robotic tools can greatly facilitate procedures in which the operator needs to access small openings and confined spaces. Particularly, in the context of robotic-assisted minimally invasive surgery (RMIS), the application of such manipulation tools can be significantly beneficial in preventing unnecessary interactions with sensitive body organs by which reducing patient’s recovery time when compared with conventional methods. However, these systems usually lack tactile feedback and are not able to perceive and quantify the interactions between themselves and soft body organs. This deficiency may result in damaging the organs due to unwanted excessive force applied. To this end, we introduce a contact force sensor based on three 'dyadic-S-shaped' beams and three optoelectronic sensors. The modular design of a flexible manipulation system described as part of this paper allows ready integration of a series of the proposed sensors within its structure. The sensor uses our novel sensing principle for measuring contact forces. The strategic employment of custom sensor structure and the optoelectronic components fulfill our design objectives which has been focused on the creation of a modular, low-cost, low-noise (electrically) with large voltage variation, without the need for an amplifier, through a simple fabrication process for MIS. Our experimental results, following a very simple calibration processes show the average errors of Fx (+19.37%±0.82, -18.32%±2.06) and Fy (+18.56%±1.69, -17.00%±1.32), and the average RMS errors of Fx (0.12N±0.0067) and Fy (0.11N±0.0032) in the measurement of force values within the range of -4 to 4 N

FPGA-based High-Performance Collision Detection: An Enabling Technique for Image-Guided Robotic Surgery

Collision detection, which refers to the computational problem of finding the relative placement or con-figuration of two or more objects, is an essential component of many applications in computer graphics and robotics. In image-guided robotic surgery, real-time collision detection is critical for preserving healthy anatomical structures during the surgical procedure. However, the computational complexity of the problem usually results in algorithms that operate at low speed. In this paper, we present a fast and accurate algorithm for collision detection between Oriented-Bounding-Boxes (OBBs) that is suitable for real-time implementation. Our proposed Sweep and Prune algorithm can perform a preliminary filtering to reduce the number of objects that need to be tested by the classical Separating Axis Test algorithm, while the OBB pairs of interest are preserved. These OBB pairs are re-checked by the Separating Axis Test algorithm to obtain accurate overlapping status between them. To accelerate the execution, our Sweep and Prune algorithm is tailor-made for the proposed method. Meanwhile, a high performance scalable hardware architecture is proposed by analyzing the intrinsic parallelism of our algorithm, and is implemented on FPGA platform. Results show that our hardware design on the FPGA platform can achieve around 8X higher running speed than the software design on a CPU platform. As a result, the proposed algorithm can achieve a collision frame rate of 1 KHz, and fulfill the requirement for the medical surgery scenario of Robot Assisted Laparoscopy.published_or_final_versio

Dynamic Active Constraints for Surgical Robots using Vector Field Inequalities

Robotic assistance allows surgeons to perform dexterous and tremor-free procedures, but robotic aid is still underrepresented in procedures with constrained workspaces, such as deep brain neurosurgery and endonasal surgery. In these procedures, surgeons have restricted vision to areas near the surgical tooltips, which increases the risk of unexpected collisions between the shafts of the instruments and their surroundings. In this work, our vector-field-inequalities method is extended to provide dynamic active-constraints to any number of robots and moving objects sharing the same workspace. The method is evaluated with experiments and simulations in which robot tools have to avoid collisions autonomously and in real-time, in a constrained endonasal surgical environment. Simulations show that with our method the combined trajectory error of two robotic systems is optimal. Experiments using a real robotic system show that the method can autonomously prevent collisions between the moving robots themselves and between the robots and the environment. Moreover, the framework is also successfully verified under teleoperation with tool-tissue interactions.Comment: Accepted on T-RO 2019, 19 Page

Dimensionality reduction in controlling articulated snake robot for endoscopy under dynamic active constraints

This paper presents a real-time control framework for a snake robot with hyper-kinematic redundancy under dynamic active constraints for minimally invasive surgery. A proximity query (PQ) formulation is proposed to compute the deviation of the robot motion from predefined anatomical constraints. The proposed method is generic and can be applied to any snake robot represented as a set of control vertices. The proposed PQ formulation is implemented on a graphic processing unit, allowing for fast updates over 1 kHz. We also demonstrate that the robot joint space can be characterized into lower dimensional space for smooth articulation. A novel motion parameterization scheme in polar coordinates is proposed to describe the transition of motion, thus allowing for direct manual control of the robot using standard interface devices with limited degrees of freedom. Under the proposed framework, the correct alignment between the visual and motor axes is ensured, and haptic guidance is provided to prevent excessive force applied to the tissue by the robot body. A resistance force is further incorporated to enhance smooth pursuit movement matched to the dynamic response and actuation limit of the robot. To demonstrate the practical value of the proposed platform with enhanced ergonomic control, detailed quantitative performance evaluation was conducted on a group of subjects performing simulated intraluminal and intracavity endoscopic tasks. © 2004-2012 IEEE.link_to_subscribed_fulltex

Robots Hiper-Redundantes: Clasificación, Estado del Arte y Problemática

Los robots hiper-redundantes son aquellos que tienen un número muy elevado de grados de libertad. En su uso cotidiano, la redundancia es referida para indicar una repetición o un uso excesivo de un concepto. En el campo de la robótica, la redundancia puede ofrecer numerosos beneficios frente a los robots convencionales. Los robots hiper-redundantes poseen una mayor habilidad para sortear obstáculos, son tolerantes a fallos en algunas de sus articulaciones y también pueden ofrecer ventajas cinemáticas. En este artículo se presentan los conceptos generales para entender este tipo de robots, así como una clasificación de los mismos, su potencial, su problemática y su evolución a lo largo de la historia

Smart Navigation in Surgical Robotics

La cirugía mínimamente invasiva, y concretamente la cirugía laparoscópica, ha supuesto un gran cambio en la forma de realizar intervenciones quirúrgicas en el abdomen. Actualmente, la cirugía laparoscópica ha evolucionado hacia otras técnicas aún menos invasivas, como es la cirugía de un solo puerto, en inglés Single Port Access Surgery. Esta técnica consiste en realizar una única incisión, por la que son introducidos los instrumentos y la cámara laparoscópica a través de un único trocar multipuerto. La principal ventaja de esta técnica es una reducción de la estancia hospitalaria por parte del paciente, y los resultados estéticos, ya que el trocar se suele introducir por el ombligo, quedando la cicatriz oculta en él. Sin embargo, el hecho de que los instrumentos estén introducidos a través del mismo trocar hace la intervención más complicada para el cirujano, que necesita unas habilidades específicas para este tipo de intervenciones. Esta tesis trata el problema de la navegación de instrumentos quirúrgicos mediante plataformas robóticas teleoperadas en cirugía de un solo puerto. En concreto, se propone un método de navegación que dispone de un centro de rotación remoto virtual, el cuál coincide con el punto de inserción de los instrumentos (punto de fulcro). Para estimar este punto se han empleado las fuerzas ejercidas por el abdomen en los instrumentos quirúrgicos, las cuales han sido medidas por sensores de esfuerzos colocados en la base de los instrumentos. Debido a que estos instrumentos también interaccionan con tejido blando dentro del abdomen, lo cual distorsionaría la estimación del punto de inserción, es necesario un método que permita detectar esta circunstancia. Para solucionar esto, se ha empleado un detector de interacción con tejido basado en modelos ocultos de Markov el cuál se ha entrenado para detectar cuatro gestos genéricos. Por otro lado, en esta tesis se plantea el uso de guiado háptico para mejorar la experiencia del cirujano cuando utiliza plataformas robóticas teleoperadas. En concreto, se propone la técnica de aprendizaje por demostración (Learning from Demonstration) para generar fuerzas que puedan guiar al cirujano durante la resolución de tareas específicas. El método de navegación propuesto se ha implantado en la plataforma quirúrgica CISOBOT, desarrollada por la Universidad de Málaga. Los resultados experimentales obtenidos validan tanto el método de navegación propuesto, como el detector de interacción con tejido blando. Por otro lado, se ha realizado un estudio preliminar del sistema de guiado háptico. En concreto, se ha empleado una tarea genérica, la inserción de una clavija, para realizar los experimentos necesarios que permitan demostrar que el método propuesto es válido para resolver esta tarea y otras similares

Phase Change Materials for Controllable Stiffness of Robotic Joints

Snake-like manipulators are well suited for operation in restricted and confined environments where the manipulator body can bend around obstacles to place an end effector at a difficult to access location. They require high stiffness when self-supporting weight against gravity and undertake precision manipulation task, but also require soft properties when operating in complex and delicate environments. A controllable stiffness manipulator has the potential to meet the application demands as it can switch between rigid and soft state. This thesis experimentally investigates the properties of four materials, (low melting point solder, hot-melt adhesive, low melting point alloy and granular material) as candidates for mechanically altering the stiffness of the joints/modules in snake-like manipulators. These materials were evaluated for bonding strength, repeatability, and activation time. Modules for a snake-like manipulator were fabricated using 3D printing and silicone casting techniques including, for the first time, variable stiffness joints that use hot-melt adhesive and low melting point alloy. These modules were evaluated for stiffness properties and low melting point solder based module was found to achieve a stiffness change 150X greater than the state of the art granular material approach. In addition, the proposed modules were able to support 25X of their own weight

Mobility, Navigation and Localization Towards Robotic Endoscopy

With significant progress being made towards improving endoscope technology such as capsule endoscopy and robotic endoscopy, the development of advanced strategies for manipulating, controlling and more generally, easing the accessibility of these devices for physicians is an important next step. This work presents the development of several robotic platforms for experimentally testing navigation and localization strategies in robotic endoscopy followed by the development and testing of navigation strategies using these devices. Finally, visual and visual inertial localization and mapping is explored on two of these robotic systems. We first present a detailed description on the state-of-the-art with regard to minimally invasive robotic surgery and then follow this with in-depth description of our design and validation of two important systems, the Robotic Endoscope Platform (REP) and the Modular Endoscopy Simulation Apparatus (MESA), for exploring some of the challenges in robotic endoscopy. Following these descriptions we present a technique for autonomous navigation of the REP within the MESA as well as an attempt at applying Simultaneous Localization and Mapping (SLAM) to allow for the real-time localization of this system. Finally, we transition these techniques to the Endoculus, a complete robotic endoscope suitable for in vivo testing, and demonstrate both autonomous navigation for this device, and the implementation of three different SLAM systems for localization and mapping of the Endoculus system in real-time. Throughout these experiments we demonstrate the potential for advanced methods in computer vision along with other sensory techniques to substantially benefit endoscopy, enabling greater and greater autonomy of these systems and furthering the case for robotic endoscopy as a whole.</p