A 6-DOF haptic manipulation system to verify assembly procedures on CAD models

During the design phase of products and before going into production, it is necessary to verify the presence of mechanical plays, tolerances, and encumbrances on production mockups. This work introduces a multi-modal system that allows verifying assembly procedures of products in Virtual Reality starting directly from CAD models. Thus leveraging the costs and speeding up the assessment phase in product design. For this purpose, the design of a novel 6-DOF Haptic device is presented. The achieved performance of the system has been validated in a demonstration scenario employing state-of-the-art volumetric rendering of interaction forces together with a stereoscopic visualization setup

A hybrid method for haptic feedback to support manual virtual product assembly

The purpose of this research is to develop methods to support manual virtual assembly using haptic (force) feedback in a virtual environment. The results of this research will be used in an engineering framework for assembly simulation, training, and maintenance. The key research challenge is to advance the ability of users to assemble complex, low clearance CAD parts as they exist digitally without the need to create expensive physical prototypes. The proposed method consists of a Virtual Reality (VR) system that combines voxel collision detection and boundary representation methods into a hybrid algorithm containing the necessary information for both force feedback and constraint recognition. The key to this approach will be successfully developing the data structure and logic needed to switch between collision detection and constraint recognition while maintaining a haptic refresh rate of 1000 Hz. VR is a set of unique technologies that support human-centered computer interaction. Experience with current VR systems that simulate low clearance assembly operations with haptic feedback indicate that such systems are highly desirable tools in the evaluation of preliminary designs, as well as virtual training and maintenance processes. This work will result in a novel interface for assembly methods prototyping, and an interface that will allow intuitive interaction with parts based on a powerful combination of analytical, visual and haptic tools

Scalability study for robotic hand platform

The goal of this thesis project was to determine the lower limit of scale for the RIT robotic grasping hand. This was accomplished using a combination of computer simulation and experimental studies. A force analysis was conducted to determine the size of air muscles required to achieve appropriate contact forces at a smaller scale. Input variables, such as the actuation force and tendon return force, were determined experimentally. A dynamic computer model of the hand system was then created using Recurdyn. This was used to predict the contact (grasping) force of the fingers at full-scale, half-scale, and quarter-scale. Correlation between the computer model and physical testing was achieved for both a life-size and half-scale finger assembly. To further demonstrate the scalability of the hand design, both half and quarter-scale robotic hand rapid prototype assemblies were built using 3D printing techniques. This thesis work identified the point where further miniaturization would require a change in the manufacturing process to micro-fabrication. Several techniques were compared as potential methods for making a production intent quarter-scale robotic hand. Investment casting, Swiss machining, and Selective Laser Sintering were the manufacturing techniques considered. A quarter-scale robotic hand tested the limits of each technology. Below this scale, micro-machining would be required. The break point for the current actuation method, air muscles, was also explored. Below the quarter-scale, an alternative actuation method would also be required. Electroactive Polymers were discussed as an option for the micro-scale. In summary, a dynamic model of the RIT robotic grasping hand was created and validated as scalable at full and half-scales. The model was then used to predict finger contact forces at the quarter-scale. The quarter-scale was identified as the break point in terms of the current RIT robotic grasping hand based on both manufacturing and actuation. A novel, prototype quarter-scale robotic hand assembly was successfully built by an additive manufacturing process, a high resolution 3D printer. However, further miniaturization would require alternate manufacturing techniques and actuation mechanisms

A Novel Minimally Invasive Tumour Localization Device

Lung cancer is one of the leading causes of death, by cancer. The usual treatment is surgical resection of tumours. However, patients who are weak or have poor pulmonary function are deemed unfit for surgery. For these patients, a minimally-invasive approach is desired. A major problem associated with minimally-invasive approaches is tumour localization in real time and accurate measurement of tool--tissue forces. This thesis describes the design, analysis, manufacturing and validation of a minimally-invasive instrument for tumour localization, named Palpatron. The instrument has an end effector that is able to support two previously designed jaws, one containing an ultrasound sensor and the other a tactile sensor. The jaws can move with two degrees of freedom to palpate tissue and rotate about the central axis of the instrument. The Palpatron has uncoupled jaw motion that allows for optimal alignment of sensors to improve data acquisition. The instrument can be easily assembled and disassembled allowing it to be cleaned and sterilized. The mechanism is articulated using push rods, each actuated by a motor. A semi-automatic control system was created for palpation. It is composed of a microcontroller that controls four motors via serial communication. In addition, the Palpatron has the ability to prevent tissue damage by measuring tool--tissue forces. Finite element analysis was used to guide material selection for designed components. Grade 5 titanium was selected for end effector links to provide a factor of safety of 1.2 against yielding under a 10 N point load at the tip of a jaw. The design was fabricated and validated by conducting experiments to test articulation and load carrying capacity. An 8-N force was applied to the instrument, which was successfully supported. The semi-automatic control system was used to perform basic maneuvering tasks to verify jaw motion capabilities. With positive testing results, the Palpatron forms the next step towards a comprehensive robotic-assisted palpation technology

Anthropomorphic surgical system for soft tissue robot-assisted surgery

Over the past century, abdominal surgery has seen a rapid transition from open procedures to less invasive methods such as laparoscopy and robot-assisted minimally invasive surgery (R-A MIS). These procedures have significantly decreased blood loss, postoperative morbidity and length of hospital stay in comparison with open surgery. R-A MIS has offered refined accuracy and more ergonomic instruments for surgeons, further minimising trauma to the patient.This thesis aims to investigate, design and prototype a novel system for R-A MIS that will provide more natural and intuitive manipulation of soft tissues and, at the same time, increase the surgeon's dexterity. The thesis reviews related work on surgical systems and discusses the requirements for designing surgical instrumentation. From the background research conducted in this thesis, it is clear that training surgeons in MIS procedures is becoming increasingly long and arduous. Furthermore, most available systems adopt a design similar to conventional laparoscopic instruments or focus on different techniques with debatable benefits. The system proposed in this thesis not only aims to reduce the training time for surgeons but also to improve the ergonomics of the procedure.In order to achieve this, a survey was conducted among surgeons, regarding their opinions on surgical training, surgical systems, how satisfied they are with them and how easy they are to use. A concept for MIS robotic instrumentation was then developed and a series of focus group meetings with surgeons were run to discuss it. The proposed system, named microAngelo, is an anthropomorphic master-slave system that comprises a three-digit miniature hand that can be controlled using the master, a three-digit sensory exoskeleton. While multi-fingered robotic hands have been developed for decades, none have been used for surgical operations. As the system has a human centred design, its relation to the human hand is discussed. Prototypes of both the master and the slave have been developed and their design and mechanisms is demonstrated. The accuracy and repeatability of the master as well as the accuracy and force capabilities of the slave are tested and discussed

Design, Development, and Evaluation of a Teleoperated Master-Slave Surgical System for Breast Biopsy under Continuous MRI Guidance

The goal of this project is to design and develop a teleoperated master-slave surgical system that can potentially assist the physician in performing breast biopsy with a magnetic resonance imaging (MRI) compatible robotic system. MRI provides superior soft-tissue contrast compared to other imaging modalities such as computed tomography or ultrasound and is used for both diagnostic and therapeutic procedures. The strong magnetic field and the limited space inside the MRI bore, however, restrict direct means of breast biopsy while performing real-time imaging. Therefore, current breast biopsy procedures employ a blind targeting approach based on magnetic resonance (MR) images obtained a priori. Due to possible patient involuntary motion or inaccurate insertion through the registration grid, such approach could lead to tool tip positioning errors thereby affecting diagnostic accuracy and leading to a long and painful process, if repeated procedures are required. Hence, it is desired to develop the aforementioned teleoperation system to take advantages of real-time MR imaging and avoid multiple biopsy needle insertions, improving the procedure accuracy as well as reducing the sampling errors. The design, implementation, and evaluation of the teleoperation system is presented in this dissertation. A MRI-compatible slave robot is implemented, which consists of a 1 degree of freedom (DOF) needle driver, a 3-DOF parallel mechanism, and a 2-DOF X-Y stage. This slave robot is actuated with pneumatic cylinders through long transmission lines except the 1-DOF needle driver is actuated with a piezo motor. Pneumatic actuation through long transmission lines is then investigated using proportional pressure valves and controllers based on sliding mode control are presented. A dedicated master robot is also developed, and the kinematic map between the master and the slave robot is established. The two robots are integrated into a teleoperation system and a graphical user interface is developed to provide visual feedback to the physician. MRI experiment shows that the slave robot is MRI-compatible, and the ex vivo test shows over 85%success rate in targeting with the MRI-compatible robotic system. The success in performing in vivo animal experiments further confirm the potential of further developing the proposed robotic system for clinical applications

Da Vinci Robot at Hospital Clinic. Haptic Devices and Performance in Robotic Tech

Treballs Finals de Grau d'Enginyeria Biomèdica. Facultat de Medicina i Ciències de la Salut. Universitat de Barcelona. Curs: 2020-2021. Director i Tutor: Manel Puig i VidalMinimally invasive surgery (MIS) is continuously evolving and improving its techniques due to the fact that is being more and more used given its numerous advantages, which may go from less pain and faster recovery to a better cosmetic outcome. A big advance in this technique has been the implementation of robotically assisted systems, which have loads of advantages as well. Nonetheless, they have some perks like the lack of tactile perception and loss of depth in the vision of the surgeon. Although clinicians have adopted some means to overcome these limitations, the lack of haptic feedback is still a big problem and it's frequent rupturing healthy tissues while suturing. Therefore, there is a huge urge and desire for the development of a robotically assisted surgical system that includes haptic feedback. The main goal of this project is to implement haptic feedback in a robotic arm to provide the surgeon with tactile perception during the interventions and therefore prevent damages to the patient

AN INTEGRATED AUGMENTED REALITY METHOD TO ASSEMBLY SIMULATION AND GUIDANCE

Ph.DDOCTOR OF PHILOSOPH

Haptics-Enabled Teleoperation for Robotics-Assisted Minimally Invasive Surgery

The lack of force feedback (haptics) in robotic surgery can be considered to be a safety risk leading to accidental tissue damage and puncturing of blood vessels due to excessive forces being applied to tissue and vessels or causing inefficient control over the instruments because of insufficient applied force. This project focuses on providing a satisfactory solution for introducing haptic feedback in robotics-assisted minimally invasive surgical (RAMIS) systems. The research addresses several key issues associated with the incorporation of haptics in a master-slave (teleoperated) robotic environment for minimally invasive surgery (MIS). In this project, we designed a haptics-enabled dual-arm (two masters - two slaves) robotic MIS testbed to investigate and validate various single-arm as well as dual-arm teleoperation scenarios. The most important feature of this setup is the capability of providing haptic feedback in all 7 degrees of freedom (DOF) required for RAMIS (3 translations, 3 rotations and pinch motion of the laparoscopic tool). The setup also enables the evaluation of the effect of replacing haptic feedback by other sensory cues such as visual representation of haptic information (sensory substitution) and the hypothesis that surgical outcomes may be improved by substituting or augmenting haptic feedback by such sensory cues