System integration of a fluoroscopic image calibration using robot assisted surgical guidance for distal locking process in closed intramedullary nailing of femur

Distal locking procedure is one of the most complex tasks in close intramedullary nailing operation which requires fluoroscopic image to interpret 2-D distal locking position on image related to 3-D distal locking position on the patient site. Hence the surgeon has to perform the distal locking process by using multiple fluoroscopic images which causes a lot of x-ray exposure to the patient and surgeon and is a time consuming task. This paper presents the system integration of a fluoroscopic image calibration using robot assisted surgical guidance. The system integration consists of three parts; distal locking recovery, fluoroscopic calibration and tracking, and robot assisted surgical guidance. The distal locking-hole recovery algorithm is based on characteristic information of the major and minor axes of distal locking hole. The fluoroscopic calibration and tracking is modeled as pin-hole projection model to estimate a projection equation based on optical tracking system. The robot-assisted surgical guidance is developed to overlay a trajectory path using a laser beam for reducing the problem of hand – eye coordination on most surgical navigation system. We integrate each part to complete a surgical navigation system for distal locking process. The experiment of system integration is conducted to validate the accuracy of distal locking axis position and orientation. The results of the system integration shows a mean angular error of 1.10 and mean Euclidean distance in X-Y plane error of 3.65 mm

Diffuse reflectance spectroscopy-enhanced drill for bone boundary detection

Intramedullary nailing is a routine orthopedic procedure used for treating fractures of femoral or tibial shafts. A critical part of this procedure involves the drilling of pilot holes in both ends of the bone for the placement of the screws that will secure the IM rod to sections of the fractured bone. This step introduces a risk of soft tissue damage because the drill bit, if not stopped in time, can transverse the bone-tissue boundary into the overlying muscle, causing unnecessary injury and prolonging healing time due to periosteum damage. In this respect, detecting the bone-tissue boundary before break-through can reduce the risks and complications associated with intramedullary nailing. Hence, in the present study, a two-wavelength diffuse reflectance spectroscopy technique was integrated into a surgical drill to optically detect bone-tissue boundary and automatically trigger the drill to stop. Furthermore, Monte-Carlo simulations were used to estimate the maximum distance from within the bone at which the bone-tissue boundary could be detected using DRS. The simulation results estimated that the detection distance, termed the “look-ahead-distance” was ∼1.5 mm for 1.3 mm source-detector fiber separation. Experimental measurements with 1.3 mm source-detector fiber separation showed that the look-ahead-distance was in the order of 250 µm in experiments with set drill rate and in the range of 1 mm in experiments where the holes were drilled by hand. Despite this difference, the automated DRS enhanced drill successfully detected the approaching bone tissue boundary when tested on samples of bovine femur and muscle tissue

Radiation-free imaging for distal hole targeting in Intramedullary nailing

Orthopedic surgeons are routinely faced with long-bone fractures. Their preferred surgical procedure for dealing with such cases is Intra-Medullary Nailing (IMN). The aforementioned surgery usually involves alignment of the fractured fragments of the long-bone followed by the insertion of a nail down its medullary canal. To prevent displacement of bone fragments, locking screws are inserted through the proximal and distal bone fragments into holes located at the proximal and distal regions of the nail. The most challenging part of IMN surgery is the location of the two distal holes of the nail after insertion, termed distal hole targeting. To find the exact location of the distal holes, several methods have been developed. The most popular method is the free-hand technique which involves the acquisition of radiographic images of the bone and nail to find the holes. The objective of this thesis is to review the current state of the art regarding distal hole targeting and investigate the possibility of developing an alternative imaging technique for finding the distal holes that will be free of ionizing radiation. More specifically, this work concentrates on characterizing the suitability of Earth’s Field Nuclear Magnetic Resonance (EFNMR) for this particular application. The characterization of this imaging method is performed through a series of experiments. The investigated solution poses several major challenges like contrast between different regions, time consumption, and detecting NMR signals in less than 19 ml water volume. The first two problems are resolved by using a contrast agent, Copper (II) Sulfate (CuSO4), which decreases the relaxation time by 6-7 times. In effect, this has decreased the experimental time. For instance, the experimental time was reduced from 8.32 min to 1.36 min. For the third challenge where the target is to detect the signal for 1.8 ml, all the proposed solutions have not worked as expected

Medical Robotics

The first generation of surgical robots are already being installed in a number of operating rooms around the world. Robotics is being introduced to medicine because it allows for unprecedented control and precision of surgical instruments in minimally invasive procedures. So far, robots have been used to position an endoscope, perform gallbladder surgery and correct gastroesophogeal reflux and heartburn. The ultimate goal of the robotic surgery field is to design a robot that can be used to perform closed-chest, beating-heart surgery. The use of robotics in surgery will expand over the next decades without any doubt. Minimally Invasive Surgery (MIS) is a revolutionary approach in surgery. In MIS, the operation is performed with instruments and viewing equipment inserted into the body through small incisions created by the surgeon, in contrast to open surgery with large incisions. This minimizes surgical trauma and damage to healthy tissue, resulting in shorter patient recovery time. The aim of this book is to provide an overview of the state-of-art, to present new ideas, original results and practical experiences in this expanding area. Nevertheless, many chapters in the book concern advanced research on this growing area. The book provides critical analysis of clinical trials, assessment of the benefits and risks of the application of these technologies. This book is certainly a small sample of the research activity on Medical Robotics going on around the globe as you read it, but it surely covers a good deal of what has been done in the field recently, and as such it works as a valuable source for researchers interested in the involved subjects, whether they are currently “medical roboticists” or not

Augmented Reality and Artificial Intelligence in Image-Guided and Robot-Assisted Interventions

In minimally invasive orthopedic procedures, the surgeon places wires, screws, and surgical implants through the muscles and bony structures under image guidance. These interventions require alignment of the pre- and intra-operative patient data, the intra-operative scanner, surgical instruments, and the patient. Suboptimal interaction with patient data and challenges in mastering 3D anatomy based on ill-posed 2D interventional images are essential concerns in image-guided therapies. State of the art approaches often support the surgeon by using external navigation systems or ill-conditioned image-based registration methods that both have certain drawbacks. Augmented reality (AR) has been introduced in the operating rooms in the last decade; however, in image-guided interventions, it has often only been considered as a visualization device improving traditional workflows. Consequently, the technology is gaining minimum maturity that it requires to redefine new procedures, user interfaces, and interactions. This dissertation investigates the applications of AR, artificial intelligence, and robotics in interventional medicine. Our solutions were applied in a broad spectrum of problems for various tasks, namely improving imaging and acquisition, image computing and analytics for registration and image understanding, and enhancing the interventional visualization. The benefits of these approaches were also discovered in robot-assisted interventions. We revealed how exemplary workflows are redefined via AR by taking full advantage of head-mounted displays when entirely co-registered with the imaging systems and the environment at all times. The proposed AR landscape is enabled by co-localizing the users and the imaging devices via the operating room environment and exploiting all involved frustums to move spatial information between different bodies. The system's awareness of the geometric and physical characteristics of X-ray imaging allows the exploration of different human-machine interfaces. We also leveraged the principles governing image formation and combined it with deep learning and RGBD sensing to fuse images and reconstruct interventional data. We hope that our holistic approaches towards improving the interface of surgery and enhancing the usability of interventional imaging, not only augments the surgeon's capabilities but also augments the surgical team's experience in carrying out an effective intervention with reduced complications

Augmented reality for computer assisted orthopaedic surgery

In recent years, computer-assistance and robotics have established their presence in operating theatres and found success in orthopaedic procedures. Benefits of computer assisted orthopaedic surgery (CAOS) have been thoroughly explored in research, finding improvements in clinical outcomes, through increased control and precision over surgical actions. However, human-computer interaction in CAOS remains an evolving field, through emerging display technologies including augmented reality (AR) – a fused view of the real environment with virtual, computer-generated holograms. Interactions between clinicians and patient-specific data generated during CAOS are limited to basic 2D interactions on touchscreen monitors, potentially creating clutter and cognitive challenges in surgery. Work described in this thesis sought to explore the benefits of AR in CAOS through: an integration between commercially available AR and CAOS systems, creating a novel AR-centric surgical workflow to support various tasks of computer-assisted knee arthroplasty, and three pre–clinical studies exploring the impact of the new AR workflow on both existing and newly proposed quantitative and qualitative performance metrics. Early research focused on cloning the (2D) user-interface of an existing CAOS system onto a virtual AR screen and investigating any resulting impacts on usability and performance. An infrared-based registration system is also presented, describing a protocol for calibrating commercial AR headsets with optical trackers, calculating a spatial transformation between surgical and holographic coordinate frames. The main contribution of this thesis is a novel AR workflow designed to support computer-assisted patellofemoral arthroplasty. The reported workflow provided 3D in-situ holographic guidance for CAOS tasks including patient registration, pre-operative planning, and assisted-cutting. Pre-clinical experimental validation on a commercial system (NAVIO®, Smith & Nephew) for these contributions demonstrates encouraging early-stage results showing successful deployment of AR to CAOS systems, and promising indications that AR can enhance the clinician’s interactions in the future. The thesis concludes with a summary of achievements, corresponding limitations and future research opportunities.Open Acces

Flexible robotic device for spinal surgery

Surgical robots have proliferated in recent years, with well-established benefits including: reduced patient trauma, shortened hospitalisation, and improved diagnostic accuracy and therapeutic outcome. Despite these benefits, many challenges in their development remain, including improved instrument control and ergonomics caused by rigid instrumentation and its associated fulcrum effect. Consequently, it is still extremely challenging to utilise such devices in cases that involve complex anatomical pathways such as the spinal column. The focus of this thesis is the development of a flexible robotic surgical cutting device capable of manoeuvring around the spinal column. The target application of the flexible surgical tool is the removal of cancerous tumours surrounding the spinal column, which cannot be excised completely using the straight surgical tools in use today; anterior and posterior sections of the spine must be accessible for complete tissue removal. A parallel robot platform with six degrees of freedom (6 DoFs) has been designed and fabricated to direct a flexible cutting tool to produce the necessary range of movements to reach anterior and posterior sections of the spinal column. A flexible water jet cutting system and a flexible mechanical drill, which may be assembled interchangeably with the flexible probe, have been developed and successfully tested experimentally. A model predicting the depth of cut by the water jet was developed and experimentally validated. A flexion probe that is able to guide the surgical cutting device around the spinal column has been fabricated and tested with human lumber model. Modelling and simulations show the capacity for the flexible surgical system to enable entering the posterior side of the human lumber model and bend around the vertebral body to reach the anterior side of the spinal column. A computer simulation with a full Graphical User Interface (GUI) was created and used to validate the system of inverse kinematic equations for the robot platform. The constraint controller and the inverse kinematics relations are both incorporated into the overall positional control structure of the robot, and have successfully established a haptic feedback controller for the 6 DoFs surgical probe, and effectively tested in vitro on spinal mock surgery. The flexible surgical system approached the surgery from the posterior side of the human lumber model and bend around the vertebral body to reach the anterior side of the spinal column. The flexible surgical robot removed 82% of mock cancerous tissue compared to 16% of tissue removed by the rigid tool.Open Acces