Robot ontologies for sensor- and Image-guided surgery

Robots and robotics are becoming more com- plex and flexible, due to technological advancement, improved sensing capabilities and machine intelligence. Service robots target a wide range of applications, relying on advanced Human–Robot Interaction. Medical robotics is becoming a leading application area within, and the number of surgical, rehabilitation and hospital assistance robots is rising rapidly. However, the complexity of the medical environment has been a major barrier, preventing a wider use of robotic technology, thus mostly teleoperated, human-in-the-loop control solutions emerged so far. Providing smarter and better medical robots requires a systematic approach in describing and translating human processes for the robots. It is believed that ontologies can bridge human cognitive understanding and robotic reasoning (machine intelligence). Besides, ontologies serve as a tool and method to assess the added value robotic technology brings into the medical environment. The purpose of this paper is to identify relevant ontology research in medical robotics, and to review the state-of-the art. It focuses on the surgical domain, fundamental terminology and interactions are described for two example applications in neurosurgery and orthopaedics

Recent trends, technical concepts and components of computer-assisted orthopedic surgery systems: A comprehensive review

Computer-assisted orthopedic surgery (CAOS) systems have become one of the most important and challenging types of system in clinical orthopedics, as they enable precise treatment of musculoskeletal diseases, employing modern clinical navigation systems and surgical tools. This paper brings a comprehensive review of recent trends and possibilities of CAOS systems. There are three types of the surgical planning systems, including: systems based on the volumetric images (computer tomography (CT), magnetic resonance imaging (MRI) or ultrasound images), further systems utilize either 2D or 3D fluoroscopic images, and the last one utilizes the kinetic information about the joints and morphological information about the target bones. This complex review is focused on three fundamental aspects of CAOS systems: their essential components, types of CAOS systems, and mechanical tools used in CAOS systems. In this review, we also outline the possibilities for using ultrasound computer-assisted orthopedic surgery (UCAOS) systems as an alternative to conventionally used CAOS systems.Web of Science1923art. no. 519

Ultrasound based navigation and control for orthopaedic robot surgery

Thesis approved in public session to obtain the PhD Degree in Mechanical Engineering. Universidade de Lisboa. Instituto Superior TécnicoA Robótica cirúrgica é uma área em expansão, contribuindo para o aumento da precisão e exatidão dos procedimentos cirúrgicos, além de produzir resultados mais confiáveis e reprodutíveis, minimizando a invasividade, reduzindo as complicações e melhorando a segurança dos pacientes, comparativamente com as técnicas convencionais. A navegação dentro da sala de operações é primordial para o sucesso dos sistemas robóticos. Neste contexto é proposto um novo sistema de navegação, usado na malha de controlo, de um sistema robótico co-manipulado, dedesenvolvido para auxiliar os cirurgiões ortopédicos. Embora possa ter outras aplicações, o sistema foi desenvolvido para realizar um furo na cabeça do fémur, necessário ao implante do fio guia na cirurgia de substituição parcial da anca. Durante a cirurgia, a posição e orientação do osso é obtida através de um processo de registo entre as imagens de US adquiridas em tempo real e o modelo CT do fémur, previamente carregado no pré-operatório. Contrariamente aos sistemas cirúrgicos atuais, não usa nenhum tipo de implante no osso para localizar o fémur, mas sim marcadores passivos colocados na sonda e no robô, e um sistema de medição óptico para medir as suas posições 3D. Os testes experimentais de validação foram realizados num phantom de um fémur humano.Abstract: Surgical Robotics is an expanding area, contributing to the increased precision and accuracy of surgical procedures, besides producing more reliable and reproducible results, minimizing the invasiveness, reducing complications and improving patient safety, compared with conventional techniques. Navigation within the operating room is fundamental to the success of robotic systems. In this context a new navigation system, used in the control loop, to co-manipulate a robotic system developed to assist orthopaedic surgeons, is proposed. Although it may have other applications, the system is designed to perform a hole in the femur head, necessary to implant the initial guide wire used in Hip Resurfacing surgery. During the surgery, the bone position and orientation is obtained through a registration process between a set of US images acquired in real time and the CT femur model, preloaded pre-operatively. Contrary to current surgical systems, it does not use any type of implant in the bone, to localize the femur, but passive markers, of an optical measurement system, placed on the probe and the robot to measure their 3D poses. Experimental validation tests were performed on a human’s femur phantom, validating the proposed system

Augmented reality for computer assisted orthopaedic surgery

In recent years, computer-assistance and robotics have established their presence in operating theatres and found success in orthopaedic procedures. Benefits of computer assisted orthopaedic surgery (CAOS) have been thoroughly explored in research, finding improvements in clinical outcomes, through increased control and precision over surgical actions. However, human-computer interaction in CAOS remains an evolving field, through emerging display technologies including augmented reality (AR) – a fused view of the real environment with virtual, computer-generated holograms. Interactions between clinicians and patient-specific data generated during CAOS are limited to basic 2D interactions on touchscreen monitors, potentially creating clutter and cognitive challenges in surgery. Work described in this thesis sought to explore the benefits of AR in CAOS through: an integration between commercially available AR and CAOS systems, creating a novel AR-centric surgical workflow to support various tasks of computer-assisted knee arthroplasty, and three pre–clinical studies exploring the impact of the new AR workflow on both existing and newly proposed quantitative and qualitative performance metrics. Early research focused on cloning the (2D) user-interface of an existing CAOS system onto a virtual AR screen and investigating any resulting impacts on usability and performance. An infrared-based registration system is also presented, describing a protocol for calibrating commercial AR headsets with optical trackers, calculating a spatial transformation between surgical and holographic coordinate frames. The main contribution of this thesis is a novel AR workflow designed to support computer-assisted patellofemoral arthroplasty. The reported workflow provided 3D in-situ holographic guidance for CAOS tasks including patient registration, pre-operative planning, and assisted-cutting. Pre-clinical experimental validation on a commercial system (NAVIO®, Smith & Nephew) for these contributions demonstrates encouraging early-stage results showing successful deployment of AR to CAOS systems, and promising indications that AR can enhance the clinician’s interactions in the future. The thesis concludes with a summary of achievements, corresponding limitations and future research opportunities.Open Acces

Medical robots with potential applications in participatory and opportunistic remote sensing: A review

Among numerous applications of medical robotics, this paper concentrates on the design, optimal use and maintenance of the related technologies in the context of healthcare, rehabilitation and assistive robotics, and provides a comprehensive review of the latest advancements in the foregoing field of science and technology, while extensively dealing with the possible applications of participatory and opportunistic mobile sensing in the aforementioned domains. The main motivation for the latter choice is the variety of such applications in the settings having partial contributions to functionalities such as artery, radiosurgery, neurosurgery and vascular intervention. From a broad perspective, the aforementioned applications can be realized via various strategies and devices benefiting from detachable drives, intelligent robots, human-centric sensing and computing, miniature and micro-robots. Throughout the paper tens of subjects, including sensor-fusion, kinematic, dynamic and 3D tissue models are discussed based on the existing literature on the state-of-the-art technologies. In addition, from a managerial perspective, topics such as safety monitoring, security, privacy and evolutionary optimization of the operational efficiency are reviewed

Computer assisted orthopaedic surgery : past, present and future

Computer technology is ubiquitous and relied upon in virtually all professional activities including neurosurgery, which is why it is surprising that it is not the case for orthopaedic surgery with fewer than 5% of surgeons using available computer technology in their procedures. In this review, we explore the evolution and background of Computer Assisted Orthopaedic Surgery (CAOS), delving into the basic principles behind the technology and the changes in the discussion on the subject throughout the years and the impact these discussions had on the field. We found evidence that industry had an important role in driving the discussion at least in knee arthroplasty-a leading field of CAOS-with the ratio between patents and publications increased from approximately 1:10 in 2004 to almost 1:3 in 2014. The adoption of CAOS is largely restrained by economics and ergonomics with sceptics challenging the accuracy and precision of navigation during the early years of CAOS moving to patient functional improvements and long term survivorship. Nevertheless, the future of CAOS remains positive with the prospect of new technologies such as improvements in image-guided surgery, enhanced navigation systems, robotics and artificial intelligence

Development and Implementation of a Computational Modeling Tool for Evaluation of THA Component Position

The human body is a complicated structure with muscles, ligaments, bones, and joints. Modeling human body with computational tools are becoming a trend [1]. More importantly, using computational tools to evaluate human body is a non-invasive technique that could help surgeons and researchers evaluate implant products [2]. Therefore, the development of a model which can analyze both implant sizing suggestion and kinematics of subject specific data could prove valuable. For total hip arthroplasty, one common complication is in vivo separation and dislocation of the femoral head within the acetabular cup [3] [4]. Developing a successful computational tool to address this issue includes developing a dynamic model of hip joint, implementing implant sizing suggestion algorithms and computing component alignments. Due to advancement in technology, the current focus has been to develop patient-specific solutions, a combined program of both hip model and implant suggestion model has been developed. In this dissertation, the primary objective is to develop a fully functional hip analysis software that not only can suggestion and template the implant sizing and position, but the software can also utilize the patient specific data to run simulation with different activities. The second objective of this dissertation is to conduct hip analysis studies using hip analysis software. Overall, the results in this dissertation discuss the effect of different stem positions and surgeon preferences on the outcome of the Total Hip Arthroplasty

Proceedings of the 1st Standardized Knowledge Representation and Ontologies for Robotics and Automation Workshop

Welcome to IEEE-ORA (Ontologies for Robotics and Automation) IROS workshop. This is the 1st edition of the workshop on! Standardized Knowledge Representation and Ontologies for Robotics and Automation. The IEEE-ORA 2014 workshop was held on the 18th September, 2014 in Chicago, Illinois, USA. In!the IEEE-ORA IROS workshop, 10 contributions were presented from 7 countries in North and South America, Asia and Europe. The presentations took place in the afternoon, from 1:30 PM to 5:00 PM. The first session was dedicated to “Standards for Knowledge Representation in Robotics”, where presentations were made from the IEEE working group standards for robotics and automation, and also from the ISO TC 184/SC2/WH7. The second session was dedicated to “Core and Application Ontologies”, where presentations were made for core robotics ontologies, and also for industrial and robot assisted surgery ontologies. Three posters were presented in emergent applications of ontologies in robotics. We would like to express our thanks to all participants. First of all to the authors, whose quality work is the essence of this workshop. Next, to all the members of the international program committee, who helped us with their expertise and valuable time. We would also like to deeply thank the IEEE-IROS 2014 organizers for hosting this workshop. Our deep gratitude goes to the IEEE Robotics and Automation Society, that sponsors! the IEEE-ORA group activities, and also to the scientific organizations that kindly agreed to sponsor all the workshop authors work

The Effect of Robotic Technology on Perioperative Outcomes in Total Knee Arthroplasty

Introduction Robotic technology has recently regained momentum in total knee arthroplasty (TKA) but the effects of this technology on accuracy of implant positioning, intraoperative soft tissue injury and postoperative functional rehabilitation remain unknown. The objectives of this research thesis were to compare a comprehensive range of radiological objectives and perioperative outcomes in conventional jig-based TKA versus robotic-arm assisted TKA, and use optical motion capture technology to quantify the effects of anterior cruciate ligament (ACL) and posterior cruciate ligament (PCL) resection on knee biomechanics. Methods A series of prospective cohort studies were undertaken in patients with established knee osteoarthritis undergoing primary conventional jig-based TKA versus robotic-arm assisted TKA. Predefined radiological and perioperative study outcomes were recorded by independent observers. Optical motion capture technology during robotic TKA was used to quantify the effects of ACL and PCL resection on knee biomechanics. Results Robotic-arm assisted TKA was associated with improved accuracy of implant positioning, reduced periarticular soft tissue injury, decreased bone trauma, improved postoperative functional rehabilitation, and reduced early systemic inflammatory response compared to conventional jig-based TKA. The Macroscopic Soft Tissue Injury (MASTI) classification system was developed and validated for grading intraoperative periarticular soft tissue injury and bone trauma during TKA. ACL resection created flexion-extension mismatch by increasing the extension gap more than the flexion gap, whilst PCL resection increased the flexion gap proportionally more than the extension gap and created mediolateral laxity in knee flexion but not in extension. Conclusion Robotic-arm assisted TKA was associated with increased accuracy of implant positioning, reduced iatrogenic soft tissue injury, and improved functional rehabilitation compared to conventional jig-based TKA. ACL and PCL resections created unique changes in knee biomechanics that affected flexion-extension gaps and mediolateral soft tissue tension during TKA. On the basis of this thesis, further clinical trials have been established to determine the long-term clinical significance of these findings

Personalized Hip and Knee Joint Replacement

This open access book describes and illustrates the surgical techniques, implants, and technologies used for the purpose of personalized implantation of hip and knee components. This new and flourishing treatment philosophy offers important benefits over conventional systematic techniques, including component positioning appropriate to individual anatomy, improved surgical reproducibility and prosthetic performance, and a reduction in complications. The techniques described in the book aim to reproduce patients’ native anatomy and physiological joint laxity, thereby improving the prosthetic hip/knee kinematics and functional outcomes in the quest of the forgotten joint. They include kinematically aligned total knee/total hip arthroplasty, partial knee replacement, and hip resurfacing. The relevance of available and emerging technological tools for these personalized approaches is also explained, with coverage of, for example, robotics, computer-assisted surgery, and augmented reality. Contributions from surgeons who are considered world leaders in diverse fields of this novel surgical philosophy make this open access book will invaluable to a wide readership, from trainees at all levels to consultants practicing lower limb surger