Development of a cognitive robotic system for simple surgical tasks

The introduction of robotic surgery within the operating rooms has significantly improved the quality of many surgical procedures. Recently, the research on medical robotic systems focused on increasing the level of autonomy in order to give them the possibility to carry out simple surgical actions autonomously. This paper reports on the development of technologies for introducing automation within the surgical workflow. The results have been obtained during the ongoing FP7 European funded project Intelligent Surgical Robotics (I-SUR). The main goal of the project is to demonstrate that autonomous robotic surgical systems can carry out simple surgical tasks effectively and without major intervention by surgeons. To fulfil this goal, we have developed innovative solutions (both in terms of technologies and algorithms) for the following aspects: fabrication of soft organ models starting from CT images, surgical planning and execution of movement of robot arms in contact with a deformable environment, designing a surgical interface minimizing the cognitive load of the surgeon supervising the actions, intra-operative sensing and reasoning to detect normal transitions and unexpected events. All these technologies have been integrated using a component-based software architecture to control a novel robot designed to perform the surgical actions under study. In this work we provide an overview of our system and report on preliminary results of the automatic execution of needle insertion for the cryoablation of kidney tumours

A Cognitive Robot Control Architecture for Autonomous Execution of Surgical Tasks

The research on medical robotics is starting to address the autonomous execution of surgical tasks, without effective intervention of humans apart from supervision and task configuration. This paper addresses the complete automation of a surgical robot by combining advanced sensing, cognition and control capabilities, developed according to rigorous assessment of surgical require- ments, formal specification of robotic system behavior and software design and implementation based on solid tools and frame- works. In particular, the paper focuses on the cognitive control architecture and its development process, based on formal modeling and verification methods as best practices to ensure safe and reliable behavior. Full implementation of the proposed architecture has been tested on an experimental setup including a novel robot specifically designed for surgical applications, but adaptable to different selected tasks (i.e. needle insertion, wound suturing)

CO-ROBOTIC ULTRASOUND IMAGING: A COOPERATIVE FORCE CONTROL APPROACH

Ultrasound (US) imaging remains one of the most commonly used imaging modalities in medical practice due to its low cost and safety. However, 63-91% of ultrasonographers develop musculoskeletal disorders due to the effort required to perform imaging tasks. Robotic ultrasound (RUS), the application of robotic systems to assist ultrasonographers in ultrasound scanning procedures, has been proposed in literature and recently deployed in clinical settings using limited degree-of-freedom (DOF) systems. An example of this includes breast-scanning systems, which allow one-DOF translation of a large ultrasound array in order to capture patients’ breast scans and minimize sonographer effort while preserving a desired clinical outcome. Recently, the robotic industry has evolved to provide light-weight, compact, accurate, and cost-effective manipulators. We leverage this new reality in able to provide ultrasonographers with a full 6-DOF system that provides force assistance to facilitate US image acquisition. Admittance robot control allows for smooth human-machine interaction in a desired task. In the case of RUS, force control is capable of assisting sonographers in facilitating and even improving the imaging results of typical procedures. We propose a new system setup for collaborative force control in US applications. This setup consists of the 6-DOF UR5 industrial robot, and a 6-axes force sensor attached to the robot tooltip, which in turn has an US probe attached to it through a custom-designed probe attachment mechanism. Additionally, an independent one-axis load cell is placed inside this attachment device and used to measure the contact force between the probe and the patient’s anatomy in real time and independent of any other forces. As the sonographer guides the US probe, the robot collaborates with the hand motions, following the path of the user. When imaging, the robot can offer assistance to the sonographer by augmenting the forces applied by him or her, thereby lessening the physical effort required as well as the resulting strain. Additional benefits include force and velocity limiting for patient safety and robot motion constraints for particular imaging tasks. Initial results of a conducted user study show the feasibility of implementing the presented robot-assisted system in a clinical setting

Recent advances in robot-assisted echography: Combining perception, control and cognition

Echography imaging is an important technique frequently used in medical diagnostics due to low-cost, non-ionising characteristics, and pragmatic convenience. Due to the shortage of skilful technicians and injuries of physicians sustained from diagnosing several patients, robot-assisted echography (RAE) system is gaining great attention in recent decades. A thorough study of the recent research advances in the field of perception, control and cognition techniques used in RAE systems is presented in this study. This survey introduces the representative system structure, applications and projects, and products. Challenges and key technological issues faced by the traditional RAE system and how the current artificial intelligence and cobots attempt to overcome these issues are summarised. Furthermore, significant future research directions in this field have been identified by this study as cognitive computing, operational skills transfer, and commercially feasible system design

Medical robots with potential applications in participatory and opportunistic remote sensing: A review

Among numerous applications of medical robotics, this paper concentrates on the design, optimal use and maintenance of the related technologies in the context of healthcare, rehabilitation and assistive robotics, and provides a comprehensive review of the latest advancements in the foregoing field of science and technology, while extensively dealing with the possible applications of participatory and opportunistic mobile sensing in the aforementioned domains. The main motivation for the latter choice is the variety of such applications in the settings having partial contributions to functionalities such as artery, radiosurgery, neurosurgery and vascular intervention. From a broad perspective, the aforementioned applications can be realized via various strategies and devices benefiting from detachable drives, intelligent robots, human-centric sensing and computing, miniature and micro-robots. Throughout the paper tens of subjects, including sensor-fusion, kinematic, dynamic and 3D tissue models are discussed based on the existing literature on the state-of-the-art technologies. In addition, from a managerial perspective, topics such as safety monitoring, security, privacy and evolutionary optimization of the operational efficiency are reviewed

Design of a Hand Held Minimally Invasive Lung Tumour Localization Device

Lung cancer is the leading type of cancer that causes death. If diagnosed, the treatment of choice is surgical resection of the tumour. Traditionally, a surgeon feels for the presence of a tumour in open thoracic surgery. However, a minimally invasive approach is desired. A major problem presented by the minimally invasive approach is the localization of the tumour. This project describes the design, analysis, and experimental validation of a novel minimally invasive instrument for lung tumour localization. The instrument end effector is a two degree of freedom lung tissue palpator. It allows for optimal tissue palpation to increase useful sensor feedback by ensuring sensor contact, and prevents tissue damage by uniformly distributing pressure on the tissue with an upper bound force. Finite element analysis was used extensively to guide the design process. The mechanism is actuated using high strength tungsten cables attached to controlled motors. Heat treatment experiments were undertaken with stainless steel alloy 440C for use in the design, achieving a device factor of safety of 4. This factor of safety is based on a 20 N force on the end effector — the approximate weight of a human lung. The design was prototyped and validation experiments were carried out to assess its articulation and its load carrying capacity. Up to 10 N of force was applied to the prototype. Issues to resolve in the current design include cable extension effects and the existence of joint inflection. The end effector was also designed to allow the inclusion of ultrasound, tactile, and kinaesthetic sensors. It is hypothesized that a plurality of sensors will increase the likelihood of positive tumour localization. These sensors, combined with the presented mechanical design, form the basis for research in robotics-assisted palpation. A proof of concept control system is presented for automated palpation

NASA Technology Applications Team: Commercial applications of aerospace technology

The Research Triangle Institute (RTI) Team has maintained its focus on helping NASA establish partnerships with U.S. industry for dual use development and technology commercialization. Our emphasis has been on outcomes, such as licenses, industry partnerships and commercialization of technologies, that are important to NASA in its mission of contributing to the improved competitive position of U.S. industry. The RTI Team has been successful in the development of NASA/industry partnerships and commercialization of NASA technologies. RTI ongoing commitment to quality and customer responsiveness has driven our staff to continuously improve our technology transfer methodologies to meet NASA's requirements. For example, RTI has emphasized the following areas: (1) Methodology For Technology Assessment and Marketing: RTI has developed and implemented effective processes for assessing the commercial potential of NASA technologies. These processes resulted from an RTI study of best practices, hands-on experience, and extensive interaction with the NASA Field Centers to adapt to their specific needs. (2) Effective Marketing Strategies: RTI surveyed industry technology managers to determine effective marketing tools and strategies. The Technology Opportunity Announcement format and content were developed as a result of this industry input. For technologies with a dynamic visual impact, RTI has developed a stand-alone demonstration diskette that was successful in developing industry interest in licensing the technology. And (3) Responsiveness to NASA Requirements: RTI listened to our customer (NASA) and designed our processes to conform with the internal procedures and resources at each NASA Field Center and the direction provided by NASA's Agenda for Change. This report covers the activities of the Research Triangle Institute Technology Applications Team for the period 1 October 1993 through 31 December 1994

NASA Technology Applications Team: Commercial applications of aerospace technology

The Research Triangle Institute (RTI) is pleased to report the results of NASA contract NASW-4367, 'Operation of a Technology Applications Team'. Through a period of significant change within NASA, the RTI Team has maintained its focus on helping NASA establish partnerships with U.S. industry for dual use development and technology commercialization. Our emphasis has been on outcomes, such as licenses, industry partnerships and commercialization of technologies that are important to NASA in its mission of contributing to the improved competitive position of U.S. industry. RTI's ongoing commitment to quality and customer responsiveness has driven our staff to continuously improve our technology transfer methodologies to meet NASA's requirements. For example, RTI has emphasized the following areas: (1) Methodology For Technology Assessment and Marketing: RTI has developed an implemented effective processes for assessing the commercial potential of NASA technologies. These processes resulted from an RTI study of best practices, hands-on experience, and extensive interaction with the NASA Field Centers to adapt to their specific needs; (2) Effective Marketing Strategies: RTI surveyed industry technology managers to determine effective marketing tools and strategies. The Technology Opportunity Announcement format and content were developed as a result of this industry input. For technologies with a dynamic visual impact, RTI has developed a stand-alone demonstration diskette that was successful in developing industry interest in licensing the technology; and (3) Responsiveness to NASA Requirements: RTI listened to our customer (NASA) and designed our processes to conform with the internal procedures and resources at each NASA Field Center and the direction provided by NASA's Agenda for Change. This report covers the activities of the Research Triangle Institute Technology Applications Team for the period 1 October 1993 through 31 December 1994