Macrobend optical sensing for pose measurement in soft robot arms

This paper introduces a pose-sensing system for soft robot arms integrating a set of macrobend stretch sensors. The macrobend sensory design in this study consists of optical fibres and is based on the notion that bending an optical fibre modulates the intensity of the light transmitted through the fibre. This sensing method is capable of measuring bending, elongation and compression in soft continuum robots and is also applicable to wearable sensing technologies, e.g. pose sensing in the wrist joint of a human hand. In our arrangement, applied to a cylindrical soft robot arm, the optical fibres for macrobend sensing originate from the base, extend to the tip of the arm, and then loop back to the base. The connectors that link the fibres to the necessary opto-electronics are all placed at the base of the arm, resulting in a simplified overall design. The ability of this custom macrobend stretch sensor to flexibly adapt its configuration allows preserving the inherent softness and compliance of the robot which it is installed on. The macrobend sensing system is immune to electrical noise and magnetic fields, is safe (because no electricity is needed at the sensing site), and is suitable for modular implementation in multi-link soft continuum robotic arms. The measurable light outputs of the proposed stretch sensor vary due to bend-induced light attenuation (macrobend loss), which is a function of the fibre bend radius as well as the number of repeated turns. The experimental study conducted as part of this research revealed that the chosen bend radius has a far greater impact on the measured light intensity values than the number of turns (if greater than five). Taking into account that the bend radius is the only significantly influencing design parameter, the macrobend stretch sensors were developed to create a practical solution to the pose sensing in soft continuum robot arms. Henceforward, the proposed sensing design was benchmarked against an electromagnetic tracking system (NDI Aurora) for validation

A Contact Force Sensor based on S-shaped Beams and Optoelectronic Sensors for Flexible Manipulators for Minimally Invasive Surgery (MIS)

Flexible, highly articulated robotic tools can greatly facilitate procedures in which the operator needs to access small openings and confined spaces. Particularly, in the context of robotic-assisted minimally invasive surgery (RMIS), the application of such manipulation tools can be significantly beneficial in preventing unnecessary interactions with sensitive body organs by which reducing patient’s recovery time when compared with conventional methods. However, these systems usually lack tactile feedback and are not able to perceive and quantify the interactions between themselves and soft body organs. This deficiency may result in damaging the organs due to unwanted excessive force applied. To this end, we introduce a contact force sensor based on three 'dyadic-S-shaped' beams and three optoelectronic sensors. The modular design of a flexible manipulation system described as part of this paper allows ready integration of a series of the proposed sensors within its structure. The sensor uses our novel sensing principle for measuring contact forces. The strategic employment of custom sensor structure and the optoelectronic components fulfill our design objectives which has been focused on the creation of a modular, low-cost, low-noise (electrically) with large voltage variation, without the need for an amplifier, through a simple fabrication process for MIS. Our experimental results, following a very simple calibration processes show the average errors of Fx (+19.37%±0.82, -18.32%±2.06) and Fy (+18.56%±1.69, -17.00%±1.32), and the average RMS errors of Fx (0.12N±0.0067) and Fy (0.11N±0.0032) in the measurement of force values within the range of -4 to 4 N

A Multi-physics Planning Paradigm for Robot Assisted Orthopaedic Surgery

Osteoporosis or severe reduction in bone mineral density is a disease that primarily affects elderly people. Osteoporotic hip fracture rates increase exponentially with age in both men and women. In addition to the high mortality rate for those sustaining such fractures, less than half of the survivors return to their pre-fracture status concerning the quality of daily living. Augmentation of the proximal femur with Polymethylmethacrylate (PMMA) bone cement (femoroplasty) has been identified as a potential preventive approach to reduce the risk of fracture. Femoroplasty, however, is associated with a risk of thermal damage as well as the leakage of cement or blockage of blood supply when large volumes of PMMA are introduced inside the bone. Several recent studies have proposed injection strategies to reduce the injection volume in simulations. This thesis describes the methods and tools developed for multi-physics planning and the execution of femoroplasty. To this end, computational models are developed to simulate how bone augmentation affects the biomechanical properties of the bone. These models are used to plan femoropasty for cadaveric specimens and showed the superiority of planned-based augmentation over generic injection strategies. Experimental tests confirmed the findings of simulations and showed a significant increase in fracture-related biomechanical properties of the augmented compared to those left intact. In addition to biomechanical studies for femoroplasty, a heat-transfer model was developed to estimate bone temperatures during augmentation. Furthermore, a curved injection strategy was introduced and validated in simulations. These developments and modeling capabilities can be extended to various augmentation surgeries including vertebroplasty and core decompression

Multi-objective particle swarm optimization for the structural design of concentric tube continuum robots for medical applications

Concentric tube robots belong to the class of continuum robotic systems whose morphology is described by continuous tangent curvature vectors. They are composed of multiple, interacting tubes nested inside one another and are characterized by their inherent flexibility. Concentric tube continuum robots equipped with tools at their distal end have high potential in minimally invasive surgery. Their morphology enables them to reach sites within the body that are inaccessible with commercial tools or that require large incisions. Further, they can be deployed through a tight lumen or follow a nonlinear path. Fundamental research has been the focus during the last years bringing them closer to the operating room. However, there remain challenges that require attention. The structural synthesis of concentric tube continuum robots is one of these challenges, as these types of robots are characterized by their large parameter space. On the one hand, this is advantageous, as they can be deployed in different patients, anatomies, or medical applications. On the other hand, the composition of the tubes and their design is not a straightforward task but one that requires intensive knowledge of anatomy and structural behavior. Prior to the utilization of such robots, the composition of tubes (i.e. the selection of design parameters and application-specific constraints) must be solved to determine a robotic design that is specifically targeted towards an application or patient. Kinematic models that describe the change in morphology and complex motion increase the complexity of this synthesis, as their mathematical description is highly nonlinear. Thus, the state of the art is concerned with the structural design of these types of robots and proposes optimization algorithms to solve for a composition of tubes for a specific patient case or application. However, existing approaches do not consider the overall parameter space, cannot handle the nonlinearity of the model, or multiple objectives that describe most medical applications and tasks. This work aims to solve these fundamental challenges by solving the parameter optimization problem by utilizing a multi-objective optimization algorithm. The main concern of this thesis is the general methodology to solve for patient- and application-specific design of concentric tube continuum robots and presents key parameters, objectives, and constraints. The proposed optimization method is based on evolutionary concepts that can handle multiple objectives, where the set of parameters is represented by a decision vector that can be of variable dimension in multidimensional space. Global optimization algorithms specifically target the constrained search space of concentric tube continuum robots and nonlinear optimization enables to handle the highly nonlinear elasticity modeling. The proposed methodology is then evaluated based on three examples that include cooperative task deployment of two robotic arms, structural stiffness optimization under the consideration of workspace constraints and external forces, and laser-induced thermal therapy in the brain using a concentric tube continuum robot. In summary, the main contributions are 1) the development of an optimization methodology that describes the key parameters, objectives, and constraints of the parameter optimization problem of concentric tube continuum robots, 2) the selection of an appropriate optimization algorithm that can handle the multidimensional search space and diversity of the optimization problem with multiple objectives, and 3) the evaluation of the proposed optimization methodology and structural synthesis based on three real applications

Design, Modeling and Control of Micro-scale and Meso-scale Tendon-Driven Surgical Robots

Manual manipulation of passive surgical tools is time consuming with uncertain results in cases of navigating tortuous anatomy, avoiding critical anatomical landmarks, and reaching targets not located in the linear range of these tools. For example, in many cardiovascular procedures, manual navigation of a micro-scale passive guidewire results in increased procedure times and radiation exposure. This thesis introduces the design of two steerable guidewires: 1) A two degree-of-freedom (2-DoF) robotic guidewire with orthogonally oriented joints to access points in a three dimensional workspace, and 2) a micro-scale coaxially aligned steerable (COAST) guidewire robot that demonstrates variable and independently controlled bending length and curvature of the distal end. The 2-DoF guidewire features two micromachined joints from a tube of superelastic nitinol of outer diameter 0.78 mm. Each joint is actuated with two nitinol tendons. The joints that are used in this robot are called bidirectional asymmetric notch (BAN) joints, and the advantages of these joints are explored and analyzed. The design of the COAST robotic guidewire involves three coaxially aligned tubes with a single tendon running centrally through the length of the robot. The outer tubes are made from micromachined nitinol allowing for tendon-driven bending of the robot at variable bending curvatures, while an inner stainless steel tube controls the bending length of the robot. By varying the lengths of the tubes as well as the tendon, and by insertion and retraction of the entire assembly, various joint lengths and curvatures may be achieved. Kinematic and static models, a compact actuation system, and a controller for this robot are presented. The capability of the robot to accurately navigate through phantom anatomical bifurcations and tortuous angles is also demonstrated in three dimensional phantom vasculature. At the meso-scale, manual navigation of passive pediatric neuroendoscopes for endoscopic third ventriculostomy may not reach target locations in the patient's ventricle. This work introduces the design, analysis and control of a meso-scale two degree-of-freedom robotic bipolar electrocautery tool that increases the workspace of the neurosurgeon. A static model is proposed for the robot joints that avoids problems arising from pure kinematic control. Using this model, a control system is developed that comprises of a disturbance observer to provide precise force control and compensate for joint hysteresis. A handheld controller is developed and demonstrated in this thesis. To allow the clinician to estimate the shape of the steerable tools within the anatomy for both micro-scale and meso-scale tools, a miniature tendon force sensor and a high deflection shape sensor are proposed and demonstrated. The force sensor features a compact design consisting of a single LED, dual-phototransistor, and a dual-screen arrangement to increase the linear range of sensor output and compensate for external disturbances, thereby allowing force measurement of up to 21 N with 99.58 % accuracy. The shape sensor uses fiber Bragg grating based optical cable mounted on a micromachined tube and is capable of measuring curvatures as high as 145 /m. These sensors were incorporated and tested in the guidewire and the neuroendoscope tool robots and can provide robust feedback for closed-loop control of these devices in the future.Ph.D

Robotic manipulators for in situ inspections of jet engines

Jet engines need to be inspected periodically and, in some instances, repaired. Currently, some of these maintenance operations require the engine to be removed from the wing and dismantled, which has a significant associated cost. The capability of performing some of these inspections and repairs while the engine is on-wing could lead to important cost savings. However, existing technology for on-wing operations is limited, and does not suffice to satisfy some of the needs. In this work, the problem of performing on-wing operations such as inspection and repair is analysed, and after an extensive literature review, a novel robotic system for the on-wing insertion and deployment of probes or other tools is proposed. The system consists of a fine-positioner, which is a miniature and dexterous robotic manipulator; a gross-positioner, which is a device to insert the fine-positioner to the engine region of interest; an end-effector, such as a probe; a deployment mechanism, which is a passive device to ensure correct contact between probe and component; and a feedback system that provides information about the robot state for control. The research and development work conducted to address the main challenges to create this robotic system is presented in this thesis. The work is focussed on the fine-positioner, as it is the most relevant and complex part of the system. After a literature review of relevant work, and as part of the exploration of potential robot concepts for the system, the kinematic capabilities of concentric tube robots (CTRs) are first investigated. The complete set of stable trajectories that can be traced in follow-the-leader motion is discovered. A case study involving simulations and an experiment is then presented to showcase and verify the work. The research findings indicate that CTRs are not suitable for the fine-positioner. However, they show that CTRs with non-annular cross section can be used for the gross-positioner. In addition, the new trajectories discovered show promise in minimally invasive surgery (MIS). Soft robotic manipulators with fluidic actuation are then selected as the most suitable concept for the fine-positioner. The design of soft robotic manipulators with fluidic actuation is investigated from a general perspective. A general framework for the design of these devices is proposed, and a set of design principles are derived. These principles are first applied in a MIS case study to illustrate and verify the work. Finite element (FE) simulations are then reported to perform design optimisation, and thus complete the case study. The design study is then applied to determine the most suitable design for the fine-positioner. An additional analytical derivation is developed, followed by FE simulations, which extend those of the case study. Eventually, this work yields a final design of the fine-positioner. The final design found is different from existing ones, and is shown to provide an important performance improvement with respect to existing soft robots in terms of wrenches it can support. The control of soft and continuum robots relevant to the fine-positioner is also studied. The full kinematics of continuum robots with constant curvature bending and extending capabilities are first investigated, which correspond to a preliminary design concept conceived for the fine-positioner. Closed-form solutions are derived, closing an open problem. These kinematics, however, do not exactly match the final fine-positioner design selected. Thus, an alternative control approach based on closed-loop control laws is then adopted. For this, a mechanical model is first developed. Closed-loop control laws are then derived based on this mechanical model for planar operation of a segment of the fine-positioner. The control laws obtained represent the foundation for the subsequent development of control laws for a full fine-positioner operating in 3D. Furthermore, work on path planning for nonholonomic systems is also reported, and a new algorithm is presented, which can be applied for the insertion of the overall robotic system. Solutions to the other parts of the robotic system for on-wing operations are also reported. A gross-positioner consisting of a non-annular CTR is proposed. Solutions for a deployment mechanism are also presented. Potential feedback systems are outlined. In addition, methods for the fabrication of the systems are reported, and the electronics and systems required for the assembly of the different parts are described. Finally, the use of the robotic system to perform on-wing inspections in a representative case study is studied to determine the viability. Inspection strategies are shortlisted, and simulations and experiments are used to study them. The results, however, indicate that inspection is not viable since the signal to noise ratio is excessively low. Nonetheless, the robotic system proposed, and the research conducted, are still expected to be useful to perform a range of on-wing operations that require the insertion and deployment of a probe or other end-effector. In addition, the trajectories discovered for CTRs, the design found for the fine-positioner, and the advances on control, also have significant potential in MIS, where there is an important need for miniature robotic manipulators and similar devices.Open Acces

Model Based Control of Soft Robots: A Survey of the State of the Art and Open Challenges

Continuum soft robots are mechanical systems entirely made of continuously deformable elements. This design solution aims to bring robots closer to invertebrate animals and soft appendices of vertebrate animals (e.g., an elephant's trunk, a monkey's tail). This work aims to introduce the control theorist perspective to this novel development in robotics. We aim to remove the barriers to entry into this field by presenting existing results and future challenges using a unified language and within a coherent framework. Indeed, the main difficulty in entering this field is the wide variability of terminology and scientific backgrounds, making it quite hard to acquire a comprehensive view on the topic. Another limiting factor is that it is not obvious where to draw a clear line between the limitations imposed by the technology not being mature yet and the challenges intrinsic to this class of robots. In this work, we argue that the intrinsic effects are the continuum or multi-body dynamics, the presence of a non-negligible elastic potential field, and the variability in sensing and actuation strategies.Comment: 69 pages, 13 figure