Context-aware learning for robot-assisted endovascular catheterization

Endovascular intervention has become a mainstream treatment of cardiovascular diseases. However, multiple challenges remain such as unwanted radiation exposures, limited two-dimensional image guidance, insufficient force perception and haptic cues. Fast evolving robot-assisted platforms improve the stability and accuracy of instrument manipulation. The master-slave system also removes radiation to the operator. However, the integration of robotic systems into the current surgical workflow is still debatable since repetitive, easy tasks have little value to be executed by the robotic teleoperation. Current systems offer very low autonomy, potential autonomous features could bring more benefits such as reduced cognitive workloads and human error, safer and more consistent instrument manipulation, ability to incorporate various medical imaging and sensing modalities. This research proposes frameworks for automated catheterisation with different machine learning-based algorithms, includes Learning-from-Demonstration, Reinforcement Learning, and Imitation Learning. Those frameworks focused on integrating context for tasks in the process of skill learning, hence achieving better adaptation to different situations and safer tool-tissue interactions. Furthermore, the autonomous feature was applied to next-generation, MR-safe robotic catheterisation platform. The results provide important insights into improving catheter navigation in the form of autonomous task planning, self-optimization with clinical relevant factors, and motivate the design of intelligent, intuitive, and collaborative robots under non-ionizing image modalities.Open Acces

Modeling and Control of Steerable Ablation Catheters

Catheters are long, flexible tubes that are extensively used in vascular and cardiac interventions, e.g., cardiac ablation, coronary angiography and mitral valve annuloplasty. Catheter-based cardiac ablation is a well-accepted treatment for atrial fibrillation, a common type of cardiac arrhythmia. During this procedure, a steerable ablation catheter is guided through the vasculature to the left atrium to correct the signal pathways inside the heart and restore normal heart rhythm. The outcome of the ablation procedure depends mainly on the correct positioning of the catheter tip at the target location inside the heart and also on maintaining a consistent contact between the catheter tip and cardiac tissue. In the presence of cardiac and respiratory motions, achieving these goals during the ablation procedure is very challenging without proper 3D visualization, dexterous control of the flexible catheter and an estimate of the catheter tip/tissue contact force. This research project provides the required basis for developing a robotics-assisted catheter manipulation system with contact force control for use in cardiac ablation procedures. The behavior of the catheter is studied in free space as well in contact with the environment to develop mathematical models of the catheter tip that are well suited for developing control systems. The validity of the proposed modeling approaches and the performance of the suggested control techniques are evaluated experimentally. As the first step, the static force-deflection relationship for ablation catheters is described with a large-deflection beam model and an optimized pseudo-rigid-body 3R model. The proposed static model is then used in developing a control system for controlling the contact force when the catheter tip is interacting with a static environment. Our studies also showed that it is possible to estimate the tip/tissue contact force by analyzing the shape of the catheter without installing a force sensor on the catheter. During cardiac ablation, the catheter tip is in contact with a relatively fast moving environment (cardiac tissue). Robotic manipulation of the catheter has the potential to improve the quality of contact between the catheter tip and cardiac tissue. To this end, the frequency response of the catheter is investigated and a control technique is proposed to compensate for the cardiac motion and to maintain a constant tip/tissue contact force. Our study on developing a motion compensated robotics-assisted catheter manipulation system suggests that redesigning the actuation mechanism of current ablation catheters would provide a major improvement in using these catheters in robotics-assisted cardiac ablation procedures

Design, Development and Force Control of a Tendon-driven Steerable Catheter with a Learning-based Approach

In this research, a learning-based force control schema for tendon-driven steerable catheters with the application in robot-assisted tissue ablation procedures was proposed and validated. To this end, initially a displacement-based model for estimating the contact force between the catheter and tissue was developed. Afterward, a tendon-driven catheter was designed and developed. Next, a software-hardware-integrated robotic system for controlling and monitoring the pose of the catheter was designed and developed. Also, a force control schema was developed based on the developed contact force model as a priori knowledge. Furthermore, the position control of the tip of the catheter was performed using a learning-based inverse kinematic approach. By combining the position control and the contact model, the force control schema was developed and validated. Validation studies were performed on phantom tissue as well as excised porcine tissue. Results of the validation studies showed that the proposed displacement-based model was 91.5% accurate in contact force prediction. Also, the system was capable of following a set of desired trajectories with an average root-mean-square error of less than 5%. Further validation studies revealed that the system could fairly generate desired static and dynamic force profiles on the phantom tissue. In summary, the proposed force control system did not necessitate the utilization of force sensors and could fairly contribute in automatizing the ablation task for robotic tissue ablation procedures

Cable-driven parallel mechanisms for minimally invasive robotic surgery

Minimally invasive surgery (MIS) has revolutionised surgery by providing faster recovery times, less post-operative complications, improved cosmesis and reduced pain for the patient. Surgical robotics are used to further decrease the invasiveness of procedures, by using yet smaller and fewer incisions or using natural orifices as entry point. However, many robotic systems still suffer from technical challenges such as sufficient instrument dexterity and payloads, leading to limited adoption in clinical practice. Cable-driven parallel mechanisms (CDPMs) have unique properties, which can be used to overcome existing challenges in surgical robotics. These beneficial properties include high end-effector payloads, efficient force transmission and a large configurable instrument workspace. However, the use of CDPMs in MIS is largely unexplored. This research presents the first structured exploration of CDPMs for MIS and demonstrates the potential of this type of mechanism through the development of multiple prototypes: the ESD CYCLOPS, CDAQS, SIMPLE, neuroCYCLOPS and microCYCLOPS. One key challenge for MIS is the access method used to introduce CDPMs into the body. Three different access methods are presented by the prototypes. By focusing on the minimally invasive access method in which CDPMs are introduced into the body, the thesis provides a framework, which can be used by researchers, engineers and clinicians to identify future opportunities of CDPMs in MIS. Additionally, through user studies and pre-clinical studies, these prototypes demonstrate that this type of mechanism has several key advantages for surgical applications in which haptic feedback, safe automation or a high payload are required. These advantages, combined with the different access methods, demonstrate that CDPMs can have a key role in the advancement of MIS technology.Open Acces

Characterisation and State Estimation of Magnetic Soft Continuum Robots

Minimally invasive surgery has become more popular as it leads to less bleeding, scarring, pain, and shorter recovery time. However, this has come with counter-intuitive devices and steep surgeon learning curves. Magnetically actuated Soft Continuum Robots (SCR) have the potential to replace these devices, providing high dexterity together with the ability to conform to complex environments and safe human interactions without the cognitive burden for the clinician. Despite considerable progress in the past decade in their development, several challenges still plague SCR hindering their full realisation. This thesis aims at improving magnetically actuated SCR by addressing some of these challenges, such as material characterisation and modelling, and sensing feedback and localisation. Material characterisation for SCR is essential for understanding their behaviour and designing effective modelling and simulation strategies. In this work, the material properties of commonly employed materials in magnetically actuated SCR, such as elastic modulus, hyper-elastic model parameters, and magnetic moment were determined. Additionally, the effect these parameters have on modelling and simulating these devices was investigated. Due to the nature of magnetic actuation, localisation is of utmost importance to ensure accurate control and delivery of functionality. As such, two localisation strategies for magnetically actuated SCR were developed, one capable of estimating the full 6 degrees of freedom (DOFs) pose without any prior pose information, and another capable of accurately tracking the full 6-DOFs in real-time with positional errors lower than 4~mm. These will contribute to the development of autonomous navigation and closed-loop control of magnetically actuated SCR

Development of a Compact Piezoworm Actuator For Mr Guided Medical Procedures

In this research, a novel piezoelectric actuator was developed to operate safely inside the magnetic resonance imaging (MRI) machine. The actuator based on novel design that generates linear and rotary motion simultaneously for higher needle insertion accuracy. One of the research main objectives is to aid in the selection of suitable materials for actuators used in this challenging environment. Usually only nonmagnetic materials are used in this extremely high magnetic environment. These materials are classified as MRI compatible materials and are selected to avoid hazardous conditions and image quality degradation. But unfortunately many inert materials to the magnetic field do not possess desirable mechanical properties in terms of hardness, stiffness and strength and much of the available data for MRI compatible materials are scattered throughout the literature and often too device specific . Furthermore, the fact that significant heating is experienced by some of these devices due to the scanner’s variable magnetic fields makes it difficult to draw general conclusions to support the choice of suitable material and typically these choices are based on a trial-and-error with extensive time required for prototype development and MRI testing of such devices. This research provides a quantitative comparison of several engineering materials in the MRI environment and comparison to theoretical behavior which should aid designers/engineers to estimate the MRI compatible material performance before the expensive step of construction and testing. This work focuses specifically on the effects in the MRI due to the material susceptibility, namely forces, torques, image artifacts and induced heating

Augmented reality (AR) for surgical robotic and autonomous systems: State of the art, challenges, and solutions

Despite the substantial progress achieved in the development and integration of augmented reality (AR) in surgical robotic and autonomous systems (RAS), the center of focus in most devices remains on improving end-effector dexterity and precision, as well as improved access to minimally invasive surgeries. This paper aims to provide a systematic review of different types of state-of-the-art surgical robotic platforms while identifying areas for technological improvement. We associate specific control features, such as haptic feedback, sensory stimuli, and human-robot collaboration, with AR technology to perform complex surgical interventions for increased user perception of the augmented world. Current researchers in the field have, for long, faced innumerable issues with low accuracy in tool placement around complex trajectories, pose estimation, and difficulty in depth perception during two-dimensional medical imaging. A number of robots described in this review, such as Novarad and SpineAssist, are analyzed in terms of their hardware features, computer vision systems (such as deep learning algorithms), and the clinical relevance of the literature. We attempt to outline the shortcomings in current optimization algorithms for surgical robots (such as YOLO and LTSM) whilst providing mitigating solutions to internal tool-to-organ collision detection and image reconstruction. The accuracy of results in robot end-effector collisions and reduced occlusion remain promising within the scope of our research, validating the propositions made for the surgical clearance of ever-expanding AR technology in the future

Development of A Kinetic Model For Loop-Free Colonoscopy Technology

The colonoscope is an important tool in diagnosis and management of diseases of the colon. One of the ongoing challenges with this device is that the colonoscope may form a loop together with the colon during the procedure. The result of the loop is that further insertion of the scope in the colon may not be possible. The loop may also cause risks of perforation of the colon and pain in the patient. There are currently several existing devices to overcome loop formation in colonoscopy, some of which have been introduced in clinical work. However, empirical assessment shows that these devices do not work very well. This is the motivation for the research presented in this thesis. In this thesis, a new paradigm of thinking, “doctor-assisted colonoscopy,” is proposed to overcome loop formation. In this new approach, the physician’s role is enhanced with new information that is acquired by sensors outside the human body and inferred from the mathematical model. It is referred to as a kinetic model due to the fact that this model describes the kinetic behaviour of the scope. This thesis is devoted to development of this kinetic model. In this study, the model of the colonoscope and the model of the colon are developed based on the Timoshenko beam theory, and parameters in both models are determined by the experiments. The following conclusions then are made: (1) self-locking of the colonoscope is the most basic cause for a loop to occur, while structural instability of the colonsocope is dependent on the self-locking; (2) both the scope and the colon can be well represented with the Timoshenko beam elements and the Linear Complementary Problem (LCP) formulation derived from Signorini’s law, and Coulom’s law for representation of interactions between the colon and scope is adequate; (3) there are effects from the location, looping, and tip deflection of the scope on flexural rigidity of the scope. Approximately, the flexural rigidity of the CF-Q160L colonoscope ranges from 300 to 650 N•cm2, and its accuracy is proven by a good agreement between the model predicted result and experimental result; (4) Rayleigh damping for the CF-Q160L colonoscope depends more on the mass matrix [M] of the colonoscope than the stiffness matrix [K], which is evident by the large coefficient value of “alpha” (0.3864) and the small coefficient value of “beta” (0.0164). The contributions of this thesis are: (1) the finding that the main cause of the loop is not structural instability of the colonoscope but rather self-locking of the colonoscope, which could lead to design of a “new-generation” colonoscope to avoid the loop; (2) a systematic evaluation of the existing colonoscopy technologies based on the well-proven Axiomatic Design Theory (ADT), which will serve as a guideline for the development of future new colonoscopes in future; (3) an approach to developing a kinetic model of the colonoscope useful to modeling similar objects such as a catheter guide-wire; (4) a novel ex-vivo colonoscopy test-bed with the kinetic and kinematic measurements useful for validation of new designs in colonoscopy technology and also useful for training physicians who perform the colonoscopy procedure; and (5) a new paradigm of thinking for colonoscopy called “doctor-assisted colonoscopy,” which has potential applications to other medical procedures such as catheter-based procedures

Effectiveness of intensive physiotherapy for gait improvement in stroke: systematic review

Introduction: Stroke is one of the leading causes of functional disability worldwide. Approximately 80% of post-stroke subjects have motor changes. Improvement of gait pattern is one of the main objectives of physiotherapists intervention in these cases. The real challenge in the recovery of gait after stroke is to understand how the remaining neural networks can be modified, to be able to provide response strategies that compensate for the function of the affected structures. There is evidence that intensive training, including physiotherapy, positively influences neuroplasticity, improving mobility, pattern and gait velocity in post-stroke recovery. Objectives: Review and analyze in a systematic way the experimental studies (RCT) that evaluate the effects of Intensive Physiotherapy on gait improvement in poststroke subjects. Methodology: Were only included all RCT performed in humans, without any specific age, that had a clinical diagnosis of stroke at any stage of evolution, with sensorimotor deficits and functional gait changes. The databases used were: Pubmed, PEDro (Physiotherapy Evidence Database) and CENTRAL (Cochrane Center Register of Controlled Trials). Results: After the application of the criteria, there were 4 final studies that were included in the systematic review. 3 of the studies obtained a score of 8 on the PEDro scale and 1 obtained a score of 4. The fact that there is clinical and methodological heterogeneity in the studies evaluated, supports the realization of the current systematic narrative review, without meta-analysis. Discussion: Although the results obtained in the 4 studies are promising, it is important to note that the significant improvements that have been found, should be carefully considered since pilot studies with small samples, such as these, are not designed to test differences between groups, in terms of the effectiveness of the intervention applied. Conclusion: Intensive Physiotherapy seems to be safe and applicable in post-stroke subjects and there are indications that it is effective in improving gait, namely speed, travelled distance and spatiotemporal parameters. However, there is a need to develop more RCTs with larger samples and that evaluate the longterm resultsN/