Control of Outdoor Robots at Higher Speeds on Challenging Terrain

This thesis studies the motion control of wheeled mobile robots. Its focus is set on high speed control on challenging terrain. Additionally, it deals with the general problem of path following, as well as path planning and obstacle avoidance in difficult conditions. First, it proposes a heuristic longitudinal control for any wheeled mobile robot, and evaluates it on different kinematic configurations and in different conditions, including laboratory experiments and participation in a robotic competition. Being the focus of the thesis, high speed control on uneven terrain is thoroughly studied, and a novel control law is proposed, based on a new model representation of skid-steered vehicles, and comprising of nonlinear lateral and longitudinal control. The lateral control part is based on the Lyapunov theory, and the convergence of the vehicle to the geometric reference path is proven. The longitudinal control is designed for high speeds, taking actuator saturation and the vehicle properties into account. The complete solution is experimentally tested on two different vehicles on several different terrain types, reaching the speeds of ca. 6 m/s, and compared against two state-of-the-art algorithms. Furthermore, a novel path planning and obstacle avoidance system is proposed, together with an extension of the proposed high speed control, which builds up a navigation system capable of autonomous outdoor person following. This system is experimentally compared against two classical obstacle avoidance methods, and evaluated by following a human jogger in outdoor environments, with both static and dynamic obstacles. All the proposed methods, together with various different state-of-the-art control approaches, are unified into one framework. The proposed framework can be used to control any wheeled mobile robot, both indoors and outdoors, at low or high speeds, avoiding all the obstacles on the way. The entire work is released as open-source software

Remote Navigation and Contact-Force Control of Radiofrequency Ablation Catheters

Atrial fibrillation (AF), the most common and clinically significant heart rhythm disorder, is characterized by rapid and irregular electrical activity in the upper chambers resulting in abnormal contractions. Radiofrequency (RF) cardiac catheter ablation is a minimally invasive curative treatment that aims to electrically correct signal pathways inside the atria to restore normal sinus rhythm. Successful catheter ablation requires the complete and permanent elimination of arrhythmogenic signals by delivering transmural RF ablation lesions contiguously near and around key cardiac structures. These procedures are complex and technically challenging and, even when performed by the most skilled physician, nearly half of patients undergo repeat procedures due to incomplete elimination of the arrhythmogenic pathways. This thesis aims to incorporate innovative design to improve catheter stability and maneuverability through the development of robotic platforms that enable precise placement of reproducibly durable ablation lesions. The first part of this thesis deals with the challenges to lesion delivery imposed by cardiorespiratory motion. One of the main determinants of the delivery of durable and transmural RF lesions is the ability to define and maintain a constant contact force between the catheter tip electrode and cardiac tissue, which is hampered by the presence of cardiorespiratory motion. To address this need, I developed and evaluated a novel catheter contact-force control device. The compact electromechanical add-on tool monitors catheter-tissue contact force in real-time and simultaneously adjusts the position of a force-sensing ablation catheter within a steerable sheath to compensate for the change in contact force. In a series of in vitro and in vivo experiments, the contact-force control device demonstrated an ability to: a) maintain an average force to within 1 gram of a set level; b) reduce contact-force variation to below 5 grams (2-8-fold improvement over manual catheter intervention); c) ensure the catheter tip never lost contact with the tissue and never approached dangerous force levels; and importantly, d) deliver reproducible RF ablation lesions regardless of cardiac tissue motion, which were of the same depth and volume as lesions delivered in the absence of tissue motion. In the second part of the thesis, I describe a novel steerable sheath and catheter robotic navigation system, which incorporates the catheter contact-force controller. The robotic platform enables precise and accurate manipulation of a remote conventional steerable sheath and permits catheter-tissue contact-force control. The robotic navigation system was evaluated in vitro using a phantom that combines stationary and moving targets within an in vitro model representing a beating heart. An electrophysiologist used the robotic system to remotely navigate the sheath and catheter tip to select targets and compared the accuracy of reaching these targets performing the same tasks manually. Robotic intervention resulted in significantly higher accuracy and significantly improved the contact-force profile between the catheter tip and moving tissue-mimicking material. Our studies demonstrate that using available contact-force information within a robotic system can ensure precise and accurate placement of reliably transmural RF ablation lesions. These robotic systems can be valuable tools used to optimize RF lesion delivery techniques and ultimately improve clinical outcomes for AF ablation therapy

New Approaches in Automation and Robotics

The book New Approaches in Automation and Robotics offers in 22 chapters a collection of recent developments in automation, robotics as well as control theory. It is dedicated to researchers in science and industry, students, and practicing engineers, who wish to update and enhance their knowledge on modern methods and innovative applications. The authors and editor of this book wish to motivate people, especially under-graduate students, to get involved with the interesting field of robotics and mechatronics. We hope that the ideas and concepts presented in this book are useful for your own work and could contribute to problem solving in similar applications as well. It is clear, however, that the wide area of automation and robotics can only be highlighted at several spots but not completely covered by a single book

Towards Closed-loop, Robot Assisted Percutaneous Interventions under MRI Guidance

Image guided therapy procedures under MRI guidance has been a focused research area over past decade. Also, over the last decade, various MRI guided robotic devices have been developed and used clinically for percutaneous interventions, such as prostate biopsy, brachytherapy, and tissue ablation. Though MRI provides better soft tissue contrast compared to Computed Tomography and Ultrasound, it poses various challenges like constrained space, less ergonomic patient access and limited material choices due to its high magnetic field. Even after, advancements in MRI compatible actuation methods and robotic devices using them, most MRI guided interventions are still open-loop in nature and relies on preoperative or intraoperative images. In this thesis, an intraoperative MRI guided robotic system for prostate biopsy comprising of an MRI compatible 4-DOF robotic manipulator, robot controller and control application with Clinical User Interface (CUI) and surgical planning applications (3DSlicer and RadVision) is presented. This system utilizes intraoperative images acquired after each full or partial needle insertion for needle tip localization. Presented system was approved by Institutional Review Board at Brigham and Women\u27s Hospital(BWH) and has been used in 30 patient trials. Successful translation of such a system utilizing intraoperative MR images motivated towards the development of a system architecture for close-loop, real-time MRI guided percutaneous interventions. Robot assisted, close-loop intervention could help in accurate positioning and localization of the therapy delivery instrument, improve physician and patient comfort and allow real-time therapy monitoring. Also, utilizing real-time MR images could allow correction of surgical instrument trajectory and controlled therapy delivery. Two of the applications validating the presented architecture; closed-loop needle steering and MRI guided brain tumor ablation are demonstrated under real-time MRI guidance

Secured force guidance of an omnidirectional non-holonomic platform

For robots to operate in real life settings, they must be able to physically interact with the environment, and for instance be able to react to force-guidance interactions. However, only a few research projects have addressed such capabilities, developing prototypes that have to be pushed from their handle bars. AZIMUT-3 is a novel omnidirectional non-holonomic mobile robot developed at IntRoLab (Intelligent, Interactive and Interdisciplinary Robot Lab, Université de Sherbrooke) with force-controlled active steering. This results in a horizontal suspension effect for which the mechanical impedance of the steering actuators can be controlled. This makes the platform ideal for developing physical guidance algorithms. One such algorithm is secured shared-control, making the platform go in the direction of the user pushing the robot while still making it move safely by avoiding obstacles. Such capability is somewhat novel in the field, and the objective is to provide safe navigation with maximum control to the user. This Master's thesis has two important contributions: an algorithm to estimate the applied efforts on AZIMUT-3 from torque measurements on its wheels; an algorithm to use these efforts with obstacle detection using laser range finder data to implement a safe, shared-control approach. Experimental results using the real platform demonstrate feasibility and safe control of the system, with performances similar to using a six degrees of freedom force sensor but at lower cost and with a broader area for shared control. Our implementation also resulted in coupling the simulation environment Webots with the ROS (Robot Operating System) library from Willow Garage, to help develop our approach in simulation before using AZIMUT-3. Overall, our work is the first in demonstrating how it is possible to naturally interact by physically moving or positioning a mobile platform in real life settings, a capability which could be useful for instance in the design of powered shopping carts or active walkers

DEVELOPMENT OF A KINETIC MODEL FOR STEERABLE CATHETERS FOR MINIMALLY INVASIVE SURGERY

The steerable catheters have demonstrated many advantages to overcome the limitations of the conventional catheters in the minimally invasive surgery. The motion and force transmission from the proximal end to distal tip of the catheter have significant effects to the efficiency and safety of surgery. While the force information between the catheter and the body (e.g., vessel) can be obtained by mounting sensors on the distal tip of the catheter, this would be more intrusive and less reliable than the one without the sensors, which is described in this disseration. In addition, the small diameters of the catheters may also restrict the idea of mounting sensors on the distal tip. The other approach to obtain the force information is to infer it from the information outside the body. This will demand an accurate mathematical model that describes the force and motion relation called kinetic model, and unfortunately, such a kinetic model is not available in the literature. In this dissertation, a kinetic model for steerable catheters is presented wich captures the following characteristics of the steerable catheter, namely (1) the geometrical non-linear behavior of the catheter in motion, (2) the deformable pathway, (3) the friction between the catheter and the pathyway, and (4) the contact between the catheter and pathway. A non-linear finite element system (SPACAR) was employed to capture these characteristics. A test-bed was built and an experiment was carried out to verify the developed kinetic model. The following conclusions can be drawn from this dissertation: (1) the developed kinetic model is accurte in comparison with those in literature; (2) the Dahl friction model, the LuGre friction model and the simplified LuGre friction model are able to capture the friction behavior between the catheter and the pathway but the Coulomb friction model fails (as it cannot capture the hysteresis property which has a significant influence on the behavior of the catheter); (3) the developed kinetic model has the potential of being used to optimize the design and operation of steerable catheters with several salient findings that (3a) the maximal contact force between the catheter and the pathway occurs on the tip of the distal part or the connecting part between the distal part and catheter body of the catheter and (3b) the rigidity and length of the distal part are crucial structural parameters that affect the motion and force transmission significantly. There are several contributions made by this dissertation. In the field of the steerable catheter, biomechanics and bio-instrumentation, the contributions are summarized in the following: (1) the approach to develop the kinetic model of the steerable catheter in a complex work environment is useful to model other similar compliant medical devices, such as endoscope; (2) the kinetic model of the steerable catheter can provide the force information to improve the efficiency and safety of MIS (minimally invastive surgery) and to realize the “doctor-assisted” catheter-based MIS procedure; (3) the kinetic model can provide accurate data for developing other simplified models for the steerable catheters in their corresponding work environments for realizing the robotic-based fully automated MIS procedure. (4) The kinetic model of the steerable catheter and the test-bed with the corresponding instruments and methods for the kinetic and kinematic measurements are a useful design validation in the steerable catheter technology as well as for the training of physicians to perform the catheter-based interventional procedure by adding more complex anatomic phantoms. In the field of continuum manipulator and continuum robots, the approach to develop the kinetic model is useful to model other manipulators and robots, such as snake-like robots

Modeling and Control of Steerable Ablation Catheters

Catheters are long, flexible tubes that are extensively used in vascular and cardiac interventions, e.g., cardiac ablation, coronary angiography and mitral valve annuloplasty. Catheter-based cardiac ablation is a well-accepted treatment for atrial fibrillation, a common type of cardiac arrhythmia. During this procedure, a steerable ablation catheter is guided through the vasculature to the left atrium to correct the signal pathways inside the heart and restore normal heart rhythm. The outcome of the ablation procedure depends mainly on the correct positioning of the catheter tip at the target location inside the heart and also on maintaining a consistent contact between the catheter tip and cardiac tissue. In the presence of cardiac and respiratory motions, achieving these goals during the ablation procedure is very challenging without proper 3D visualization, dexterous control of the flexible catheter and an estimate of the catheter tip/tissue contact force. This research project provides the required basis for developing a robotics-assisted catheter manipulation system with contact force control for use in cardiac ablation procedures. The behavior of the catheter is studied in free space as well in contact with the environment to develop mathematical models of the catheter tip that are well suited for developing control systems. The validity of the proposed modeling approaches and the performance of the suggested control techniques are evaluated experimentally. As the first step, the static force-deflection relationship for ablation catheters is described with a large-deflection beam model and an optimized pseudo-rigid-body 3R model. The proposed static model is then used in developing a control system for controlling the contact force when the catheter tip is interacting with a static environment. Our studies also showed that it is possible to estimate the tip/tissue contact force by analyzing the shape of the catheter without installing a force sensor on the catheter. During cardiac ablation, the catheter tip is in contact with a relatively fast moving environment (cardiac tissue). Robotic manipulation of the catheter has the potential to improve the quality of contact between the catheter tip and cardiac tissue. To this end, the frequency response of the catheter is investigated and a control technique is proposed to compensate for the cardiac motion and to maintain a constant tip/tissue contact force. Our study on developing a motion compensated robotics-assisted catheter manipulation system suggests that redesigning the actuation mechanism of current ablation catheters would provide a major improvement in using these catheters in robotics-assisted cardiac ablation procedures

2D laser-based probabilistic motion tracking in urban-like environments

All over the world traffic injuries and fatality rates are increasing every year. The combination of negligent and imprudent drivers, adverse road and weather conditions produces tragic results with dramatic loss of life. In this scenario, the use of mobile robotics technology onboard vehicles could reduce casualties. Obstacle motion tracking is an essential ability for car-like mobile robots. However, this task is not trivial in urban environments where a great quantity and variety of obstacles may induce the vehicle to take erroneous decisions. Unfortunately, obstacles close to its sensors frequently cause blind zones behind them where other obstacles could be hidden. In this situation, the robot may lose vital information about these obstructed obstacles that can provoke collisions. In order to overcome this problem, an obstacle motion tracking module based only on 2D laser scan data was developed. Its main parts consist of obstacle detection, obstacle classification, and obstacle tracking algorithms. A motion detection module using scan matching was developed aiming to improve the data quality for navigation purposes; a probabilistic grid representation of the environment was also implemented. The research was initially conducted using a MatLab simulator that reproduces a simple 2D urban-like environment. Then the algorithms were validated using data samplings in real urban environments. On average, the results proved the usefulness of considering obstacle paths and velocities while navigating at reasonable computational costs. This, undoubtedly, will allow future controllers to obtain a better performance in highly dynamic environments.Coordenacao de Aperfeicoamento de Pessoal de Nivel Superior (CAPES

Optical flow estimation using steered-L1 norm

Motion is a very important part of understanding the visual picture of the surrounding environment. In image processing it involves the estimation of displacements for image points in an image sequence. In this context dense optical flow estimation is concerned with the computation of pixel displacements in a sequence of images, therefore it has been used widely in the field of image processing and computer vision. A lot of research was dedicated to enable an accurate and fast motion computation in image sequences. Despite the recent advances in the computation of optical flow, there is still room for improvements and optical flow algorithms still suffer from several issues, such as motion discontinuities, occlusion handling, and robustness to illumination changes. This thesis includes an investigation for the topic of optical flow and its applications. It addresses several issues in the computation of dense optical flow and proposes solutions. Specifically, this thesis is divided into two main parts dedicated to address two main areas of interest in optical flow. In the first part, image registration using optical flow is investigated. Both local and global image registration has been used for image registration. An image registration based on an improved version of the combined Local-global method of optical flow computation is proposed. A bi-lateral filter was used in this optical flow method to improve the edge preserving performance. It is shown that image registration via this method gives more robust results compared to the local and the global optical flow methods previously investigated. The second part of this thesis encompasses the main contribution of this research which is an improved total variation L1 norm. A smoothness term is used in the optical flow energy function to regularise this function. The L1 is a plausible choice for such a term because of its performance in preserving edges, however this term is known to be isotropic and hence decreases the penalisation near motion boundaries in all directions. The proposed improved L1 (termed here as the steered-L1 norm) smoothness term demonstrates similar performance across motion boundaries but improves the penalisation performance along such boundaries

Route Planning for Long-Term Robotics Missions

Many future robotic applications such as the operation in large uncertain environment depend on a more autonomous robot. The robotics long term autonomy presents challenges on how to plan and schedule goal locations across multiple days of mission duration. This is an NP-hard problem that is infeasible to solve for an optimal solution due to the large number of vertices to visit. In some cases the robot hardware constraints also adds the requirement to return to a charging station multiple times in a long term mission. The uncertainties in the robot model and environment require the robot planner to account for them beforehand or to adapt and improve its plan during runtime. The problem to be solved in this work is how to plan multiple day routes for a robot where all predefined locations must be visited only a single time and at each route the robot must start and return to the same initial position while respecting the daily maximum operation time constraint. The proposed solution uses problem definitions from the delivery industry and compares various metaheuristic based techniques for planning and scheduling the multiple day routes for a robotic mission. Therefore the problem of planning multiple day routes for a robot is modeled as a time constrained Vehicle Routing Problem where the robot daily plan is limited by how long the robot with a full charge can operate. The costs are modeled as the time a robot takes to move among locations considering robot and environment characteristics. The solution for this method is obtained in a two step process where a greedy initial solution is generated and then a local search is performed using meta-heuristic based methods. A custom time window formulation with respect to the theoretical maximum daily route is presented to add human expert input, priorities or expiration time to the planned routes allowing the planner to be flexible to various robotic applications. This thesis also proposes an intermediary mission control layer, that connects the daily route plan to the robot navigation layer. The goal of the Mission Control is to monitor the robot operation, continuously improve its route and adapt to unexpected events by dropping waypoints according to some defined penalties. This is an iterative process where optimization is performed locally in real time as the robot traverse its goals and offline at the end of each day with the remaining vertices. The performance of the various meta-heuristic and how optimization improves over time are analysed in several robotic route planning and scheduling scenarios. Two robotic simulation environments were built to demonstrate practical application of these methods. An unmanned ground vehicle operated fully autonomously using the presented methods in a simulated underground stone mine environment where the goal is to inspect the pillars for structural failures and a farm environment where the goal is to pollinate flowers with an attached robotic arm. All the optimization methods tested presented significant improvement in the total route costs compared to the initial Path-Cheapest-Arc solution. However the Guided Local Search presented a smaller standard deviation among the methods in most situations. The time-windows allowed for a seamless integration with an expert human input and the mission control layer, forced the robot to operate within the mission constraints by dynamically choosing the routes and the necessity of dropping some of the vertices