Vitreo-retinal eye surgery robot : sustainable precision

Vitreo-retinal eye surgery encompasses the surgical procedures performed on the vitreous humor and the retina. A procedure typically consists of the removal of the vitreous humor, the peeling of a membrane and/or the repair of a retinal detachment. Vitreo-retinal surgery is performed minimal invasively. Small needle shaped instruments are inserted into the eye. Instruments are manipulated by hand in four degrees of freedom about the insertion point. Two rotations move the instrument tip laterally, in addition to a translation in axial instrument direction and a rotation about its longitudinal axis. The manipulation of the instrument tip, e.g. a gripping motion can be considered as a fifth degree of freedom. While performing vitreo-retinal surgery manually, the surgeon faces various challenges. Typically, delicate micrometer range thick tissue is operated, for which steady hand movements and high accuracy instrument manipulation are required. Lateral instrument movements are inverted by the pivoting insertion point and scaled depending on the instrument insertion depth. A maximum of two instruments can be used simultaneously. There is nearly no perception of surgical forces, since most forces are below the human detection limit. Therefore, the surgeon relies only on visual feedback, obtained via a microscope or endoscope. Both vision systems force the surgeon to work in a static and non ergonomic body posture. Although the surgeon’s proficiency improves throughout his career, hand tremor will become a problem at higher age. Robotically assisted surgery with a master-slave system can assist the surgeon in these challenges. The slave system performs the actual surgery, by means of instrument manipulators which handle the instruments. The surgeon remains in control of the instruments by operating haptic interfaces via a master. Using electronic hardware and control software, the master and slave are connected. Amongst others, advantages as tremor filtering, up-scaled force feedback, down-scaled motions and stabilized instrument positioning will enhance dexterity on surgical tasks. Furthermore, providing the surgeon an ergonomic body posture will prolong the surgeon’s career. This thesis focuses on the design and realization of a high precision slave system for eye surgery. The master-slave system uses a table mounted design, where the system is compact, lightweight, easy to setup and equipped to perform a complete intervention. The slave system consists of two main parts: the instrument manipulators and their passive support system. Requirements are derived from manual eye surgery, conversations with medical specialists and analysis of the human anatomy and vitreo-retinal interventions. The passive support system provides a stiff connection between the instrument manipulator, patient and surgical table. Given the human anatomical diversity, presurgical adjustments can be made to allow the instrument manipulators to be positioned over each eye. Most of the support system is integrated within the patient’s headrest. On either the left or right side, two exchangeable manipulator-support arms can be installed onto the support system, depending on the eye being operated upon. The compact, lightweight and easy to install design, allows for a short setup time and quick removal in case of a complication. The slave system’s surgical reach is optimized to emulate manually performed surgery. For bimanual instrument operation, two instrument manipulators are used. Additional instrument manipulators can be used for non-active tools e.g. an illumination probe or an endoscope. An instrument manipulator allows the same degrees of freedom and a similar reach as manually performed surgery. Instrument forces are measured to supply force feedback to the surgeon via haptic interfaces. The instrument manipulator is designed for high stiffness, is play free and has low friction to allow tissue manipulation with high accuracy. Each instrument manipulator is equipped with an on board instrument change system, by which instruments can be changed in a fast and secure way. A compact design near the instrument allows easy access to the surgical area, leaving room for the microscope and peripheral equipment. The acceptance of a surgical robot for eye surgery mostly relies on equipment safety and reliability. The design of the slave system features various safety measures, e.g. a quick release mechanism for the instrument manipulator and additional locks on the pre-surgical adjustment fixation clamp. Additional safety measures are proposed, like a hard cover over the instrument manipulator and redundant control loops in the controlling FPGA. A method to fixate the patient’s head to the headrest by use of a custom shaped polymer mask is proposed. Two instrument manipulators and their passive support system have been realized so far, and the first experimental results confirm the designed low actuation torque and high precision performance

Design of the Control System of 2-DOF Parallel Manipulator Based on CoDeSys

The 2-DOF parallel manipulator takes a parallelogram construction which can make its workbench always remain stable. Now it is widely used in various industrial sites. In consideration of the construction features and the control demands of 2-DOF parallel manipulator, this paper mainly introduces the motion control scheme and man-machine interface design of the manipulator. Based on the motion control programming platform of CoDeSys, the motion control and simulation debugging of the 2-DOF parallel manipulator are realized

안전한 재구성 로봇 시스템: 설계, 프로그래밍 및 반응형 경로계획

학위논문 (박사) -- 서울대학교 대학원 : 공과대학 기계항공공학부, 2020. 8. 박종우.The next generation of robots are being asked to work in close proximity to humans. At the same time, the robot should have the ability to change its topology to flexibly cope with various tasks. To satisfy these two requirements, we propose a novel modular reconfi gurable robot and accompanying software architecture, together with real-time motion planning algorithms to allow for safe operation in unstructured dynamic environments with humans. Two of the key innovations behind our modular manipulator design are a genderless connector and multi-dof modules. By making the modules connectable regardless of the input/output directions, a genderless connector increases the number of possible connections. The developed genderless connector can transmit as much load as necessary to an industrial robot. In designing two-dof modules, an offset between two joints is imposed to improve the overall integration and the safety of the modules. To cope with the complexity in modeling due to the genderless connector and multi-dof modules, a programming architecture for modular robots is proposed. The key feature of the proposed architecture is that it efficiently represents connections of multi-dof modules only with connections between modules, while existing architectures should explicitly represent all connections between links and joints. The data structure of the proposed architecture contains properties of tree-structured multi-dof modules with intra-module relations. Using the data structure and connection relations between modules, kinematic/dynamic parameters of connected modules can be obtained through forward recursion. For safe operation of modular robots, real-time robust collision avoidance algorithms for kinematic singularities are proposed. The main idea behind the algorithms is generating control inputs that increase the directional manipulability of the robot to the object direction by reducing directional safety measures. While existing directional safety measures show undesirable behaviors in the vicinity of the kinematic singularities, the proposed geometric safety measure generates stable control inputs in the entire joint space. By adding the preparatory input from the geometric safety measure to the repulsive input, a hierarchical collision avoidance algorithm that is robust to kinematic singularity is implemented. To mathematically guarantee the safety of the robot, another collision avoidance algorithm using the invariance control framework with velocity-dependent safety constraints is proposed. When the object approached the robot from a singular direction, the safety constraints are not satis ed in the initial state of the robot and the safety cannot be guaranteed using the invariance control. By proposing a control algorithm that quickly decreases the preparatory constraints below thresholds, the robot re-enters the constraint set and avoids collisions using the invariance control framework. The modularity and safety of the developed reconfi gurable robot is validated using a set of simulations and hardware experiments. The kinematic/dynamic model of the assembled robot is obtained in real-time and used to accurately control the robot. Due to the safe design of modules with o sets and the high-level safety functions with collision avoidance algorithms, the developed recon figurable robot has a broader safe workspace and wider ranger of safe operation speed than those of cooperative robots.다음 세대의 로봇은 사람과 가까이에서 협업할 수 있는 기능을 가져야한다. 그와 동시에, 로봇은 다양하게 변하는 작업에 대해 유연하게 대처할 수 있도록 자신의 구조를 바꾸는 기능을 가져야 한다. 이러한 두 가지 요구조건을 만족시키기 위해, 본 논문에서는 새로운 모듈라 로봇 시스템과 프로그래밍 아키텍쳐를 제시하고, 사람이 존재하는 동적 환경에서 안전한 로봇의 운용을 위한 실시한 경로 계획 알고리즘을 제시한다. 개발된 모듈라 로봇의 두 가지 핵심적인 혁신성은 무성별 커넥터와 다자유도 모듈에서 찾을 수 있다. 입력/출력 방향에 상관 없이 모듈이 연결될 수 있도록 함으로써, 무성별 커넥터는 결합 가능한 경우의 수를 늘릴 수 있다. 개발된 무성별 커넥터는 산업용 로봇에서 요구되는 충분한 부하를 견딜 수 있도록 설계되었다. 2 자유도 모듈의 설계에서 두 축 사이에 오프셋을 가지도록 함으로써 전체적인 완성도 및 안전도를 증가시켰다. 무성별 커넥터와 다자유도 모듈로 인한 모델링의 복잡성에 대응하기 위해, 일반적인 모듈라 로봇을 위한 소프트웨어 아키텍쳐를 제안하였다. 기존 모듈라 로봇의 연결을 나타내는 방법이 모든 링크와 조인트 사이의 연결 관계를 별도로 나타내야하는 것과 다르게, 제안된 아키텍쳐는 모듈들 사이의 연결관계만을 나타냄으로써 효율적인 다자유도 모듈의 연결관계를 나타낼 수 있다는 것을 특징으로 한다. 이를 위해 트리 구조를 가지는 일반적인 다자유도 모듈의 성질을 나타내는 데이터 구조를 정의하였다. 모듈들 사이의 연결관계 및 데이터 구조를 이용하여, 정확한 기구학/동역학 모델 파라미터를 얻어내는 순방향 재귀 알고리즘을 구현하였다. 모듈라 로봇의 안전한 운용을 위해, 기구학적 특이점에 강건한 실시간 충돌회피 알고리즘을 제안하였다. 방향성 안전도를 줄이는 방향의 제어 입력을 생성하여 물체 방향으로의 로봇 방향성 매니퓰러빌리티를 증가시키는 것이 제안한 알고리즘의 핵심이다. 기존의 방향성 안전도가 기구학적 특이점 근처에서 원하지 않는 성질을 가지는 것과는 반대로, 제안한 기하학적 안전도는 전체 조인트 공간에서 안정적인 제어 입력을 생성한다. 이 기하학적 안전도를 이용하여, 기구학적 특이점에 강건한 계층적 충돌회피 알고리즘을 구현하였다. 수학적으로 로봇의 안전도를 보장하기 위해, 상대속도에 종속적인 안전 제약조건을 가지는 불변 제어 프레임워크을 이용하여 또 하나의 충돌 회피 알고리즘을 제안하였다. 물체가 특이점 방향으로부터 로봇에 접근할 때, 로봇의 초기 상태에서 안전 제약조건을 만족시키지 못하게 되어 불변제어를 적용할 수 없게 된다. 준비 제약조건을 빠르게 임계점 아래로 감소시키는 알고리즘을 적용함으로써, 로봇은 제약조건 집합에 다시 들어가고 불변 제어 방법을 이용하여 충돌을 회피할 수 있게 된다. 개발된 재구성 로봇의 모듈라리티와 안전도는 일련의 시뮬레이션과 하드웨어 실험을 통해 검증되었다. 실시간으로 조립된 로봇의 기구학/동역학 모델을 얻어내 정밀 제어에 사용하였다. 안전한 모듈 디자인과 충돌 회피 등의 고차원 안전 기능을 통하여, 개발된 재구성 로봇은 기존 협동로봇보다 넓은 안전한 작업공간과 작업속도를 가진다.1 Introduction 1 1.1 Modularity and Recon gurability 1 1.2 Safe Interaction 4 1.3 Contributions of This Thesis 9 1.3.1 A Recon gurable Modular Robot System with Bidirectional Modules 9 1.3.2 A Modular Robot Software Programming Architecture 10 1.3.3 Anticipatory Collision Avoidance Planning 11 1.4 Organization of This Thesis 14 2 Design and Prototyping of the ModMan 17 2.1 Genderless Connector 18 2.2 Modules for ModMan 21 2.2.1 Joint Modules 21 2.2.2 Link and Gripper Modules 25 2.3 Experiments 26 2.3.1 System Setup 26 2.3.2 Repeatability Comparison with Non-recon gurable Robot Manipulators 28 2.3.3 E ect of the O set in Two-dof Modules 30 2.4 Conclusion 32 3 A Programming Architecture for Modular Recon gurable Robots 33 3.1 Data Structure for Multi-dof Joint Modules 34 3.2 Automatic Kinematic Modeling 37 3.3 Automatic Dynamic Modeling 40 3.4 Flexibility in Manipulator 42 3.5 Experiments 45 3.5.1 System Setup 46 3.5.2 Recon gurability 46 3.5.3 Pick-and-Place with Vision Sensors 48 3.6 Conclusion 49 4 A Preparatory Safety Measure for Robust Collision Avoidance 51 4.1 Preliminaries on Manipulability and Safety 52 4.2 Analysis on Reected Mass 56 4.3 Manipulability Control on S+(1;m) 60 4.3.1 Geometry of the Group of Positive Semi-de nite Matrices 60 4.3.2 Rank-One Manipulability Control 63 4.4 Collision Avoidance with Preparatory Action 65 4.4.1 Repulsive and Preparatory Potential Functions 65 4.4.2 Hierarchical Control and Task Relaxation 67 4.5 Experiments 70 4.5.1 Manipulability Control 71 4.5.2 Collision Avoidance 75 4.6 Conclusion 82 5 Collision Avoidance with Velocity-Dependent Constraints 85 5.1 Input-Output Linearization 87 5.2 Invariance Control 89 5.3 Velocity-Dependent Constraints for Robot Safety 90 5.3.1 Velocity-Dependent Repulsive Constraints 90 5.3.2 Preparatory Constraints 92 5.3.3 Corrective Control for Dangerous Initial State 93 5.4 Experiment 95 5.5 Conclusion 98 6 Conclusion 101 6.1 Overview of This Thesis 101 6.2 Future Work 104 Appendix A Appendix 107 A.1 Preliminaries on Graph Theory 107 A.2 Lie-Theoretic Formulations of Robot Kinematics and Dynamics 108 A.3 Derivatives of Eigenvectors and Eigenvalues 110 A.4 Proof of Proposition Proposition 4.1 111 A.5 Proof of Triangle Inequality When p = 1 114 A.6 Detailed Conditions for a Danger Field 115 Bibliography 117 Abstract 127Docto

Modelling, Control and Optimization of Modular Reconfigurable Robots

Modular reconfigurable robots are robotic systems offering new opportunities to rapidly create fit-to-task flexible automation lines. The recent trends of increasingly varying market needs in low-volume high-mix manufacturing demands for highly adaptable robotic systems like this. In this context, methods for quickly and automatically generating a modular robot model and controller should be developed. Moreover, modularity and reconfigurabilty open up new opportunities for on-demand robot morphology optimization for varying tasks. Therefore a method to optimize the robot design for a certain criterion should be provided in order to exploit the full potential of reconfigurable robots. In this thesis, a complete hard- and software architecture for a modular reconfigurable EtherCAT-based robot is presented. This novel approach allows to automatically reconstruct the topology of different robot structures, composed of a set of body modules, each of which represents an EtherCAT slave. This approach enables to obtain in an automatic way the kinematic and dynamic model of the robot and store it in URDF format as soon as the physical robot is assembled or reconfigured. The method also automatically reshapes a generic optimization-based controller to be instantly used after reconfiguration. Finally, a study and analysis on how to find the best suited reconfigurable robot morphology for a given task are presented, starting from a fixed set of joint and link modules. In particular, is shown how exploiting multi-arm robotic systems and modifying the relative and absolute positions of their bases, can expand the solution space for a given task. Results obtained in simulations for different tasks, are verified with real-world experiments using a in-house developed reconfigurable robot prototype

Elderly Assist Robot

This project aimed to create a robot capable of assisting elderly people with tasks in their everyday lives. The project focused on the design, simulation, and the implementation of a mobile robotic base with an attached robotic arm. The project culminated in a prototype robot capable of performing basic chassis and arm control which can be used as a platform for future development

Inertial Measurement Network Design and Prototyping for Intelligent Hydraulic Machines

Robotisation of heavy machinery requires extensive sensing of the working environment and the motion state of the machine in relation to its environment. Inertial measurements provide a cost effective way of acquiring the pose of the machine and its parts. There are multiple earlier inertial measurement device designs that have been used in the context of heavy machinery automation research. A new, more modular design was proposed and developed as part of this thesis. The new design leverages modern communication features and enables experimenting with different sensors with relatively low effort. A concept for the new device was first drawn up. After some critical components had been selected, the concept could be turned into an actual design. The design was refined and finalised, after which prototypes could be manufactured. When the functional prototypes proved the design to be working, they could be tested on a hydraulic manipulator, similar to the use case. The sensor network formed with the new devices proved to perform better than the previously used system. The modularity of the devices enables further hardware development and future improvements. They also provide a platform for developing more sophisticated software with additional features.Raskaiden työkoneiden robotisointi vaatii sekä laajamittaista ympäristön aistimista, että työkoneen oman tai sisäisen liiketilan aistimista ympäristöön nähden. Inertiamittaus on kustannustehokas tapa saada koneen ja sen osien asento mitatuksi. Useita erilaisia työkoneiden automatisoinnin tutkimukseen tarkoitettuja inertiamittauslaitteita on kehitetty aiemmin. Uutta, modulaarisempaa laitetta ehdotettiin ja se kehitettiin osana tätä diplomityötä. Uusi laite hyödyntää moderneja tiedonsiirto-ominaisuuksia ja mahdollistaa erilaisten anturien kokeilemisen suhteellisen vähällä vaivalla. Uudesta laitteesta luotiin ensin konsepti. Joidenkin kriittisten komponenttivalintojen jälkeen konsepti saatettiin muuttaa varsinaiseksi laitesuunnitelmaksi. Suunnitelman hiomisen ja viimeistelyn jälkeen voitiin valmistaa prototyypit. Kun toiminnalliset prototyypit osoittivat laitesuunnitelman toimivan, voitiin siirtyä niiden koestamiseen hydraulipuomissa, joka vastaa käyttökohdetta. Uusien laitteiden muodostama anturiverkko osoittautui paremmin toimivaksi, kuin aiemmin käytössä ollut järjestelmä. Laitteiden modulaarisuus mahdollistaa laitteiston jatkokehittämisen sekä parannukset tulevaisuudessa. Ne tarjoavat myös alustan monimutkaisempien, lisätoiminnallisuuksia sisältävien ohjelmistojen kehittämiselle

Teleoperating a mobile manipulator and a free-flying camera from a single haptic device

© 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other worksThe paper presents a novel teleoperation system that allows the simultaneous and continuous command of a ground mobile manipulator and a free flying camera, implemented using an UAV, from which the operator can monitor the task execution in real-time. The proposed decoupled position and orientation workspace mapping allows the teleoperation from a single haptic device with bounded workspace of a complex robot with unbounded workspace. When the operator is reaching the position and orientation boundaries of the haptic workspace, linear and angular velocity components are respectively added to the inputs of the mobile manipulator and the flying camera. A user study on a virtual environment has been conducted to evaluate the performance and the workload on the user before and after proper training. Analysis on the data shows that the system complexity is not an obstacle for an efficient performance. This is a first step towards the implementation of a teleoperation system with a real mobile manipulator and a low-cost quadrotor as the free-flying camera.Accepted versio

Modeling and Control of Flexible Link Manipulators

Autonomous maritime navigation and offshore operations have gained wide attention with the aim of reducing operational costs and increasing reliability and safety. Offshore operations, such as wind farm inspection, sea farm cleaning, and ship mooring, could be carried out autonomously or semi-autonomously by mounting one or more long-reach robots on the ship/vessel. In addition to offshore applications, long-reach manipulators can be used in many other engineering applications such as construction automation, aerospace industry, and space research. Some applications require the design of long and slender mechanical structures, which possess some degrees of flexibility and deflections because of the material used and the length of the links. The link elasticity causes deflection leading to problems in precise position control of the end-effector. So, it is necessary to compensate for the deflection of the long-reach arm to fully utilize the long-reach lightweight flexible manipulators. This thesis aims at presenting a unified understanding of modeling, control, and application of long-reach flexible manipulators. State-of-the-art dynamic modeling techniques and control schemes of the flexible link manipulators (FLMs) are discussed along with their merits, limitations, and challenges. The kinematics and dynamics of a planar multi-link flexible manipulator are presented. The effects of robot configuration and payload on the mode shapes and eigenfrequencies of the flexible links are discussed. A method to estimate and compensate for the static deflection of the multi-link flexible manipulators under gravity is proposed and experimentally validated. The redundant degree of freedom of the planar multi-link flexible manipulator is exploited to minimize vibrations. The application of a long-reach arm in autonomous mooring operation based on sensor fusion using camera and light detection and ranging (LiDAR) data is proposed.publishedVersio

Physical Interaction and Control of Robotic Systems Using Hardware-in-the-Loop Simulation

Robotic systems used in industries and other complex applications need huge investment, and testing of them under robust conditions are highly challenging. Controlling and testing of such systems can be done with ease with the support of hardware-in-the-loop (HIL) simulation technique and it saves lot of time and resources. The chapter deals on the various interaction methods of robotic systems with physical environments using tactile, force, and vision sensors. It also discusses about the usage of hardware-in-the-loop technique for testing of grasp and task control algorithms in the model of robotic systems. The chapter also elaborates on usage of hardware and software platforms for implementing the control algorithms for performing physical interaction. Finally, the chapter summarizes with the case study of HIL implementation of the control algorithms in Texas Instruments (TI) C2000 microcontroller, interacting with model of Kuka’s youBot Mobile Manipulator. The mathematical model is developed using MATLAB software and the virtual animation setup of the robot is developed using the Virtual Robot Experimentation Platform (V-REP) robot simulator. By actuating the Kuka’s youBot mobile manipulator in the V-REP tool, it is observed to produce a tracking accuracy of 92% for physical interaction and object handling tasks