안전한 재구성 로봇 시스템: 설계, 프로그래밍 및 반응형 경로계획

학위논문 (박사) -- 서울대학교 대학원 : 공과대학 기계항공공학부, 2020. 8. 박종우.The next generation of robots are being asked to work in close proximity to humans. At the same time, the robot should have the ability to change its topology to flexibly cope with various tasks. To satisfy these two requirements, we propose a novel modular reconfi gurable robot and accompanying software architecture, together with real-time motion planning algorithms to allow for safe operation in unstructured dynamic environments with humans. Two of the key innovations behind our modular manipulator design are a genderless connector and multi-dof modules. By making the modules connectable regardless of the input/output directions, a genderless connector increases the number of possible connections. The developed genderless connector can transmit as much load as necessary to an industrial robot. In designing two-dof modules, an offset between two joints is imposed to improve the overall integration and the safety of the modules. To cope with the complexity in modeling due to the genderless connector and multi-dof modules, a programming architecture for modular robots is proposed. The key feature of the proposed architecture is that it efficiently represents connections of multi-dof modules only with connections between modules, while existing architectures should explicitly represent all connections between links and joints. The data structure of the proposed architecture contains properties of tree-structured multi-dof modules with intra-module relations. Using the data structure and connection relations between modules, kinematic/dynamic parameters of connected modules can be obtained through forward recursion. For safe operation of modular robots, real-time robust collision avoidance algorithms for kinematic singularities are proposed. The main idea behind the algorithms is generating control inputs that increase the directional manipulability of the robot to the object direction by reducing directional safety measures. While existing directional safety measures show undesirable behaviors in the vicinity of the kinematic singularities, the proposed geometric safety measure generates stable control inputs in the entire joint space. By adding the preparatory input from the geometric safety measure to the repulsive input, a hierarchical collision avoidance algorithm that is robust to kinematic singularity is implemented. To mathematically guarantee the safety of the robot, another collision avoidance algorithm using the invariance control framework with velocity-dependent safety constraints is proposed. When the object approached the robot from a singular direction, the safety constraints are not satis ed in the initial state of the robot and the safety cannot be guaranteed using the invariance control. By proposing a control algorithm that quickly decreases the preparatory constraints below thresholds, the robot re-enters the constraint set and avoids collisions using the invariance control framework. The modularity and safety of the developed reconfi gurable robot is validated using a set of simulations and hardware experiments. The kinematic/dynamic model of the assembled robot is obtained in real-time and used to accurately control the robot. Due to the safe design of modules with o sets and the high-level safety functions with collision avoidance algorithms, the developed recon figurable robot has a broader safe workspace and wider ranger of safe operation speed than those of cooperative robots.다음 세대의 로봇은 사람과 가까이에서 협업할 수 있는 기능을 가져야한다. 그와 동시에, 로봇은 다양하게 변하는 작업에 대해 유연하게 대처할 수 있도록 자신의 구조를 바꾸는 기능을 가져야 한다. 이러한 두 가지 요구조건을 만족시키기 위해, 본 논문에서는 새로운 모듈라 로봇 시스템과 프로그래밍 아키텍쳐를 제시하고, 사람이 존재하는 동적 환경에서 안전한 로봇의 운용을 위한 실시한 경로 계획 알고리즘을 제시한다. 개발된 모듈라 로봇의 두 가지 핵심적인 혁신성은 무성별 커넥터와 다자유도 모듈에서 찾을 수 있다. 입력/출력 방향에 상관 없이 모듈이 연결될 수 있도록 함으로써, 무성별 커넥터는 결합 가능한 경우의 수를 늘릴 수 있다. 개발된 무성별 커넥터는 산업용 로봇에서 요구되는 충분한 부하를 견딜 수 있도록 설계되었다. 2 자유도 모듈의 설계에서 두 축 사이에 오프셋을 가지도록 함으로써 전체적인 완성도 및 안전도를 증가시켰다. 무성별 커넥터와 다자유도 모듈로 인한 모델링의 복잡성에 대응하기 위해, 일반적인 모듈라 로봇을 위한 소프트웨어 아키텍쳐를 제안하였다. 기존 모듈라 로봇의 연결을 나타내는 방법이 모든 링크와 조인트 사이의 연결 관계를 별도로 나타내야하는 것과 다르게, 제안된 아키텍쳐는 모듈들 사이의 연결관계만을 나타냄으로써 효율적인 다자유도 모듈의 연결관계를 나타낼 수 있다는 것을 특징으로 한다. 이를 위해 트리 구조를 가지는 일반적인 다자유도 모듈의 성질을 나타내는 데이터 구조를 정의하였다. 모듈들 사이의 연결관계 및 데이터 구조를 이용하여, 정확한 기구학/동역학 모델 파라미터를 얻어내는 순방향 재귀 알고리즘을 구현하였다. 모듈라 로봇의 안전한 운용을 위해, 기구학적 특이점에 강건한 실시간 충돌회피 알고리즘을 제안하였다. 방향성 안전도를 줄이는 방향의 제어 입력을 생성하여 물체 방향으로의 로봇 방향성 매니퓰러빌리티를 증가시키는 것이 제안한 알고리즘의 핵심이다. 기존의 방향성 안전도가 기구학적 특이점 근처에서 원하지 않는 성질을 가지는 것과는 반대로, 제안한 기하학적 안전도는 전체 조인트 공간에서 안정적인 제어 입력을 생성한다. 이 기하학적 안전도를 이용하여, 기구학적 특이점에 강건한 계층적 충돌회피 알고리즘을 구현하였다. 수학적으로 로봇의 안전도를 보장하기 위해, 상대속도에 종속적인 안전 제약조건을 가지는 불변 제어 프레임워크을 이용하여 또 하나의 충돌 회피 알고리즘을 제안하였다. 물체가 특이점 방향으로부터 로봇에 접근할 때, 로봇의 초기 상태에서 안전 제약조건을 만족시키지 못하게 되어 불변제어를 적용할 수 없게 된다. 준비 제약조건을 빠르게 임계점 아래로 감소시키는 알고리즘을 적용함으로써, 로봇은 제약조건 집합에 다시 들어가고 불변 제어 방법을 이용하여 충돌을 회피할 수 있게 된다. 개발된 재구성 로봇의 모듈라리티와 안전도는 일련의 시뮬레이션과 하드웨어 실험을 통해 검증되었다. 실시간으로 조립된 로봇의 기구학/동역학 모델을 얻어내 정밀 제어에 사용하였다. 안전한 모듈 디자인과 충돌 회피 등의 고차원 안전 기능을 통하여, 개발된 재구성 로봇은 기존 협동로봇보다 넓은 안전한 작업공간과 작업속도를 가진다.1 Introduction 1 1.1 Modularity and Recon gurability 1 1.2 Safe Interaction 4 1.3 Contributions of This Thesis 9 1.3.1 A Recon gurable Modular Robot System with Bidirectional Modules 9 1.3.2 A Modular Robot Software Programming Architecture 10 1.3.3 Anticipatory Collision Avoidance Planning 11 1.4 Organization of This Thesis 14 2 Design and Prototyping of the ModMan 17 2.1 Genderless Connector 18 2.2 Modules for ModMan 21 2.2.1 Joint Modules 21 2.2.2 Link and Gripper Modules 25 2.3 Experiments 26 2.3.1 System Setup 26 2.3.2 Repeatability Comparison with Non-recon gurable Robot Manipulators 28 2.3.3 E ect of the O set in Two-dof Modules 30 2.4 Conclusion 32 3 A Programming Architecture for Modular Recon gurable Robots 33 3.1 Data Structure for Multi-dof Joint Modules 34 3.2 Automatic Kinematic Modeling 37 3.3 Automatic Dynamic Modeling 40 3.4 Flexibility in Manipulator 42 3.5 Experiments 45 3.5.1 System Setup 46 3.5.2 Recon gurability 46 3.5.3 Pick-and-Place with Vision Sensors 48 3.6 Conclusion 49 4 A Preparatory Safety Measure for Robust Collision Avoidance 51 4.1 Preliminaries on Manipulability and Safety 52 4.2 Analysis on Reected Mass 56 4.3 Manipulability Control on S+(1;m) 60 4.3.1 Geometry of the Group of Positive Semi-de nite Matrices 60 4.3.2 Rank-One Manipulability Control 63 4.4 Collision Avoidance with Preparatory Action 65 4.4.1 Repulsive and Preparatory Potential Functions 65 4.4.2 Hierarchical Control and Task Relaxation 67 4.5 Experiments 70 4.5.1 Manipulability Control 71 4.5.2 Collision Avoidance 75 4.6 Conclusion 82 5 Collision Avoidance with Velocity-Dependent Constraints 85 5.1 Input-Output Linearization 87 5.2 Invariance Control 89 5.3 Velocity-Dependent Constraints for Robot Safety 90 5.3.1 Velocity-Dependent Repulsive Constraints 90 5.3.2 Preparatory Constraints 92 5.3.3 Corrective Control for Dangerous Initial State 93 5.4 Experiment 95 5.5 Conclusion 98 6 Conclusion 101 6.1 Overview of This Thesis 101 6.2 Future Work 104 Appendix A Appendix 107 A.1 Preliminaries on Graph Theory 107 A.2 Lie-Theoretic Formulations of Robot Kinematics and Dynamics 108 A.3 Derivatives of Eigenvectors and Eigenvalues 110 A.4 Proof of Proposition Proposition 4.1 111 A.5 Proof of Triangle Inequality When p = 1 114 A.6 Detailed Conditions for a Danger Field 115 Bibliography 117 Abstract 127Docto

A Novel Docking and Communications System for Heterogeneous Modular Robots

Modular robots are systems of many independent modules that can mechanically join and communicate with one another to form a robot morphology that can accomplish more than any of the modules could accomplish independently. Systems of modular robots that can dynamically reconfigure can form an ideal morphology for a given task, or repair the system if one or more modules fail. Such capabilities are useful for applications such as operating in harsh environments and exploration of extra-terrestrial planets. Previous work in the field has been focused on locomotion strategies, reconfiguration strategies and docking connector design. While these are all very important areas of research, if modular robots are to progress to the stage of being deployable systems, work needs to be done on developing a holistic platform that research can be built upon. This thesis describes the work that has been done to create a new heterogeneous cubic modular robot platform, Mo*, with particular focus on developing a system that can be used as a standard for modular robot development through a novel connection mechanism and communication strategy It is hoped that this can advance the field of research by allowing providing a platform that can be used for a wide range of future research The system is designed and built, with experiments being performed to test the performance of the docking mechanism and communication system between modules. The hardware system developed in this work could be used and built upon to further advance the capabilities modular robotic systems for real world applications

Modular Self-Reconfigurable Robotic Systems: A Survey on Hardware Architectures

Modular self-reconfigurable robots present wide and unique solutions for growing demands in the domains of space exploration, automation, consumer products, and so forth. The higher utilization factor and self-healing capabilities are most demanded traits in robotics for real world applications and modular robotics offer better solutions in these perspectives in relation to traditional robotics. The researchers in robotics domain identified various applications and prototyped numerous robotic models while addressing constraints such as homogeneity, reconfigurability, form factor, and power consumption. The diversified nature of various modular robotic solutions proposed for real world applications and utilization of different sensor and actuator interfacing techniques along with physical model optimizations presents implicit challenges to researchers while identifying and visualizing the merits/demerits of various approaches to a solution. This paper attempts to simplify the comparison of various hardware prototypes by providing a brief study on hardware architectures of modular robots capable of self-healing and reconfiguration along with design techniques adopted in modeling robots, interfacing technologies, and so forth over the past 25 years

Self-repair during continuous motion with modular robots

Through the use of multiple modules with the ability to reconfigure to form different morphologies, modular robots provide a potential method to develop more adaptable and resilient robots. Robots operating in challenging and hard-to-reach environments such as infrastructure inspection, post-disaster search-and-rescue under rubble and planetary surface exploration, could benefit from the capabilities modularity offers, especially the inherent fault tolerance which reconfigurability can provide. With self-reconfigurable modular robots self-repair, removing failed modules from a larger structure to replace them with operating modules, allows the functionality of the multi-robot organism as a whole to be recovered when modules are damaged. Previous self-repair work has, for the duration of self-repair procedures, paused group tasks in which the multi-robot organism was engaged, this thesis investigates Self-repair during continuous motion, ``Dynamic Self-repair", as a way to allow repair and group tasks to proceed concurrently. In this thesis a new modular robotic platform, Omni-Pi-tent, with capabilities for Dynamic Self-repair is developed. This platform provides a unique combination of genderless docking, omnidirectional locomotion, 3D reconfiguration possibilities and onboard sensing and autonomy. The platform is used in a series of simulated experiments to compare the performance of newly developed dynamic strategies for self-repair and self-assembly to adaptations of previous work, and in hardware demonstrations to explore their practical feasibility. Novel data structures for defining modular robotic structures, and the algorithms to process them for self-repair, are explained. It is concluded that self-repair during continuous motion can allow modular robots to complete tasks faster, and more effectively, than self-repair strategies which require collective tasks to be halted. The hardware and strategies developed in this thesis should provide valuable lessons for bringing modular robots closer to real-world applications

Self-assembly and Self-repair during Motion with Modular Robots

Self-reconfigurable modular robots consist of multiple modular elements and have the potential to enable future autonomous systems to adapt themselves to handle unstructured environments, novel tasks, or damage to their constituent elements. This paper considers methods of self-assembly, bringing together robotic modules to form larger organism-like structures, and self-repair, removing and replacing faulty modules damaged by internal events or environmental phenomena, which allow group tasks for the multi-robot organism to continue to progress while assembly and repair take place. We showthat such “inmotion" strategies can successfully assemble and repair a range of structures. Previously developed self-assembly and self-repair strategies have required group tasks to be halted before they could begin. This paper finds that self-assembly and self-repair methods able to operate during group tasks can enable faster completion of the task than previous strategies, and provide reliability benefits in some circumstances. The practicality of these new methods is shown with physical hardware demonstrations. These results show the feasibility of assembling and repairing modular robots whilst other tasks are in progress

Challenges in the Locomotion of Self-Reconfigurable Modular Robots

Self-Reconfigurable Modular Robots (SRMRs) are assemblies of autonomous robotic units, referred to as modules, joined together using active connection mechanisms. By changing the connectivity of these modules, SRMRs are able to deliberately change their own shape in order to adapt to new environmental circumstances. One of the main motivations for the development of SRMRs is that conventional robots are limited in their capabilities by their morphology. The promise of the field of self-reconfigurable modular robotics is to design robots that are robust, self-healing, versatile, multi-purpose, and inexpensive. Despite significant efforts by numerous research groups worldwide, the potential advantages of SRMRs have yet to be realized. A high number of degrees of freedom and connectors make SRMRs more versatile, but also more complex both in terms of mechanical design and control algorithms. Scalability issues affect these robots in terms of hardware, low-level control, and high-level planning. In this thesis we identify and target three major challenges: (i) Hardware design; (ii) Planning and control; and, (iii) Application challenges. To tackle the hardware challenges we redesigned and manufactured the Self-Reconfigurable Modular Robot Roombots to meet desired requirements and characteristics. We explored in detail and improved two major mechanical components of an SRMR: the actuation and the connection mechanisms. We also analyzed the use of compliant extensions to increase locomotion performance in terms of locomotion speed and power consumption. We contributed to the control challenge by developing new methods that allow an arbitrary SRMR structure to learn to locomote in an efficient way. We defined a novel bio-inspired locomotion-learning framework that allows the quick and reliable optimization of new gaits after a morphological change due to self-reconfiguration or human construction. In order to find new suitable application scenarios for SRMRs we envision the use of Roombots modules to create Self-Reconfigurable Robotic Furniture. As a first step towards this vision, we explored the use and control of Plug-n-Play Robotic Elements that can augment existing pieces of furniture and create new functionalities in a household to improve quality of life

Theory of Self-maintaining Robots

This thesis proposes a theory for robotic systems that can be fully self-maintaining. The presented design principles focus on functional survival of the robots over long periods of time without human maintenance. Self-maintaining semi-autonomous mobile robots are in great demand in nuclear disposal sites from where their removal for maintenance is undesirable due to their radioactive contamination. Similar are requirements for robots in various defence tasks or space missions. For optimal design, modular solutions are balanced against capabilities to replace smaller components in a robot by itself or by help from another robot. Modules are proposed for the basic platform, which enable self-maintenance within a team of robots helping each other. The primary method of self-maintenance is replacement of malfunctioning modules or components by the robots themselves. Replacement necessitates a robot team’s ability to diagnose and replace malfunctioning modules as needed. Due to their design, these robots still remain manually re-configurable if opportunity arises for human intervention. A system reliability model is developed to describe the new theory. Depending on the system reliability model, the redundancy allocation problem is presented and solved by a multi objective algorithm. Finally, the thesis introduces the self-maintaining process and transfers it to a multi robot task allocation problem with a solution by genetic algorithm

High-Dimensional Design Evaluations For Self-Aligning Geometries

Physical connectors with self-aligning geometry aid in the docking process for many robotic and automatic control systems such as robotic self-reconfiguration and air-to-air refueling. This self-aligning geometry provides a wider range of acceptable error tolerance in relative pose between the two rigid objects, increasing successful docking chances. In a broader context, mechanical alignment properties are also useful for other cases such as foot placement and stability, grasping or manipulation. Previously, computational limitations and costly algorithms prevented high-dimensional analysis. The algorithms presented in this dissertation will show a reduced computational time and improved resolution for this kind of problem. This dissertation reviews multiple methods for evaluating modular robot connector geometries as a case study in determining alignment properties. Several metrics are introduced in terms of the robustness of the alignment to errors across the full dimensional range of possible offsets. Algorithms for quantifying error robustness will be introduced and compared in terms of accuracy, reliability, and computational cost. Connector robustness is then compared across multiple design parameters to find trends in alignment behavior. Methods developed and compared include direct simulation and contact space analysis algorithms (geometric by a \u27pre-partitioning\u27 method, and discrete by flooding). Experimental verification for certain subsets is also performed to confirm the results. By evaluating connectors using these algorithms we obtain concrete metric values. We then quantitatively compare their alignment capabilities in either SE(2) or SE(3) under a pseudo-static assumption

Self-sufficiency of an autonomous self-reconfigurable modular robotic organism

In recent years, getting inspiration from simple but complex biological organisms, several advances have been seen in autonomous systems to mimic different behaviors that emerge from the interactions of a large group of simple individuals with each other and with the environment. Among several open issues a significantly important issue, not addressed so far, is the self-sufficiency, or in other words, the energetic autonomy of a modular robotic organism. This feature plays a pivotal role in maintaining a robotic organism\u27s autonomy for a longer period of time. To address the challenges of self-sufficiency, a novel dynamic power management system (PMS) with fault tolerant energy sharing is proposed, realized in the form of hardware and software, and tested. The innate fault tolerant feature of the proposed PMS ensures power sharing in an organism despite docked faulty robotic modules. Due to the unavailability of sufficient number of real robotic modules a simulation framework called Replicator Power Flow Simulator is devised for the implementation of application software layer power management components. The simulation framework was especially devised because at the time of writing this work no simulation tool was available that could be used to perform power sharing and fault tolerance experiments at an organism level. The simulation experiments showed that the proposed application software layer dynamic power sharing policies in combination with the distributed fault tolerance feature in addition to self-sufficiency are expected to enhance the robustness and stability of a real modular robotic organism under varying conditions.Inspiriert von einfachen aber komplexen biologischen Organismen wurden in den letzten Jahren verschiedenste autonome Systeme entwickelt, welche die Verhaltensweisen einer großen Gruppe einfacher Individuen nachahmen. Das zentrale und bis heute ungelöste Problem dieser Organismen ist deren autonome Energieversorgung. Zur Sicherstellung der Energieversorgung eines aus mehreren Robotern zusammengesetzten Organismus wurde in dieser Arbeit ein neuartiges Power-Management-System (PMS) konzipiert, aufgebaut und an einzelnen Robotermodulen und einem Roboterorganismus getestet. Die Hardware eines bestehenden Roboters wurde um ein neues Konzept erweitert, das auch bei fehlerhaften Robotermodulen einen Energieaustausch sicherstellt und so zu einer erhöhten Robustheit des PMS führen soll. Das entwickelte PMS wurde in modulare Roboter integriert und beispielhaft anhand eines Roboterorganismus getestet. In Ermangelung einer ausreichenden Anzahl von Robotermodulen wurde eine Simulationsumgebung entwickelt und die Software des PMS im Simulationsprogramm, anstatt im Roboter, implementiert. Dieses Simulationswerkzeug ist momentan das Einzige, das unter Berücksichtigung des Bewegungsmodells des Organismus den Energietransport im Roboterorganismus visuell darstellt und das Verhalten in verschiedenen Fehlerfällen simulieren kann. Die Simulationen und Messungen zeigen, dass das entwickelte PMS geeignet ist, die Energieversorgung von Roboterorganismen auch in Fehlerfällen sicherzustellen und so die Stabilität und Robustheit zu erhöhen