A Vision-based Scheme for Kinematic Model Construction of Re-configurable Modular Robots

Re-configurable modular robotic (RMR) systems are advantageous for their reconfigurability and versatility. A new modular robot can be built for a specific task by using modules as building blocks. However, constructing a kinematic model for a newly conceived robot requires significant work. Due to the finite size of module-types, models of all module-types can be built individually and stored in a database beforehand. With this priori knowledge, the model construction process can be automated by detecting the modules and their corresponding interconnections. Previous literature proposed theoretical frameworks for constructing kinematic models of modular robots, assuming that such information was known a priori. While well-devised mechanisms and built-in sensors can be employed to detect these parameters automatically, they significantly complicate the module design and thus are expensive. In this paper, we propose a vision-based method to identify kinematic chains and automatically construct robot models for modular robots. Each module is affixed with augmented reality (AR) tags that are encoded with unique IDs. An image of a modular robot is taken and the detected modules are recognized by querying a database that maintains all module information. The poses of detected modules are used to compute: (i) the connection between modules and (ii) joint angles of joint-modules. Finally, the robot serial-link chain is identified and the kinematic model constructed and visualized. Our experimental results validate the effectiveness of our approach. While implementation with only our RMR is shown, our method can be applied to other RMRs where self-identification is not possible

Generalized approach to the modelling of modular machines

This paper describes a method of graphically simulating modular machines within a computer aided design environment. This forms part of a much larger Science and Engineering Research Council (SERC) funded programme aimed at advancing modern practices when designing and building manufacturing machines. A generalized approach to the synthesis of the generic features of various kinematic motion pairs is presented and prismatic and revolute motion primitives generalized in their functional and geometric aspects. A hierarchical ring and tree data structure has been designed and implemented to comprehensively represent these motion pairs and to simulate their performance. More complex modular manufacturing machines can be represented using information from a library of up to three degree of freedom motion modules. Seven two degree of freedom motion primitives and twelve three degree of freedom motion primitives with articulation configurations have been analyzed and included in the motion primitive library. The configuration of modular machines comprised of physically separate but logically connected distributed motion primitives are described. Examples of a two-finger industrial robot gripper and a three-finger industrial robot hand are used to demonstrate the general principles

Graphical modelling of modular machines

This research is aimed at advancing machine design through specifying and implementing (in "proof of concept" form) a set of tools which graphically model modular machines. The tools allow mechanical building elements (or machine modules) to be selected and configured together in a highly flexible manner so that operation of the chosen configuration can be simulated and performance properties evaluated. Implementation of the tools has involved an extension in capability of a proprietary robot simulation system. This research has resulted in a general approach to graphically modelling manufacturing machines built from modular elements. A focus of study has been on a decomposition of machine functionality leading to the establishment of a library of modular machine primitives. This provides a useful source of commonly required machine building elements for use by machine designers. Study has also focussed on the generation of machine configuration tools which facilitate the construction of a simulation model and ultimately the physical machine itself. Simulation aspects of machine control are also considered which depict methods of manipulating a machine model in the simulation phase. In addition methods of achieving machine programming have been considered which specify the machine and its operational tasks. Means of adopting common information data structures are also considered which can facilitate interfacing with other systems, including the physical machine system constructed as an issue of the simulation phase. Each of these study areas is addressed in its own context, but collectively they provide a means of creating a complete modular machine design environment which can provide significant assistance to machine designers. Part of the methodology employed in the study is based on the use of the discrete event simulation technique. To easily and effectively describe a modular machine and its activity in a simulation model, a hierarchical ring and tree data structure has been designed and implemented. The modularity and reconfigurability are accommodated by the data structure, and homogeneous transformations are adopted to determine the spatial location and orientation of each of the machine elements. A three-level machine task programming approach is used to describe the machine's activities. A common data format method is used to interface the machine design environment with the physical machine and other building blocks of manufacturing systems (such as CAD systems) where systems integration approaches can lead to enhanced product realisation. The study concludes that a modular machine design environment can be created by employing the graphical simulation approach together with a set of comprehensive configuration. tools. A generic framework has been derived which outlines the way in which machine design environments can be constructed and suggestions are made as to how the proof of concept design environment implemented in this study can be advanced

안전한 재구성 로봇 시스템: 설계, 프로그래밍 및 반응형 경로계획

학위논문 (박사) -- 서울대학교 대학원 : 공과대학 기계항공공학부, 2020. 8. 박종우.The next generation of robots are being asked to work in close proximity to humans. At the same time, the robot should have the ability to change its topology to flexibly cope with various tasks. To satisfy these two requirements, we propose a novel modular reconfi gurable robot and accompanying software architecture, together with real-time motion planning algorithms to allow for safe operation in unstructured dynamic environments with humans. Two of the key innovations behind our modular manipulator design are a genderless connector and multi-dof modules. By making the modules connectable regardless of the input/output directions, a genderless connector increases the number of possible connections. The developed genderless connector can transmit as much load as necessary to an industrial robot. In designing two-dof modules, an offset between two joints is imposed to improve the overall integration and the safety of the modules. To cope with the complexity in modeling due to the genderless connector and multi-dof modules, a programming architecture for modular robots is proposed. The key feature of the proposed architecture is that it efficiently represents connections of multi-dof modules only with connections between modules, while existing architectures should explicitly represent all connections between links and joints. The data structure of the proposed architecture contains properties of tree-structured multi-dof modules with intra-module relations. Using the data structure and connection relations between modules, kinematic/dynamic parameters of connected modules can be obtained through forward recursion. For safe operation of modular robots, real-time robust collision avoidance algorithms for kinematic singularities are proposed. The main idea behind the algorithms is generating control inputs that increase the directional manipulability of the robot to the object direction by reducing directional safety measures. While existing directional safety measures show undesirable behaviors in the vicinity of the kinematic singularities, the proposed geometric safety measure generates stable control inputs in the entire joint space. By adding the preparatory input from the geometric safety measure to the repulsive input, a hierarchical collision avoidance algorithm that is robust to kinematic singularity is implemented. To mathematically guarantee the safety of the robot, another collision avoidance algorithm using the invariance control framework with velocity-dependent safety constraints is proposed. When the object approached the robot from a singular direction, the safety constraints are not satis ed in the initial state of the robot and the safety cannot be guaranteed using the invariance control. By proposing a control algorithm that quickly decreases the preparatory constraints below thresholds, the robot re-enters the constraint set and avoids collisions using the invariance control framework. The modularity and safety of the developed reconfi gurable robot is validated using a set of simulations and hardware experiments. The kinematic/dynamic model of the assembled robot is obtained in real-time and used to accurately control the robot. Due to the safe design of modules with o sets and the high-level safety functions with collision avoidance algorithms, the developed recon figurable robot has a broader safe workspace and wider ranger of safe operation speed than those of cooperative robots.다음 세대의 로봇은 사람과 가까이에서 협업할 수 있는 기능을 가져야한다. 그와 동시에, 로봇은 다양하게 변하는 작업에 대해 유연하게 대처할 수 있도록 자신의 구조를 바꾸는 기능을 가져야 한다. 이러한 두 가지 요구조건을 만족시키기 위해, 본 논문에서는 새로운 모듈라 로봇 시스템과 프로그래밍 아키텍쳐를 제시하고, 사람이 존재하는 동적 환경에서 안전한 로봇의 운용을 위한 실시한 경로 계획 알고리즘을 제시한다. 개발된 모듈라 로봇의 두 가지 핵심적인 혁신성은 무성별 커넥터와 다자유도 모듈에서 찾을 수 있다. 입력/출력 방향에 상관 없이 모듈이 연결될 수 있도록 함으로써, 무성별 커넥터는 결합 가능한 경우의 수를 늘릴 수 있다. 개발된 무성별 커넥터는 산업용 로봇에서 요구되는 충분한 부하를 견딜 수 있도록 설계되었다. 2 자유도 모듈의 설계에서 두 축 사이에 오프셋을 가지도록 함으로써 전체적인 완성도 및 안전도를 증가시켰다. 무성별 커넥터와 다자유도 모듈로 인한 모델링의 복잡성에 대응하기 위해, 일반적인 모듈라 로봇을 위한 소프트웨어 아키텍쳐를 제안하였다. 기존 모듈라 로봇의 연결을 나타내는 방법이 모든 링크와 조인트 사이의 연결 관계를 별도로 나타내야하는 것과 다르게, 제안된 아키텍쳐는 모듈들 사이의 연결관계만을 나타냄으로써 효율적인 다자유도 모듈의 연결관계를 나타낼 수 있다는 것을 특징으로 한다. 이를 위해 트리 구조를 가지는 일반적인 다자유도 모듈의 성질을 나타내는 데이터 구조를 정의하였다. 모듈들 사이의 연결관계 및 데이터 구조를 이용하여, 정확한 기구학/동역학 모델 파라미터를 얻어내는 순방향 재귀 알고리즘을 구현하였다. 모듈라 로봇의 안전한 운용을 위해, 기구학적 특이점에 강건한 실시간 충돌회피 알고리즘을 제안하였다. 방향성 안전도를 줄이는 방향의 제어 입력을 생성하여 물체 방향으로의 로봇 방향성 매니퓰러빌리티를 증가시키는 것이 제안한 알고리즘의 핵심이다. 기존의 방향성 안전도가 기구학적 특이점 근처에서 원하지 않는 성질을 가지는 것과는 반대로, 제안한 기하학적 안전도는 전체 조인트 공간에서 안정적인 제어 입력을 생성한다. 이 기하학적 안전도를 이용하여, 기구학적 특이점에 강건한 계층적 충돌회피 알고리즘을 구현하였다. 수학적으로 로봇의 안전도를 보장하기 위해, 상대속도에 종속적인 안전 제약조건을 가지는 불변 제어 프레임워크을 이용하여 또 하나의 충돌 회피 알고리즘을 제안하였다. 물체가 특이점 방향으로부터 로봇에 접근할 때, 로봇의 초기 상태에서 안전 제약조건을 만족시키지 못하게 되어 불변제어를 적용할 수 없게 된다. 준비 제약조건을 빠르게 임계점 아래로 감소시키는 알고리즘을 적용함으로써, 로봇은 제약조건 집합에 다시 들어가고 불변 제어 방법을 이용하여 충돌을 회피할 수 있게 된다. 개발된 재구성 로봇의 모듈라리티와 안전도는 일련의 시뮬레이션과 하드웨어 실험을 통해 검증되었다. 실시간으로 조립된 로봇의 기구학/동역학 모델을 얻어내 정밀 제어에 사용하였다. 안전한 모듈 디자인과 충돌 회피 등의 고차원 안전 기능을 통하여, 개발된 재구성 로봇은 기존 협동로봇보다 넓은 안전한 작업공간과 작업속도를 가진다.1 Introduction 1 1.1 Modularity and Recon gurability 1 1.2 Safe Interaction 4 1.3 Contributions of This Thesis 9 1.3.1 A Recon gurable Modular Robot System with Bidirectional Modules 9 1.3.2 A Modular Robot Software Programming Architecture 10 1.3.3 Anticipatory Collision Avoidance Planning 11 1.4 Organization of This Thesis 14 2 Design and Prototyping of the ModMan 17 2.1 Genderless Connector 18 2.2 Modules for ModMan 21 2.2.1 Joint Modules 21 2.2.2 Link and Gripper Modules 25 2.3 Experiments 26 2.3.1 System Setup 26 2.3.2 Repeatability Comparison with Non-recon gurable Robot Manipulators 28 2.3.3 E ect of the O set in Two-dof Modules 30 2.4 Conclusion 32 3 A Programming Architecture for Modular Recon gurable Robots 33 3.1 Data Structure for Multi-dof Joint Modules 34 3.2 Automatic Kinematic Modeling 37 3.3 Automatic Dynamic Modeling 40 3.4 Flexibility in Manipulator 42 3.5 Experiments 45 3.5.1 System Setup 46 3.5.2 Recon gurability 46 3.5.3 Pick-and-Place with Vision Sensors 48 3.6 Conclusion 49 4 A Preparatory Safety Measure for Robust Collision Avoidance 51 4.1 Preliminaries on Manipulability and Safety 52 4.2 Analysis on Reected Mass 56 4.3 Manipulability Control on S+(1;m) 60 4.3.1 Geometry of the Group of Positive Semi-de nite Matrices 60 4.3.2 Rank-One Manipulability Control 63 4.4 Collision Avoidance with Preparatory Action 65 4.4.1 Repulsive and Preparatory Potential Functions 65 4.4.2 Hierarchical Control and Task Relaxation 67 4.5 Experiments 70 4.5.1 Manipulability Control 71 4.5.2 Collision Avoidance 75 4.6 Conclusion 82 5 Collision Avoidance with Velocity-Dependent Constraints 85 5.1 Input-Output Linearization 87 5.2 Invariance Control 89 5.3 Velocity-Dependent Constraints for Robot Safety 90 5.3.1 Velocity-Dependent Repulsive Constraints 90 5.3.2 Preparatory Constraints 92 5.3.3 Corrective Control for Dangerous Initial State 93 5.4 Experiment 95 5.5 Conclusion 98 6 Conclusion 101 6.1 Overview of This Thesis 101 6.2 Future Work 104 Appendix A Appendix 107 A.1 Preliminaries on Graph Theory 107 A.2 Lie-Theoretic Formulations of Robot Kinematics and Dynamics 108 A.3 Derivatives of Eigenvectors and Eigenvalues 110 A.4 Proof of Proposition Proposition 4.1 111 A.5 Proof of Triangle Inequality When p = 1 114 A.6 Detailed Conditions for a Danger Field 115 Bibliography 117 Abstract 127Docto

A hyper-redundant manipulator

“Hyper-redundant” manipulators have a very large number of actuatable degrees of freedom. The benefits of hyper-redundant robots include the ability to avoid obstacles, increased robustness with respect to mechanical failure, and the ability to perform new forms of robot locomotion and grasping. The authors examine hyper-redundant manipulator design criteria and the physical implementation of one particular design: a variable geometry truss

Unified Modeling of Unconventional Modular and Reconfigurable Manipulation System

Customization of manipulator configurations using modularity and reconfigurability aspects is receiving much attention. Modules presented so far in literature deals with the conventional and standard configurations. This paper presents the 3D printable, light-weight and unconventional modules: MOIRs' Mark-2, to develop any custom `n'-Degrees-of-Freedom (DoF) serial manipulator even with the non-parallel and non-perpendicular jointed configuration. These unconventional designs of modular configurations seek an easy adaptable solution for both modular assembly and software interfaces for automatic modeling and control. A strategy of assembling the modules, automatic and unified modeling of the modular and reconfigurable manipulators with unconventional parameters is proposed in this paper using the proposed 4 modular units. A reconfigurable software architecture is presented for the automatic generation of kinematic and dynamic models and configuration files, through which, a designer can design, validate using visualization, plan and execute the motion of the developed configuration as required. The framework developed is based upon an open source platform called as Robot Operating System (ROS), which acts as a digital twin for the modular configurations. For the experimental demonstration, a 3D printed modular library is developed and an unconventional configuration is assembled, using the proposed modules followed by automatic modeling and control, for a single cell of the vertical farm setup

A Rapidly Reconfigurable Robotics Workcell and Its Applictions for Tissue Engineering

This article describes the development of a component-based technology robot system that can be rapidly configured to perform a specific manufacturing task. The system is conceived with standard and inter-operable components including actuator modules, rigid link connectors and tools that can be assembled into robots with arbitrary geometry and degrees of freedom. The reconfigurable "plug-and-play" robot kinematic and dynamic modeling algorithms are developed. These algorithms are the basis for the control and simulation of reconfigurable robots. The concept of robot configuration optimization is introduced for the effective use of the rapidly reconfigurable robots. Control and communications of the workcell components are facilitated by a workcell-wide TCP/IP network and device level CAN-bus networks. An object-oriented simulation and visualization software for the reconfigurable robot is developed based on Windows NT. Prototypes of the robot systems configured to perform 3D contour following task and the positioning task are constructed and demonstrated. Applications of such systems for biomedical tissue scaffold fabrication are considered.Singapore-MIT Alliance (SMA

Automatic Modeling for Modular Reconfigurable Robotic Systems: Theory and Practice

A modular reconfigurable robot consists of a collection of individual link and joint components that can be assembled into a number of different robot ge-ometries. Compared to a conventional industrial robot with fixed geometry, such a system can provide flexibility to the user to cope with a wide spectru

Kinematically optimal hyper-redundant manipulator configurations

“Hyper-redundant” robots have a very large or infinite degree of kinematic redundancy. This paper develops new methods for determining “optimal” hyper-redundant manipulator configurations based on a continuum formulation of kinematics. This formulation uses a backbone curve model to capture the robot's essential macroscopic geometric features. The calculus of variations is used to develop differential equations, whose solution is the optimal backbone curve shape. We show that this approach is computationally efficient on a single processor, and generates solutions in O(1) time for an N degree-of-freedom manipulator when implemented in parallel on O(N) processors. For this reason, it is better suited to hyper-redundant robots than other redundancy resolution methods. Furthermore, this approach is useful for many hyper-redundant mechanical morphologies which are not handled by known methods