Genetically evolved dynamic control for quadruped walking

The aim of this dissertation is to show that dynamic control of quadruped locomotion is achievable through the use of genetically evolved central pattern generators. This strategy is tested both in simulation and on a walking robot. The design of the walker has been chosen to be statically unstable, so that during motion less than three supporting feet may be in contact with the ground. The control strategy adopted is capable of propelling the artificial walker at a forward locomotion speed of ~1.5 Km/h on rugged terrain and provides for stability of motion. The learning of walking, based on simulated genetic evolution, is carried out in simulation to speed up the process and reduce the amount of damage to the hardware of the walking robot. For this reason a general-purpose fast dynamic simulator has been developed, able to efficiently compute the forward dynamics of tree-like robotic mechanisms. An optimization process to select stable walking patterns is implemented through a purposely designed genetic algorithm, which implements stochastic mutation and cross-over operators. The algorithm has been tailored to address the high cost of evaluation of the optimization function, as well as the characteristics of the parameter space chosen to represent controllers. Experiments carried out on different conditions give clear indications on the potential of the approach adopted. A proof of concept is achieved, that stable dynamic walking can be obtained through a search process which identifies attractors in the dynamics of the motor-control system of an artificial walker

Consider the robot - Abstraction of bioinspired leg coordination and its application to a hexapod robot under consideration of technical constraints

Paskarbeit J. Consider the robot - Abstraction of bioinspired leg coordination and its application to a hexapod robot under consideration of technical constraints. Bielefeld: Universität Bielefeld; 2017.To emulate the movement agility and adaptiveness of stick insects in technical systems such as piezo actuators (Szufnarowski et al. 2014) or hexapod robots (Schneider, Cruse et al. 2006), a direct adaptation of bioinspired walking controllers like WALKNET has often been suggested. However, stick insects have very specific features such as adhesive foot pads that allow them to cling to the ground. Typically, robots do not possess such features. Besides, robots tend to be bigger and heavier than their biological models, usually possessing a different mass distribution as well. This leads to different mechanical and functional properties that need to be addressed in control. Based on the model of the stick insect *Carausius morosus*, the six-legged robot HECTOR was developed in this work to test and evaluate bioinspired controllers. The robot's geometrical layout corresponds to that of the stick insect, scaled up by a factor of 20. Moreover, like the stick insect, the robot features an inherent compliance in its joints. This compliance facilitates walking in uneven terrain since small irregularities can be compensated passively without controller intervention. However, the robot differs from the biological model, e.g., in terms of its size, mass, and mass distribution. Also, it does not possess any means to cling to the ground and therefore must maintain static stability to avoid tilting. To evaluate the ability of stick insects to maintain static stability, experimental data (published by Theunissen et al. (2014)) was examined. It can be shown that stick insects do not maintain static stability at all times. Still, due to their adhesive foot pads, they do not tumble. Therefore, a direct replication of the biological walking controller would not be suitable for the control of HECTOR. In a next step, the bioinspired walking controller WALKNET (Cruse, Kindermann, et al. 1998) was evaluated regarding its applicability for the control of HECTOR. For this purpose, different parametrizations of WALKNET were tested in a simulation environment. For forward walking, parameter sets were found that achieve a high, although not permanent stability. Thus, for the control of HECTOR, which requires continuous stability, a more abstract adaption of the bioinspired coordination had to be found. Based on the original coordination concepts of WALKNET, new coordination mechanisms were developed that incorporate the technical requirements (static stability, angular joint limits, torque constraints, etc.). The ability of the resulting controller to generate insect-like gaits is demonstrated for different walking scenarios in simulation. Moreover, locomotion that is unlikely for insects such as backwards and sidewards walking is shown to be feasible using the novel control approach. At the end of this work the applicability of the approach for the control of the real robot is proved in experiments on visual collision avoidance and basic climbing ability

Affordances And Control Of A Spine Morphology For Robotic Quadrupedal Locomotion

How does a robot\u27s body affect what it can do? This thesis explores the question with respect to a body morphology common to biology but rare in contemporary robotics: the presence of a bendable back. In this document, we introduce the Canid and Inu quadrupedal robots designed to test hypotheses related to the presence of a robotic sagittal-plane bending back (which we refer to as a ``spine morphology\u27\u27). The thesis then describes and quantifies several advantages afforded by this morphological design choice that can be evaluated against its added weight and complexity, and proposes control strategies to both deal with the increase in degrees-of-freedom from the spine morphology and to leverage an increase in agility to reactively navigate irregular terrain. Specifically, we show using the metric of ``specific agility\u27\u27 that a spine can provides a reservoir of elastic energy storage that can be rapidly converted to kinetic energy, that a spine can augment the effective workspace of the legs without diminishing their force generation capability, and that -- in cases of direct-drive or nearly direct-drive leg actuation -- the spine motors can contribute more work in stance than the same actuator weight used in the legs, but can do so without diminishing the platform\u27s proprioceptive capabilities. To put to use the agility provided by a suitably designed robotic platform, we introduce a formalism to approximate a set of transitional navigational tasks over irregular terrain such as leaping over a gap that lend itself to doubly reactive control synthesis. We also directly address the increased complexity introduced by the spine joint with a modular compositional control framework with nice stability properties that begins to offer insight into the role of spines for steady-state running. A central theme to both the reactive navigation and the modular control frameworks is that analytical tractability is achieved by approximating the modes driving the environmental interactions with constant-acceleration dynamics

Reactive Planning With Legged Robots In Unknown Environments

Unlike the problem of safe task and motion planning in a completely known environment, the setting where the obstacles in a robot\u27s workspace are not initially known and are incrementally revealed online has so far received little theoretical interest, with existing algorithms usually demanding constant deliberative replanning in the presence of unanticipated conditions. Moreover, even though recent advances show that legged platforms are becoming better at traversing rough terrains and environments, legged robots are still mostly used as locomotion research platforms, with applications restricted to domains where interaction with the environment is usually not needed and actively avoided. In order to accomplish challenging tasks with such highly dynamic robots in unexplored environments, this research suggests with formal arguments and empirical demonstration the effectiveness of a hierarchical control structure, that we believe is the first provably correct deliberative/reactive planner to engage an unmodified general purpose mobile manipulator in physical rearrangements of its environment. To this end, we develop the mobile manipulation maneuvers to accomplish each task at hand, successfully anchor the useful kinematic unicycle template to control our legged platforms, and integrate perceptual feedback with low-level control to coordinate each robot\u27s movement. At the same time, this research builds toward a useful abstraction for task planning in unknown environments, and provides an avenue for incorporating partial prior knowledge within a deterministic framework well suited to existing vector field planning methods, by exploiting recent developments in semantic SLAM and object pose and triangular mesh extraction using convolutional neural net architectures. Under specific sufficient conditions, formal results guarantee collision avoidance and convergence to designated (fixed or slowly moving) targets, for both a single robot and a robot gripping and manipulating objects, in previously unexplored workspaces cluttered with non-convex obstacles. We encourage the application of our methods by providing accompanying software with open-source implementations of our algorithms

협업 로봇을 위한 서비스 기반과 모델 기반의 소프트웨어 개발 방법론

학위논문(박사)--서울대학교 대학원 :공과대학 전기·컴퓨터공학부,2020. 2. 하순회.가까운 미래에는 다양한 로봇이 다양한 분야에서 하나의 임무를 협력하여 수행하는 모습은 흔히 볼 수 있게 될 것이다. 그러나 실제로 이러한 모습이 실현되기에는 두 가지의 어려움이 있다. 먼저 로봇을 운용하기 위한 소프트웨어를 명세하는 기존 연구들은 대부분 개발자가 로봇의 하드웨어와 소프트웨어에 대한 지식을 알고 있는 것을 가정하고 있다. 그래서 로봇이나 컴퓨터에 대한 지식이 없는 사용자들이 여러 대의 로봇이 협력하는 시나리오를 작성하기는 쉽지 않다. 또한, 로봇의 소프트웨어를 개발할 때 로봇의 하드웨어의 특성과 관련이 깊어서, 다양한 로봇의 소프트웨어를 개발하는 것도 간단하지 않다. 본 논문에서는 상위 수준의 미션 명세와 로봇의 행위 프로그래밍으로 나누어 새로운 소프트웨어 개발 프레임워크를 제안한다. 또한, 본 프레임워크는 크기가 작은 로봇부터 계산 능력이 충분한 로봇들이 서로 군집을 이루어 미션을 수행할 수 있도록 지원한다. 본 연구에서는 로봇의 하드웨어나 소프트웨어에 대한 지식이 부족한 사용자도 로봇의 동작을 상위 수준에서 명세할 수 있는 스크립트 언어를 제안한다. 제안하는 언어는 기존의 스크립트 언어에서는 지원하지 않는 네 가지의 기능인 팀의 구성, 각 팀의 서비스 기반 프로그래밍, 동적으로 모드 변경, 다중 작업(멀티 태스킹)을 지원한다. 우선 로봇은 팀으로 그룹 지을 수 있고, 로봇이 수행할 수 있는 기능을 서비스 단위로 추상화하여 새로운 복합 서비스를 명세할 수 있다. 또한 로봇의 멀티 태스킹을 위해 '플랜' 이라는 개념을 도입하였고, 복합 서비스 내에서 이벤트를 발생시켜서 동적으로 모드가 변환할 수 있도록 하였다. 나아가 여러 로봇의 협력이 더욱 견고하고, 유연하고, 확장성을 높이기 위해, 군집 로봇을 운용할 때 로봇이 임무를 수행하는 도중에 문제가 생길 수 있으며, 상황에 따라 로봇을 동적으로 다른 행위를 수행할 수 있다고 가정한다. 이를 위해 동적으로도 팀을 구성할 수 있고, 여러 대의 로봇이 하나의 서비스를 수행하는 그룹 서비스를 지원하고, 일대 다 통신과 같은 새로운 기능을 스크립트 언어에 반영하였다. 따라서 확장된 상위 수준의 스크립트 언어는 비전문가도 다양한 유형의 협력 임무를 쉽게 명세할 수 있다. 로봇의 행위를 프로그래밍하기 위해 다양한 소프트웨어 개발 프레임워크가 연구되고 있다. 특히 재사용성과 확장성을 중점으로 둔 연구들이 최근 많이 사용되고 있지만, 대부분의 이들 연구는 리눅스 운영체제와 같이 많은 하드웨어 자원을 필요로 하는 운영체제를 가정하고 있다. 또한, 프로그램의 분석 및 성능 예측 등을 고려하지 않기 때문에, 자원 제약이 심한 크기가 작은 로봇의 소프트웨어를 개발하기에는 어렵다. 그래서 본 연구에서는 임베디드 소프트웨어를 설계할 때 쓰이는 정형적인 모델을 이용한다. 이 모델은 정적 분석과 성능 예측이 가능하지만, 로봇의 행위를 표현하기에는 제약이 있다. 그래서 본 논문에서 외부의 이벤트에 의해 수행 중간에 행위를 변경하는 로봇을 위해 유한 상태 머신 모델과 데이터 플로우 모델이 결합하여 동적 행위를 명세할 수 있는 확장된 모델을 적용한다. 그리고 딥러닝과 같이 계산량을 많이 필요로 하는 응용을 분석하기 위해, 루프 구조를 명시적으로 표현할 수 있는 모델을 제안한다. 마지막으로 여러 로봇의 협업 운용을 위해 로봇 사이에 공유되는 정보를 나타내기 위해 두 가지 모델을 사용한다. 먼저 중앙에서 공유 정보를 관리하기 위해 라이브러리 태스크라는 특별한 태스크를 통해 공유 정보를 나타낸다. 또한, 로봇이 자신의 정보를 가까운 로봇들과 공유하기 위해 멀티캐스팅을 위한 새로운 포트를 추가한다. 이렇게 확장된 정형적인 모델은 실제 로봇 코드로 자동 생성되어, 소프트웨어 설계 생산성 및 개발 효율성에 이점을 가진다. 비전문가가 명세한 스크립트 언어는 정형적인 태스크 모델로 변환하기 위해 중간 단계인 전략 단계를 추가하였다. 제안하는 방법론의 타당성을 검증하기 위해, 시뮬레이션과 여러 대의 실제 로봇을 이용한 협업하는 시나리오에 대해 실험을 진행하였다.In the near future, it will be common that a variety of robots are cooperating to perform a mission in various fields. There are two software challenges when deploying collaborative robots: how to specify a cooperative mission and how to program each robot to accomplish its mission. In this paper, we propose a novel software development framework that separates mission specification and robot behavior programming, which is called service-oriented and model-based (SeMo) framework. Also, it can support distributed robot systems, swarm robots, and their hybrid. For mission specification, a novel scripting language is proposed with the expression capability. It involves team composition and service-oriented behavior specification of each team, allowing dynamic mode change of operation and multi-tasking. Robots are grouped into teams, and the behavior of each team is defined with a composite service. The internal behavior of a composite service is defined by a sequence of services that the robots will perform. The notion of plan is applied to express multi-tasking. And the robot may have various operating modes, so mode change is triggered by events generated in a composite service. Moreover, to improve the robustness, scalability, and flexibility of robot collaboration, the high-level mission scripting language is extended with new features such as team hierarchy, group service, one-to-many communication. We assume that any robot fails during the execution of scenarios, and the grouping of robots can be made at run-time dynamically. Therefore, the extended mission specification enables a casual user to specify various types of cooperative missions easily. For robot behavior programming, an extended dataflow model is used for task-level behavior specification that does not depend on the robot hardware platform. To specify the dynamic behavior of the robot, we apply an extended task model that supports a hybrid specification of dataflow and finite state machine models. Furthermore, we propose a novel extension to allow the explicit specification of loop structures. This extension helps the compute-intensive application, which contains a lot of loop structures, to specify explicitly and analyze at compile time. Two types of information sharing, global information sharing and local knowledge sharing, are supported for robot collaboration in the dataflow graph. For global information, we use the library task, which supports shared resource management and server-client interaction. On the other hand, to share information locally with near robots, we add another type of port for multicasting and use the knowledge sharing technique. The actual robot code per robot is automatically generated from the associated task graph, which minimizes the human efforts in low-level robot programming and improves the software design productivity significantly. By abstracting the tasks or algorithms as services and adding the strategy description layer in the design flow, the mission specification is refined into task-graph specification automatically. The viability of the proposed methodology is verified with preliminary experiments with three cooperative mission scenarios with heterogeneous robot platforms and robot simulator.Chapter 1. Introduction 1 1.1 Motivation 1 1.2 Contribution 7 1.3 Dissertation Organization 9 Chapter 2. Background and Existing Research 11 2.1 Terminologies 11 2.2 Robot Software Development Frameworks 25 2.3 Parallel Embedded Software Development Framework 31 Chapter 3. Overview of the SeMo Framework 41 3.1 Motivational Examples 45 Chapter 4. Robot Behavior Programming 47 4.1 Related works 48 4.2 Model-based Task Graph Specification for Individual Robots 56 4.3 Model-based Task Graph Specification for Cooperating Robots 70 4.4 Automatic Code Generation 74 4.5 Experiments 78 Chapter 5. High-level Mission Specification 81 5.1 Service-oriented Mission Specification 82 5.2 Strategy Description 93 5.3 Automatic Task Graph Generation 96 5.4 Related works 99 5.5 Experiments 104 Chapter 6. Conclusion 114 6.1 Future Research 116 Bibliography 118 Appendices 133 요약 158Docto

Flexible Supervised Autonomy for Exploration in Subterranean Environments

While the capabilities of autonomous systems have been steadily improving in recent years, these systems still struggle to rapidly explore previously unknown environments without the aid of GPS-assisted navigation. The DARPA Subterranean (SubT) Challenge aimed to fast track the development of autonomous exploration systems by evaluating their performance in real-world underground search-and-rescue scenarios. Subterranean environments present a plethora of challenges for robotic systems, such as limited communications, complex topology, visually-degraded sensing, and harsh terrain. The presented solution enables long-term autonomy with minimal human supervision by combining a powerful and independent single-agent autonomy stack, with higher level mission management operating over a flexible mesh network. The autonomy suite deployed on quadruped and wheeled robots was fully independent, freeing the human supervision to loosely supervise the mission and make high-impact strategic decisions. We also discuss lessons learned from fielding our system at the SubT Final Event, relating to vehicle versatility, system adaptability, and re-configurable communications.Comment: Field Robotics special issue: DARPA Subterranean Challenge, Advancement and Lessons Learned from the Final

Generating timed trajectories foran autonomous robot

Tese de Doutoramento Programa Doutoral em Engenharia Electrónica e ComputadoresThe inclusion of timed movements in control architectures for mobile navigation has received an increasing attention over the last years. Timed movements allow modulat- ing the behavior of the mobile robot according to the elapsed time, such that the robot reaches a goal location within a specified time constraint. If the robot takes longer than expected to reach the goal location, its linear velocity is increased for compen- sating the delay. Timed movements are also relevant when sequences of missions are considered. The robot should follow the predefined time schedule, so that the next mission is initiated without delay. The performance of the architecture that controls the robot can be validated through simulations and field experiments. However, ex- perimental tests do not cover all the possible solutions. These should be guided by a stability analysis, which might provide directions to improve the architecture design in cases of inadequate performance of the architecture. This thesis aims at developing a navigation architecture and its stability analysis based on the Contraction Theory. The architecture is based on nonlinear dynamical systems and must guide a mobile robot, such that it reaches a goal location within a time constraint while avoiding unexpected obstacles in a cluttered and dynamic real environment. The stability analysis based on the Contraction Theory might provide conditions to the dynamical systems parameters, such that the dynamical systems are designed as contracting, ensuring the global exponential stability of the architecture. Furthermore, Contraction Theory provides solutions to analyze the success of the mis- sion as a stability problem. This provides formal results that evaluate the performance of the architecture, allowing the comparison to other navigation architectures. To verify the ability of the architecture to guide the mobile robot, several experi- mental tests were conducted. The obtained results show that the proposed architecture is able to drive mobile robots with timed movements in indoor environments for large distances without human intervention. Furthermore, the results show that the Con- traction Theory is an important tool to design stable control architectures and to analyze the success of the robotic missions as a stability problem.A inclusão de movimentos temporizados em arquitecturas de controlo para navegação móvel tem aumentado ao longo dos últimos anos. Movimentos temporizados permitem modular o comportamento do robô de tal forma que ele chegue ao seu destino dentro de um tempo especificado. Se o robô se atrasar, a sua velocidade linear deve ser aumen- tada para compensar o atraso. Estes movimentos são também importantes quando se consideram sequências de missões. O robô deve seguir o escalonamento da sequência, de tal forma que a próxima missão seja iniciada sem atraso. O desempenho da arqui- tectura pode ser validado através de simulações e experiências reais. Contudo, testes experimentais não cobrem todas as possíveis soluções. Estes devem ser conduzidos por uma análise de estabilidade, que pode fornecer direcções para melhorar o desempenho da arquitectura. O objectivo desta tese é desenvolver uma arquitectura de navegação e analisar a sua estabilidade através da teoria da Contracção. A arquitectura é baseada em sistemas dinâmicos não lineares e deve controlar o robô móvel num ambiente real, desordenado e dinâmico, de tal modo que ele chegue à posição alvo dentro de uma restrição de tempo especificada. A análise de estabilidade baseada na teoria da Contracção pode fornecer condições aos parâmetros dos sistemas dinâmicos de modo a desenha-los como contracções, e assim garantir a estabilidade exponencial global da arquitectura. Esta teoria fornece ainda soluções interessantes para analisar o sucesso da missão como um problema de estabilidade. Isto providencia resultados formais que avaliam o desem- penho da arquitectura e permitem a comparação com outras arquitecturas. Para verificar a habilidade da arquitectura em controlar o robô móvel, foram con- duzidos vários testes experimentais. Os resultados obtidos mostram que a arquitectura proposta é capaz de controlar robôs móveis com movimentos temporizados em ambi- entes interiores durante grandes distâncias e sem intervenção humana. Além disso, os resultados mostram que a teoria da Contracção é uma ferramenta importante para desenhar arquitecturas de controlo estáveis e para analisar o sucesso das missões efec- tuadas pelo robô como um problema de estabilidade.Portuguese Science and Technology Foundation (FCT) SFRH/BD/68805/2010