Hardware, software and control design considerations towards low-cost compliant quadruped robots

Quadrupedal robots have been a field of interest the last few years, with many new maturing platforms. Many of these projects have in common the use of state of the art actuation and sensing, and therefore are able to handle difficult locomotion tasks very effectively. This work focuses on another trend of low-cost, quadrupedal robots, that features less precise actuators and sensors, but overcomes their limitations with strong bio-inspired designs to achieve state of the art locomotion. We aim here to further extend the achievements of this approach to handle more complex tasks and that require anticipation, We would like also to verify to which extent a close synergy between clever mechanics, sensorimotor coordination, and Central Pattern Generator models is able to handle these tasks. This thesis presents supporting work that was required to pursue this goal. A software architecture for the development of real-time drivers and low-level control for robotic applications, based on a clear separation of concerns is presented. An implementation of this architecture able to handle the specific requirements for small compliant quadruped robots is proposed. Furthermore, the development and integration of a communication protocol for inter-electronic devices communication on the Oncilla robot is discussed. As leg load is a key quantity in some of the sensory-motor coordination this thesis want to explore, a novel tactile sensing approach for its estimation is proposed, based on an Extended Kalman Filter data fusion of static and dynamic tactile sensor information. Then, to support the design of efficient interactions between the control and the bio-inspired mechanics, accurate dynamic modeling of the Advanced Spring Loaded Pantographic leg, equipping all robots considered here, is presented. We propose two approaches to this modeling with the presentation of their benefits and limitations. Finally, two Central Pattern Generator architectures are proposed, based on biologically inspired foot trajectories. The first is using a well-known method for inter-limb coordination with strong neural coupling, and the second, the Tegotae rule, relies only on limb physical coupling and strong sensory-motor coordination. These two approaches are compared on their capacity to handle dynamic footstep placement and it let to the conclusion that strong sensory-motor coordination is required for this task

Towards Agility: Definition, Benchmark and Design Considerations for Small, Quadrupedal Robots

Agile quadrupedal locomotion in animals and robots is yet to be fully understood, quantified or achieved. An intuitive notion of agility exists, but neither a concise definition nor a common benchmark can be found. Further, it is unclear, what minimal level of mechatronic complexity is needed for this particular aspect of locomotion. In this thesis we address and partially answer two primary questions: (Q1) What is agile legged locomotion (agility) and how can wemeasure it? (Q2) How can wemake agile legged locomotion with a robot a reality? To answer our first question, we define agility for robot and animal alike, building a common ground for this particular component of locomotion and introduce quantitative measures to enhance robot evaluation and comparison. The definition is based on and inspired by features of agility observed in nature, sports, and suggested in robotics related publications. Using the results of this observational and literature review, we build a novel and extendable benchmark of thirteen different tasks that implement our vision of quantitatively classifying agility. All scores are calculated from simple measures, such as time, distance, angles and characteristic geometric values for robot scaling. We normalize all unit-less scores to reach comparability between different systems. An initial implementation with available robots and real agility-dogs as baseline finalize our effort of answering the first question. Bio-inspired designs introducing and benefiting from morphological aspects present in nature allowed the generation of fast, robust and energy efficient locomotion. We use engineering tools and interdisciplinary knowledge transferred from biology to build low-cost robots able to achieve a certain level of agility and as a result of this addressing our second question. This iterative process led to a series of robots from Lynx over Cheetah-Cub-S, Cheetah-Cub-AL, and Oncilla to Serval, a compliant robot with actuated spine, high range of motion in all joints. Serval presents a high level of mobility at medium speeds. With many successfully implemented skills, using a basic kinematics-duplication from dogs (copying the foot-trajectories of real animals and replaying themotion on the robot using a mathematical interpretation), we found strengths to emphasize, weaknesses to correct and made Serval ready for future attempts to achieve even more agile locomotion. We calculated Servalâs agility scores with the result of it performing better than any of its predecessors. Our small, safe and low-cost robot is able to execute up to 6 agility tasks out of 13 with the potential to reachmore after extended development. Concluding, we like to mention that Serval is able to cope with step-downs, smooth, bumpy terrain and falling orthogonally to the ground

Combining Reflexes and External Sensory Information in a Neuromusculoskeletal Model to Control a Quadruped Robot

This article examines the importance of integrating locomotion and cognitive information for achieving dynamic locomotion from a viewpoint combining biology and ecological psychology. We present a mammalian neuromusculoskeletal model from external sensory information processing to muscle activation, which includes: 1) a visual-attention control mechanism for controlling attention to external inputs; 2) object recognition representing the primary motor cortex; 3) a motor control model that determines motor commands traveling down the corticospinal and reticulospinal tracts; 4) a central pattern generation model representing pattern generation in the spinal cord; and 5) a muscle reflex model representing the muscle model and its reflex mechanism. The proposed model is able to generate the locomotion of a quadruped robot in flat and natural terrain. The experiment also shows the importance of a postural reflex mechanism when experiencing a sudden obstacle. We show the reflex mechanism when a sudden obstacle is separately detected from both external (retina) and internal (touching afferent) sensory information. We present the biological rationale for supporting the proposed model. Finally, we discuss future contributions, trends, and the importance of the proposed research

Path planning for mobile robots in the real world: handling multiple objectives, hierarchical structures and partial information

Autonomous robots in real-world environments face a number of challenges even to accomplish apparently simple tasks like moving to a given location. We present four realistic scenarios in which robot navigation takes into account partial information, hierarchical structures, and multiple objectives. We start by discussing navigation in indoor environments shared with people, where routes are characterized by effort, risk, and social impact. Next, we improve navigation by computing optimal trajectories and implementing human-friendly local navigation behaviors. Finally, we move to outdoor environments, where robots rely on uncertain traversability estimations and need to account for the risk of getting stuck or having to change route

Actuation-Aware Simplified Dynamic Models for Robotic Legged Locomotion

In recent years, we witnessed an ever increasing number of successful hardware implementations of motion planners for legged robots. If one common property is to be identified among these real-world applications, that is the ability of online planning. Online planning is forgiving, in the sense that it allows to relentlessly compensate for external disturbances of whatever form they might be, ranging from unmodeled dynamics to external pushes or unexpected obstacles and, at the same time, follow user commands. Initially replanning was restricted only to heuristic-based planners that exploit the low computational effort of simplified dynamic models. Such models deliberately only capture the main dynamics of the system, thus leaving to the controllers the issue of anchoring the desired trajectory to the whole body model of the robot. In recent years, however, we have seen a number of new approaches attempting to increase the accuracy of the dynamic formulation without trading-off the computational efficiency of simplified models. In this dissertation, as an example of successful hardware implementation of heuristics and simplified model-based locomotion, I describe the framework that I developed for the generation of an omni-directional bounding gait for the HyQ quadruped robot. By analyzing the stable limit cycles for the sagittal dynamics and the Center of Pressure (CoP) for the lateral stabilization, the described locomotion framework is able to achieve a stable bounding while adapting to terrains of mild roughness and to sudden changes of the user desired linear and angular velocities. The next topic reported and second contribution of this dissertation is my effort to formulate more descriptive simplified dynamic models, without trading off their computational efficiency, in order to extend the navigation capabilities of legged robots to complex geometry environments. With this in mind, I investigated the possibility of incorporating feasibility constraints in these template models and, in particular, I focused on the joint torques limits which are usually neglected at the planning stage. In this direction, the third contribution discussed in this thesis is the formulation of the so called actuation wrench polytope (AWP), defined as the set of feasible wrenches that an articulated robot can perform given its actuation limits. Interesected with the contact wrench cone (CWC), this yields a new 6D polytope that we name feasible wrench polytope (FWP), defined as the set of all wrenches that a legged robot can realize given its actuation capabilities and the friction constraints. Results are reported where, thanks to efficient computational geometry algorithms and to appropriate approximations, the FWP is employed for a one-step receding horizon optimization of center of mass trajectory and phase durations given a predefined step sequence on rough terrains. For the sake of reachable workspace augmentation, I then decided to trade off the generality of the FWP formulation for a suboptimal scenario in which a quasi-static motion is assumed. This led to the definition of the, so called, local/instantaneous actuation region and of the global actuation/feasible region. They both can be seen as different variants of 2D linear subspaces orthogonal to gravity where the robot is guaranteed to place its own center of mass while being able to carry its own body weight given its actuation capabilities. These areas can be intersected with the well known frictional support region, resulting in a 2D linear feasible region, thus providing an intuitive tool that enables the concurrent online optimization of actuation consistent CoM trajectories and target foothold locations on rough terrains

Development, Control, and Empirical Evaluation of the Six-Legged Robot SpaceClimber Designed for Extraterrestrial Crater Exploration

In the recent past, mobile robots played an important role in the field of extraterrestrial surface exploration. Unfortunately, the currently available space exploration rovers do not provide the necessary mobility to reach scientifically interesting places in rough and steep terrain like boulder fields and craters. Multi-legged robots have proven to be a good solution to provide high mobility in unstructured environments. However, space missions place high demands on the system design, control, and performance which are hard to fulfill with such kinematically complex systems. This thesis focuses on the development, control, and evaluation of a six-legged robot for the purpose of lunar crater exploration considering the requirements arising from the envisaged mission scenario. The performance of the developed system is evaluated and optimized based on empirical data acquired in significant and reproducible experiments performed in a laboratory environment in order to show thecapability of the system to perform such a task and to provide a basis for the comparability with other mobile robotic solutions

Locomoção de humanoides robusta e versátil baseada em controlo analítico e física residual

Humanoid robots are made to resemble humans but their locomotion abilities are far from ours in terms of agility and versatility. When humans walk on complex terrains or face external disturbances, they combine a set of strategies, unconsciously and efficiently, to regain stability. This thesis tackles the problem of developing a robust omnidirectional walking framework, which is able to generate versatile and agile locomotion on complex terrains. We designed and developed model-based and model-free walk engines and formulated the controllers using different approaches including classical and optimal control schemes and validated their performance through simulations and experiments. These frameworks have hierarchical structures that are composed of several layers. These layers are composed of several modules that are connected together to fade the complexity and increase the flexibility of the proposed frameworks. Additionally, they can be easily and quickly deployed on different platforms. Besides, we believe that using machine learning on top of analytical approaches is a key to open doors for humanoid robots to step out of laboratories. We proposed a tight coupling between analytical control and deep reinforcement learning. We augmented our analytical controller with reinforcement learning modules to learn how to regulate the walk engine parameters (planners and controllers) adaptively and generate residuals to adjust the robot’s target joint positions (residual physics). The effectiveness of the proposed frameworks was demonstrated and evaluated across a set of challenging simulation scenarios. The robot was able to generalize what it learned in one scenario, by displaying human-like locomotion skills in unforeseen circumstances, even in the presence of noise and external pushes.Os robôs humanoides são feitos para se parecerem com humanos, mas suas habilidades de locomoção estão longe das nossas em termos de agilidade e versatilidade. Quando os humanos caminham em terrenos complexos ou enfrentam distúrbios externos combinam diferentes estratégias, de forma inconsciente e eficiente, para recuperar a estabilidade. Esta tese aborda o problema de desenvolver um sistema robusto para andar de forma omnidirecional, capaz de gerar uma locomoção para robôs humanoides versátil e ágil em terrenos complexos. Projetámos e desenvolvemos motores de locomoção sem modelos e baseados em modelos. Formulámos os controladores usando diferentes abordagens, incluindo esquemas de controlo clássicos e ideais, e validámos o seu desempenho por meio de simulações e experiências reais. Estes frameworks têm estruturas hierárquicas compostas por várias camadas. Essas camadas são compostas por vários módulos que são conectados entre si para diminuir a complexidade e aumentar a flexibilidade dos frameworks propostos. Adicionalmente, o sistema pode ser implementado em diferentes plataformas de forma fácil. Acreditamos que o uso de aprendizagem automática sobre abordagens analíticas é a chave para abrir as portas para robôs humanoides saírem dos laboratórios. Propusemos um forte acoplamento entre controlo analítico e aprendizagem profunda por reforço. Expandimos o nosso controlador analítico com módulos de aprendizagem por reforço para aprender como regular os parâmetros do motor de caminhada (planeadores e controladores) de forma adaptativa e gerar resíduos para ajustar as posições das juntas alvo do robô (física residual). A eficácia das estruturas propostas foi demonstrada e avaliada em um conjunto de cenários de simulação desafiadores. O robô foi capaz de generalizar o que aprendeu em um cenário, exibindo habilidades de locomoção humanas em circunstâncias imprevistas, mesmo na presença de ruído e impulsos externos.Programa Doutoral em Informátic

Soft pneumatic actuators: a review of design, fabrication, modeling, sensing, control and applications

Soft robotics is a rapidly evolving field where robots are fabricated using highly deformable materials and usually follow a bioinspired design. Their high dexterity and safety make them ideal for applications such as gripping, locomotion, and biomedical devices, where the environment is highly dynamic and sensitive to physical interaction. Pneumatic actuation remains the dominant technology in soft robotics due to its low cost and mass, fast response time, and easy implementation. Given the significant number of publications in soft robotics over recent years, newcomers and even established researchers may have difficulty assessing the state of the art. To address this issue, this article summarizes the development of soft pneumatic actuators and robots up until the date of publication. The scope of this article includes the design, modeling, fabrication, actuation, characterization, sensing, control, and applications of soft robotic devices. In addition to a historical overview, there is a special emphasis on recent advances such as novel designs, differential simulators, analytical and numerical modeling methods, topology optimization, data-driven modeling and control methods, hardware control boards, and nonlinear estimation and control techniques. Finally, the capabilities and limitations of soft pneumatic actuators and robots are discussed and directions for future research are identified

Cellulo: Tangible Haptic Swarm Robots for Learning

Robots are steadily becoming one of the significant 21st century learning technologies that aim to improve education within both formal and informal environments. Such robots, called Robots for Learning, have so far been utilized as constructionist tools or social agents that aided learning from distinct perspectives. This thesis presents a novel approach to Robots for Learning that aims to explore new added values by means of investigating uses for robots in educational scenarios beyond those that are commonly tackled: We develop a platform from scratch to be "as versatile as pen and paper", namely as composed of easy to use objects that feel like they belong in the learning ecosystem while being seamlessly usable across many activities that help teach a variety of subjects. Following this analogy, we design our platform as many low-cost, palm-sized tangible robots that operate on printed paper sheets, controlled by readily available mobile computers such as smartphones or tablets. From the learners' perspective, our robots are thus physical and manipulable points of hands-on interaction with learning activities where they play the role of both abstract and concrete objects that are otherwise not easily represented. We realize our novel platform in four incremental phases, each of which consists of a development stage and multiple subsequent validation stages. First, we develop accurately positioned tangibles, characterize their localization performance and test the learners' interaction with our tangibles in a playful activity. Second, we integrate mobility into our tangibles and make them full-blown robots, characterize their locomotion performance and test the emerging notion of moving vs. being moved in a learning activity. Third, we enable haptic feedback capability on our robots, measure their range of usability and test them within a complete lesson that highlights this newly developed affordance. Fourth, we develop the means of building swarms with our haptic-enabled tangible robots and test the final form of our platform in a lesson co-designed with a teacher. Our effort thus contains the participation of more than 370 child learners over the span of these phases, which leads to the initial insights into this novel Robots for Learning avenue. Besides its main contributions to education, this thesis further contributes to a range of research fields related to our technological developments, such as positioning systems, robotic mechanism design, haptic interfaces and swarm robotics