Bio-Inspired Robotics

Modern robotic technologies have enabled robots to operate in a variety of unstructured and dynamically-changing environments, in addition to traditional structured environments. Robots have, thus, become an important element in our everyday lives. One key approach to develop such intelligent and autonomous robots is to draw inspiration from biological systems. Biological structure, mechanisms, and underlying principles have the potential to provide new ideas to support the improvement of conventional robotic designs and control. Such biological principles usually originate from animal or even plant models, for robots, which can sense, think, walk, swim, crawl, jump or even fly. Thus, it is believed that these bio-inspired methods are becoming increasingly important in the face of complex applications. Bio-inspired robotics is leading to the study of innovative structures and computing with sensory–motor coordination and learning to achieve intelligence, flexibility, stability, and adaptation for emergent robotic applications, such as manipulation, learning, and control. This Special Issue invites original papers of innovative ideas and concepts, new discoveries and improvements, and novel applications and business models relevant to the selected topics of ``Bio-Inspired Robotics''. Bio-Inspired Robotics is a broad topic and an ongoing expanding field. This Special Issue collates 30 papers that address some of the important challenges and opportunities in this broad and expanding field

Studio dell'interazione tra Sistema Muscoloscheletrico Umano e Dispositivi di Assistenza Robotici

In the latest years, robotic technologies have been increasingly introduced in rehabilitation with the main purpose of reducing the costs and speeding up the recovery process of patients. However, most of the commercial devices impose a pre-programmed trajectory to the limbs of the patients, who therefore behave in a passive way. Another current major limitation is the inability to accurately evaluate the dynamics of the interaction between the patient and the robotic device. This interaction plays a central role in the mutual modulation of human and robot system behavior with respect of their standalone behavior. In particular, the prediction of the interaction can provide useful information to better design the exoskeleton as well as the rehabilitation treatment. This thesis presents my proposed solution for the development of a simulator able to dynamically simulate at the same time the actuated robot device, the human body, and their emerging physical interaction during the movement cooperation. The main idea behind this solution is to decompose the main system in different levels. I called the proposed solution Multi-Level modeling approach, which is the main topic of this thesis. I proposed the following decomposition: Human, Robot, and Boundary Level. The levels are integrated into a whole system in which each of them addresses specific challenges. The Human Level represents the subject who is wearing, for example, an exoskeleton for the lower limbs. To reach a symbiotic collaboration between the subject and the exoskeleton, the proposed approach has to include the subject's intentions and efforts. Moreover, user's internal transformations provide important information about the internal dynamic parameters modulation due to the external device. The Robot Level consists of the wearable robot system which supports the movements. Our proposed approach includes models of both device mechanics and control strategies. This allows to test different control strategies and find the one that better fits each specific patient's needs and characteristics. The last level is the Boundary Level, which has the main objective to model the human-robot mechanical power transfer, including also the non-idealities (such as dissipative forces), in order to accurately estimate interactions. Challenges emerged during the development of the simulator system were faced, investigating different solutions, and selecting and validating the most promising one. First, I selected a common software platform, able to simultaneously reproduce the dynamic behavior of the three levels. The common software platform allows to build a quite flexible system where different solution could be evaluated simply modifying model parameters. Among different available software, OpenSim was selected because it is well known and used for the dynamic study of human movement. Although OpenSim was well tested in biomechanics, it required a further evaluation as simulator for Robot and Boudary Levels. Performed tests and their motivations are reported in this work. Human internal dynamics parameters are modulated by the influence of the external device. I proposed to monitor this variation, taking into consideration the neural drive sent to the muscles. This can be done by measuring the muscles' electromyographic (EMG) signals, which are the electrical potential generated by muscle cells when they are activated, prior to muscle contraction. These signals can be used as input for a physiologically accurate human musculoskeletal model, to calculate the subject contribution to the movement. As the relation between EMGs and the generated muscle forces and joint moments is not linear, the neuromusculoskeletal model is indeed needed to replicate step-by-step all the internal transformations which occur from the excitation of the muscle to the joint movement. Estimation of the emerging interaction, during the human-robot cooperation, can be performed through an interaction model which is basically a set of contact models. Due to the specific rehabilitation purpose of our work, this contact model needs special attention. I introduced and validated a procedure to calibrate the contact models to improve the accuracy of the estimated interaction forces. One of the problems of using EMG signals is that, in order to acquire them in a non-invasive way, surface electrodes must be used; however, this means that the collected data quality is quite susceptible to the electrodes placements and decay, and to electric and magnetic interferences. In many contexts, such as home rehabilitation, this could be a limitation. An alternative solution to avoid the direct EMG measurement is presented in this work. The idea is that for some repetitive tasks, which are most interesting for rehabilitation, it is possible to substitute the direct data collection with a subject specific model of EMGs. The objective of this work is to provide an effective approach to estimate the emerging interaction during the human-robot movement cooperation. The Multi-Level Modeling approach, presented in this thesis, decomposes this complex problem allowing to find all the required components to realize a whole system able to reach this objective

From walking to running: robust and 3D humanoid gait generation via MPC

Humanoid robots are platforms that can succeed in tasks conceived for humans. From locomotion in unstructured environments, to driving cars, or working in industrial plants, these robots have a potential that is yet to be disclosed in systematic every-day-life applications. Such a perspective, however, is opposed by the need of solving complex engineering problems under the hardware and software point of view. In this thesis, we focus on the software side of the problem, and in particular on locomotion control. The operativity of a legged humanoid is subordinate to its capability of realizing a reliable locomotion. In many settings, perturbations may undermine the balance and make the robot fall. Moreover, complex and dynamic motions might be required by the context, as for instance it could be needed to start running or climbing stairs to achieve a certain location in the shortest time. We present gait generation schemes based on Model Predictive Control (MPC) that tackle both the problem of robustness and tridimensional dynamic motions. The proposed control schemes adopt the typical paradigm of centroidal MPC for reference motion generation, enforcing dynamic balance through the Zero Moment Point condition, plus a whole-body controller that maps the generated trajectories to joint commands. Each of the described predictive controllers also feature a so-called stability constraint, preventing the generation of diverging Center of Mass trajectories with respect to the Zero Moment Point. Robustness is addressed by modeling the humanoid as a Linear Inverted Pendulum and devising two types of strategies. For persistent perturbations, a way to use a disturbance observer and a technique for constraint tightening (to ensure robust constraint satisfaction) are presented. In the case of impulsive pushes instead, techniques for footstep and timing adaptation are introduced. The underlying approach is to interpret robustness as a MPC feasibility problem, thus aiming at ensuring the existence of a solution for the constrained optimization problem to be solved at each iteration in spite of the perturbations. This perspective allows to devise simple solutions to complex problems, favoring a reliable real-time implementation. For the tridimensional locomotion, on the other hand, the humanoid is modeled as a Variable Height Inverted Pendulum. Based on it, a two stage MPC is introduced with particular emphasis on the implementation of the stability constraint. The overall result is a gait generation scheme that allows the robot to overcome relatively complex environments constituted by a non-flat terrain, with also the capability of realizing running gaits. The proposed methods are validated in different settings: from conceptual simulations in Matlab to validations in the DART dynamic environment, up to experimental tests on the NAO and the OP3 platforms

Review article: locomotion systems for ground mobile robots in unstructured environments

Abstract. The world market of mobile robotics is expected to increase substantially in the next 20 yr, surpassing the market of industrial robotics in terms of units and sales. Important fields of application are homeland security, surveillance, demining, reconnaissance in dangerous situations, and agriculture. The design of the locomotion systems of mobile robots for unstructured environments is generally complex, particularly when they are required to move on uneven or soft terrains, or to climb obstacles. This paper sets out to analyse the state-of-the-art of locomotion mechanisms for ground mobile robots, focussing on solutions for unstructured environments, in order to help designers to select the optimal solution for specific operating requirements. The three main categories of locomotion systems (wheeled - W, tracked - T and legged - L) and the four hybrid categories that can be derived by combining these main locomotion systems are discussed with reference to maximum speed, obstacle-crossing capability, step/stair climbing capability, slope climbing capability, walking capability on soft terrains, walking capability on uneven terrains, energy efficiency, mechanical complexity, control complexity and technology readiness. The current and future trends of mobile robotics are also outlined

Learning Motion Skills for a Humanoid Robot

This thesis investigates the learning of motion skills for humanoid robots. As groundwork, a humanoid robot with integrated fall management was developed as an experimental platform. Then, two different approaches for creating motion skills were investigated. First, one that is based on Cartesian quintic splines with optimized parameters. Second, a reinforcement learning-based approach that utilizes the first approach as a reference motion to guide the learning. Both approaches were tested on the developed robot and on further simulated robots to show their generalization. A special focus was set on the locomotion skill, but a standing-up and kick skill are also discussed. Diese Dissertation beschäftigt sich mit dem Lernen von Bewegungsfähigkeiten für humanoide Roboter. Als Grundlage wurde zunächst ein humanoider Roboter mit integriertem Fall Management entwickelt, welcher als Experimentalplatform dient. Dann wurden zwei verschiedene Ansätze für die Erstellung von Bewegungsfähigkeiten untersucht. Zu erst einer der kartesische quintische Splines mit optimierten Parametern nutzt. Danach wurde ein Ansatz basierend auf bestärkendem Lernen untersucht, welcher den ersten Ansatz als Referenzbewegung benutzt. Beide Ansätze wurden sowohl auf der entwickelten Roboterplatform, als auch auf weiteren simulierten Robotern getestet um die Generalisierbarkeit zu zeigen. Ein besonderer Fokus wurde auf die Fähigkeit des Gehens gelegt, aber auch Aufsteh- und Schussfähigkeiten werden diskutiert

Locomotion system for ground mobile robots in uneven and unstructured environments

One of the technology domains with the greatest growth rates nowadays is service robots. The extensive use of ground mobile robots in environments that are unstructured or structured for humans is a promising challenge for the coming years, even though Automated Guided Vehicles (AGV) moving on flat and compact grounds are already commercially available and widely utilized to move components and products inside indoor industrial buildings. Agriculture, planetary exploration, military operations, demining, intervention in case of terrorist attacks, surveillance, and reconnaissance in hazardous conditions are important application domains. Due to the fact that it integrates the disciplines of locomotion, vision, cognition, and navigation, the design of a ground mobile robot is extremely interdisciplinary. In terms of mechanics, ground mobile robots, with the exception of those designed for particular surroundings and surfaces (such as slithering or sticky robots), can move on wheels (W), legs (L), tracks (T), or hybrids of these concepts (LW, LT, WT, LWT). In terms of maximum speed, obstacle crossing ability, step/stair climbing ability, slope climbing ability, walking capability on soft terrain, walking capability on uneven terrain, energy efficiency, mechanical complexity, control complexity, and technology readiness, a systematic comparison of these locomotion systems is provided in [1]. Based on the above-mentioned classification, in this thesis, we first introduce a small-scale hybrid locomotion robot for surveillance and inspection, WheTLHLoc, with two tracks, two revolving legs, two active wheels, and two passive omni wheels. The robot can move in several different ways, including using wheels on the flat, compact ground,[1] tracks on soft, yielding terrain, and a combination of tracks, legs, and wheels to navigate obstacles. In particular, static stability and non-slipping characteristics are considered while analyzing the process of climbing steps and stairs. The experimental test on the first prototype has proven the planned climbing maneuver’s efficacy and the WheTLHLoc robot's operational flexibility. Later we present another development of WheTLHLoc and introduce WheTLHLoc 2.0 with newly designed legs, enabling the robot to deal with bigger obstacles. Subsequently, a single-track bio-inspired ground mobile robot's conceptual and embodiment designs are presented. This robot is called SnakeTrack. It is designed for surveillance and inspection activities in unstructured environments with constrained areas. The vertebral column has two end modules and a variable number of vertebrae linked by compliant joints, and the surrounding track is its essential component. Four motors drive the robot: two control the track motion and two regulate the lateral flexion of the vertebral column for steering. The compliant joints enable limited passive torsion and retroflection of the vertebral column, which the robot can use to adapt to uneven terrain and increase traction. Eventually, the new version of SnakeTrack, called 'Porcospino', is introduced with the aim of allowing the robot to move in a wider variety of terrains. The novelty of this thesis lies in the development and presentation of three novel designs of small-scale mobile robots for surveillance and inspection in unstructured environments, and they employ hybrid locomotion systems that allow them to traverse a variety of terrains, including soft, yielding terrain and high obstacles. This thesis contributes to the field of mobile robotics by introducing new design concepts for hybrid locomotion systems that enable robots to navigate challenging environments. The robots presented in this thesis employ modular designs that allow their lengths to be adapted to suit specific tasks, and they are capable of restoring their correct position after falling over, making them highly adaptable and versatile. Furthermore, this thesis presents a detailed analysis of the robots' capabilities, including their step-climbing and motion planning abilities. In this thesis we also discuss possible refinements for the robots' designs to improve their performance and reliability. Overall, this thesis's contributions lie in the design and development of innovative mobile robots that address the challenges of surveillance and inspection in unstructured environments, and the analysis and evaluation of these robots' capabilities. The research presented in this thesis provides a foundation for further work in this field, and it may be of interest to researchers and practitioners in the areas of robotics, automation, and inspection. As a general note, the first robot, WheTLHLoc, is a hybrid locomotion robot capable of combining tracked locomotion on soft terrains, wheeled locomotion on flat and compact grounds, and high obstacle crossing capability. The second robot, SnakeTrack, is a small-size mono-track robot with a modular structure composed of a vertebral column and a single peripherical track revolving around it. The third robot, Porcospino, is an evolution of SnakeTrack and includes flexible spines on the track modules for improved traction on uneven but firm terrains, and refinements of the shape of the track guidance system. This thesis provides detailed descriptions of the design and prototyping of these robots and presents analytical and experimental results to verify their capabilities