An Overview on Principles for Energy Efficient Robot Locomotion

Despite enhancements in the development of robotic systems, the energy economy of today's robots lags far behind that of biological systems. This is in particular critical for untethered legged robot locomotion. To elucidate the current stage of energy efficiency in legged robotic systems, this paper provides an overview on recent advancements in development of such platforms. The covered different perspectives include actuation, leg structure, control and locomotion principles. We review various robotic actuators exploiting compliance in series and in parallel with the drive-train to permit energy recycling during locomotion. We discuss the importance of limb segmentation under efficiency aspects and with respect to design, dynamics analysis and control of legged robots. This paper also reviews a number of control approaches allowing for energy efficient locomotion of robots by exploiting the natural dynamics of the system, and by utilizing optimal control approaches targeting locomotion expenditure. To this end, a set of locomotion principles elaborating on models for energetics, dynamics, and of the systems is studied

3LP: a linear 3D-walking model including torso and swing dynamics

In this paper, we present a new model of biped locomotion which is composed of three linear pendulums (one per leg and one for the whole upper body) to describe stance, swing and torso dynamics. In addition to double support, this model has different actuation possibilities in the swing hip and stance ankle which could be widely used to produce different walking gaits. Without the need for numerical time-integration, closed-form solutions help finding periodic gaits which could be simply scaled in certain dimensions to modulate the motion online. Thanks to linearity properties, the proposed model can provide a computationally fast platform for model predictive controllers to predict the future and consider meaningful inequality constraints to ensure feasibility of the motion. Such property is coming from describing dynamics with joint torques directly and therefore, reflecting hardware limitations more precisely, even in the very abstract high level template space. The proposed model produces human-like torque and ground reaction force profiles and thus, compared to point-mass models, it is more promising for precise control of humanoid robots. Despite being linear and lacking many other features of human walking like CoM excursion, knee flexion and ground clearance, we show that the proposed model can predict one of the main optimality trends in human walking, i.e. nonlinear speed-frequency relationship. In this paper, we mainly focus on describing the model and its capabilities, comparing it with human data and calculating optimal human gait variables. Setting up control problems and advanced biomechanical analysis still remain for future works.Comment: Journal paper under revie

Stability analysis and control for bipedal locomotion using energy methods

In this thesis, we investigate the stability of limit cycles of passive dynamic walking. The formation process of the limit cycles is approached from the view of energy interaction. We introduce for the first time the notion of the energy portrait analysis originated from the phase portrait. The energy plane is spanned by the total energy of the system and its derivative, and different energy trajectories represent the energy portrait in the plane. One of the advantages of this method is that the stability of the limit cycles can be easily shown in a 2D plane regardless of the dimension of the system. The energy portrait of passive dynamic walking reveals that the limit cycles are formed by the interaction between energy loss and energy gain during each cycle, and they are equal at equilibria in the energy plane. In addition, the energy portrait is exploited to examine the existence of semi-passive limit cycles generated using the energy supply only at the take-off phase. It is shown that the energy interaction at the ground contact compensates for the energy supply, which makes the total energy invariant yielding limit cycles. This result means that new limit cycles can be generated according to the energy supply without changing the ground slope, and level ground walking, whose energy gain at the contact phase is always zero, can be achieved without actuation during the swing phase. We design multiple switching controllers by virtue of this property to increase the basin of attraction. Multiple limit cycles are linearized using the Poincare map method, and the feedback gains are computed taking into account the robustness and actuator saturation. Once a trajectory diverges from a basin of attraction, we switch the current controller to one that includes the trajectory in its basin of attraction. Numerical simulations confirm that a set of limit cycles can be used to increase the basin of attraction further by switching the controllers one after another. To enhance our knowledge of the limit cycles, we performed sophisticated simulations and found all stable and unstable limit cycles from the various ground slopes not only for the symmetric legs but also for the unequal legs that cause gait asymmetries. As a result, we present a novel classification of the passive limit cycles showing six distinct groups that are consecutive and cyclical

Control Implementation of Dynamic Locomotion on Compliant, Underactuated, Force-Controlled Legged Robots with Non-Anthropomorphic Design

The control of locomotion on legged robots traditionally involves a robot that takes a standard legged form, such as the anthropomorphic humanoid, the dog-like quadruped, or the bird-like biped. Additionally, these systems will often be actuated with position-controlled servos or series-elastic actuators that are connected through rigid links. This work investigates the control implementation of dynamic, force-controlled locomotion on a family of legged systems that significantly deviate from these classic paradigms by incorporating modern, state-of-the-art proprioceptive actuators on uniquely configured compliant legs that do not closely resemble those found in nature. The results of this work can be used to better inform how to implement controllers on legged systems without stiff, position-controlled actuators, and also provide insight on how intelligently designed mechanical features can potentially simplify the control of complex, nonlinear dynamical systems like legged robots. To this end, this work presents the approach to control for a family of non-anthropomorphic bipedal robotic systems which are developed both in simulation and with physical hardware. The first is the Non-Anthropomorphic Biped, Version 1 (NABi-1) that features position-controlled joints along with a compliant foot element on a minimally actuated leg, and is controlled using simple open-loop trajectories based on the Zero Moment Point. The second system is the second version of the non-anthropomorphic biped (NABi-2) which utilizes the proprioceptive Back-drivable Electromagnetic Actuator for Robotics (BEAR) modules for actuation and fully realizes feedback-based force controlled locomotion. These systems are used to highlight both the strengths and weaknesses of utilizing proprioceptive actuation in systems, and suggest the tradeoffs that are made when using force control for dynamic locomotion. These systems also present case studies for different approaches to system design when it comes to bipedal legged robots

The landscape of movement control in locomotion: Cost, strategy, and solution

Features of gait are determined at multiple levels, from the selection of the gait itself (e.g., walk or run) through the specific parameters utilized (stride length, frequency, etc.) to the pattern of muscular excitation. The ultimate choices are determined neurally, but what is involved with deciding on the appropriate strategy? Human locomotion appears stereotyped not so much because the pattern is predetermined, but because these movement patterns are good solutions for providing movement utilizing the machinery available to the individual (the legs and their requisite components). Under different circumstances the appropriate solution may differ broadly (different gait) or subtly (different parameters). Interpretation of the neural decision making process would benefit from understanding the influences that are utilized in the selection of the appropriate solution in any set of circumstances, including normal conditions. In this review we survey an array of studies that point to energetic cost as a key input to the gait coordination system, and not just an outcome of the gait pattern implemented. We then use that information to rigorously define the construct proposed by Sparrow and Newell (1998) where the effects of environment, organism, and task act as constraints determining the solution set available, and the coordination pattern is then implemented under pressure for energetic economy. The fit between the environment and the organism define affordances that can be actualized. We rely on a novel conceptualization of task that recognizes that the task goal needs to be separated from the mechanisms that achieve it so that the selection of a particular implementation strategy can be exposed and understood. This reformulation of the Sparrow and Newell construct is then linked to the proposed pressure for economy by considering it as an optimization problem, where the most readily selected gait strategy will be the one that achieves the task goal at (or near) the energetic minimum

Magnetorheological Variable Stiffness Robot Legs for Improved Locomotion Performance

In an increasingly automated world, interest in the field of robotics is surging, with an exciting branch of this area being legged robotics. These biologically inspired robots have leg-like limbs which enable locomotion, suited to challenging terrains which wheels struggle to conquer. While it has been quite some time since the idea of a legged machine was first made a reality, this technology has been modernised with compliant legs to improve locomotion performance. Recently, developments in biological science have uncovered that humans and animals alike control their leg stiffness, adapting to different locomotion conditions. Furthermore, as these studies highlighted potential to improve upon the existing compliant-legged robots, modern robot designs have seen implementation of variable stiffness into their legs. As this is quite a new concept, few works have been published which document such designs, and hence much potential exists for research in this area. As a promising technology which can achieve variable stiffness, magnetorheological (MR) smart materials may be ideal for use in robot legs. In particular, recent advances have enabled the use of MR fluid (MRF) to facilitate variable stiffness in a robust manner, in contrast to MR elastomer (MRE). Developed in this thesis is what was at the time the first rotary MR damper variable stiffness mechanism. This is proposed by the author for use within a robot leg to enable rapid stiffness control during locomotion. Based its mechanics and actuation, the leg is termed the magnetorheological variable stiffness actuator leg mark-I (MRVSAL-I). The leg, with a C-shaped morphology suited to torque actuation is first characterised through linear compression testing, demonstrating a wide range of stiffness variation. This variation is in response to an increase in electric current supplied to the internal electromagnetic coils of the MR damper. A limited degrees-of-freedom (DOF) bipedal locomotion platform is designed and manufactured to study the locomotion performance resulting from the variable stiffness leg. It is established that optimal stiffness tuning of the leg could achieve reduced mechanical cost of transport (MCOT), thereby improving locomotion performance. Despite the advancements to locomotion demonstrated, some design issues with the leg required further optimisation and a new leg morphology

Viability in State-Action Space: Connecting Morphology, Control, and Learning

Wie können wir Robotern ermöglichen, modellfrei und direkt auf der Hardware zu lernen? Das maschinelle Lernen nimmt als Standardwerkzeug im Arsenal des Robotikers seinen Platz ein. Es gibt jedoch einige offene Fragen, wie man die Kontrolle über physikalische Systeme lernen kann. Diese Arbeit gibt zwei Antworten auf diese motivierende Frage. Das erste ist ein formales Mittel, um die inhärente Robustheit eines gegebenen Systemdesigns zu quantifizieren, bevor der Controller oder das Lernverfahren entworfen wird. Dies unterstreicht die Notwendigkeit, sowohl das Hardals auch das Software-Design eines Roboters zu berücksichtigen, da beide Aspekte in der Systemdynamik untrennbar miteinander verbunden sind. Die zweite ist die Formalisierung einer Sicherheitsmass, die modellfrei erlernt werden kann. Intuitiv zeigt diese Mass an, wie leicht ein Roboter Fehlschläge vermeiden kann. Auf diese Weise können Roboter unbekannte Umgebungen erkunden und gleichzeitig Ausfälle vermeiden. Die wichtigsten Beiträge dieser Dissertation basieren sich auf der Viabilitätstheorie. Viabilität bietet eine alternative Sichtweise auf dynamische Systeme: Anstatt sich auf die Konvergenzeigenschaften eines Systems in Richtung Gleichgewichte zu konzentrieren, wird der Fokus auf Menge von Fehlerzuständen und die Fähigkeit des Systems, diese zu vermeiden, verlagert. Diese Sichtweise eignet sich besonders gut für das Studium der Lernkontrolle an Robotern, da Stabilität im Sinne einer Konvergenz während des Lernprozesses selten gewährleistet werden kann. Der Begriff der Viabilität wird formal auf den Zustand-Aktion-Raum erweitert, mit Viabilitätsmengen von Staat-Aktionspaaren. Eine über diese Mengen definierte Mass ermöglicht eine quantifizierte Bewertung der Robustheit, die für die Familie aller fehlervermeidenden Regler gilt, und ebnet den Weg für ein sicheres, modellfreies Lernen. Die Arbeit beinhaltet auch zwei kleinere Beiträge. Der erste kleine Beitrag ist eine empirische Demonstration der Shaping durch ausschliessliche Modifikation der Systemdynamik. Diese Demonstration verdeutlicht die Bedeutung der Robustheit gegenüber Fehlern für die Lernkontrolle: Ausfälle können nicht nur Schäden verursachen, sondern liefern in der Regel auch keine nützlichen Gradienteninformationen für den Lernprozess. Der zweite kleine Beitrag ist eine Studie über die Wahl der Zustandsinitialisierungen. Entgegen der Intuition und der üblichen Praxis zeigt diese Studie, dass es zuverlässiger sein kann, das System gelegentlich aus einem Zustand zu initialisieren, der bekanntermassen unkontrollierbar ist.How can we enable robots to learn control model-free and directly on hardware? Machine learning is taking its place as a standard tool in the roboticist’s arsenal. However, there are several open questions on how to learn control for physical systems. This thesis provides two answers to this motivating question. The first is a formal means to quantify the inherent robustness of a given system design, prior to designing the controller or learning agent. This emphasizes the need to consider both the hardware and software design of a robot, which are inseparably intertwined in the system dynamics. The second is the formalization of a safety-measure, which can be learned model-free. Intuitively, this measure indicates how easily a robot can avoid failure, and enables robots to explore unknown environments while avoiding failures. The main contributions of this dissertation are based on viability theory. Viability theory provides a slightly unconventional view of dynamical systems: instead of focusing on a system’s convergence properties towards equilibria, the focus is shifted towards sets of failure states and the system’s ability to avoid these sets. This view is particularly well suited to studying learning control in robots, since stability in the sense of convergence can rarely be guaranteed during the learning process. The notion of viability is formally extended to state-action space, with viable sets of state-action pairs. A measure defined over these sets allows a quantified evaluation of robustness valid for the family of all failure-avoiding control policies, and also paves the way for enabling safe model-free learning. The thesis also includes two minor contributions. The first minor contribution is an empirical demonstration of shaping by exclusively modifying the system dynamics. This demonstration highlights the importance of robustness to failures for learning control: not only can failures cause damage, but they typically do not provide useful gradient information for the learning process. The second minor contribution is a study on the choice of state initializations. Counter to intuition and common practice, this study shows it can be more reliable to occasionally initialize the system from a state that is known to be uncontrollable

Dynamic Walking Models to Understand Asymmetric Gait Characteristics

Passive dynamic walking models remarkably predict gait behaviour such as walk-run transition speeds, preferred step length, stride frequencies and - with the inclusion of springs - ground reaction forces. Muscular or neurological conditions may lead to asymmetric walking characteristics that, in turn, come with long term health risks. Gait analysis may be used to understand an individual patient’s conditions to help rehabilitate them. However, people adapt their kinematic and kinetic walking patterns so it can be hard to distinguish the effects of gait alterations such as inertial imbalance or injury. In this thesis a compass walking model with no active controllers is explored to understand the dynamics of gait. To help us interpret the effects of mass imbalance with a prosthetic foot or orthotic device, asymmetric loading conditions are investigated. A simple spring-mass walking model is used to explore the effects of altered touch-down angles and effective leg stiffness to see if these are used as strategies to alter the characteristics of gait. Results show that an asymmetric touch-down angle alters step length while retaining a symmetric stance time. A hybrid model is then derived with springs to emulate human-like ground reaction forces and asymmetric inertial loading of the legs. Results support previous research that push-off from the trailing leg propels the leg mass more than the body mass. Higher rates of joint forces, larger step lengths and a longer stance time on the residual limb may be due to the prosthetic leg stiffness or the higher location of centre-of-mass. These results help us understand how the dynamic components affect gait characteristics such as step length, stance time and walking speeds. This work is motivated by the needs of persons with disabilities and by the desire to understand human walking