Design and control of a teleoperation system for humanoid walking

Master'sMASTER OF ENGINEERIN

Climbing and Walking Robots

With the advancement of technology, new exciting approaches enable us to render mobile robotic systems more versatile, robust and cost-efficient. Some researchers combine climbing and walking techniques with a modular approach, a reconfigurable approach, or a swarm approach to realize novel prototypes as flexible mobile robotic platforms featuring all necessary locomotion capabilities. The purpose of this book is to provide an overview of the latest wide-range achievements in climbing and walking robotic technology to researchers, scientists, and engineers throughout the world. Different aspects including control simulation, locomotion realization, methodology, and system integration are presented from the scientific and from the technical point of view. This book consists of two main parts, one dealing with walking robots, the second with climbing robots. The content is also grouped by theoretical research and applicative realization. Every chapter offers a considerable amount of interesting and useful information

Télé-opération Corps Complet de Robots Humanoïdes

This thesis aims to investigate systems and tools for teleoperating a humanoid robot. Robotteleoperation is crucial to send and control robots in environments that are dangerous or inaccessiblefor humans (e.g., disaster response scenarios, contaminated environments, or extraterrestrialsites). The term teleoperation most commonly refers to direct and continuous control of a robot.In this case, the human operator guides the motion of the robot with her/his own physical motionor through some physical input device. One of the main challenges is to control the robot in a waythat guarantees its dynamical balance while trying to follow the human references. In addition,the human operator needs some feedback about the state of the robot and its work site through remotesensors in order to comprehend the situation or feel physically present at the site, producingeffective robot behaviors. Complications arise when the communication network is non-ideal. Inthis case the commands from human to robot together with the feedback from robot to human canbe delayed. These delays can be very disturbing for the human operator, who cannot teleoperatetheir robot avatar in an effective way.Another crucial point to consider when setting up a teleoperation system is the large numberof parameters that have to be tuned to effectively control the teleoperated robots. Machinelearning approaches and stochastic optimizers can be used to automate the learning of some of theparameters.In this thesis, we proposed a teleoperation system that has been tested on the humanoid robotiCub. We used an inertial-technology-based motion capture suit as input device to control thehumanoid and a virtual reality headset connected to the robot cameras to get some visual feedback.We first translated the human movements into equivalent robot ones by developping a motionretargeting approach that achieves human-likeness while trying to ensure the feasibility of thetransferred motion. We then implemented a whole-body controller to enable the robot to trackthe retargeted human motion. The controller has been later optimized in simulation to achieve agood tracking of the whole-body reference movements, by recurring to a multi-objective stochasticoptimizer, which allowed us to find robust solutions working on the real robot in few trials.To teleoperate walking motions, we implemented a higher-level teleoperation mode in whichthe user can use a joystick to send reference commands to the robot. We integrated this setting inthe teleoperation system, which allows the user to switch between the two different modes.A major problem preventing the deployment of such systems in real applications is the presenceof communication delays between the human input and the feedback from the robot: evena few hundred milliseconds of delay can irremediably disturb the operator, let alone a few seconds.To overcome these delays, we introduced a system in which a humanoid robot executescommands before it actually receives them, so that the visual feedback appears to be synchronizedto the operator, whereas the robot executed the commands in the past. To do so, the robot continuouslypredicts future commands by querying a machine learning model that is trained on pasttrajectories and conditioned on the last received commands.Cette thèse vise à étudier des systèmes et des outils pour la télé-opération d’un robot humanoïde.La téléopération de robots est cruciale pour envoyer et contrôler les robots dans des environnementsdangereux ou inaccessibles pour les humains (par exemple, des scénarios d’interventionen cas de catastrophe, des environnements contaminés ou des sites extraterrestres). Le terme téléopérationdésigne le plus souvent le contrôle direct et continu d’un robot. Dans ce cas, l’opérateurhumain guide le mouvement du robot avec son propre mouvement physique ou via un dispositifde contrôle. L’un des principaux défis est de contrôler le robot de manière à garantir son équilibredynamique tout en essayant de suivre les références humaines. De plus, l’opérateur humain abesoin d’un retour d’information sur l’état du robot et de son site via des capteurs à distance afind’appréhender la situation ou de se sentir physiquement présent sur le site, produisant des comportementsde robot efficaces. Des complications surviennent lorsque le réseau de communicationn’est pas idéal. Dans ce cas, les commandes de l’homme au robot ainsi que la rétroaction du robotà l’homme peuvent être retardées. Ces délais peuvent être très gênants pour l’opérateur humain,qui ne peut pas télé-opérer efficacement son avatar robotique.Un autre point crucial à considérer lors de la mise en place d’un système de télé-opérationest le grand nombre de paramètres qui doivent être réglés pour contrôler efficacement les robotstélé-opérés. Des approches d’apprentissage automatique et des optimiseurs stochastiques peuventêtre utilisés pour automatiser l’apprentissage de certains paramètres.Dans cette thèse, nous avons proposé un système de télé-opération qui a été testé sur le robothumanoïde iCub. Nous avons utilisé une combinaison de capture de mouvement basée sur latechnologie inertielle comme périphérique de contrôle pour l’humanoïde et un casque de réalitévirtuelle connecté aux caméras du robot pour obtenir un retour visuel. Nous avons d’abord traduitles mouvements humains en mouvements robotiques équivalents en développant une approchede retargeting de mouvement qui atteint la ressemblance humaine tout en essayant d’assurer lafaisabilité du mouvement transféré. Nous avons ensuite implémenté un contrôleur du corps entierpour permettre au robot de suivre le mouvement humain reciblé. Le contrôleur a ensuite étéoptimisé en simulation pour obtenir un bon suivi des mouvements de référence du corps entier,en recourant à un optimiseur stochastique multi-objectifs, ce qui nous a permis de trouver dessolutions robustes fonctionnant sur le robot réel en quelques essais.Pour télé-opérer les mouvements de marche, nous avons implémenté un mode de télé-opérationde niveau supérieur dans lequel l’utilisateur peut utiliser un joystick pour envoyer des commandesde référence au robot. Nous avons intégré ce paramètre dans le système de télé-opération, ce quipermet à l’utilisateur de basculer entre les deux modes différents.Un problème majeur empêchant le déploiement de tels systèmes dans des applications réellesest la présence de retards de communication entre l’entrée humaine et le retour du robot: mêmequelques centaines de millisecondes de retard peuvent irrémédiablement perturber l’opérateur,encore plus quelques secondes. Pour surmonter ces retards, nous avons introduit un système danslequel un robot humanoïde exécute des commandes avant de les recevoir, de sorte que le retourvisuel semble être synchronisé avec l’opérateur, alors que le robot exécutait les commandes dansle passé. Pour ce faire, le robot prédit en permanence les commandes futures en interrogeant unmodèle d’apprentissage automatique formé sur les trajectoires passées et conditionné aux dernièrescommandes reçues

Analysis of Human Push Recovery Motions Based on Optimization

The ability to cope with large perturbations is essential to avoid falling for humans as well as for humanoid robots. Every day millions of people are affected by injuries due to falling. This is a huge problem not only for the individuum but also for the society as it costs the health care systems billions of euros. Also in the field of humanoid robots fall avoidance is very important as it protects robots against breakage. In this thesis, the problem of fall avoidance is addressed using a combination of optimization, human-modeling and recorded push recovery motions. The aim is to identify the principles that lead to human-like push recovery motions. The human is modeled by rigid segments combined by joints leading to an underactuated multi-body representation. These models are included in multiple stage optimal control problems to reconstruct and sythesize human push recovery motions considering the dynamics of a human over the whole time horizon. Due to the high nonlinearity, the optimization problem is solved based on a direct multiple shooting method. To analyze the human push recovery motions, dynamically-consistent motions for the model that closely track experimental data are produced. The joint angles and joint torques for the human model controlled by joint torque derivatives are compared for perturbed and unperturbed motions from two subjects. The results verify the assumption that the heavier the perturbation is and the higher it is applied at the upper body, the larger are the resulting joint torques. We show that including optimally chosen spring-damper elements in the joints can reduce the active joint torques significantly. We further exploit our motion reconstruction approach to determine the states that are most affected during a perturbation. Relevant parameters such as the orientation and position of the head and body, joint angles and torques of the perturbed motions are analyzed for deviations to the unperturbed motions at the point in time when the push occurs. Identifying the point in time when the model states of the perturbed motions differ from the unperturbed motions, the reaction times are determined. To better understand human push recovery motions, we also investigate in a motion sythesis approach. This approach enables a control hypothesis, in the form of a specific objective function, to be formed. The minimization of effort combined with a periodicity formulation results in human-like motions and the influence of the push strength is analyzed. Formulating the objective function as a weighted linear combination of possible optimality criteria provides the possibility to analyze different optimality criteria and their resulting motion. The difficulty is, that for a given motion, it is not known, which criteria lead to that specific motion. In this thesis, the results for different basal objective functions are analyzed. These studies prepare to determine the optimal weights of the criteria by including the presented motion generation formulation in an inverse optimal control problem. Having analyzed general weights that lead to a good approximation of the human recovery motions, the resulting objective function can be used to generate push recovery motions also for humanoid robots or assistive devices such as exoskeletons. To show another application in the improvement of technical assistive devices, we include two combined human exoskeleton models of different weights in our calculations. This allows us to analyze the joint torques for these models including the exoskeletons and compare the results to a human model. As the resulting joint torques are quite large, we also formulate combined human exoskeleton models with passive spring-damper elements that act in parallel to the active torques. This compliant formulation leads to a significant reduction of the active joint torque needed for the recovery motion. The reduction of the active joint torques allows the reduction of energy needed for the recovery motion or can enable the recovery from stronger perturbations

Benchmarking Stability of Bipedal Locomotion Based on Individual Full Body Dynamics and Foot Placement Strategies–Application to Impaired and Unimpaired Walking

The principles underlying smooth and effortless human walking while maintaining stability as well as the ability to quickly respond to unexpected perturbations result from a plethora of well-balanced parameters, most of them yet to be determined. In this paper, we investigate criteria that may be useful for benchmarking stability properties of human walking. We perform dynamic reconstructions of human walking motions of unimpaired subjects and subjects walking with transfemoral prostheses from motion capture recordings using optimal control. We aim at revealing subject-specific strategies in applying dynamics in order to maintain steady gait considering irregularities such as deviating gait patterns or asymmetric body segment properties. We identify foot placement with respect to the Instantaneous Capture Point as the strategy globally applied by the subjects to obtain steady gait and propose the Residual Orbital Energy as a measure allowing for benchmarking human-like gait toward confident vs. cautious gait

Adaptive control for wearable robots in human-centered rehabilitation tasks

Robotic rehabilitation therapies have been improving by providing the needed assistance to the patient, in a human-centered environment, and also helping the therapist to choose the necessary procedure. This thesis presents an adaptive "Assistance-as-needed" strategy which adheres to the specific needs of the patient and with the inputs from the therapist, whenever needed. The exertion of assistive and responsive behavior of the lower limb wearable robot is dedicated for the rehabilitation of incomplete spinal cord injury (SCI) patients. The main objective is to propose and evaluate an adaptive control model on a wearable robot, assisting the user and adhering to their needs, with no or less combination of external devices. The adaptation must be more interactive to understand the user needs and their volitional orders. Similarly, by using the existing muscular strength, in incomplete SCI patients, as a motivation to pursue the movement and assist them, only when needed. The adaptive behavior of the wearable robot is proposed by monitoring the interaction and movement of the user. This adaptation is achieved by modulating the stiffness of the exoskeleton in function of joint parameters, such as positions and interaction torques. These joint parameters are measured from the user independently and then used to update the new stiffness value. The adaptive algorithm performs with no need of external sensors, making it simple in terms of usage. In terms of rehabilitation, it is also desirable to be compatible with combination of assistive devices such as muscle stimulation, neural activity (BMI) and body balance (Wii), to deliver a user friendly and effective therapy. Combination of two control approaches has been employed, to improve the efficiency of the adaptive control model and was evaluated using a wearable lower limb exoskeleton device, H1. The control approaches, Hierarchical and Task based approach have been used to assist the patient as needed and simultaneously motivate the patient to pursue the therapy. Hierarchical approach facilitates combination of multiple devices to deliver an effective therapy by categorizing the control architecture in two layers, Low level and High level control. Task-based approaches engage in each task individually and allow the possibility to combine them at any point of time. It is also necessary to provide an interaction based approach to ensure the complete involvement of the user and for an effective therapy. By means of this dissertation, a task based adaptive control is proposed, in function of human-orthosis interaction, which is applied on a hierarchical control scheme. This control scheme is employed in a wearable robot, with the intention to be applied or accommodated to different pathologies, with its adaptive capabilities. The adaptive control model for gait assistance provides a comprehensive solution through a single implementation: Adaptation inside a gait cycle, continuous support through gait training and in real time. The performance of this control model has been evaluated with healthy subjects, as a preliminary study, and with paraplegic patients. Results of the healthy subjects showed a significant change in the pattern of the interaction torques, elucidating a change in the effort and adaptation to the user movement. In case of patients, the adaptation showed a significant improvement in the joint performance (flexion/extension range) and change in interaction torques. The change in interaction torques (positive to negative) reflects the active participation of the patient, which also explained the adaptive performance. The patients also reported that the movement of the exoskeleton is flexible and the walking patterns were similar to their own distinct patterns. The presented work is performed as part of the project HYPER, funded by Ministerio de Ciencia y Innovación, Spain. (CSD2009 - 00067 CONSOLIDER INGENIOLas terapias de rehabilitación robóticas han sido mejoradas gracias a la inclusión de la asistencia bajo demanda, adaptada a las variaciones de las necesidades del paciente, así como a la inclusión de la ayuda al terapeuta en la elección del procedimiento necesario. Esta tesis presenta una estrategia adaptativa de asistencia bajo demanda, la cual se ajusta a las necesidades específicas del paciente junto a las aportaciones del terapeuta siempre que sea necesario. El esfuerzo del comportamiento asistencial y receptivo del robot personal portátil para extremidades inferiores está dedicado a la rehabilitación de pacientes con lesión de la médula espinal (LME) incompleta. El objetivo principal es proponer y evaluar un modelo de control adaptativo en un robot portátil, ayudando al usuario y cumpliendo con sus necesidades, en ausencia o con reducción de dispositivos externos. La adaptación debe ser más interactiva para entender las necesidades del usuario y sus intenciones u órdenes volitivas. De modo similar, usando la fuerza muscular existente (en pacientes con LME incompleta) como motivación para lograr el movimiento y asistirles solo cuando sea necesario. El comportamiento adaptativo del robot portátil se propone mediante la monitorización de la interacción y movimiento del usuario. Esta adaptación conjunta se consigue modulando la rigidez en función de los parámetros de la articulación, tales como posiciones y pares de torsión. Dichos parámetros se miden del usuario de forma independiente y posteriormente se usan para actualizar el nuevo valor de la rigidez. El desempeño del algoritmo adaptativo no requiere de sensores externos, lo que favorece la simplicidad de su uso. Para una adecuada rehabilitación, efectiva y accesible para el usuario, es necesaria la compatibilidad con diversos mecanismos de asistencia tales como estimulación muscular, actividad neuronal y equilibrio corporal. Para mejorar la eficiencia del modelo de control adaptativo se ha empleado una combinación de dos enfoques de control, y para su evaluación se ha utilizado un exoesqueleto robótico H1. Los enfoques de control Jerárquico y de Tarea se han utilizado para ayudar al usuario según sea necesario, y al mismo tiempo motivarle para continuar el tratamiento. Enfoque jerárquico facilita la combinación de múltiples dispositivos para ofrecer un tratamiento eficaz mediante la categorización de la arquitectura de control en dos niveles : el control de bajo nivel y de alto nivel. Los enfoques basados en tareas involucran a la persona en cada tarea individual, y ofrecen la posibilidad de combinarlas en cualquier momento. También es necesario proporcionar un enfoque basado en la interacción con el usuario, para asegurar su participación y lograr así una terapia eficaz. Mediante esta tesis, proponemos un control adaptativo basado en tareas y en función de la interacción persona-ortesis, que se aplica en un esquema de control jerárquico. Este esquema de control se emplea en un robot portátil, con la intención de ser aplicado o acomodado a diferentes patologías, con sus capacidades de adaptación. El modelo de control adaptativo propuesto proporciona una solución integral a través de una única aplicación: adaptación dentro de la marcha y apoyo continúo a través de ejercicios de movilidad en tiempo real. El rendimiento del modelo se ha evaluado en sujetos sanos según un estudio preliminar, y posteriormente también en pacientes parapléjicos. Los resultados en sujetos sanos mostraron un cambio significativo en el patrón de los pares de interacción, elucidando un cambio en la energía y la adaptación al movimiento del usuario. En el caso de los pacientes, la adaptación mostró una mejora significativa en la actuación conjunta (rango de flexión / extensión) y el cambio en pares de interacción. El cambio activo en pares de interacción (positivo a negativo) refleja la participación activa del paciente, lo que también explica el comportamiento adaptativo

Stable locomotion of humanoid robots based on mass concentrated model

El estudio de la locomoción de robots humanoides es actualmente un área muy activa, en el campo de la robótica. Partiendo del principio que el hombre esta construyendo robots para trabajar juntos cooperando en ambientes humanos. La estabilidad durante la caminata es un factor crítico que prevee la caída del robot, la cual puede causar deterioros al mismo y a las personas en su entorno. De esta manera, el presente trabajo pretende resolver una parte del problema de la locomoción bípeda, esto es los métodos empleados para “La generación del paso” (“Gait generation”) y asi obtener la caminata estable. Para obtener una marcha estable se utilizan modelos de masa concentrada. De esta manera el modelo del “pendulo invertido simple” y el modelo del “carro sobre la mesa” se han utilizado para conseguir la marcha estable de robots humanoides. En el modelo del pendulo invertido, la masa el pendulo conduce el movimiento del centro de gravedad (CDG) del robot humanoide durante la marcha. Se detallara que el CDG se mueve como una bola libre sobre un plano bajo las leyes del pendulo en el campo de gravedad. Mientras que en el modelo del “carro sobre la mesa”, el carro conduce el movimiento del CDG durante la marcha. En este caso, el movimiento del carro es tratado como un sistema servocontrolado, y el movimiento del CDG es obtenido con los actuales y futuros estados de referencia del Zero Moment Point (ZMP). El método para generar el paso propuesto esta compuesto de varias capas como son Movimiento global, movimiento local, generación de patrones de movimiento, cinemática inversa y dinámica inversa y finalmente una corrección off-line. Donde la entrada en este método es la meta global (es decir la configuración final del robot, en el entorno de marcha) y las salidas son los patrones de movimiento de las articulaciones junto con el patrón de referencia del ZMP. Por otro lado, se ha propuesto el método para generar el “Paso acíclico”. Este método abarca el movimiento del paso dinámico incluyendo todo el cuerpo del robot humanoide, desde desde cuaquier postura genérica estáticamente estable hasta otra; donde las entradas son los estados inicial y final del robot (esto es los ángulos iniciales y finales de las articulaciones) y las salidas son las trayectorias de referencia de cada articulación y del ZMP. Se han obtenido resultados satisfactorios en las simulaciones y en el robot humanoide real Rh-1 desarrollado en el Robotics lab de la Universidad Carlos III de Madrid. De igual manera el movimiento innovador llamado “Paso acíclico” se ha implemenado exitosamente en el robot humanoide HRP-2 (desarrollado por el AIST e Industrias Kawada Inc., Japon). Finalmente los resultados, contribuciones y trabajos futuros se expondran y discutirán. _______________________________________________The study of humanoid robot locomotion is currently a very active area in robotics, since humans build robots to work their environments in common cooperation and in harmony. Stability during walking motion is a critical fact in preventing the robot from falling down and causing the human or itself damages. This work tries to solve a part of the locomotion problem, which is, the “Gait Generation” methods used to obtain stable walking. Mass concentrated models are used to obtain stable walking motion. Thus the inverted pendulum model and the cart-table model are used to obtain stable walking motion in humanoid robots. In the inverted pendulum model, the mass of the pendulum drives the center of gravity (COG) motion of the humanoid robot while it is walking. It will be detailed that the COG moves like a free ball on a plane under the laws of the pendulum in the field of gravity. While in the cart-table model, the cart drives the COG motion during walking motion. In this case, the cart motion is treated as a servo control system, obtaining its motion from future reference states of the ZMP. The gait generation method proposed has many layers like Global motion, local motion, motion patterns generation, inverse kinematics and inverse dynamics and finally off-line correction. When the input in the gait generation method is the global goal (that is the final configuration of the robot in walking environment), and the output is the joint patterns and ZMP reference patterns. Otherwise, the “Acyclic gait” method is proposed. This method deals with the whole body humanoid robot dynamic step motion from any generic posture to another one when the input is the initial and goal robot states (that is the initial and goal joint angles) and the output is the joint and ZMP reference patterns. Successful simulation and actual results have been obtained with the Rh- 1 humanoid robot developed in the Robotics lab (Universidad Carlos III de Madrid, Spain) and the innovative motion called “Acyclic gait” implemented in the HRP-2 humanoid robot platform (developed by the AIST and Kawada Industries Inc., Japan). Furthermore, the results, contributions and future works will be discussed

Bio-Inspired Robotics

Modern robotic technologies have enabled robots to operate in a variety of unstructured and dynamically-changing environments, in addition to traditional structured environments. Robots have, thus, become an important element in our everyday lives. One key approach to develop such intelligent and autonomous robots is to draw inspiration from biological systems. Biological structure, mechanisms, and underlying principles have the potential to provide new ideas to support the improvement of conventional robotic designs and control. Such biological principles usually originate from animal or even plant models, for robots, which can sense, think, walk, swim, crawl, jump or even fly. Thus, it is believed that these bio-inspired methods are becoming increasingly important in the face of complex applications. Bio-inspired robotics is leading to the study of innovative structures and computing with sensory–motor coordination and learning to achieve intelligence, flexibility, stability, and adaptation for emergent robotic applications, such as manipulation, learning, and control. This Special Issue invites original papers of innovative ideas and concepts, new discoveries and improvements, and novel applications and business models relevant to the selected topics of ``Bio-Inspired Robotics''. Bio-Inspired Robotics is a broad topic and an ongoing expanding field. This Special Issue collates 30 papers that address some of the important challenges and opportunities in this broad and expanding field