Descriptive and explanatory tools for human movement and state estimation in humanoid robotics

Le sujet principal de cette thèse est le mouvement des systèmes anthropomorphes, et plus particulièrement la locomotion bipède des humains et des robots humanoïdes. Pour caractériser et comprendre la locomotion bipède, il est instructif d'en étudier les causes, qui résident dans le contrôle et l'organisation du mouvement, et les conséquences qui en résultent, que sont le mouvement et les interactions physiques avec l'environnement. Concernant les causes, par exemple, quels sont les principes qui régissent l'organisation des ordres moteurs pour élaborer une stratégie de déplacement spécifique ? Puis, quelles grandeurs physiques pouvons-nous calculer pour décrire au mieux le mouvement résultant de ces commandes motrices ? Ces questions sont en partie abordées par la proposition d'une extension mathématique de l'approche du Uncontrolled Manifold au contrôle moteur de tâches dynamiques, puis par la présentation d'un nouveau descripteur de la locomotion anthropomorphe. En lien avec ce travail analytique vient le problème de l'estimation de l'état pour les systèmes anthropomorphes. La difficulté d'un tel problème vient du fait que les mesures apportent un bruit qui n'est pas toujours séparable des données informatives, et que l'état du système n'est pas nécessairement observable. Pour se débarrasser du bruit, des techniques de filtrage classiques peuvent être employées, mais elles sont susceptibles d'altérer le contenu des signaux d'intérêt. Pour faire face à ce problème, nous présentons une méthode récursive, basée sur le filtrage complémentaire, pour estimer la position du centre de masse et la variation du moment cinétique d'un système en contact, deux quantités centrales de la locomotion bipède. Une autre idée pour se débarrasser du bruit de mesure est de réaliser qu'il résulte en une estimation irréaliste de la dynamique du système. En exploitant les équations du mouvement, qui dictent la dynamique temporelle du système, et en estimant une trajectoire plutôt qu'un point unique, nous présentons ensuite une estimation du maximum de vraisemblance en utilisant l'algorithme de programmation différentielle dynamique pour effectuer une estimation optimale de l'état centroidal des systèmes en contact. Finalement, une réflexion pluridisciplinaire est présentée, sur le rôle fonctionnel et computationnel joué par la tête chez les animaux. La pertinence de son utilisation en robotique mobile y est discutée, pour l'estimation d'état et la perception multisensorielle.The substantive subject of this thesis is the motion of anthropomorphic systems, and more particularly the bipedal locomotion of humans and humanoid robots. To characterize and understand bipedal locomotion, it is instructive to study its motor causes and its resulting physical consequences, namely, the interactions with the environment. Concerning the causes, for instance, what are the principles that govern the organization of motor orders in humans for elaborating a specific displacement strategy? And then, which physical quantities can we compute for best describing the motion resulting from these motor orders ? These questions are in part addressed by the proposal of a mathematical extension of the Uncontrolled Manifold approach for the motor control of dynamic tasks and through the presentation of a new descriptor of anthropomorphic locomotion. In connection with this analytical work, comes the problem of state estimation in anthropomorphic systems. The difficulty of such a problem comes from the fact that the measurements carry noise which is not always separable from the informative data, and that the state of the system is not necessarily observable. To get rid of the noise, classical filtering techniques can be employed but they are likely to distort the signals. To cope with this issue, we present a recursive method, based on complementary filtering, to estimate the position of the center of mass and the angular momentum variation of the human body, two central quantities of human locomotion. Another idea to get rid of the measurements noise is to acknowledge the fact that it results in an unrealistic estimation of the motion dynamics. By exploiting the equations of motion, which dictate the temporal dynamics of the system, and by estimating a trajectory versus a single point, we then present maximum likelihood estimation using the dynamic differential programming algorithm to perform optimal centroidal state estimation for systems in contact. Finally, a multidisciplinary reflection on the functional and computational role played by the head in animals is presented. The relevance of using this solution in mobile robotics is discussed, particularly for state estimation and multisensory perception

Aerospace medicine and biology: A continuing bibliography with indexes (supplement 292)

This bibliography lists 192 reports, articles and other documents introduced into the NASA scientific and technical information system in December, 1986

Recent Progress in Legged Robots Locomotion Control

International audiencePurpose of review. In recent years, legged robots locomotion has been transitioning from mostly flat ground in controlled settings to generic indoor and outdoor environments, approaching now real industrial scenarios. This paper aims at documenting some of the key progress made in legged locomotion control that enabled this transition. Recent findings. Legged locomotion control makes extensive use of numerical trajectory optimization and its online implementation, Model Predictive Control. A key progress has been how this optimization is handled, with refined models and refined numerical methods. This led the legged locomotion research community to heavily invest in and contribute to the development of new optimization methods and efficient numerical software

Fondements calculatoires de la locomotion anthropomorphe

La locomotion anthropomorphe est un processus complexe qui met en jeu un très grand nombre de degrés de liberté, le corps humain disposant de plus de trois cents articulations contre une trentaine chez les robots humanoïdes. Pris dans leur ensemble, ces degrés de liberté montrent une certaine cohérence rendant possible la mise en mouvement du système anthropomorphe et le maintien de son équilibre, dans le but d'éviter la chute. Cette thèse met en lumière les fondements calculatoires à l'origine de cette orchestration. Elle introduit un cadre mathématique unifié permettant à la fois l'étude de la locomotion humaine, et la génération de trajectoires locomotrices pour les robots humanoïdes. Ce cadre consiste en une réduction de la dynamique corps-complet du système pour ne considérer que sa projection autour du centre de gravité, aussi appelée dynamique centroïdale. Bien que réduite, nous montrons que cette dynamique centroïdale joue un rôle central dans la compréhension et la formation des mouvements locomoteurs. Pour ce faire, nous établissons dans un premier temps les conditions d'observabilité de cette dynamique, c'est-à-dire que nous montrons dans quelle mesure cette donnée peut être appréhendée à partir des capteurs couramment employés en biomécanique et en robotique. Forts de ces conditions d'observabilité, nous proposons un estimateur capable de reconstruire la position non-biaisée du centre de gravité. A partir de cet estimateur et de l'acquisition de mouvements de marche sur divers sujets, nous mettons en évidence la présence d'un motif cycloïdal du centre de gravité dans le plan sagittal lorsque l'humain marche de manière nominale, c'est-à-dire sans y penser. La présence de ce motif suggère l'existence d'une synergie motrice jusqu'alors ignorée, soutenant la théorie d'une coordination générale des mouvements pendant la locomotion. La dernière contribution de cette thèse porte sur la locomotion multi-contacts. Les humains ont une agilité remarquable pour effectuer des mouvements locomoteurs qui nécessitent l'utilisation conjointe des bras et des jambes, comme lors de l'ascension d'une paroi rocheuse. Comment doter les robots humanoïdes de telles capacités ? La difficulté n'est certainement pas technologique, puisque les robots actuels sont capables de développer des puissances mécaniques suffisantes. Leurs performances, évaluées tant en termes de qualité des mouvements que de temps de calcul, restent très limitées. Dans cette thèse, nous abordons le problème de génération de trajectoires multi-contacts sous la forme d'un problème de commande optimale. L'intérêt de cette formulation est de partir du modèle réduit de la dynamique centroïdale tout en répondant aux contraintes d'équilibre. L'idée originale consiste à maximiser la vraisemblance de cette dynamique réduite vis-à-vis de la dynamique corps-complet. Elle repose sur l'apprentissage d'une mesure d'occupation qui reflète les capacités cinématiques et dynamiques du robot. Elle est effective : l'algorithmique qui en découle est compatible avec des applications temps réel. L'approche a été évaluée avec succès sur le robot humanoïde HRP-2, sur plusieurs modes de locomotions, démontrant ainsi sa polyvalence.Anthropomorphic locomotion is a complex process that involves a very large number of degrees of freedom, the human body having more than three hundred joints against thirty in humanoid robots. Taken as a whole, these degrees of freedom show a certain coherence making it possible to set the anthropomorphic system in motion and maintain its equilibrium, in order to avoid falling. This thesis highlights the computational foundations behind this orchestration. It introduces a unified mathematical framework allowing both the study of human locomotion and the generation of locomotive trajectories for humanoid robots. This framework consists of a reduction of the body-complete dynamics of the system to consider only its projection around the center of gravity, also called centroid dynamics. Although reduced, we show that this centroidal dynamics plays a central role in the understanding and formation of locomotive movements. To do this, we first establish the observability conditions of this dynamic, that is to say that we show to what extent this data can be apprehended from sensors commonly used in biomechanics and robotics. Based on these observability conditions, we propose an estimator able to reconstruct the unbiased position of the center of gravity. From this estimator and the acquisition of walking motions on various subjects, we highlight the presence of a cycloidal pattern of the center of gravity in the sagittal plane when the human is walking nominally, that is, to say without thinking. The presence of this motif suggests the existence of a motor synergy hitherto unknown, supporting the theory of a general coordination of movements during locomotion. The last contribution of this thesis is on multi-contact locomotion. Humans have remarkable agility to perform locomotive movements that require joint use of the arms and legs, such as when climbing a rock wall. How to equip humanoid robots with such capabilities? The difficulty is certainly not technological, since current robots are able to develop sufficient mechanical powers. Their performances, evaluated both in terms of quality of movement and computing time, remain very limited. In this thesis, we address the problem of generating multi-contact trajectories in the form of an optimal control problem. The interest of this formulation is to start from the reduced model of centroid dynamics while responding to equilibrium constraints. The original idea is to maximize the likelihood of this reduced dynamic with respect to body-complete dynamics. It is based on learning a measurement of occupation that reflects the kinematic and dynamic capabilities of the robot. It is effective: the resulting algorithmic is compatible with real-time applications. The approach has been successfully evaluated on the humanoid robot HRP-2, on several modes of locomotion, thus demonstrating its versatility

Advances in Clinical Neurophysiology

Including some of the newest advances in the field of neurophysiology, this book can be considered as one of the treasures that interested scientists would like to collect. It discusses many disciplines of clinical neurophysiology that are, currently, crucial in the practice as they explain methods and findings of techniques that help to improve diagnosis and to ensure better treatment. While trying to rely on evidence-based facts, this book presents some new ideas to be applied and tested in the clinical practice. Advances in Clinical Neurophysiology is important not only for the neurophysiologists but also for clinicians interested or working in wide range of specialties such as neurology, neurosurgery, intensive care units, pediatrics and so on. Generally, this book is written and designed to all those involved in, interpreting or requesting neurophysiologic tests

Novel Bidirectional Body - Machine Interface to Control Upper Limb Prosthesis

Objective. The journey of a bionic prosthetic user is characterized by the opportunities and limitations involved in adopting a device (the prosthesis) that should enable activities of daily living (ADL). Within this context, experiencing a bionic hand as a functional (and, possibly, embodied) limb constitutes the premise for mitigating the risk of its abandonment through the continuous use of the device. To achieve such a result, different aspects must be considered for making the artificial limb an effective support for carrying out ADLs. Among them, intuitive and robust control is fundamental to improving amputees’ quality of life using upper limb prostheses. Still, as artificial proprioception is essential to perceive the prosthesis movement without constant visual attention, a good control framework may not be enough to restore practical functionality to the limb. To overcome this, bidirectional communication between the user and the prosthesis has been recently introduced and is a requirement of utmost importance in developing prosthetic hands. Indeed, closing the control loop between the user and a prosthesis by providing artificial sensory feedback is a fundamental step towards the complete restoration of the lost sensory-motor functions. Within my PhD work, I proposed the development of a more controllable and sensitive human-like hand prosthesis, i.e., the Hannes prosthetic hand, to improve its usability and effectiveness. Approach. To achieve the objectives of this thesis work, I developed a modular and scalable software and firmware architecture to control the Hannes prosthetic multi-Degree of Freedom (DoF) system and to fit all users’ needs (hand aperture, wrist rotation, and wrist flexion in different combinations). On top of this, I developed several Pattern Recognition (PR) algorithms to translate electromyographic (EMG) activity into complex movements. However, stability and repeatability were still unmet requirements in multi-DoF upper limb systems; hence, I started by investigating different strategies to produce a more robust control. To do this, EMG signals were collected from trans-radial amputees using an array of up to six sensors placed over the skin. Secondly, I developed a vibrotactile system to implement haptic feedback to restore proprioception and create a bidirectional connection between the user and the prosthesis. Similarly, I implemented an object stiffness detection to restore tactile sensation able to connect the user with the external word. This closed-loop control between EMG and vibration feedback is essential to implementing a Bidirectional Body - Machine Interface to impact amputees’ daily life strongly. For each of these three activities: (i) implementation of robust pattern recognition control algorithms, (ii) restoration of proprioception, and (iii) restoration of the feeling of the grasped object's stiffness, I performed a study where data from healthy subjects and amputees was collected, in order to demonstrate the efficacy and usability of my implementations. In each study, I evaluated both the algorithms and the subjects’ ability to use the prosthesis by means of the F1Score parameter (offline) and the Target Achievement Control test-TAC (online). With this test, I analyzed the error rate, path efficiency, and time efficiency in completing different tasks. Main results. Among the several tested methods for Pattern Recognition, the Non-Linear Logistic Regression (NLR) resulted to be the best algorithm in terms of F1Score (99%, robustness), whereas the minimum number of electrodes needed for its functioning was determined to be 4 in the conducted offline analyses. Further, I demonstrated that its low computational burden allowed its implementation and integration on a microcontroller running at a sampling frequency of 300Hz (efficiency). Finally, the online implementation allowed the subject to simultaneously control the Hannes prosthesis DoFs, in a bioinspired and human-like way. In addition, I performed further tests with the same NLR-based control by endowing it with closed-loop proprioceptive feedback. In this scenario, the results achieved during the TAC test obtained an error rate of 15% and a path efficiency of 60% in experiments where no sources of information were available (no visual and no audio feedback). Such results demonstrated an improvement in the controllability of the system with an impact on user experience. Significance. The obtained results confirmed the hypothesis of improving robustness and efficiency of a prosthetic control thanks to of the implemented closed-loop approach. The bidirectional communication between the user and the prosthesis is capable to restore the loss of sensory functionality, with promising implications on direct translation in the clinical practice

On the development of a cybernetic prosthetic hand

The human hand is the end organ of the upper limb, which in humans serves the important function of prehension, as well as being an important organ for sensation and communication. It is a marvellous example of how a complex mechanism can be implemented, capable of realizing very complex and useful tasks using a very effective combination of mechanisms, sensing, actuation and control functions. In this thesis, the road towards the realization of a cybernetic hand has been presented. After a detailed analysis of the model, the human hand, a deep review of the state of the art of artificial hands has been carried out. In particular, the performance of prosthetic hands used in clinical practice has been compared with the research prototypes, both for prosthetic and for robotic applications. By following a biomechatronic approach, i.e. by comparing the characteristics of these hands with the natural model, the human hand, the limitations of current artificial devices will be put in evidence, thus outlining the design goals for a new cybernetic device. Three hand prototypes with a high number of degrees of freedom have been realized and tested: the first one uses microactuators embedded inside the structure of the fingers, and the second and third prototypes exploit the concept of microactuation in order to increase the dexterity of the hand while maintaining the simplicity for the control. In particular, a framework for the definition and realization of the closed-loop electromyographic control of these devices has been presented and implemented. The results were quite promising, putting in evidence that, in the future, there could be two different approaches for the realization of artificial devices. On one side there could be the EMG-controlled hands, with compliant fingers but only one active degree of freedom. On the other side, more performing artificial hands could be directly interfaced with the peripheral nervous system, thus establishing a bi-directional communication with the human brain

Acta Universitatis Sapientiae - Electrical and Mechanical Engineering

Series Electrical and Mechanical Engineering publishes original papers and surveys in various fields of Electrical and Mechanical Engineering