359 research outputs found

    Electromyography Based Human-Robot Interfaces for the Control of Artificial Hands and Wearable Devices

    Get PDF
    The design of robotic systems is currently facing human-inspired solutions as a road to replicate the human ability and flexibility in performing motor tasks. Especially for control and teleoperation purposes, the human-in-the-loop approach is a key element within the framework know as Human-Robot Interface. This thesis reports the research activity carried out for the design of Human-Robot Interfaces based on the detection of human motion intentions from surface electromyography. The main goal was to investigate intuitive and natural control solutions for the teleoperation of both robotic hands during grasping tasks and wearable devices during elbow assistive applications. The design solutions are based on the human motor control principles and surface electromyography interpretation, which are reviewed with emphasis on the concept of synergies. The electromyography based control strategies for the robotic hand grasping and the wearable device assistance are also reviewed. The contribution of this research for the control of artificial hands rely on the integration of different levels of the motor control synergistic organization, and on the combination of proportional control and machine learning approaches under the guideline of user-centred intuitiveness in the Human-Robot Interface design specifications. From the side of the wearable devices, the control of a novel upper limb assistive device based on the Twisted String Actuation concept is faced. The contribution regards the assistance of the elbow during load lifting tasks, exploring a simplification in the use of the surface electromyography within the design of the Human-Robot Interface. The aim is to work around complex subject-dependent algorithm calibrations required by joint torque estimation methods

    System Identification of Bipedal Locomotion in Robots and Humans

    Get PDF
    The ability to perform a healthy walking gait can be altered in numerous cases due to gait disorder related pathologies. The latter could lead to partial or complete mobility loss, which affects the patients’ quality of life. Wearable exoskeletons and active prosthetics have been considered as a key component to remedy this mobility loss. The control of such devices knows numerous challenges that are yet to be addressed. As opposed to fixed trajectories control, real-time adaptive reference generation control is likely to provide the wearer with more intent control over the powered device. We propose a novel gait pattern generator for the control of such devices, taking advantage of the inter-joint coordination in the human gait. Our proposed method puts the user in the control loop as it maps the motion of healthy limbs to that of the affected one. To design such control strategy, it is critical to understand the dynamics behind bipedal walking. We begin by studying the simple compass gait walker. We examine the well-known Virtual Constraints method of controlling bipedal robots in the image of the compass gait. In addition, we provide both the mechanical and control design of an affordable research platform for bipedal dynamic walking. We then extend the concept of virtual constraints to human locomotion, where we investigate the accuracy of predicting lower limb joints angular position and velocity from the motion of the other limbs. Data from nine healthy subjects performing specific locomotion tasks were collected and are made available online. A successful prediction of the hip, knee, and ankle joints was achieved in different scenarios. It was also found that the motion of the cane alone has sufficient information to help predict good trajectories for the lower limb in stairs ascent. Better estimates were obtained using additional information from arm joints. We also explored the prediction of knee and ankle trajectories from the motion of the hip joints

    Otimização muscle-in-the-loop em tempo real para reabilitação física com um exosqueleto ativo: uma mudança de paradigma

    Get PDF
    Assisting human locomotion with a wearable robotic orthosis is still quite challenging, largely due to the complexity of the neuromusculoskeletal system, the time-varying dynamics that accompany motor adaptation, and the uniqueness of every individual’s response to the assistance given by the robot. To this day, these devices have not met their well-known promise yet, mostly due to the fact that they are not perfectly suitable for the rehabilitation of neuropathologic patients. One of the main challenges hampering this goal still relies on the interface and co-dependency between the human and the machine. Nowadays, most commercial exoskeletons replay pre-defined gait patterns, whereas research exoskeletons are switching to controllers based on optimized torque profiles. In most cases, the dynamics of the human musculoskeletal system are still ignored and do not take into account the optimal conditions for inducing a positive modulation of neuromuscular activity. This is because both rehabilitation strategies are still emphasized on the macro level of the whole joint instead of focusing on the muscles’ dynamics and activity, which are the actual anatomical elements that may need to be rehabilitated. Strategies to keep the human in the loop of the exoskeleton’s control laws in real-time may help to overcome these challenges. The main purpose of the present dissertation is to make a paradigm shift in the approach on how the assistance that is given to a subject by an exoskeleton is modelled and controlled during physical rehabilitation. Therefore, in the scope of the present work, it was intended to design, concede, implement, and validate a real-time muscle-in-the-loop optimization model to find the best assistive support ratio that would induce optimal rehabilitation conditions to a specific group of impaired muscles while having a minimum impact on the other healthy muscles. The developed optimization model was implemented in the form of a plugin and was integrated on a neuromechanical model-based interface for driving a bilateral ankle exoskeleton. Experimental pilot tests evaluated the feasibility and effectiveness of the model. Results of the most significant pilots achieved EMG reductions up to 61 ± 3 % in Soleus and 41 ± 10 % in Gastrocnemius Lateralis. Moreover, results also demonstrated the efficiency of the optimization’s specific reduction on rehabilitation by looking into the muscular fatigue after each experiment. Finally, two parallel preliminary studies emerged from the pilots, which looked at muscle adaptation, after a new assistive condition had been applied, over time and at the effect of the lateral positioning of the exoskeleton’s actuators on the leg muscles.Auxiliar a locomoção humana com uma ortose robótica ainda é bastante desafiante, em grande parte devido à complexidade do sistema neuromusculoesquelético, à dinâmica variável no tempo que acompanha a adaptação motora e à singularidade da resposta de cada indivíduo à assistência dada pelo robô. Até hoje, está por cumprir a promessa inicial destes dispositivos, principalmente devido ao facto de não serem perfeitamente adequados para a reabilitação de pacientes neuropatológicos. Um dos principais desafios que dificultam esse objetivo foca-se ainda na interface e na co-dependência entre o ser humano e a máquina. Hoje em dia, a maioria dos exoesqueletos comerciais reproduz padrões de marcha predefinidos, enquanto que os exoesqueletos em investigação estão só agora a mudar para controladores com base em perfis de binário otimizados. Na maioria dos casos, a dinâmica do sistema musculoesquelético humano ainda é ignorada e não tem em consideração as condições ideais para induzir uma modulação positiva da atividade neuromuscular. Isso ocorre porque ambas as estratégias de reabilitação ainda são enfatizadas no nível macro de toda a articulação, em vez de se concentrar na dinâmica e atividade dos músculos, que são os elementos anatómicos que realmente precisam de ser reabilitados. Estratégias para manter o ser humano em loop nos comandos que controlam o exoesqueleto em tempo real podem ajudar a superar estes desafios. O principal objetivo desta dissertação é fazer uma mudança de paradigma na abordagem em como a assistência que é dada a um sujeito por um exosqueleto é modelada e controlada durante a reabilitação física. Portanto, no contexto do presente trabalho, pretendeu-se projetar, conceder, implementar e validar um modelo de otimização muscle-in-the-loop em tempo real para encontrar a melhor relação de suporte capaz de induzir as condições ideais de reabilitação para um grupo específico de músculos fragilizados, tendo um impacto mínimo nos outros músculos saudáveis. O modelo de otimização desenvolvido foi implementado na forma de um plugin e foi integrado numa interface baseada num modelo neuromecânico para o controlo de um exoesqueleto bilateral de tornozelo. Testes experimentais piloto avaliaram a viabilidade e a eficácia do modelo. Os resultados dos testes mais significativos demonstraram reduções de EMG de até 61 ± 3 % no Soleus e 41 ± 10 % no Gastrocnemius Lateral. Adicionalmente, os resultados demonstraram também a eficiência em reabilitação da redução específica no EMG devido à otimização tendo em conta a fadiga muscular após cada teste. Finalmente, dois estudos preliminares paralelos emergiram dos testes piloto, que analisaram a adaptação muscular após uma nova condição assistiva ter sido definida ao longo do tempo e o efeito do posicionamento lateral dos atuadores do exoesqueleto nos músculos da perna.Mestrado em Engenharia Biomédic

    Experimental Study on Human Arm Reaching with and without a Reduced Mobility for Applications in Medical Human-Interactive Robotics

    Get PDF
    Along with increasing advances in robotic technologies, there are now significant efforts under way to improve the quality of life especially those with physical disabilities or impairments. Control of such medical human-interactive robotics (HIR) involves complications in its design and control due to uncertain human factors. This dissertation makes its efforts to resolve three main challenges of an advanced HIR controller development: 1) detecting the operator’s motion intent, 2) understanding human motor behavior from the robotic perspective, and 3) generating reference motion for the HIR. Our interests in such challenges are limited to the point-to-point reaching of the human arm for applications of their solutions in the control of rehabilitation exoskeletons, therapeutic haptic devices, and prosthetic arms. In the context of human motion intent detection, a mobile motion capture system (MCS) enhanced with myoprocessors is developed to capture kinematics and dynamics of human arm in reaching movements. The developed MCS adopts wireless IMU (inertial measurement unit) sensors to capture ADL (activities of daily life) motions in the real-life environment. In addition, measured muscle activation patterns from selected muscle groups are converted into muscular force values by myoprocessors. This allows a reliable motion intent detection by quantify one of the most frequently used driving signal of the HIR, EMG (electromyography), in a standardized way. In order to understand the human motor behavior from the robotic viewpoint, a computational model on reaching is required. Since such model can be constituted by experimental observations, this dissertation look into invariant motion features of reaching with and without elbow constraint condition to establish a foundation of the computational model. The HIR should generate its reference motions by reflecting motor behavior of the natural human reaching. Though the accurate approximation of such behavior is critical, we also need to take into account the computational cost, especially for real-time applications such as the HIR control. In this manner, a higher order kinematic synthesis of mechanical linkage systems is adopted to approximate natural human hand profiles. Finally, a novel control concept of a myo-prosthetic arm is proposed as an application of all findings and efforts made in this dissertation

    Musculoskeletal Modeling of the Human Lower Limb Stiffness for Robotic Applications

    Get PDF
    This research work presents a physiologically accurate and novel computationally fast neuromusculoskeletal model of the human lower limb stiffness. The proposed computational framework uses electromyographic signals, motion capture data and ground reaction forces to predict the force developed by 43 musculotendon actuators. The estimated forces are then used to compute the musculotendon stiffness and the corresponding joint stiffness. The estimations at each musculotendon unit is constrained to simultaneously satisfy the joint angles and the joint moments of force generated with respect to five degrees of freedom, including: Hip Adduction-Abduction, Hip Flexion-Extension, Hip Internal-External Rotation, Knee Flexion-Extension, and Ankle Plantar-Dorsi Flexion. Advanced methods are used to perform accurate muscle-driven dynamic simulations and to guarantee the dynamic consistency between kinematic and kinetic data. This study presents also the design, simulation and prototyping of a small musculoskeletal humanoid made for replicating the human musculoskeletal structure in an artificial apparatus capable to maintain a quiet standing position using only a completely passive elastic actuation structure. The proposed prototype has a total mass of about 2 kg and its height is 40 cm. It comprises of four segments for each leg and six degrees of freedom, including: Hip Adduction-Abduction, Hip Flexion-Extension, Knee Flexion-Extension, Ankle Plantar-Dorsi Flexion, Ankle Inversion-Eversion, and Toe Flexion-Extension. In order to reconstruct the continuous state space parameters proper of the assembly's control of quiet standing, a hybrid non-linear Extended Kalman Filter based technique is proposed to combine a base-excited inverted pendulum kinematic model of the robot with the discrete-time position measurements. This research work provides effective solutions and readily available software tools to improve the human interaction with robotic assistive devices, advancing the research in neuromusculoskeletal modeling to better understand the mechanisms of actuation provided by human muscles and the rules that govern the lower limb joint stiffness regulation. The obtained results suggest that the neuromusculoskeletal modeling technology can be exploited to address the challenges on the development of musculoskeletal humanoids, new generation human-robot interfaces, motion control algorithms, and intelligent assistive wearable devices capable to effectively ensure a proper dynamic coupling between human and robot

    Human skill capturing and modelling using wearable devices

    Get PDF
    Industrial robots are delivering more and more manipulation services in manufacturing. However, when the task is complex, it is difficult to programme a robot to fulfil all the requirements because even a relatively simple task such as a peg-in-hole insertion contains many uncertainties, e.g. clearance, initial grasping position and insertion path. Humans, on the other hand, can deal with these variations using their vision and haptic feedback. Although humans can adapt to uncertainties easily, most of the time, the skilled based performances that relate to their tacit knowledge cannot be easily articulated. Even though the automation solution may not fully imitate human motion since some of them are not necessary, it would be useful if the skill based performance from a human could be firstly interpreted and modelled, which will then allow it to be transferred to the robot. This thesis aims to reduce robot programming efforts significantly by developing a methodology to capture, model and transfer the manual manufacturing skills from a human demonstrator to the robot. Recently, Learning from Demonstration (LfD) is gaining interest as a framework to transfer skills from human teacher to robot using probability encoding approaches to model observations and state transition uncertainties. In close or actual contact manipulation tasks, it is difficult to reliabley record the state-action examples without interfering with the human senses and activities. Therefore, wearable sensors are investigated as a promising device to record the state-action examples without restricting the human experts during the skilled execution of their tasks. Firstly to track human motions accurately and reliably in a defined 3-dimensional workspace, a hybrid system of Vicon and IMUs is proposed to compensate for the known limitations of the individual system. The data fusion method was able to overcome occlusion and frame flipping problems in the two camera Vicon setup and the drifting problem associated with the IMUs. The results indicated that occlusion and frame flipping problems associated with Vicon can be mitigated by using the IMU measurements. Furthermore, the proposed method improves the Mean Square Error (MSE) tracking accuracy range from 0.8Ëš to 6.4Ëš compared with the IMU only method. Secondly, to record haptic feedback from a teacher without physically obstructing their interactions with the workpiece, wearable surface electromyography (sEMG) armbands were used as an indirect method to indicate contact feedback during manual manipulations. A muscle-force model using a Time Delayed Neural Network (TDNN) was built to map the sEMG signals to the known contact force. The results indicated that the model was capable of estimating the force from the sEMG armbands in the applications of interest, namely in peg-in-hole and beater winding tasks, with MSE of 2.75N and 0.18N respectively. Finally, given the force estimation and the motion trajectories, a Hidden Markov Model (HMM) based approach was utilised as a state recognition method to encode and generalise the spatial and temporal information of the skilled executions. This method would allow a more representative control policy to be derived. A modified Gaussian Mixture Regression (GMR) method was then applied to enable motions reproduction by using the learned state-action policy. To simplify the validation procedure, instead of using the robot, additional demonstrations from the teacher were used to verify the reproduction performance of the policy, by assuming human teacher and robot learner are physical identical systems. The results confirmed the generalisation capability of the HMM model across a number of demonstrations from different subjects; and the reproduced motions from GMR were acceptable in these additional tests. The proposed methodology provides a framework for producing a state-action model from skilled demonstrations that can be translated into robot kinematics and joint states for the robot to execute. The implication to industry is reduced efforts and time in programming the robots for applications where human skilled performances are required to cope robustly with various uncertainties during tasks execution

    Generating whole body movements for dynamics anthropomorphic systems under constraints

    Get PDF
    Cette thèse étudie la question de la génération de mouvements corps-complet pour des systèmes anthropomorphes. Elle considère le problème de la modélisation et de la commande en abordant la question difficile de la génération de mouvements ressemblant à ceux de l'homme. En premier lieu, un modèle dynamique du robot humanoïde HRP-2 est élaboré à partir de l'algorithme récursif de Newton-Euler pour les vecteurs spatiaux. Un nouveau schéma de commande dynamique est ensuite développé, en utilisant une cascade de programmes quadratiques (QP) optimisant des fonctions coûts et calculant les couples de commande en satisfaisant des contraintes d'égalité et d'inégalité. La cascade de problèmes quadratiques est définie par une pile de tâches associée à un ordre de priorité. Nous proposons ensuite une formulation unifiée des contraintes de contacts planaires et nous montrons que la méthode proposée permet de prendre en compte plusieurs contacts non coplanaires et généralise la contrainte usuelle du ZMP dans le cas où seulement les pieds sont en contact avec le sol. Nous relions ensuite les algorithmes de génération de mouvement issus de la robotique aux outils de capture du mouvement humain en développant une méthode originale de génération de mouvement visant à imiter le mouvement humain. Cette méthode est basée sur le recalage des données capturées et l'édition du mouvement en utilisant le solveur hiérarchique précédemment introduit et la définition de tâches et de contraintes dynamiques. Cette méthode originale permet d'ajuster un mouvement humain capturé pour le reproduire fidèlement sur un humanoïde en respectant sa propre dynamique. Enfin, dans le but de simuler des mouvements qui ressemblent à ceux de l'homme, nous développons un modèle anthropomorphe ayant un nombre de degrés de liberté supérieur à celui du robot humanoïde HRP2. Le solveur générique est utilisé pour simuler le mouvement sur ce nouveau modèle. Une série de tâches est définie pour décrire un scénario joué par un humain. Nous montrons, par une simple analyse qualitative du mouvement, que la prise en compte du modèle dynamique permet d'accroitre naturellement le réalisme du mouvement.This thesis studies the question of whole body motion generation for anthropomorphic systems. Within this work, the problem of modeling and control is considered by addressing the difficult issue of generating human-like motion. First, a dynamic model of the humanoid robot HRP-2 is elaborated based on the recursive Newton-Euler algorithm for spatial vectors. A new dynamic control scheme is then developed adopting a cascade of quadratic programs (QP) optimizing the cost functions and computing the torque control while satisfying equality and inequality constraints. The cascade of the quadratic programs is defined by a stack of tasks associated to a priority order. Next, we propose a unified formulation of the planar contact constraints, and we demonstrate that the proposed method allows taking into account multiple non coplanar contacts and generalizes the common ZMP constraint when only the feet are in contact with the ground. Then, we link the algorithms of motion generation resulting from robotics to the human motion capture tools by developing an original method of motion generation aiming at the imitation of the human motion. This method is based on the reshaping of the captured data and the motion editing by using the hierarchical solver previously introduced and the definition of dynamic tasks and constraints. This original method allows adjusting a captured human motion in order to reliably reproduce it on a humanoid while respecting its own dynamics. Finally, in order to simulate movements resembling to those of humans, we develop an anthropomorphic model with higher number of degrees of freedom than the one of HRP-2. The generic solver is used to simulate motion on this new model. A sequence of tasks is defined to describe a scenario played by a human. By a simple qualitative analysis of motion, we demonstrate that taking into account the dynamics provides a natural way to generate human-like movements

    Humanoid Robots

    Get PDF
    For many years, the human being has been trying, in all ways, to recreate the complex mechanisms that form the human body. Such task is extremely complicated and the results are not totally satisfactory. However, with increasing technological advances based on theoretical and experimental researches, man gets, in a way, to copy or to imitate some systems of the human body. These researches not only intended to create humanoid robots, great part of them constituting autonomous systems, but also, in some way, to offer a higher knowledge of the systems that form the human body, objectifying possible applications in the technology of rehabilitation of human beings, gathering in a whole studies related not only to Robotics, but also to Biomechanics, Biomimmetics, Cybernetics, among other areas. This book presents a series of researches inspired by this ideal, carried through by various researchers worldwide, looking for to analyze and to discuss diverse subjects related to humanoid robots. The presented contributions explore aspects about robotic hands, learning, language, vision and locomotion

    Biomechatronics: Harmonizing Mechatronic Systems with Human Beings

    Get PDF
    This eBook provides a comprehensive treatise on modern biomechatronic systems centred around human applications. A particular emphasis is given to exoskeleton designs for assistance and training with advanced interfaces in human-machine interaction. Some of these designs are validated with experimental results which the reader will find very informative as building-blocks for designing such systems. This eBook will be ideally suited to those researching in biomechatronic area with bio-feedback applications or those who are involved in high-end research on manmachine interfaces. This may also serve as a textbook for biomechatronic design at post-graduate level

    Advancing Musculoskeletal Robot Design for Dynamic and Energy-Efficient Bipedal Locomotion

    Get PDF
    Achieving bipedal robot locomotion performance that approaches human performance is a challenging research topic in the field of humanoid robotics, requiring interdisciplinary expertise from various disciplines, including neuroscience and biomechanics. Despite the remarkable results demonstrated by current humanoid robots---they can walk, stand, turn, climb stairs, carry a load, push a cart---the versatility, stability, and energy efficiency of humans have not yet been achieved. However, with robots entering our lives, whether in the workplace, in clinics, or in normal household environments, such improvements are increasingly important. The current state of research in bipedal robot locomotion reveals that several groups have continuously demonstrated enhanced locomotion performance of the developed robots. But each of these groups has taken a unilateral approach and placed the focus on only one aspect, in order to achieve enhanced movement abilities;---for instance, the motion control and postural stability or the mechanical design. The neural and mechanical systems in human and animal locomotion, however, are strongly coupled and should therefore not be treated separately. Human-inspired musculoskeletal design of bipedal robots offers great potential for enhanced dynamic and energy-efficient locomotion but also imposes major challenges for motion planning and control. In this thesis, we first present a detailed review of the problems related to achieving enhanced dynamic and energy-efficient bipedal locomotion, from various important perspectives, and examine the essential properties of the human locomotory apparatus. Subsequently, existing insights and approaches from biomechanics, to understand the neuromechanical motion apparatus, and from robotics, to develop more human-like robots that can move in our environment, are discussed in detail. These thorough investigations of the interrelated essential design decisions are used to develop a novel design for a musculoskeletal bipedal robot, BioBiped1, such that, in the long term, it is capable of realizing dynamic hopping, running, and walking motions. The BioBiped1 robot features a highly compliant tendon-driven actuation system that mimics key functionalities of the human lower limb system. In experiments, BioBiped1's locomotor function for the envisioned gaits is validated globally. It is shown that the robot is able to rebound passively, store and release energy, and actively push off from the ground. The proof of concept of BioBiped1's locomotor function, however, marks only the starting point for our investigations, since this novel design concept opens up a number of questions regarding the required design complexity for the envisioned motions and the appropriate motion generation and control concept. For this purpose, a simulator specifically designed for the requirements of musculoskeletally actuated robotic systems, including sufficiently realistic ground reaction forces, is developed. It relies on object-oriented design and is based on a numerical solver, without model switching, to enable the analysis of impact peak forces and the simulation of flight phases. The developed library also contains the models of the actuated and passive mono- and biarticular elastic tendons and a penalty-based compliant contact model with nonlinear damping, to incorporate the collision, friction, and stiction forces occurring during ground contact. Using these components, the full multibody system (MBS) dynamics model is developed. To ensure a sufficiently similar behavior of the simulated and the real musculoskeletal robot, various measurements and parameter identifications for sub-models are performed. Finally, it is shown that the simulation model behaves similarly to the real robot platform. The intelligent combination of actuated and passive mono- and biarticular tendons, imitating important human muscle groups, offers tremendous potential for improved locomotion performance but also requires a sophisticated concept for motion control of the robot. Therefore, a further contribution of this thesis is the development of a centralized, nonlinear model-based method for motion generation and control that utilizes the derived detailed dynamics models of the implemented actuators. The concept is used to realize both computer-generated hopping and human jogging motions. Additionally, the problem of appropriate motor-gear unit selection prior to the robot's construction is tackled, using this method. The thesis concludes with a number of simulation studies in which several leg actuation designs are examined for their optimality with regard to systematically selected performance criteria. Furthermore, earlier paradoxical biomechanical findings about biarticular muscles in running are presented and, for the first time, investigated by detailed simulation of the motion dynamics. Exploring the Lombard paradox, a novel reduced and energy-efficient locomotion model without knee extensor has been simulated successfully. The models and methods developed within this thesis, as well as the insights gained, are already being employed to develop future prototypes. In particular, the optimal dimensioning and setting of the actuators, including all mono- and biarticular muscle-tendon units, are based on the derived design guidelines and are extensively validated by means of the simulation models and the motion control method. These developments are expected to significantly enhance progress in the field of bipedal robot design and, in the long term, to drive improvements in rehabilitation for humans through an understanding of the neuromechanics underlying human walking and the application of this knowledge to the design of prosthetics
    • …
    corecore