Achieving human-like dexterity in robotic hands : inspiration from human hand biomechanics and neuromuscular control

The human hand's unique biomechanical structure and neuromuscular control combine to produce amazing dexterous capabilities in a way that is still not fully understood. The Anatomically Correct Testbed (ACT) hand is a robotic system that is designed as a physical simulation of the human hand, and can help us examine and potentially uncover the roles of biomechanics and neural control in achieving dexterity. In this dissertation, I utilize the ACT hand and other robotic systems to explore the underlying sources of human hand dexterity, with the goal of understanding the fundamental differences between robotic and human hands in terms of (i) mechanical joint/tendon structure and (ii) control strategies. To begin, I develop comprehensive mechanical models that describe the musculoskeletal and tendon mechanics of the fingers and thumb of the human hand. Then, I work to isolate the contributions of biomechanical structure and neuromuscular control toward human dexterity. I have developed and implemented control strategies for achieving fine object manipulation first with the robotic hand of a space humanoid, Robonaut 2, and then with the ACT hand. I examined the unique control challenges, including uncontrollable joints and the requirement of accurate internal models, that arise due to the human hand's complex musculotendon structure and the potential advantages offered by the human hand's design, such as passive joint coupling to facilitate grasp shape adaptation and force production capabilities that are ideally suited for common manipulation tasks. Finally, inspired by the neuromuscular control strategies of the human hand, I have developed a novel hierarchical control strategy for the ACT hand and experimentally demonstrated improved grasp stability and manipulation capabilities compared to conventional robotic control laws. Through an in-depth exploration of human hand biomechanics and neuromuscular control, theoretical control analysis of robotic and human hands, and experimental demonstration of fine object manipulation, this work uncovers crucial insights into the sources of human hand dexterity that have the potential to drive innovative design and control strategies and bring robotic and prosthetic hands closer to human levels of dexterity.Mechanical Engineerin

On Neuromechanical Approaches for the Study of Biological Grasp and Manipulation

Biological and robotic grasp and manipulation are undeniably similar at the level of mechanical task performance. However, their underlying fundamental biological vs. engineering mechanisms are, by definition, dramatically different and can even be antithetical. Even our approach to each is diametrically opposite: inductive science for the study of biological systems vs. engineering synthesis for the design and construction of robotic systems. The past 20 years have seen several conceptual advances in both fields and the quest to unify them. Chief among them is the reluctant recognition that their underlying fundamental mechanisms may actually share limited common ground, while exhibiting many fundamental differences. This recognition is particularly liberating because it allows us to resolve and move beyond multiple paradoxes and contradictions that arose from the initial reasonable assumption of a large common ground. Here, we begin by introducing the perspective of neuromechanics, which emphasizes that real-world behavior emerges from the intimate interactions among the physical structure of the system, the mechanical requirements of a task, the feasible neural control actions to produce it, and the ability of the neuromuscular system to adapt through interactions with the environment. This allows us to articulate a succinct overview of a few salient conceptual paradoxes and contradictions regarding under-determined vs. over-determined mechanics, under- vs. over-actuated control, prescribed vs. emergent function, learning vs. implementation vs. adaptation, prescriptive vs. descriptive synergies, and optimal vs. habitual performance. We conclude by presenting open questions and suggesting directions for future research. We hope this frank assessment of the state-of-the-art will encourage and guide these communities to continue to interact and make progress in these important areas

Switched Kinematic and Force Control for Lower-Limb Motorized Exoskeletons and Functional Electrical Stimulation

Millions of people experience movement deficits from neurological conditions (NCs) that impair their walking ability and leg function. Exercise-based rehabilitation procedures have shown the potential to facilitate neurological reorganization and functional recovery. Lower-limb powered exoskeletons and motorized ergometers have been combined with functional electrical stimulation (FES) to provide repetitive movement, partially reduce the burden of therapists, improve range of motion, and induce therapeutic benefits. FES evokes artificial muscles contractions and can improve muscle mass and strength, and bone density in people with NCs. Stationary cycling is recommended for individuals who cannot perform load-bearing activities or have increased risks of falling. Cycling has been demonstrated to impart physiological and cardiovascular benefits. Motorized FES-cycling combines an electric motor and electrical stimulation of lower-limb muscles to facilitate coordinated, long-duration exercise, while mitigating the inherent muscle fatigue due to FES. Lower-limb exoskeletons coupled with FES, also called neuroprostheses or hybrid exoskeletons, can facilitate continuous, repetitive motion to improve gait function and build muscle capacity. The human-robot interaction during rehabilitative cycling and walking yield a mix of discrete effects (i.e., foot impact, input switching to engage lower-limb muscles and electric motors, etc.) and continuous nonlinear, uncertain, time-varying dynamics. Switching control is necessary to allocate the control inputs to lower-limb muscle groups and electric motors involved during assisted cycling and walking. Kinematic tracking has been the primary control objective for devices that combine FES and electric motors. However, there are force interactions between the machine and the human during cycling and walking that motivate the design of torque-based controllers (i.e., exploit torque or force feedback) to shape the leg dynamics through controlling joint kinematics and kinetics. Technical challenges exist to develop closed-loop feedback control strategies that integrate kinematic and force feedback in the presence of switching and discontinuous effects. The motivation in this dissertation is to design, analyze and implement switching controllers for assisted cycling and walking leveraging kinematic and force feedback while guaranteeing the stability of the human-robot closed-loop system. In Chapter 1, the motivation to design closed-loop controllers for motorized FES-cycling and powered exoskeletons is described. A survey of closed-loop kinematic and force feedback control methods is also introduced related to the tracking objectives presented in the subsequent chapters of the dissertation. In Chapter 2, the dynamics models for walking and assisted cycling are described. First, a bipedal walking system model with switched dynamics is introduced to control a powered lower-limb exoskeleton. Then, a stationary FES-cycling model with nonlinear dynamics and switched control inputs is introduced based on published literature. The muscle stimulation pattern is defined based on the kinematic effectiveness of the rider, which depends on the crank angle. The experimental setup for lower-limb exoskeleton and FES-cycling are described. In Chapter 3, a hierarchical control strategy is developed to interface a cable-driven lower-limb exoskeleton. A two-layer control system is developed to adjust cable tensions and apply torque about the knee joint using a pair of electric motors that provide knee flexion and extension. The control design is segregated into a joint-level control loop and a low-level loop using feedback of the angular positions of the electric motors to mitigate cable slacking. A Lyapunov-based stability analysis is developed to ensure exponential tracking for both control objectives. Moreover, an average dwell time analysis computes an upper bound on the number of motor switches to preserve exponential tracking. Preliminary experimental results in an able-bodied individual are depicted. The developed control strategy is extended and applied to the control of both knee and hip joints in Chapter 4 for treadmill walking. In Chapter 4, a cable-driven lower-limb exoskeleton is integrated with FES for treadmill walking at a constant speed. A nonlinear robust controller is used to activate the quadriceps and hamstrings muscle groups via FES to achieve kinematic tracking about the knee joint. Moreover, electric motors adjust the knee joint stiffness throughout the gait cycle using an integral torque feedback controller. A Lyapunov-based stability analysis is developed to ensure exponential tracking of the kinematic and torque closed-loop error systems, while guaranteeing that the control input signals remain bounded. The developed controllers were tested in real-time walking experiments on a treadmill in three able-bodied individuals at two gait speeds. The experimental results demonstrate the feasibility of coupling a cable-driven exoskeleton with FES for treadmill walking using a switching-based control strategy and exploiting both kinematic and force feedback. In Chapter 5, input-output data is exploited using a finite-time algorithm to estimate the target desired torque leveraging an estimate of the active torque produced by muscles via FES. The convergence rate of the finite-time algorithm can be adjusted by tuning selectable parameters. To achieve cadence and torque tracking for FES-cycling, nonlinear robust tracking controllers are designed for muscles and motor. A Lyapunov-based stability analysis is developed to ensure exponential tracking of the closed-loop cadence error system and global uniformly ultimate bounded (GUUB) torque tracking. A discrete-time Lyapunov-based stability analysis leveraging a recent tool for finite-time systems is developed to ensure convergence and guarantee that the finite-time algorithm is Holder continuous. The developed tracking controllers for the muscles and electric motor and finite-time algorithm to compute the desired torque are implemented in real-time during cycling experiments in seven able-bodied individuals. Multiple cycling trials are implemented with different gain parameters of the finite-time torque algorithm to compare tracking performance for all participants. Chapter 6 highlights the contributions of the developed control methods and provides recommendations for future research extensions

Robust Compensation of Electromechanical Delay during Neuromuscular Electrical Stimulation of Antagonistic Muscles

Neuromuscular electrical stimulation (NMES) can potentially be used to restore the limb function in persons with neurological disorders, such as spinal cord injury (SCI), stroke, etc. Researches on control system design has so far focused on relatively simple unidirectional NMES applications requiring stimulation of single muscle group. However, for some advanced tasks such as pedaling or walking, stimulation of multiple muscles is required. For example, to extend as well as flex a limb joint requires electrical stimulation of an antagonistic muscle pair. This is due to the fact that muscles are unidirectional actuators. The control challenge is to allocate control inputs to antagonist muscles based on the system output, usually a limb angle error to achieve a smooth and precise transition between antagonistic muscles without causing discontinuities. Furthermore, NMES input to each muscle is delayed by an electromechanical delay (EMD), which arises due to the time lag between the electrical excitation and the force development in muscle. And EMD is known to cause instability or performance loss during closed-loop control of NMES. In this thesis, a robust delay compensation controller for EMDs in antagonistic muscles is presented. A Lyapunov stability analysis yields uniformly ultimately bounded tracking for a human limb joint actuated by antagonistic muscles. The simulation results indicate that the controller is robust and effective in switching between antagonistic muscles and compensating EMDs during a simulated NMES task. Further experiments on a dual motor testbed shows its feasibility as an NMES controller for human antagonistic muscles

On neuromechanical approaches for the study of biological and robotic grasp and manipulation

abstract: Biological and robotic grasp and manipulation are undeniably similar at the level of mechanical task performance. However, their underlying fundamental biological vs. engineering mechanisms are, by definition, dramatically different and can even be antithetical. Even our approach to each is diametrically opposite: inductive science for the study of biological systems vs. engineering synthesis for the design and construction of robotic systems. The past 20 years have seen several conceptual advances in both fields and the quest to unify them. Chief among them is the reluctant recognition that their underlying fundamental mechanisms may actually share limited common ground, while exhibiting many fundamental differences. This recognition is particularly liberating because it allows us to resolve and move beyond multiple paradoxes and contradictions that arose from the initial reasonable assumption of a large common ground. Here, we begin by introducing the perspective of neuromechanics, which emphasizes that real-world behavior emerges from the intimate interactions among the physical structure of the system, the mechanical requirements of a task, the feasible neural control actions to produce it, and the ability of the neuromuscular system to adapt through interactions with the environment. This allows us to articulate a succinct overview of a few salient conceptual paradoxes and contradictions regarding under-determined vs. over-determined mechanics, under- vs. over-actuated control, prescribed vs. emergent function, learning vs. implementation vs. adaptation, prescriptive vs. descriptive synergies, and optimal vs. habitual performance. We conclude by presenting open questions and suggesting directions for future research. We hope this frank and open-minded assessment of the state-of-the-art will encourage and guide these communities to continue to interact and make progress in these important areas at the interface of neuromechanics, neuroscience, rehabilitation and robotics.The electronic version of this article is the complete one and can be found online at: https://jneuroengrehab.biomedcentral.com/articles/10.1186/s12984-017-0305-

Legged locomotion over irregular terrains: State of the art of human and robot performance

Legged robotic technologies have moved out of the lab to operate in real environments, characterized by a wide variety of unpredictable irregularities and disturbances, all this in close proximity with humans. Demonstrating the ability of current robots to move robustly and reliably in these conditions is becoming essential to prove their safe operation. Here, we report an in-depth literature review aimed at verifying the existence of common or agreed protocols and metrics to test the performance of legged system in realistic environments. We primarily focused on three types of robotic technologies, i.e., hexapods, quadrupeds and bipeds. We also included a comprehensive overview on human locomotion studies, being it often considered the gold standard for performance, and one of the most important sources of bioinspiration for legged machines. We discovered that very few papers have rigorously studied robotic locomotion under irregular terrain conditions. On the contrary, numerous studies have addressed this problem on human gait, being nonetheless of highly heterogeneous nature in terms of experimental design. This lack of agreed methodology makes it challenging for the community to properly assess, compare and predict the performance of existing legged systems in real environments. On the one hand, this work provides a library of methods, metrics and experimental protocols, with a critical analysis on the limitations of the current approaches and future promising directions. On the other hand, it demonstrates the existence of an important lack of benchmarks in the literature, and the possibility of bridging different disciplines, e.g., the human and robotic, towards the definition of standardized procedure that will boost not only the scientific development of better bioinspired solutions, but also their market uptake