Design and Development of an Affordable Haptic Robot with Force-Feedback and Compliant Actuation to Improve Therapy for Patients with Severe Hemiparesis

The study describes the design and development of a single degree-of-freedom haptic robot, Haptic Theradrive, for post-stroke arm rehabilitation for in-home and clinical use. The robot overcomes many of the weaknesses of its predecessor, the TheraDrive system, that used a Logitech steering wheel as the haptic interface for rehabilitation. Although the original TheraDrive system showed success in a pilot study, its wheel was not able to withstand the rigors of use. A new haptic robot was developed that functions as a drop-in replacement for the Logitech wheel. The new robot can apply larger forces in interacting with the patient, thereby extending the functionality of the system to accommodate low-functioning patients. A new software suite offers appreciably more options for tailored and tuned rehabilitation therapies. In addition to describing the design of the hardware and software, the paper presents the results of simulation and experimental case studies examining the system\u27s performance and usability

A Robust Wheel Interface With A Novel Adaptive Controller For Computer/robot-Assisted Motivating Rehabilitation

TheraDrive is a low-cost robotic system for post-stroke upper extremity rehabilitation. This system uses off-the-shelf computer gaming wheels with force feedback to help reduce motor impairment and improve function in the arms of stroke survivors. Preliminary results show that the TheraDrive system lacks a robust mechanical linkage that can withstand the forces exerted by patients, lacks a patient-specific adaptive controller to deliver personalized therapy, and is not capable of delivering effective therapy to severely low-functioning patients. A new low-cost, high-force haptic robot with a single degree of freedom has been developed to address these concerns. The resulting TheraDrive consists of an actuated hand crank with a compliant transmission. Actuation is provided by a brushed DC motor, geared to output up to 50 lbf (223 N) at the end effector. To enable safe human-machine interaction, a special compliant element was developed to function also as a failsafe torque limiter. A load cell is used to determine the human-machine interaction forces for use by the robot\u27s impedance controller. The impedance controller renders a virtual spring that attracts or repels the end effector from a moving target that the human must track during therapy exercises. As exercises are performed, an adaptive controller monitors patient performance and adjusts the spring stiffness to ensure that exercises are difficult but doable, which is important for maintaining patient motivation. Experiments with a computer model of a human and robot show the adaptive controller\u27s ability to maintain difficulty of exercises after a period of initial calibration. Seven human subjects (3 normal, 4 stroke-impaired) were used to test this system alongside the original TheraDrive system in order to compare both systems. Data showed that the new system produced a larger change in normalized trajectory tracking error when assistance/resistance was added to exercises when compared to the original TheraDrive. Data also showed that adaptive control led subject performance to be closer to a desired level. Motivation surveys showed no significant difference in subject motivation between the two systems. When asked to choose a preferred system, stroke subjects unanimously chose the new robot

On the Interplay between Mechanical and Computational Intelligence in Robot Hands

Researchers have made tremendous advances in robotic grasping in the past decades. On the hardware side, a lot of robot hand designs were proposed, covering a large spectrum of dexterity (from simple parallel grippers to anthropomorphic hands), actuation (from underactuated to fully actuated), and sensing capabilities (from only open/close states to tactile sensing). On the software side, grasping techniques also evolved significantly, from open-loop control, classical feedback control, to learning-based policies. However, most of the studies and applications follow the one-way paradigm that mechanical engineers/researchers design the hardware first and control/learning experts write the code to use the hand. In contrast, we aim to study the interplay between the mechanical and computational aspects in robotic grasping. We believe both sides are important but cannot solve grasping problems on their own, and both sides are highly connected by the laws of physics and should not be developed separately. We use the term "Mechanical Intelligence" to refer to the ability realized by mechanisms to appropriately respond to the external inputs, and we show that incorporating Mechanical Intelligence with Computational Intelligence is beneficial for grasping. The first part of this thesis is to derive hand underactuation mechanisms from grasp data. The mechanical coordination in robot hands, which is one type of Mechanical Intelligence, corresponds to the concept of dimensionality reduction in Machine Learning. However, the resulted low-dimensional manifolds need to be realizable using underactuated mechanisms. In this project, we first collect simulated grasp data without accounting for underactuation, apply a dimensionality reduction technique (we term it "Mechanically Realizable Manifolds") considering both pre-contact postural synergies and post-contact joint torque coordination, and finally build robot hands based on the resulted low-dimensional models. We also demonstrate a real-world application on a free-flying robot for the International Space Station. The second part is about proprioceptive grasping for unknown objects by taking advantage of hand compliance. Mechanical compliance is intrinsically connected to force/torque sensing and control. In this work, we proposed a series-elastic hand providing embodied compliance and proprioception, and an associated grasping policy using a network of proportional-integral controllers. We show that, without any prior model of the object and with only proprioceptive sensing, a robot hand can make stable grasps in a reactive fashion. The last part is about developing the Mechanical and Computational Intelligence jointly --- to co-optimize the mechanisms and control policies using deep Reinforcement Learning (RL). Traditional RL treats robot hardware as immutable and models it as part of the environment. In contrast, we move the robot hardware out of the environment, express its mechanics as auto-differentiable physics and connect it with the computational policy to create a unified policy (we term this method "Hardware as Policy"), which allows RL algorithms to back-propagate gradients w.r.t both hardware and computational parameters and optimize them in the same fashion. We present a mass-spring toy problem to illustrate this idea, and also a real-world design case of an underactuated hand. The three projects we present in this thesis are meaningful examples to demonstrate the interplay between the mechanical and computational aspects of robotic grasping. In the Conclusion part, we summarize some high-level philosophies and suggestions to integrate Mechanical and Computational Intelligence, as well as the high-level challenges that still exist when pushing this area forward

Advancing Musculoskeletal Robot Design for Dynamic and Energy-Efficient Bipedal Locomotion

Achieving bipedal robot locomotion performance that approaches human performance is a challenging research topic in the field of humanoid robotics, requiring interdisciplinary expertise from various disciplines, including neuroscience and biomechanics. Despite the remarkable results demonstrated by current humanoid robots---they can walk, stand, turn, climb stairs, carry a load, push a cart---the versatility, stability, and energy efficiency of humans have not yet been achieved. However, with robots entering our lives, whether in the workplace, in clinics, or in normal household environments, such improvements are increasingly important. The current state of research in bipedal robot locomotion reveals that several groups have continuously demonstrated enhanced locomotion performance of the developed robots. But each of these groups has taken a unilateral approach and placed the focus on only one aspect, in order to achieve enhanced movement abilities;---for instance, the motion control and postural stability or the mechanical design. The neural and mechanical systems in human and animal locomotion, however, are strongly coupled and should therefore not be treated separately. Human-inspired musculoskeletal design of bipedal robots offers great potential for enhanced dynamic and energy-efficient locomotion but also imposes major challenges for motion planning and control. In this thesis, we first present a detailed review of the problems related to achieving enhanced dynamic and energy-efficient bipedal locomotion, from various important perspectives, and examine the essential properties of the human locomotory apparatus. Subsequently, existing insights and approaches from biomechanics, to understand the neuromechanical motion apparatus, and from robotics, to develop more human-like robots that can move in our environment, are discussed in detail. These thorough investigations of the interrelated essential design decisions are used to develop a novel design for a musculoskeletal bipedal robot, BioBiped1, such that, in the long term, it is capable of realizing dynamic hopping, running, and walking motions. The BioBiped1 robot features a highly compliant tendon-driven actuation system that mimics key functionalities of the human lower limb system. In experiments, BioBiped1's locomotor function for the envisioned gaits is validated globally. It is shown that the robot is able to rebound passively, store and release energy, and actively push off from the ground. The proof of concept of BioBiped1's locomotor function, however, marks only the starting point for our investigations, since this novel design concept opens up a number of questions regarding the required design complexity for the envisioned motions and the appropriate motion generation and control concept. For this purpose, a simulator specifically designed for the requirements of musculoskeletally actuated robotic systems, including sufficiently realistic ground reaction forces, is developed. It relies on object-oriented design and is based on a numerical solver, without model switching, to enable the analysis of impact peak forces and the simulation of flight phases. The developed library also contains the models of the actuated and passive mono- and biarticular elastic tendons and a penalty-based compliant contact model with nonlinear damping, to incorporate the collision, friction, and stiction forces occurring during ground contact. Using these components, the full multibody system (MBS) dynamics model is developed. To ensure a sufficiently similar behavior of the simulated and the real musculoskeletal robot, various measurements and parameter identifications for sub-models are performed. Finally, it is shown that the simulation model behaves similarly to the real robot platform. The intelligent combination of actuated and passive mono- and biarticular tendons, imitating important human muscle groups, offers tremendous potential for improved locomotion performance but also requires a sophisticated concept for motion control of the robot. Therefore, a further contribution of this thesis is the development of a centralized, nonlinear model-based method for motion generation and control that utilizes the derived detailed dynamics models of the implemented actuators. The concept is used to realize both computer-generated hopping and human jogging motions. Additionally, the problem of appropriate motor-gear unit selection prior to the robot's construction is tackled, using this method. The thesis concludes with a number of simulation studies in which several leg actuation designs are examined for their optimality with regard to systematically selected performance criteria. Furthermore, earlier paradoxical biomechanical findings about biarticular muscles in running are presented and, for the first time, investigated by detailed simulation of the motion dynamics. Exploring the Lombard paradox, a novel reduced and energy-efficient locomotion model without knee extensor has been simulated successfully. The models and methods developed within this thesis, as well as the insights gained, are already being employed to develop future prototypes. In particular, the optimal dimensioning and setting of the actuators, including all mono- and biarticular muscle-tendon units, are based on the derived design guidelines and are extensively validated by means of the simulation models and the motion control method. These developments are expected to significantly enhance progress in the field of bipedal robot design and, in the long term, to drive improvements in rehabilitation for humans through an understanding of the neuromechanics underlying human walking and the application of this knowledge to the design of prosthetics

Reinforcement Learning of Single Legged Locomotion

This paper presents the application of reinforcement learning to improve the performance of highly dynamic single legged locomotion with compliant series elastic actuators. The goal is to optimally exploit the capabilities of the hardware in terms of maximum jump height, jump distance, and energy efficiency of periodic hopping. These challenges are tackled with the reinforcement learning method Policy Improvement with Path Integrals (PI2) in a model-free approach to learn parameterized motor velocity trajectories as well as highlevel control parameters. The combination of simulation and hardware-based optimization allows to efficiently obtain optimal control policies in an up to 10-dimensional parameter space. The robotic leg learns to temporarily store energy in the elastic elements of the joints in order to improve the jump height and distance. In addition, we present a method to learn time-independent control policies and apply it to improve the energetic efficiency of periodic hopping

Bioinspired template-based control of legged locomotion

cient and robust locomotion is a crucial condition for the more extensive use of legged robots in real world applications. In that respect, robots can learn from animals, if the principles underlying locomotion in biological legged systems can be transferred to their artificial counterparts. However, legged locomotion in biological systems is a complex and not fully understood problem. A great progress to simplify understanding locomotion dynamics and control was made by introducing simple models, coined ``templates'', able to represent the overall dynamics of animal (including human) gaits. One of the most recognized models is the spring-loaded inverted pendulum (SLIP) which consists of a point mass atop a massless spring. This model provides a good description of human gaits, such as walking, hopping and running. Despite its high level of abstraction, it supported and inspired the development of successful legged robots and was used as explicit targets for control, over the years. Inspired from template models explaining biological locomotory systems and Raibert's pioneering legged robots, locomotion can be realized by basic subfunctions: (i) stance leg function, (ii) leg swinging and (iii) balancing. Combinations of these three subfunctions can generate different gaits with diverse properties. Using the template models, we investigate how locomotor subfunctions contribute to stabilize different gaits (hopping, running and walking) in different conditions (e.g., speeds). We show that such basic analysis on human locomotion using conceptual models can result in developing new methods in design and control of legged systems like humanoid robots and assistive devices (exoskeletons, orthoses and prostheses). This thesis comprises research in different disciplines: biomechanics, robotics and control. These disciplines are required to do human experiments and data analysis, modeling of locomotory systems, and implementation on robots and an exoskeleton. We benefited from facilities and experiments performed in the Lauflabor locomotion laboratory. Modeling includes two categories: conceptual (template-based, e.g. SLIP) models and detailed models (with segmented legs, masses/inertias). Using the BioBiped series of robots (and the detailed BioBiped MBS models; MBS stands for Multi-Body-System), we have implemented newly-developed design and control methods related to the concept of locomotor subfunctions on either MBS models or on the robot directly. In addition, with involvement in BALANCE project (\url{http://balance-fp7.eu/}), we implemented balance-related control approaches on an exoskeleton to demonstrate their performance in human walking. The outcomes of this research includes developing new conceptual models of legged locomotion, analysis of human locomotion based on the newly developed models following the locomotor subfunction trilogy, developing methods to benefit from the models in design and control of robots and exoskeletons. The main contribution of this work is providing a novel approach for modular control of legged locomotion. With this approach we can identify the relation between different locomotor subfunctions e.g., between balance and stance (using stance force for tuning balance control) or balance and swing (two joint hip muscles can support the swing leg control relating it to the upper body posture) and implement the concept of modular control based on locomotor subfunctions with a limited exchange of sensory information on several hardware platforms (legged robots, exoskeleton)