Optical Enhancement of Exoskeleton-Based Estimation of Glenohumeral Angles

In Robot-Assisted Rehabilitation (RAR) the accurate estimation of the patient limb joint angles is critical for assessing therapy efficacy. In RAR, the use of classic motion capture systems (MOCAPs) (e.g., optical and electromagnetic) to estimate the Glenohumeral (GH) joint angles is hindered by the exoskeleton body, which causes occlusions and magnetic disturbances. Moreover, the exoskeleton posture does not accurately reflect limb posture, as their kinematic models differ. To address the said limitations in posture estimation, we propose installing the cameras of an optical marker-based MOCAP in the rehabilitation exoskeleton. Then, the GH joint angles are estimated by combining the estimated marker poses and exoskeleton Forward Kinematics. Such hybrid system prevents problems related to marker occlusions, reduced camera detection volume, and imprecise joint angle estimation due to the kinematic mismatch of the patient and exoskeleton models. This paper presents the formulation, simulation, and accuracy quantification of the proposed method with simulated human movements. In addition, a sensitivity analysis of the method accuracy to marker position estimation errors, due to system calibration errors and marker drifts, has been carried out. The results show that, even with significant errors in the marker position estimation, method accuracy is adequate for RAR

Inverse kinematics for upper limb compound movement estimation in exoskeleton-assisted rehabilitation

Robot-Assisted Rehabilitation (RAR) is relevant for treating patients affected by nervous system injuries (e.g., stroke and spinal cord injury) -- The accurate estimation of the joint angles of the patient limbs in RAR is critical to assess the patient improvement -- The economical prevalent method to estimate the patient posture in Exoskeleton-based RAR is to approximate the limb joint angles with the ones of the Exoskeleton -- This approximation is rough since their kinematic structures differ -- Motion capture systems (MOCAPs) can improve the estimations, at the expenses of a considerable overload of the therapy setup -- Alternatively, the Extended Inverse Kinematics Posture Estimation (EIKPE) computational method models the limb and Exoskeleton as differing parallel kinematic chains -- EIKPE has been tested with single DOFmovements of the wrist and elbow joints -- This paper presents the assessment of EIKPEwith elbow-shoulder compoundmovements (i.e., object prehension) -- Ground-truth for estimation assessment is obtained from an optical MOCAP (not intended for the treatment stage) -- The assessment shows EIKPE rendering a good numerical approximation of the actual posture during the compoundmovement execution, especially for the shoulder joint angles -- This work opens the horizon for clinical studies with patient groups, Exoskeleton models, and movements types -

Upper Limb Posture Estimation in Robotic and Virtual Reality-based Rehabilitation.

New motor rehabilitation therapies include virtual reality (VR) and robotic technologies. In limb rehabilitation, limb posture is required to (1) provide a limb realistic representation in VR games and (2) assess the patient improvement. When exoskeleton devices are used in the therapy, the measurements of their joint angles cannot be directly used to represent the posture of the patient limb, since the human and exoskeleton kinematic models differ. In response to this shortcoming, we propose a method to estimate the posture of the human limb attached to the exoskeleton. We use the exoskeleton joint angles measurements and the constraints of the exoskeleton on the limb to estimate the human limb joints angles. This paper presents (a) the mathematical formulation and solution to the problem, (b) the implementation of the proposed solution on a commercial exoskeleton system for the upper limb rehabilitation, (c) its integration into a rehabilitation VR game platform, and (d) the quantitative assessment of the method during elbow and wrist analytic training. Results show that this method properly estimates the limb posture to (i) animate avatars that represent the patient in VR games and (ii) obtain kinematic data for the patient assessment during elbow and wrist analytic rehabilitation

Robotic exoskeletons: A perspective for the rehabilitation of arm coordination in stroke patients

Upper-limb impairment after stroke is caused by weakness, loss of individual joint control, spasticity, and abnormal synergies. Upper-limb movement frequently involves abnormal, stereotyped, and fixed synergies, likely related to the increased use of sub-cortical networks following the stroke. The flexible coordination of the shoulder and elbow joints is also disrupted. New methods for motor learning, based on the stimulation of activity- dependent neural plasticity have been developed. These include robots that can adaptively assist active movements and generate many movement repetitions. However, most of these robots only control the movement of the hand in space. The aim of the present text is to analyze the potential of robotic exoskeletons to specifically rehabilitate joint motion and particularly inter-joint coordination. First, a review of studies on upper-limb coordination in stroke patients is presented and the potential for recovery of coordination is examined. Second, issues relating to the mechanical design of exoskeletons and the transmission of constraints between the robotic and human limbs are discussed. The third section considers the development of different methods to control exoskeletons: existing rehabilitation devices and approaches to the control and rehabilitation of joint coordinations are then reviewed, along with preliminary clinical results available. Finally, perspectives and future strategies for the design of control mechanisms for rehabilitation exoskeletons are discussed

Effect of external force and bimanual operation on upper limb pose during human-robot collaboration

During physical Human-Robot Interaction (pHRI) in industrial applications such as human-robot collaborative abrasive blasting, the operator often interacts with the robot using two hands, exchanging forces through handle bars. For the robot to provide appropriate assistance to the operator and for safe interaction, it would be benefficial for the robot to know the pose of the user. This problem is often challenging due to environmental factors, limited sensing capability in the environment and the robot, and redundancy of the human upper-limb. This paper presents experimental study on how two-hand interaction and force exchange affect the operators upper-limb pose, which can be characterized by swivel angle. The poses of ten subjects were recorded as they interacted with a collaborative robot. Differences in the adopted upper limb pose were analyzed with respect to factors such as unimanual versus bimanual operation, and the amplitude of interaction force between an operator and the robot. The results discovered that the the effect of bimanual operation on the upper limb pose differs between individuals and the magnitude of the force had a varying effect on the pose. The requirement of applying a force forward produced an overall lower swivel angle

Motion planning of upper-limb exoskeleton robots : a review

ABSTRACT: Background: Motion planning is an important part of exoskeleton control that improves the wearer’s safety and comfort. However, its usage introduces the problem of trajectory planning. The objective of trajectory planning is to generate the reference input for the motion-control system. This review explores the methods of trajectory planning for exoskeleton control. In order to reduce the number of surveyed papers, this review focuses on the upper limbs, which require refined three-dimensional motion planning. Methods: A systematic search covering the last 20 years was conducted in Ei Compendex, Inspect-IET, Web of Science, PubMed, ProQuest, and Science-Direct. The search strategy was to use and combine terms “trajectory planning”, “upper limb”, and ”exoskeleton” as high-level keywords. “Trajectory planning” and “motion planning” were also combined with the following keywords: “rehabilitation”, “humanlike motion“, “upper extremity“, “inverse kinematic“, and “learning machine “. Results: A total of 67 relevant papers were discovered. Results were then classified into two main categories of methods to plan trajectory: (i) Approaches based on Cartesian motion planning, and inverse kinematics using polynomial-interpolation or optimization-based methods such as minimum-jerk, minimum-torque-change, and inertia-like models; and (ii) approaches based on “learning by demonstration” using machine-learning techniques such as supervised learning based on neural networks, and learning methods based on hidden Markov models, Gaussian mixture models, and dynamic motion primitives. Conclusions: Various methods have been proposed to plan the trajectories for upper-limb exoskeleton robots, but most of them plan the trajectory offline. The review approach is general and could be extended to lower limbs. Trajectory planning has the advantage of extending the applicability of therapy robots to home usage (assistive exoskeletons); it also makes it possible to mitigate the shortages of medical caregivers and therapists, and therapy costs. In this paper, we also discuss challenges associated with trajectory planning: kinematic redundancy and incompatibility, and the trajectory-optimization problem. Commonly, methods based on the computation of swivel angles and other methods rely on the relationship (e.g., coordinated or synergistic) between the degrees of freedom used to resolve kinematic redundancy for exoskeletons. Moreover, two general solutions, namely, the self-tracing configuration of the joint axis and the alignment-free configuration of the joint axis, which add the appropriate number of extra degrees of freedom to the mechanism, were employed to improve the kinematic incompatibility between human and exoskeleton. Future work will focus on online trajectory planning and optimal control. This will be done because very few online methods were found in the scope of this study