Adaptive hybrid robotic system for rehabilitation of reaching movement after a brain injury: a usability study

BACKGROUND: Brain injury survivors often present upper-limb motor impairment affecting the execution of functional activities such as reaching. A currently active research line seeking to maximize upper-limb motor recovery after a brain injury, deals with the combined use of functional electrical stimulation (FES) and mechanical supporting devices, in what has been previously termed hybrid robotic systems. This study evaluates from the technical and clinical perspectives the usability of an integrated hybrid robotic system for the rehabilitation of upper-limb reaching movements after a brain lesion affecting the motor function. METHODS: The presented system is comprised of four main components. The hybrid assistance is given by a passive exoskeleton to support the arm weight against gravity and a functional electrical stimulation device to assist the execution of the reaching task. The feedback error learning (FEL) controller was implemented to adjust the intensity of the electrical stimuli delivered on target muscles according to the performance of the users. This control strategy is based on a proportional-integral-derivative feedback controller and an artificial neural network as the feedforward controller. Two experiments were carried out in this evaluation. First, the technical viability and the performance of the implemented FEL controller was evaluated in healthy subjects (N = 12). Second, a small cohort of patients with a brain injury (N = 4) participated in two experimental session to evaluate the system performance. Also, the overall satisfaction and emotional response of the users after they used the system was assessed. RESULTS: In the experiment with healthy subjects, a significant reduction of the tracking error was found during the execution of reaching movements. In the experiment with patients, a decreasing trend of the error trajectory was found together with an increasing trend in the task performance as the movement was repeated. Brain injury patients expressed a great acceptance in using the system as a rehabilitation tool. CONCLUSIONS: The study demonstrates the technical feasibility of using the hybrid robotic system for reaching rehabilitation. Patients’ reports on the received intervention reveal a great satisfaction and acceptance of the hybrid robotic system

Congruent and Incongruent Corticospinal Activations at the Level of Multiple Effectors

Motor resonance is defined as the subliminal activation of the motor system while observing actions performed by others. However, resonating with another person's actions is not always an appropriate response: In real life, people do not just imitate but rather respond in a suitable fashion. A growing body of neurophysiologic studies has demonstrated that motor resonance can be overridden by complementary motor responses (such as preparing a precision grip on a small object when seeing an open hand in sign of request). In this study, we investigated the relationship between congruent and incongruent corticospinal activations at the level of multiple effectors. The modulation of MEPs evoked by single-pulse TMS over the motor cortex was assessed in upper and lower limb muscles of participants observing a soccer player performing a penalty kick straight in their direction. Study results revealed a double dissociation: Seeing the soccer player kicking the ball triggered a motor resonance in the observer's lower limb, whereas the upper limb response afforded by the object was overridden. On the other hand, seeing the ball approaching the observers elicited a complementary motor activation in upper limbs while motor resonance in lower limbs disappeared. Control conditions showing lateral kicks, mimicked kicks, and a ball in penalty area were also included to test the motor coding of object affordances. Results point to a modulation of motor responses in different limbs over the course of action and in function of their relevance in different contexts. We contend that ecologically valid paradigms are nowadays needed to shed light on the motor system functioning in complex forms of interaction

The Development of a Myoelectric Training Tool for Above-Elbow Amputees

The objective of above-elbow myoelectric prostheses is to reestablish the functionality of missing limbs and increase the quality of life of amputees. By using electromyography (EMG) electrodes attached to the surface of the skin, amputees are able to control motors in myoelectric prostheses by voluntarily contracting the muscles of their residual limb. This work describes the development of an inexpensive myoelectric training tool (MTT) designed to help upper limb amputees learn how to use myoelectric technology in advance of receiving their actual myoelectric prosthesis. The training tool consists of a physical and simulated robotic arm, signal acquisition hardware, controller software, and a graphical user interface. The MTT improves over earlier training systems by allowing a targeted muscle reinnervation (TMR) patient to control up to two degrees of freedom simultaneously. The training tool has also been designed to function as a research prototype for novel myoelectric controllers. A preliminary experiment was performed in order to evaluate the effectiveness of the MTT as a learning tool and to identify any issues with the system. Five able-bodied participants performed a motor-learning task using the EMG controlled robotic arm with the goal of moving five balls from one box to another as quickly as possible. The results indicate that the subjects improved their skill in myoelectric control over the course of the trials. A usability survey was administered to the subjects after their trials. Results from the survey showed that the shoulder degree of freedom was the most difficult to control

Automation of motor dexterity assessment

Motor dexterity assessment is regularly performed in rehabilitation wards to establish patient status and automatization for such routinary task is sought. A system for automatizing the assessment of motor dexterity based on the Fugl-Meyer scale and with loose restrictions on sensing technologies is presented. The system consists of two main elements: 1) A data representation that abstracts the low level information obtained from a variety of sensors, into a highly separable low dimensionality encoding employing t-distributed Stochastic Neighbourhood Embedding, and, 2) central to this communication, a multi-label classifier that boosts classification rates by exploiting the fact that the classes corresponding to the individual exercises are naturally organized as a network. Depending on the targeted therapeutic movement class labels i.e. exercises scores, are highly correlated-patients who perform well in one, tends to perform well in related exercises-; and critically no node can be used as proxy of others - an exercise does not encode the information of other exercises. Over data from a cohort of 20 patients, the novel classifier outperforms classical Naive Bayes, random forest and variants of support vector machines (ANOVA: p <; 0.001). The novel multi-label classification strategy fulfills an automatic system for motor dexterity assessment, with implications for lessening therapist's workloads, reducing healthcare costs and providing support for home-based virtual rehabilitation and telerehabilitation alternatives

New control strategies for neuroprosthetic systems

The availability of techniques to artificially excite paralyzed muscles opens enormous potential for restoring both upper and lower extremity movements with\ud neuroprostheses. Neuroprostheses must stimulate muscle, and control and regulate the artificial movements produced. Control methods to accomplish these tasks include feedforward (open-loop), feedback, and adaptive control. Feedforward control requires a great deal of information about the biomechanical behavior of the limb. For the upper extremity, an artificial motor program was developed to provide such movement program input to a neuroprosthesis. In lower extremity control, one group achieved their best results by attempting to meet naturally perceived gait objectives rather than to follow an exact joint angle trajectory. Adaptive feedforward control, as implemented in the cycleto-cycle controller, gave good compensation for the gradual decrease in performance observed with open-loop control. A neural network controller was able to control its system to customize stimulation parameters in order to generate a desired output trajectory in a given individual and to maintain tracking performance in the presence of muscle fatigue. The authors believe that practical FNS control systems must\ud exhibit many of these features of neurophysiological systems

Speech Sensorimotor Learning through a Virtual Vocal Tract

Studies of speech sensorimotor learning often manipulate auditory feedback by modifying isolated acoustic parameters such as formant frequency or fundamental frequency using near real-time resynthesis of a participant\u27s speech. An alternative approach is to engage a participant in a total remapping of the sensorimotor working space using a virtual vocal tract. To support this approach for studying speech sensorimotor learning we have developed a system to control an articulatory synthesizer using electromagnetic articulography data. Articulator movement data from the NDI Wave System are streamed to a Maeda articulatory synthesizer. The resulting synthesized speech provides auditory feedback to the participant. This approach allows the experimenter to generate novel articulatory-acoustic mappings. Moreover, the acoustic output of the synthesizer can be perturbed using acoustic resynthesis methods. Since no robust speech-acoustic signal is required from the participant, this system will allow for the study of sensorimotor learning in any individuals, even those with severe speech disorders. In the current work we present preliminary results that demonstrate that typically-functioning participants can use a virtual vocal tract to produce diphthongs within a novel articulatory-acoustic workspace. Once sufficient baseline performance is established, perturbations to auditory feedback (formant shifting) can elicit compensatory and adaptive articulatory responses

Visual Error Augmentation for Enhancing Motor Learning and Rehabilitative Relearning

We developed a real-time controller for a 2 degree-of-freedom robotic system using xPC Target. This system was used to investigate how different methods of performance error feedback can lead to faster and more complete motor learning in individuals asked to compensate for a novel visuo-motor transformation (a 30 degree rotation). Four groups of normal human subjects were asked to reach with their unseen arm to visual targets surrounding a central starting location. A cursor tracking hand motion was provided during each reach. For one group of subjects, deviations from the ideal compensatory hand movement (i.e. trajectory errors) were amplified with a gain of 2 whereas another group was provided visual feedback with a gain of 3.1. Yet another group was provided cursor feedback wherein the cursor was rotated by an additional (constant) offset angle. We compared the rates at which the hand paths converged to the steady-state trajectories. Our results demonstrate that error-augmentation can improve the rate and extent of motor learning of visuomotor rotations in healthy subjects. We also tested this method on straightening the movements of stroke subjects, and our early results suggest that error amplification can facilitate neurorehabilitation strategies in brain injuries such as stroke

Influence of Muscle Fatigue on Electromyogram-Kinematic Correlation During Robot-Assisted Upper Limb Training

© The Author(s) 2020. Creative Commons Non Commercial CC BY-NC: This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (https://creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us. sagepub.com/en-us/nam/open-access-at-sage).Introduction: Studies on adaptive robot-assisted upper limb training interactions do not often consider the implications of muscle fatigue sufficiently. Methods: In order to explore this, we initially assessed muscle fatigue in 10 healthy subjects using electromyogram features (average power and median power frequency) during an assist-as-needed interaction with HapticMASTER robot. Spearman’s correlation study was conducted between EMG average power and kinematic force components. Since the robotic assistance resulted in a variable fatigue profile across participants, a completely tiring experiment, without a robot in the loop, was also designed to confirm the results. Results: A significant increase in average power and a decrease in median frequency were observed in the most active muscles. Average power in the frequency band of 0.8-2.5Hz and median frequency in the band of 20-450Hz are potential fatigue indicators. Also, comparing the correlation coefficients across trials indicated that correlation was reduced as the muscles were fatigued. Conclusions: Robotic assistance based on user’s performance has resulted in lesser muscle fatigue, which caused an increase in the EMG-force correlation. We now intend to utilize the electromyogram and kinematic features for the auto-adaptation of therapeutic human-robot interactions.Peer reviewedFinal Published versio

Visual, Motor and Attentional Influences on Proprioceptive Contributions to Perception of Hand Path Rectilinearity during Reaching

We examined how proprioceptive contributions to perception of hand path straightness are influenced by visual, motor and attentional sources of performance variability during horizontal planar reaching. Subjects held the handle of a robot that constrained goal-directed movements of the hand to the paths of controlled curvature. Subjects attempted to detect the presence of hand path curvature during both active (subject driven) and passive (robot driven) movements that either required active muscle force production or not. Subjects were less able to discriminate curved from straight paths when actively reaching for a target versus when the robot moved their hand through the same curved paths. This effect was especially evident during robot-driven movements requiring concurrent activation of lengthening but not shortening muscles. Subjects were less likely to report curvature and were more variable in reporting when movements appeared straight in a novel “visual channel” condition previously shown to block adaptive updating of motor commands in response to deviations from a straight-line hand path. Similarly, compromised performance was obtained when subjects simultaneously performed a distracting secondary task (key pressing with the contralateral hand). The effects compounded when these last two treatments were combined. It is concluded that environmental, intrinsic and attentional factors all impact the ability to detect deviations from a rectilinear hand path during goal-directed movement by decreasing proprioceptive contributions to limb state estimation. In contrast, response variability increased only in experimental conditions thought to impose additional attentional demands on the observer. Implications of these results for perception and other sensorimotor behaviors are discussed