Intelligent upper-limb exoskeleton using deep learning to predict human intention for sensory-feedback augmentation

The age and stroke-associated decline in musculoskeletal strength degrades the ability to perform daily human tasks using the upper extremities. Although there are a few examples of exoskeletons, they need manual operations due to the absence of sensor feedback and no intention prediction of movements. Here, we introduce an intelligent upper-limb exoskeleton system that uses cloud-based deep learning to predict human intention for strength augmentation. The embedded soft wearable sensors provide sensory feedback by collecting real-time muscle signals, which are simultaneously computed to determine the user's intended movement. The cloud-based deep-learning predicts four upper-limb joint motions with an average accuracy of 96.2% at a 200-250 millisecond response rate, suggesting that the exoskeleton operates just by human intention. In addition, an array of soft pneumatics assists the intended movements by providing 897 newton of force and 78.7 millimeter of displacement at maximum. Collectively, the intent-driven exoskeleton can augment human strength by 5.15 times on average compared to the unassisted exoskeleton. This report demonstrates an exoskeleton robot that augments the upper-limb joint movements by human intention based on a machine-learning cloud computing and sensory feedback.Comment: 15 pages, 6 figures, 1 table, Submitted for possible publicatio

Quantifying Performance of Bipedal Standing with Multi-channel EMG

Spinal cord stimulation has enabled humans with motor complete spinal cord injury (SCI) to independently stand and recover some lost autonomic function. Quantifying the quality of bipedal standing under spinal stimulation is important for spinal rehabilitation therapies and for new strategies that seek to combine spinal stimulation and rehabilitative robots (such as exoskeletons) in real time feedback. To study the potential for automated electromyography (EMG) analysis in SCI, we evaluated the standing quality of paralyzed patients undergoing electrical spinal cord stimulation using both video and multi-channel surface EMG recordings during spinal stimulation therapy sessions. The quality of standing under different stimulation settings was quantified manually by experienced clinicians. By correlating features of the recorded EMG activity with the expert evaluations, we show that multi-channel EMG recording can provide accurate, fast, and robust estimation for the quality of bipedal standing in spinally stimulated SCI patients. Moreover, our analysis shows that the total number of EMG channels needed to effectively predict standing quality can be reduced while maintaining high estimation accuracy, which provides more flexibility for rehabilitation robotic systems to incorporate EMG recordings

A review on locomotion mode recognition and prediction when using active orthoses and exoskeletons

Understanding how to seamlessly adapt the assistance of lower-limb wearable assistive devices (active orthosis (AOs) and exoskeletons) to human locomotion modes (LMs) is challenging. Several algorithms and sensors have been explored to recognize and predict the users’ LMs. Nevertheless, it is not yet clear which are the most used and effective sensor and classifier configurations in AOs/exoskeletons and how these devices’ control is adapted according to the decoded LMs. To explore these aspects, we performed a systematic review by electronic search in Scopus and Web of Science databases, including published studies from 1 January 2010 to 31 August 2022. Sixteen studies were included and scored with 84.7 ± 8.7% quality. Decoding focused on level-ground walking along with ascent/descent stairs tasks performed by healthy subjects. Time-domain raw data from inertial measurement unit sensors were the most used data. Different classifiers were employed considering the LMs to decode (accuracy above 90% for all tasks). Five studies have adapted the assistance of AOs/exoskeletons attending to the decoded LM, in which only one study predicted the new LM before its occurrence. Future research is encouraged to develop decoding tools considering data from people with lower-limb impairments walking at self-selected speeds while performing daily LMs with AOs/exoskeletons.This work was funded in part by the Fundação para a Ciência e Tecnologia (FCT) with the Reference Scholarship under grant 2020.05711.BD, under the Stimulus of Scientific Employment with the grant 2020.03393.CEECIND, and in part by the FEDER Funds through the COMPETE 2020— Programa Operacional Competitividade e Internacionalização (POCI) and P2020 with the Reference Project SmartOs Grant POCI-01-0247-FEDER-039868, and by FCT national funds, under the national support to R&D units grant, through the reference project UIDB/04436/2020 and UIDP/04436/2020

Embedded system for upper-limb exoskeleton based on electromyography control

A major problem in an exoskeleton based on electromyography (EMG) control with pattern recognition-based is the need for more time to train and to calibrate the system in order able to adapt for different subjects and variable. Unfortunately, the implementation of the joint prediction on an embedded system for the exoskeleton based on the EMG control with non-pattern recognition-based is very rare. Therefore, this study presents an implementation of elbow-joint angle prediction on an embedded system to control an upper limb exoskeleton based on the EMG signal. The architecture of the system consisted of a bio-amplifier, an embedded ARMSTM32F429 microcontroller, and an exoskeleton unit driven by a servo motor. The elbow joint angle was predicted based on the EMG signal that is generated from biceps. The predicted angle was obtained by extracting the EMG signal using a zero-crossing feature and filtering the EMG feature using a Butterworth low pass filter. This study found that the range of root mean square error and correlation coefficients are 8°-16° and 0.94-0.99, respectively which suggest that the predicted angle is close to the desired angle and there is a high relationship between the predicted angle and the desired angle

IMU-based human activity recognition and payload classification for low-back exoskeletons

Nowadays, work-related musculoskeletal disorders have a drastic impact on a large part of the world population. In particular, low-back pain counts as the leading cause of absence from work in the industrial sector. Robotic exoskeletons have great potential to improve industrial workers’ health and life quality. Nonetheless, current solutions are often limited by sub-optimal control systems. Due to the dynamic environment in which they are used, failure to adapt to the wearer and the task may be limiting exoskeleton adoption in occupational scenarios. In this scope, we present a deep-learning-based approach exploiting inertial sensors to provide industrial exoskeletons with human activity recognition and adaptive payload compensation. Inertial measurement units are easily wearable or embeddable in any industrial exoskeleton. We exploited Long-Short Term Memory networks both to perform human activity recognition and to classify the weight of lifted objects up to 15 kg. We found a median F1 score of 90.80 % (activity recognition) and 87.14 % (payload estimation) with subject-specific models trained and tested on 12 (6M-6F) young healthy volunteers. We also succeeded in evaluating the applicability of this approach with an in-lab real-time test in a simulated target scenario. These high-level algorithms may be useful to fully exploit the potential of powered exoskeletons to achieve symbiotic human–robot interaction