Real-time EMG based pattern recognition control for hand prostheses : a review on existing methods, challenges and future implementation

Upper limb amputation is a condition that significantly restricts the amputees from performing their daily activities. The myoelectric prosthesis, using signals from residual stump muscles, is aimed at restoring the function of such lost limbs seamlessly. Unfortunately, the acquisition and use of such myosignals are cumbersome and complicated. Furthermore, once acquired, it usually requires heavy computational power to turn it into a user control signal. Its transition to a practical prosthesis solution is still being challenged by various factors particularly those related to the fact that each amputee has different mobility, muscle contraction forces, limb positional variations and electrode placements. Thus, a solution that can adapt or otherwise tailor itself to each individual is required for maximum utility across amputees. Modified machine learning schemes for pattern recognition have the potential to significantly reduce the factors (movement of users and contraction of the muscle) affecting the traditional electromyography (EMG)-pattern recognition methods. Although recent developments of intelligent pattern recognition techniques could discriminate multiple degrees of freedom with high-level accuracy, their efficiency level was less accessible and revealed in real-world (amputee) applications. This review paper examined the suitability of upper limb prosthesis (ULP) inventions in the healthcare sector from their technical control perspective. More focus was given to the review of real-world applications and the use of pattern recognition control on amputees. We first reviewed the overall structure of pattern recognition schemes for myo-control prosthetic systems and then discussed their real-time use on amputee upper limbs. Finally, we concluded the paper with a discussion of the existing challenges and future research recommendations

Classification of EMG signals to control a prosthetic hand using time-frequesncy representations and Support Vector Machines

Myoelectric signals (MES) are viable control signals for externally-powered prosthetic devices. They may improve both the functionality and the cosmetic appearance of these devices. Conventional controllers, based on the signal\u27s amplitude features in the control strategy, lack a large number of controllable states because signals from independent muscles are required for each degree of freedom (DoF) of the device. Myoelectric pattern recognition systems can overcome this problem by discriminating different residual muscle movements instead of contraction levels of individual muscles. However, the lack of long-term robustness in these systems and the design of counter-intuitive control/command interfaces have resulted in low clinical acceptance levels. As a result, the development of robust, easy to use myoelectric pattern recognition-based control systems is the main challenge in the field of prosthetic control. This dissertation addresses the need to improve the controller\u27s robustness by designing a pattern recognition-based control system that classifies the user\u27s intention to actuate the prosthesis. This system is part of a cost-effective prosthetic hand prototype developed to achieve an acceptable level of functional dexterity using a simple to use interface. A Support Vector Machine (SVM) classifier implemented as a directed acyclic graph (DAG) was created. It used wavelet features from multiple surface EMG channels strategically placed over five forearm muscles. The classifiers were evaluated across seven subjects. They were able to discriminate five wrist motions with an accuracy of 91.5%. Variations of electrode locations were artificially introduced at each recording session as part of the procedure, to obtain data that accounted for the changes in the user\u27s muscle patterns over time. The generalization ability of the SVM was able to capture most of the variability in the data and to maintain an average classification accuracy of 90%. Two principal component analysis (PCA) frameworks were also evaluated to study the relationship between EMG recording sites and the need for feature space reduction. The dimension of the new feature set was reduced with the goal of improving the classification accuracy and reducing the computation time. The analysis indicated that the projection of the wavelet features into a reduced feature space did not significantly improve the accuracy and the computation time. However, decreasing the number of wavelet decomposition levels did lower the computational load without compromising the average signal classification accuracy. Based on the results of this work, a myoelectric pattern recognition-based control system that uses an SVM classifier applied to time-frequency features may be used to discriminate muscle contraction patterns for prosthetic applications

Stationary wavelet processing and data imputing in myoelectric pattern recognition on a low-cost embedded system

Pattern recognition-based decoding of surface electromyography allows for intuitive and flexible control of prostheses but comes at the cost of sensitivity to in-band noise and sensor faults. System robustness can be improved with wavelet-based signal processing and data imputing, but no attempt has been made to implement such algorithms on real-time, portable systems. The aim of this work was to investigate the feasibility of low-latency, wavelet-based processing and data imputing on an embedded device capable of controlling upper-arm prostheses. Nine able-bodied subjects performed Motion Tests while inducing transient disturbances. Additional investigation was performed on pre-recorded Motion Tests from 15 able-bodied subjects with simulated disturbances. Results from real-time tests were inconclusive, likely due to the low number of disturbance episodes, but simulated tests showed significant improvements in most metrics for both algorithms. However, both algorithms also showed reduced responsiveness during disturbance episodes. These results suggest wavelet-based processing and data imputing can be implemented in portable, real-time systems to potentially improve robustness to signal distortion in prosthetic devices with the caveat of reduced responsiveness for the typically short duration of signal disturbances. The trade-off between large-scale signal corruption robustness and system responsiveness warrants further studies in daily life activities

Towards electrodeless EMG linear envelope signal recording for myo-activated prostheses control

After amputation, the residual muscles of the limb may function in a normal way, enabling the electromyogram (EMG) signals recorded from them to be used to drive a replacement limb. These replacement limbs are called myoelectric prosthesis. The prostheses that use EMG have always been the first choice for both clinicians and engineers. Unfortunately, due to the many drawbacks of EMG (e.g. skin preparation, electromagnetic interferences, high sample rate, etc.); researchers have aspired to find suitable alternatives. One proposes the dry-contact, low-cost sensor based on a force-sensitive resistor (FSR) as a valid alternative which instead of detecting electrical events, detects mechanical events of muscle. FSR sensor is placed on the skin through a hard, circular base to sense the muscle contraction and to acquire the signal. Similarly, to reduce the output drift (resistance) caused by FSR edges (creep) and to maintain the FSR sensitivity over a wide input force range, signal conditioning (Voltage output proportional to force) is implemented. This FSR signal acquired using FSR sensor can be used directly to replace the EMG linear envelope (an important control signal in prosthetics applications). To find the best FSR position(s) to replace a single EMG lead, the simultaneous recording of EMG and FSR output is performed. Three FSRs are placed directly over the EMG electrodes, in the middle of the targeted muscle and then the individual (FSR1, FSR2 and FSR3) and combination of FSR (e.g. FSR1+FSR2, FSR2-FSR3) is evaluated. The experiment is performed on a small sample of five volunteer subjects. The result shows a high correlation (up to 0.94) between FSR output and EMG linear envelope. Consequently, the usage of the best FSR sensor position shows the ability of electrode less FSR-LE to proportionally control the prosthesis (3-D claw). Furthermore, FSR can be used to develop a universal programmable muscle signal sensor that can be suitable to control the myo-activated prosthesis

Bio-signal based control in assistive robots: a survey

Recently, bio-signal based control has been gradually deployed in biomedical devices and assistive robots for improving the quality of life of disabled and elderly people, among which electromyography (EMG) and electroencephalography (EEG) bio-signals are being used widely. This paper reviews the deployment of these bio-signals in the state of art of control systems. The main aim of this paper is to describe the techniques used for (i) collecting EMG and EEG signals and diving these signals into segments (data acquisition and data segmentation stage), (ii) dividing the important data and removing redundant data from the EMG and EEG segments (feature extraction stage), and (iii) identifying categories from the relevant data obtained in the previous stage (classification stage). Furthermore, this paper presents a summary of applications controlled through these two bio-signals and some research challenges in the creation of these control systems. Finally, a brief conclusion is summarized

Reduction of Limb Position Invariant of SEMG Signals for Improved Prosthetic Control using Spectrogram

Prostheses are artificial devices that replace a missing body part, which might be lost through injury, infection, or a condition present at birth. It is proposed to re-establish the normal functions of the missing body part and can be made by hand or with a computer-aided design. As per the World Health Organization, around 160,000 individuals in Malaysia are required to use prostheses. One of the elements that influence the current prosthesis control is that the variety in the limb position and normal use results in different electromyogram (EMG) signals with the same movement at various positions. Consequently, the objective of this study is to ensure that amputees can control their prosthetics in an exact manner regardless of their hand movement and limb position. The raw EMG signals are taken from eight different hand movements’ classes at five different limb positions and each of these hand movements has seven electrodes attach to it. This paper utilizes time-frequency distribution which is spectrogram to extract the EMG feature and six SVM classification learners; linear, quadratic, cubic, fine Gaussian, medium Gaussian, and coarse Gaussian were compared to find the most reasonable one for this application. The analysis performance is then verified based on classification accuracy. From the results, the overall accuracy for the classification is 65% (linear), 87.5% (quadratic) and 97.5% (cubic), 100% (fine Gaussian), 70% (medium Gaussian, and 45% (coarse Gaussian), respectively. It is believed that the study could fill in as knowledge to improve conventional prosthetic control strategies

Stationary Wavelet Processing and Data Imputing in Myoelectric Pattern Recognition on a Low-Cost Embedded System

Pattern recognition-based decoding of surface electromyography allows for intuitive and flexible control of prostheses but comes at the cost of sensitivity to in-band noise and sensor faults. System robustness can be improved with wavelet-based signal processing and data imputing, but no attempt has been made to implement such algorithms on real-time, portable systems. The aim of this work was to investigate the feasibility of low-latency, wavelet-based processing and data imputing on an embedded device capable of controlling upper-arm prostheses. Nine able-bodied subjects performed Motion Tests while inducing transient disturbances. Additional investigation was performed on pre-recorded Motion Tests from 15 able-bodied subjects with simulated disturbances. Results from real-time tests were inconclusive, likely due to the low number of disturbance episodes, but simulated tests showed significant improvements in most metrics for both algorithms. However, both algorithms also showed reduced responsiveness during disturbance episodes. These results suggest wavelet-based processing and data imputing can be implemented in portable, real-time systems to potentially improve robustness to signal distortion in prosthetic devices with the caveat of reduced responsiveness for the typically short duration of signal disturbances. The trade-off between large-scale signal corruption robustness and system responsiveness warrants further studies in daily life activities