A CNN-LSTM Hybrid Model for Wrist Kinematics Estimation Using Surface Electromyography

Convolutional neural network (CNN) has been widely exploited for simultaneous and proportional myoelectric control due to its capability of deriving informative, representative and transferable features from surface electromyography (sEMG). However, muscle contractions have strong temporal dependencies but conventional CNN can only exploit spatial correlations. Considering that long short-term memory neural network (LSTM) is able to capture long-term and non-linear dynamics of time-series data, in this paper we propose a CNN-LSTM hybrid model to fully explore the temporal-spatial information in sEMG. Firstly, CNN is utilized to extract deep features from sEMG spectrum, then these features are processed via LSTM-based sequence regression to estimate wrist kinematics. Six healthy participants are recruited for the participatory collection and motion analysis under various experimental setups. Estimation results in both intra-session and inter-session evaluations illustrate that CNN-LSTM significantly outperforms CNN, LSTM and several representative machine learning approaches, particularly when complex wrist movements are activated

Human lower limb activity recognition techniques, databases, challenges and its applications using sEMG signal: an overview

Human lower limb activity recognition (HLLAR) has grown in popularity over the last decade mainly because to its applications in the identification and control of neuromuscular disorders, security, robotics, and prosthetics. Surface electromyography (sEMG) sensors provide various advantages over other wearable or visual sensors for HLLAR applications, including quick response, pervasiveness, no medical monitoring, and negligible infection. Recognizing lower limb activity from sEMG signals is also challenging owing to the noise in the sEMG signal. Pre- processing of sEMG signals is extremely desirable before the classification because they allow a more consistent and precise evaluation in the above applications. This article provides a segment-by-segment overview of: (1) Techniques for eliminating artifacts from sEMG signals from the lower limb. (2) A survey of existing datasets of lower limb sEMG. (3) A concise description of the various techniques for processing and classifying sEMG data for various applications involving lower limb activity. Finally, an open discussion is presented, which may result in the identification of a variety of future research possibilities for human lower limb activity recognition. Therefore, it is possible to anticipate that the framework presented in this study can aid in the advancement of sEMG-based recognition of human lower limb activity

A survey on bio-signal analysis for human-robot interaction

The use of bio-signals analysis in human-robot interaction is rapidly increasing. There is an urgent demand for it in various applications, including health care, rehabilitation, research, technology, and manufacturing. Despite several state-of-the-art bio-signals analyses in human-robot interaction (HRI) research, it is unclear which one is the best. In this paper, the following topics will be discussed: robotic systems should be given priority in the rehabilitation and aid of amputees and disabled people; second, domains of feature extraction approaches now in use, which are divided into three main sections (time, frequency, and time-frequency). The various domains will be discussed, then a discussion of each domain's benefits and drawbacks, and finally, a recommendation for a new strategy for robotic systems

Human knee abnormality detection from imbalanced sEMG data

The classification of imbalanced datasets, especially in medicine, is a major problem in data mining. Such a problem is evident in analyzing normal and abnormal subjects about knee from data collected during walking. In this work, surface electromyography (sEMG) data were collected during walking from the lower limb of 22 individuals (11 with and 11 without knee abnormality). Subjects with a knee abnormality take longer to complete the walking task than healthy subjects. Therefore, the SEMG signal length of unhealthy subjects is longer than that of healthy subjects, resulting in a problem of imbalance in the collected sEMG signal data. Thus, the development of a classification model for such datasets is challenging due to the bias towards the majority class in the data. The collected sEMG signals are challenging due to the contribution of multiple motor units at a time and their dependency on neuromuscular activity, physiological and anatomical properties of the involved muscles. Hence, automated analysis of such sEMG signals is an arduous task. A multi-step classification scheme is proposed in this research to overcome this limitation. The wavelet denoising (WD) scheme is used to denoise the collected sEMG signals, followed by the extraction of eleven time-domain features. The oversampling techniques are then used to balance the data under analysis by increasing the training minority class. The competency of the proposed scheme was assessed using various computational classifiers with 10 fold cross-validation. It was found that the oversampling techniques improve the performance of all studied classifiers when applied to the studied imbalanced sEMG data. (c) 2021 Elsevier Lt

American Sign Language Recognition System by Using Surface EMG Signal

Sign Language Recognition (SLR) system is a novel method that allows hard of hearing to communicate with general society. In this study, American Sign Language (ASL) recognition system was proposed by using the surface Electromyography (sEMG). The objective of this study is to recognize the American Sign Language alphabet letters and allow users to spell words and sentences. For this purpose, sEMG data are acquired from subject right forearm for twenty-seven American Sign Language gestures of twenty-six English alphabets and one for home position. Time and frequency domain (band power) information used in the feature extraction process. As a classification method, Support Vector Machine and Ensemble Learning algorithm were used and their performances are compared with tabulated results. In conclusion, the results of this study show that sEMG signal can be used for SLR systems

Study of the electromyographic signal dynamic behavior in Amyotrophic Lateral Sclerosis (ALS)

Amyotrophic Lateral Sclerosis (ALS) is a neurodegenerative disease characterized by motor neurons degeneration, which reduces muscular force, being very difficult to diagnose. Mathematical methods are used in order to analyze the surface electromiographic signal’s dynamic behavior (Fractal Dimension (FD) and Multiscale Entropy (MSE)), evaluate different muscle group’s synchronization (Coherence and Phase Locking Factor (PLF)) and to evaluate the signal’s complexity (Lempel-Ziv (LZ) techniques and Detrended Fluctuation Analysis (DFA)). Surface electromiographic signal acquisitions were performed in upper limb muscles, being the analysis executed for instants of contraction for ipsilateral acquisitions for patients and control groups. Results from LZ, DFA and MSE analysis present capability to distinguish between the patient group and the control group, whereas coherence, PLF and FD algorithms present results very similar for both groups. LZ, DFA and MSE algorithms appear then to be a good measure of corticospinal pathways integrity. A classification algorithm was applied to the results in combination with extracted features from the surface electromiographic signal, with an accuracy percentage higher than 70% for 118 combinations for at least one classifier. The classification results demonstrate capability to distinguish members between patients and control groups. These results can demonstrate a major importance in the disease diagnose, once surface electromyography (sEMG) may be used as an auxiliary diagnose method