Adaptive real-time identification of motor unit discharges from non-stationary high-density surface electromyographic signals

Objective. Estimation of the discharge pattern of motor units by electromyography (EMG) decomposition has been applied for neurophysiologic investigations, clinical diagnosis, and human-machine interfacing. However, most of the methods for EMG decomposition are currently applied offline. Here, we propose an approach for high-density surface EMG decomposition in real-time. Methods. A real-time decomposition scheme including two sessions, offline training and online decomposition, is proposed based on the convolutional kernel compensation algorithm. The estimation parameters, separation vectors and the thresholds for spike extraction, are first computed during offline training, and then they are directly applied to estimate motor unit spike trains (MUSTs) during the online decomposition. The estimation parameters are updated with the identification of new discharges to adapt to non-stationary conditions. The decomposition accuracy was validated on simulated EMG signals by convolving synthetic MUSTs with motor unit action potentials (MUAPs). Moreover, the accuracy of the online decomposition was assessed from experimental signals recorded from forearm muscles using a signal-based performance metrics (pulse-to-noise ratio, PNR). Main results. The proposed algorithm yielded a high decomposition accuracy and robustness to non-stationary conditions. The accuracy of MUSTs identified from simulated EMG signals was > 80% for most conditions. From experimental EMG signals, on average, 12±2 MUSTs were identified from each electrode grid with PNR of 25.0±1.8 dB, corresponding to an estimated decomposition accuracy > 75%. Conclusion and Significance. These results indicate the feasibility of real-time identification of motor unit activities non-invasively during variable force contractions, extending the potential applications of high-density EMG as a neural interface

Studies of the relationship between the surface electromyogram, joint torque and impedance

This compendium-format dissertation (i.e., comprised mostly of published and in-process articles) primarily reports on system identification methods that relate the surface electromyogram (EMG)—the electrical activity of skeletal muscles—to mechanical kinetics. The methods focus on activities of the elbow and hand-wrist. The relationship between the surface EMG and joint impedance was initially studied. My work provided a complete second-order EMG-based impedance characterization of stiffness, viscosity and inertia over a complete range of nominal torques, from a single perturbation trial with slowly varied torque. A single perturbation trial provides a more convenient method for impedance evaluation. The RMS errors of the EMG-based method were 20.01% for stiffness and 7.05% for viscosity, compared with the traditional mechanical measurement. Three projects studied the relationship between EMG and force/torque, a topic that has been studied for a number of years. Optimal models use whitened EMG amplitude, combining multiple EMG channels and a polynomial equation to describe this relationship. First, we used three techniques to improve current models at the elbow joint. Three more features were extracted from the EMG (waveform length, slope sign change rate and zero crossing rate), in addition to EMG amplitude. Each EMG channel was used separately, compared to previous studies which combined multiple channels from biceps and, separately, from triceps muscles. Finally, an exponential power law model was used. Each of these improvement techniques showed better performance (P\u3c0.05 and ~0.7 percent maximum voluntary contraction (%MVC) error reduction from a nominal error of 5.5%MVC) than the current “optimal” model. However, the combination of pairs of these techniques did not further improve results. Second, traditional prostheses only control 1 degree of freedom (DoF) at a time. My work provided evidence for the feasibility of controlling 2-DoF wrist movements simultaneously, with a minimum number of electrodes. Results suggested that as few as four conventional electrodes, optimally located about the forearm, could provide 2-DoF simultaneous, independent and proportional control with error ranging from 9.0–10.4 %MVC, which is similar to the 1-DoF approach (error from 8.8–9.8 %MVC) currently used for commercial prosthesis control. The third project was similar to the second, except that this project studied controlling a 1-DoF wrist with one hand DoF simultaneously. It also demonstrated good performance with the error ranging from 7.8-8.7 %MVC, compared with 1-DoF control. Additionally, I participated in two team projects—EMG decomposition and static wrist EMG to torque—which are described herein

Towards electrodeless EMG linear envelope signal recording for myo-activated prostheses control

After amputation, the residual muscles of the limb may function in a normal way, enabling the electromyogram (EMG) signals recorded from them to be used to drive a replacement limb. These replacement limbs are called myoelectric prosthesis. The prostheses that use EMG have always been the first choice for both clinicians and engineers. Unfortunately, due to the many drawbacks of EMG (e.g. skin preparation, electromagnetic interferences, high sample rate, etc.); researchers have aspired to find suitable alternatives. One proposes the dry-contact, low-cost sensor based on a force-sensitive resistor (FSR) as a valid alternative which instead of detecting electrical events, detects mechanical events of muscle. FSR sensor is placed on the skin through a hard, circular base to sense the muscle contraction and to acquire the signal. Similarly, to reduce the output drift (resistance) caused by FSR edges (creep) and to maintain the FSR sensitivity over a wide input force range, signal conditioning (Voltage output proportional to force) is implemented. This FSR signal acquired using FSR sensor can be used directly to replace the EMG linear envelope (an important control signal in prosthetics applications). To find the best FSR position(s) to replace a single EMG lead, the simultaneous recording of EMG and FSR output is performed. Three FSRs are placed directly over the EMG electrodes, in the middle of the targeted muscle and then the individual (FSR1, FSR2 and FSR3) and combination of FSR (e.g. FSR1+FSR2, FSR2-FSR3) is evaluated. The experiment is performed on a small sample of five volunteer subjects. The result shows a high correlation (up to 0.94) between FSR output and EMG linear envelope. Consequently, the usage of the best FSR sensor position shows the ability of electrode less FSR-LE to proportionally control the prosthesis (3-D claw). Furthermore, FSR can be used to develop a universal programmable muscle signal sensor that can be suitable to control the myo-activated prosthesis

Grasp force estimation from the transient EMG using high-density surface recordings.

Objective: Understanding the neurophysiological signals underlying voluntary motor control and decoding them for prosthesis control are among the major challenges in applied neuroscience and bioengineering. Usually, information from the electrical activity of residual forearm muscles (i.e. the electromyogram, EMG) is used to control different functions of a prosthesis. Noteworthy, forearm EMG patterns at the onset of a contraction (transient phase) have shown to contain predictive information about upcoming grasps. However, decoding this information for the estimation of grasp force was so far overlooked. Approach: High Density-EMG signals (192 channels) were recorded from twelve participants performing a pick-and-lift task. The final grasp force was estimated offline using linear regressors, with four subsets of channels and ten features obtained using three channels-features selection methods. Two different evaluation metrics (absolute error and R2), complemented with statistical analysis, were used to select the optimal configuration of the parameters. Different windows of data starting at the grasp force (GF) onset were compared to determine the time at which the grasp force can be ascertained from the EMG signals. Main results: The prediction accuracy improved by increasing the window length from the moment of the onset and kept improving until the steady state at which a plateau of performances was reached. With our methodology, estimations of the grasp force through 16 EMG channels reached an absolute error of 2.52% the maximum voluntary force using only transient information and 1.99% with the first 500ms of data following the onset. Significance: The final GF estimation from transient EMG was comparable to the one obtained using steady state data, confirming our hypothesis that the transient phase contains information about the final grasp force. This result paves the way to fast online myoelectric controllers capable of decoding grasp strength from the very early portion of the EMG signal

Improving the Performance of Dynamic Electromyogram-to-Force Models for the Hand-Wrist and Multiple Fingers

Relating surface electromyogram (EMG) activity to force/torque models is used in many areas including: prosthesis control systems, to regulate direction and speed of movement in reaching and matching tasks; clinical biomechanics, to assess muscle deficiency and effort levels; and ergonomics analysis, to assess risk of work-related injury such as back pain, fatigue and skill tests. This thesis work concentrated on improving the performance of dynamic EMG-to-force models for the hand-wrist and multiple fingers. My contributions include: 1) rapid calibration of dynamic hand-wrist EMG-force models using a minimum number of electrodes, 2) efficiently training two degree of freedom (DoF) hand-wrist EMG-force models, and 3) estimating individual and combined fingertip forces from forearm EMG during constant-pose, force-varying tasks. My calibration approach for hand-wrist EMG-force models optimized three main factors for 1-DoF and 2-DoF tasks: training duration (14, 22, 30, 38, 44, 52, 60, 68, 76 s), number of electrodes (2 through 16), and model forms (subject-specific, DoF-specific, universal). The results show that training duration can be reduced from historical 76 s to 40–60 s without statistically affecting the average error for both 1-DoF and 2-DoF tasks. Reducing the number of electrodes depended on the number of DoFs. One-DoF models can be reduced to 2 electrodes with average test error range of 8.3–9.2% maximum voluntary contraction (MVC), depending on the DoF (e.g., flexion-extension, radial-ulnar deviation, pronation-supination, open-close). Additionally, 2-DoF models can be reduced to 6 electrodes with average error of 7.17–9.21 %MVC. Subject-specific models had the lowest error for 1-DoF tasks while DoF-specific and universal were the lowest for 2-DoF tasks. In the EMG-finger project, we studied independent contraction of one, two, three or four fingers (thumb excluded), as well as contraction of four fingers in unison. Using regression, we found that a pseudo-inverse tolerance (ratio of largest to smallest singular value) of 0.01 was optimal. Lower values produced erratic models and higher values produced models with higher errors. EMG-force errors using one finger ranged from 2.5–3.8 %MVC, using the optimal pseudoinverse tolerance. With additional fingers (two, three or four), the average error ranged from 5–8 %MVC. When four fingers contracted in unison, the average error was 4.3 %MVC. Additionally, I participated in two team projects—EMG-force dynamic models about the elbow and relating forearm muscle EMG to finger force during slowly force varying contractions. This work is also described herein

ViT-MDHGR: Cross-day Reliability and Agility in Dynamic Hand Gesture Prediction via HD-sEMG Signal Decoding

Surface electromyography (sEMG) and high-density sEMG (HD-sEMG) biosignals have been extensively investigated for myoelectric control of prosthetic devices, neurorobotics, and more recently human-computer interfaces because of their capability for hand gesture recognition/prediction in a wearable and non-invasive manner. High intraday (same-day) performance has been reported. However, the interday performance (separating training and testing days) is substantially degraded due to the poor generalizability of conventional approaches over time, hindering the application of such techniques in real-life practices. There are limited recent studies on the feasibility of multi-day hand gesture recognition. The existing studies face a major challenge: the need for long sEMG epochs makes the corresponding neural interfaces impractical due to the induced delay in myoelectric control. This paper proposes a compact ViT-based network for multi-day dynamic hand gesture prediction. We tackle the main challenge as the proposed model only relies on very short HD-sEMG signal windows (i.e., 50 ms, accounting for only one-sixth of the convention for real-time myoelectric implementation), boosting agility and responsiveness. Our proposed model can predict 11 dynamic gestures for 20 subjects with an average accuracy of over 71% on the testing day, 3-25 days after training. Moreover, when calibrated on just a small portion of data from the testing day, the proposed model can achieve over 92% accuracy by retraining less than 10% of the parameters for computational efficiency