Simulation of motor unit action potential recordings from intramuscular multichannel scanning electrodes

International audienceMultichannel intramuscular EMG (iEMG) recordings provide information on motor neuron behaviour, muscle fiber (MF) innervation geometry and, recently, have been proposed as means for establishing human-machine interfaces. Objective: in order to provide a reliable benchmark for computational methods applied to such recordings, we propose a simulation model for iEMG signals acquired by intramuscular multi-channel electrodes. Methods: we propose a number of modifications to the existing iEMG simulation methods, such as farthest point sampling for more uniform motor unit in-nervation centers distribution in the muscle cross-section, fiber-neuron assignment algorithm, motor neuron action potential propagation delay modelling and a linear model for multichannel recordings simulation. The proposed approach is also extended to gradually shifting (scanning) electrodes. Results: we provide representative applications of this model to the validation of methods for the estimation of motor unit territories, and for iEMG decomposition. Moreover, we extend this model to a full multichannel iEMG simulator using classical linear EMG modelling and existing approaches to the generation of motor neuron discharge sequences. Conclusions: the obtained simulation model provides physiologically accurate MUAPs across entire motor unit territories and for various electrode configurations. Significance: it can be used for the development and evaluation of mathematical methods for multichannel iEMG processing and analysis

Adaptive real-time identification of motor unit discharges from non-stationary high-density surface electromyographic signals

Objective. Estimation of the discharge pattern of motor units by electromyography (EMG) decomposition has been applied for neurophysiologic investigations, clinical diagnosis, and human-machine interfacing. However, most of the methods for EMG decomposition are currently applied offline. Here, we propose an approach for high-density surface EMG decomposition in real-time. Methods. A real-time decomposition scheme including two sessions, offline training and online decomposition, is proposed based on the convolutional kernel compensation algorithm. The estimation parameters, separation vectors and the thresholds for spike extraction, are first computed during offline training, and then they are directly applied to estimate motor unit spike trains (MUSTs) during the online decomposition. The estimation parameters are updated with the identification of new discharges to adapt to non-stationary conditions. The decomposition accuracy was validated on simulated EMG signals by convolving synthetic MUSTs with motor unit action potentials (MUAPs). Moreover, the accuracy of the online decomposition was assessed from experimental signals recorded from forearm muscles using a signal-based performance metrics (pulse-to-noise ratio, PNR). Main results. The proposed algorithm yielded a high decomposition accuracy and robustness to non-stationary conditions. The accuracy of MUSTs identified from simulated EMG signals was > 80% for most conditions. From experimental EMG signals, on average, 12±2 MUSTs were identified from each electrode grid with PNR of 25.0±1.8 dB, corresponding to an estimated decomposition accuracy > 75%. Conclusion and Significance. These results indicate the feasibility of real-time identification of motor unit activities non-invasively during variable force contractions, extending the potential applications of high-density EMG as a neural interface

Recursive decomposition of electromyographic signals with a varying number of active sources: Bayesian modelling and filtering

International audienceThis paper describes a sequential decomposition algorithm for single channel intramuscular electromyography (iEMG) generated by a varying number of active motor neurons. As in previous work, we establish a Hidden Markov Model of iEMG, in which each motor neuron spike train is modeled as a renewal process with inter-spike intervals following a discrete Weibull law and motor unit action potentials are modeled as impulse responses of linear time-invariant systems with known prior. We then expand this model by introducing an activation vector associated to the state vector of the Hidden Markov Model. This activation vector represents recruitment/derecruitment of motor units and is estimated together with the state vector using Bayesian filtering. Non-stationarity of the model parameters is addressed by means of a sliding window approach, thus making the algorithm adaptive to variations in contraction force and motor unit action potential waveforms. The algorithm was validated using simulated and experimental iEMG signals with varying number of active motor units. The experimental signals were acquired from the tibialis anterior and abductor digiti minimi muscles by fine wire and needle electrodes. The decomposition accuracy in both simulated and experimental signals exceeded 90% and the recruitment/derecruitment was successfully tracked by the algorithm. Because of its parallel structure, this algorithm can be efficiently accelerated, which lays the basis for its future real-time applications in human-machine interfaces, e.g. for prosthetic control

On the Utility of Representation Learning Algorithms for Myoelectric Interfacing

Electrical activity produced by muscles during voluntary movement is a reflection of the firing patterns of relevant motor neurons and, by extension, the latent motor intent driving the movement. Once transduced via electromyography (EMG) and converted into digital form, this activity can be processed to provide an estimate of the original motor intent and is as such a feasible basis for non-invasive efferent neural interfacing. EMG-based motor intent decoding has so far received the most attention in the field of upper-limb prosthetics, where alternative means of interfacing are scarce and the utility of better control apparent. Whereas myoelectric prostheses have been available since the 1960s, available EMG control interfaces still lag behind the mechanical capabilities of the artificial limbs they are intended to steer—a gap at least partially due to limitations in current methods for translating EMG into appropriate motion commands. As the relationship between EMG signals and concurrent effector kinematics is highly non-linear and apparently stochastic, finding ways to accurately extract and combine relevant information from across electrode sites is still an active area of inquiry.This dissertation comprises an introduction and eight papers that explore issues afflicting the status quo of myoelectric decoding and possible solutions, all related through their use of learning algorithms and deep Artificial Neural Network (ANN) models. Paper I presents a Convolutional Neural Network (CNN) for multi-label movement decoding of high-density surface EMG (HD-sEMG) signals. Inspired by the successful use of CNNs in Paper I and the work of others, Paper II presents a method for automatic design of CNN architectures for use in myocontrol. Paper III introduces an ANN architecture with an appertaining training framework from which simultaneous and proportional control emerges. Paper Iv introduce a dataset of HD-sEMG signals for use with learning algorithms. Paper v applies a Recurrent Neural Network (RNN) model to decode finger forces from intramuscular EMG. Paper vI introduces a Transformer model for myoelectric interfacing that do not need additional training data to function with previously unseen users. Paper vII compares the performance of a Long Short-Term Memory (LSTM) network to that of classical pattern recognition algorithms. Lastly, paper vIII describes a framework for synthesizing EMG from multi-articulate gestures intended to reduce training burden

A denoising algorithm for surface EMG decomposition

The goal of the present thesis was to investigate a novel motor unit potential train (MUPT) editing routine, based on decreasing the variability in shape (variance ratio, VR) of the MUP ensemble. Decomposed sEMG data from 20 participants at 60% MVC of wrist flexion was used. There were two levels of denoising (relaxed and strict) criteria for removing discharge times associated with waveforms that did not decrease the VR and increase its signal-to-noise ratio (SNR) of the MUP ensemble. The peak-to-peak amplitude and the duration between the positive and negative peaks for the MUP template were dependent on the level of denoising (p’s 0.05). The same was true between denoising criteria (p>0.05). Editing the MUPT based on MUP shape resulted in significant differences in measures extracted from the MUP template, with trivial difference between the standard error of estimate for mean IDIs between the complete and denoised MUPTs

A myoelectric digital twin for fast and realistic modelling in deep learning

Muscle electrophysiology has emerged as a powerful tool to drive human machine interfaces, with many new recent applications outside the traditional clinical domains, such as robotics and virtual reality. However, more sophisticated, functional, and robust decoding algorithms are required to meet the fine control requirements of these applications. Deep learning has shown high potential in meeting these demands, but requires a large amount of high-quality annotated data, which is expensive and time-consuming to acquire. Data augmentation using simulations, a strategy applied in other deep learning applications, has never been attempted in electromyography due to the absence of computationally efficient models. We introduce a concept of Myoelectric Digital Twin - highly realistic and fast computational model tailored for the training of deep learning algorithms. It enables simulation of arbitrary large and perfectly annotated datasets of realistic electromyography signals, allowing new approaches to muscular signal decoding, accelerating the development of human-machine interfaces

Biosignal Generation and Latent Variable Analysis with Recurrent Generative Adversarial Networks

The effectiveness of biosignal generation and data augmentation with biosignal generative models based on generative adversarial networks (GANs), which are a type of deep learning technique, was demonstrated in our previous paper. GAN-based generative models only learn the projection between a random distribution as input data and the distribution of training data.Therefore, the relationship between input and generated data is unclear, and the characteristics of the data generated from this model cannot be controlled. This study proposes a method for generating time-series data based on GANs and explores their ability to generate biosignals with certain classes and characteristics. Moreover, in the proposed method, latent variables are analyzed using canonical correlation analysis (CCA) to represent the relationship between input and generated data as canonical loadings. Using these loadings, we can control the characteristics of the data generated by the proposed method. The influence of class labels on generated data is analyzed by feeding the data interpolated between two class labels into the generator of the proposed GANs. The CCA of the latent variables is shown to be an effective method of controlling the generated data characteristics. We are able to model the distribution of the time-series data without requiring domain-dependent knowledge using the proposed method. Furthermore, it is possible to control the characteristics of these data by analyzing the model trained using the proposed method. To the best of our knowledge, this work is the first to generate biosignals using GANs while controlling the characteristics of the generated data

Synchronization of motoneuron firings: an epiphenomenon of hierarchical control revealed by statistically robust methods

Thesis (Ph.D.)--Boston UniversityFor more than four decades, observations of synchronized motoneuron firings detected during human muscle contractions have been used to determine the strength of common inputs shared by motoneurons. This notion is referred to as the "common input". It relies on the supposition that synchronization is caused by branches of presynaptic inputs shared by motoneurons. However, direct empirical observations that physical common inputs elicit synchronized firings have never been reported. The disquiet over the lack of physical evidence has been compounded by the lack of statistical rigor of the methods used to detect synchronized firings. In spite of its seemingly wide acceptance, the validity of the common input notion remains unproven. I set out to evaluate the methods used to detect synchronization and derive an improved statistical approach to test rigorously the notion that common inputs cause synchronization. More than, 1,000,000 firings from over 2,100 motoneurons were decomposed from EMG signals collected during voluntary contractions ranging from 5% to 50% of the maximal force in two human muscles - a data set an order of magnitude greater than any reported in previous synchronization studies. Any errors that occurred during EMG decomposition were classified and mitigated using a newly derived error reduction algorithm. With improved estimates of the firing times, I developed a statistically-based method (SigMax) for detecting synchronized firings and compared it to three other commonly used techniques. SigMax revealed three types of errors produced by the previous methods that ignore proper statistical considerations necessary to detect synchronization. Using the error reduction and SigMax method, I designed two experiments to examine the possible physiological cause of motoneuron synchronization. The first experiment implemented a dual force-level contraction paradigm to test the common input notion. My analysis demonstrated that anatomically hard-wired common inputs were not responsible for the changes in synchronization that occurred with changes in contraction force. Therefore, I implemented a second experimental protocol to ascertain factors other than common inputs that may cause synchronization. Results from a three- dimensional regression analysis of these data indicated that synchronization likely occurs as an epiphenomenon of the sensitivities of motoneuron firing rates to voluntary excitation

Optimal Motor Unit Subset Selection for Accurate Motor Intention Decoding: Towards Dexterous Real-Time Interfacing

Objective: Motor unit (MU) discharge timings encode human motor intentions to the finest degree. Whilst tapping into such information can bring significant gains to a range of applications, current approaches to MU decoding from surface signals do not scale well with the demands of dexterous human-machine interfacing (HMI). To optimize the forward estimation accuracy and time-efficiency of such systems, we propose the inclusion of task-wise initialization and MU subset selection. Methods: Offline analyses were conducted on data recorded from 11 non-disabled subjects. Task-wise decomposition was applied to identify MUs from high-density surface electromyography (HD-sEMG) pertaining to 18 wrist/forearm motor tasks. The activities of a selected subset of MUs were extracted from test data and used for forward estimation of intended motor tasks and joint kinematics. To that end, various combinations of subset selection and estimation algorithms (both regression and classification-based) were tested for a range of subset sizes. Results: The mutual information-based minimum Redundancy Maximum Relevance (mRMR-MI) criterion retained MUs with the highest predicative power. When the portion of tracked MUs was reduced down to 25%, the regression performance decreased only by 3% (R2=0.79) while classification accuracy dropped by 2.7% (accuracy = 74%) when kernel-based estimators were considered. Conclusion and Significance: Careful selection of tracked MUs can optimize the efficiency of MU-driven interfacing. In particular, prioritization of MUs exhibiting strong nonlinear relationships with target motions is best leveraged by kernel-based estimators. Hence, this frees resources for more robust and adaptive MU decoding techniques to be implemented in future

Human knee abnormality detection from imbalanced sEMG data

The classification of imbalanced datasets, especially in medicine, is a major problem in data mining. Such a problem is evident in analyzing normal and abnormal subjects about knee from data collected during walking. In this work, surface electromyography (sEMG) data were collected during walking from the lower limb of 22 individuals (11 with and 11 without knee abnormality). Subjects with a knee abnormality take longer to complete the walking task than healthy subjects. Therefore, the SEMG signal length of unhealthy subjects is longer than that of healthy subjects, resulting in a problem of imbalance in the collected sEMG signal data. Thus, the development of a classification model for such datasets is challenging due to the bias towards the majority class in the data. The collected sEMG signals are challenging due to the contribution of multiple motor units at a time and their dependency on neuromuscular activity, physiological and anatomical properties of the involved muscles. Hence, automated analysis of such sEMG signals is an arduous task. A multi-step classification scheme is proposed in this research to overcome this limitation. The wavelet denoising (WD) scheme is used to denoise the collected sEMG signals, followed by the extraction of eleven time-domain features. The oversampling techniques are then used to balance the data under analysis by increasing the training minority class. The competency of the proposed scheme was assessed using various computational classifiers with 10 fold cross-validation. It was found that the oversampling techniques improve the performance of all studied classifiers when applied to the studied imbalanced sEMG data. (c) 2021 Elsevier Lt