Experimental Investigations of EMG-Torque Modeling for the Human Upper Limb

The electrical activity of skeletal muscle—the electromyogram (EMG)—is of value to many different application areas, including ergonomics, clinical biomechanics and prosthesis control. For many applications, the EMG is related to muscular tension, joint torque and/or applied forces. In these cases, a goal is for an EMG-torque model to emulate the natural relationship between the central nervous system (as evidenced in the surface EMG) and peripheral joints and muscles. This thesis work concentrated on experimental investigations of EMG-torque modeling. My contributions include: 1) continuing to evaluate the advantage of advanced EMG amplitude estimators, 2) studying system identification techniques (regularizing the least squares fit and increasing training data duration) to improve EMG-torque model performance, and 3) investigating the influence of joint angle on EMG-torque modeling. Results show that the advanced EMG amplitude estimator reduced the model error by 21%—71% compared to conventional estimators. Use of the regularized least squares fit with 52 seconds of training data reduced the model error by 20% compared to the least squares fit without regulation when using 26 seconds of training data. It is also demonstrated that the influence of joint angle can be modeled as a multiplicative factor in slowly force-varying and force-varying contractions at various, fixed angles. The performance of the models that account for the joint angle are not statistically different from a model that was trained at each angle separately and thus does not interpolate across angles. The EMG-torque models that account for joint angle and utilize advanced EMG amplitude estimation and system identification techniques achieved an error of 4.06±1.2% MVCF90 (i.e., error referenced to maximum voluntary contraction at 90° flexion), while models without using these advanced techniques and only accounting for a joint angle of 90° generated an error of 19.15±11.2% MVCF90. This thesis also summarizes other collaborative research contributions performed as part of this thesis. (1) EMG-force modeling at the finger tips was studied with the purpose of assessing the ability to determine two or more independent, continuous degrees of freedom of control from the muscles of the forearm [with WPI and Sherbrooke University]. (2) Investigation of EMG bandwidth requirements for whitening for real-time applications of EMG whitening techniques [with WPI colleagues]. (3) Investigation of the ability of surface EMG to estimate joint torque at future times [with WPI colleagues]. (4) Decomposition of needle EMG data was performed as part of a study to characterize motor unit behavior in patients with amyotrophic lateral sclerosis (ALS) [with Spaulding Rehabilitation Hospital, Boston, MA]

Virtual sensor of surface electromyography in a new extensive fault-tolerant classification system

A few prosthetic control systems in the scientific literature obtain pattern recognition algorithms adapted to changes that occur in the myoelectric signal over time and, frequently, such systems are not natural and intuitive. These are some of the several challenges for myoelectric prostheses for everyday use. The concept of the virtual sensor, which has as its fundamental objective to estimate unavailable measures based on other available measures, is being used in other fields of research. The virtual sensor technique applied to surface electromyography can help to minimize these problems, typically related to the degradation of the myoelectric signal that usually leads to a decrease in the classification accuracy of the movements characterized by computational intelligent systems. This paper presents a virtual sensor in a new extensive fault-tolerant classification system to maintain the classification accuracy after the occurrence of the following contaminants: ECG interference, electrode displacement, movement artifacts, power line interference, and saturation. The Time-Varying Autoregressive Moving Average (TVARMA) and Time-Varying Kalman filter (TVK) models are compared to define the most robust model for the virtual sensor. Results of movement classification were presented comparing the usual classification techniques with the method of the degraded signal replacement and classifier retraining The experimental results were evaluated for these five noise types in 16 surface electromyography (sEMG) channel degradation case studies. The proposed system without using classifier retraining techniques recovered of mean classification accuracy was of 4% to 38% for electrode displacement, movement artifacts, and saturation noise. The best mean classification considering all signal contaminants and channel combinations evaluated was the classification using the retraining method, replacing the degraded channel by the virtual sensor TVARMA model. This method recovered the classification accuracy after the degradations, reaching an average of 5.7% below the classification of the clean signal, that is the signal without the contaminants or the original signal. Moreover, the proposed intelligent technique minimizes the impact of the motion classification caused by signal contamination related to degrading events over time. There are improvements in the virtual sensor model and in the algorithm optimization that need further development to provide an increase the clinical application of myoelectric prostheses but already presents robust results to enable research with virtual sensors on biological signs with stochastic behavior

Toward Optimized VR/AR Ergonomics: Modeling and Predicting User Neck Muscle Contraction

Ergonomic efficiency is essential to the mass and prolonged adoption of VR/AR experiences. While VR/AR head-mounted displays unlock users' natural wide-range head movements during viewing, their neck muscle comfort is inevitably compromised by the added hardware weight. Unfortunately, little quantitative knowledge for understanding and addressing such an issue is available so far. Leveraging electromyography devices, we measure, model, and predict VR users' neck muscle contraction levels (MCL) while they move their heads to interact with the virtual environment. Specifically, by learning from collected physiological data, we develop a bio-physically inspired computational model to predict neck MCL under diverse head kinematic states. Beyond quantifying the cumulative MCL of completed head movements, our model can also predict potential MCL requirements with target head poses only. A series of objective evaluations and user studies demonstrate its prediction accuracy and generality, as well as its ability in reducing users' neck discomfort by optimizing the layout of visual targets. We hope this research will motivate new ergonomic-centered designs for VR/AR and interactive graphics applications. Source code is released at: https://github.com/NYU-ICL/xr-ergonomics-neck-comfort.Comment: ACM SIGGRAPH 2023 Conference Proceeding

Myoelectric forearm prostheses: State of the art from a user-centered perspective

User acceptance of myoelectric forearm prostheses is currently low. Awkward control, lack of feedback, and difficult training are cited as primary reasons. Recently, researchers have focused on exploiting the new possibilities offered by advancements in prosthetic technology. Alternatively, researchers could focus on prosthesis acceptance by developing functional requirements based on activities users are likely to perform. In this article, we describe the process of determining such requirements and then the application of these requirements to evaluating the state of the art in myoelectric forearm prosthesis research. As part of a needs assessment, a workshop was organized involving clinicians (representing end users), academics, and engineers. The resulting needs included an increased number of functions, lower reaction and execution times, and intuitiveness of both control and feedback systems. Reviewing the state of the art of research in the main prosthetic subsystems (electromyographic [EMG] sensing, control, and feedback) showed that modern research prototypes only partly fulfill the requirements. We found that focus should be on validating EMG-sensing results with patients, improving simultaneous control of wrist movements and grasps, deriving optimal parameters for force and position feedback, and taking into account the psychophysical aspects of feedback, such as intensity perception and spatial acuity

A Study of Myoelectric Signal Processing

This dissertation of various aspects of electromyogram (EMG: muscle electrical activity) signal processing is comprised of two projects in which I was the lead investigator and two team projects in which I participated. The first investigator-led project was a study of reconstructing continuous EMG discharge rates from neural impulses. Related methods for calculating neural firing rates in other contexts were adapted and applied to the intramuscular motor unit action potential train firing rate. Statistical results based on simulation and clinical data suggest that performances of spline-based methods are superior to conventional filter-based methods in the absence of decomposition error, but they unacceptably degrade in the presence of even the smallest decomposition errors present in real EMG data, which is typically around 3-5%. Optimal parameters for each method are found, and with normal decomposition error rates, ranks of these methods with their optimal parameters are given. Overall, Hanning filtering and Berger methods exhibit consistent and significant advantages over other methods. In the second investigator-led project, the technique of signal whitening was applied prior to motion classification of upper limb surface EMG signals previously collected from the forearm muscles of intact and amputee subjects. The motions classified consisted of 11 hand and wrist actions pertaining to prosthesis control. Theoretical models and experimental data showed that whitening increased EMG signal bandwidth by 65-75% and the coefficients of variation of temporal features computed from the EMG were reduced. As a result, a consistent classification accuracy improvement of 3-5% was observed for all subjects at small analysis durations (\u3c 100 ms). In the first team-based project, advanced modeling methods of the constant posture EMG-torque relationship about the elbow were studied: whitened and multi-channel EMG signals, training set duration, regularized model parameter estimation and nonlinear models. Combined, these methods reduced error to less than a quarter of standard techniques. In the second team-based project, a study related biceps-triceps surface EMG to elbow torque at seven joint angles during constant-posture contractions. Models accounting for co-contraction estimated that individual flexion muscle torques were much higher than models that did not account for co-contraction

Relating forearm muscle electrical activity to finger forces

The electromyogram (EMG) signal is desired to be used as a control signal for applications such as multifunction prostheses, wheelchair navigation, gait generation, grasping control, virtual keyboards, and gesture-based interfaces [25]. Several research studies have attempted to relate the electromyogram (EMG) activity of the forearm muscles to the mechanical activity of the wrist, hand and/or fingers [41], [42], [43]. A primary interest is for EMG control of powered upper-limb prostheses and rehabilitation orthotics. Existing commercial EMG-controlled devices are limited to rudimentary control capabilities of either discrete states (e.g. hand close/open), or one degree of freedom proportional control [4], [36]. Classification schemes for discriminating between hand/wrist functions and individual finger movements have demonstrated accuracy up to 95% [38], [39], [29]. These methods may provide for increased amputee function, though continuous control of movement is not generally achieved. This thesis considered proportional control via EMG-based estimation of finger forces with the goal of identifying whether multiple degrees of freedom of proportional control information are available from the surface EMG of the forearm. Electromyogram (EMG) activity from the extensor and flexor muscles of the forearm was sensed with bipolar surface electrodes and related to the force produced at the four fingertips during constant-posture, slowly force-varying contractions from 20 healthy subjects. The contractions ranged between 30% maximum voluntary contractions (MVC) extension and 30% MVC flexion. EMG amplitude sampling rate, least squares regularization, linear vs. nonlinear models and number of electrodes used in the system identification were studied. Results are supportive that multiple degrees of freedom of proportional control information are available from the surface EMG of the forearm, at least in healthy subjects. An EMG amplitude sampling frequency of 4.096 Hz was found to produce models which allowed for good EMG amplitude estimates. Least squares regularization with a pseudo-inverse tolerance of 0.055 resulted in significant improvement in modeling results, with an average error of 4.69% MVC-6.59% MVC (maximum voluntary contraction). Increasing polynomial order did not significantly improve modeling results. Results from smaller electrode arrays remained fairly good with as few as six electrodes, with the average %MVC error ranging from 5.13%-7.01% across the four fingers. This study also identified challenges in the current experimental study design and subsequent system identification when EMG-force modeling is performed with four fingers simultaneously. Methods to compensate for these issues have been proposed in this thesis