High performance wearable ultrasound as a human-machine interface for wrist and hand kinematic tracking

Objective: Non-invasive human machine interfaces (HMIs) have high potential in medical, entertainment, and industrial applications. Traditionally, surface electromyography (sEMG) has been used to track muscular activity and infer motor intention. Ultrasound (US) has received increasing attention as an alternative to sEMG-based HMIs. Here, we developed a portable US armband system with 24 channels and a multiple receiver approach, and compared it with existing sEMG- and US-based HMIs on movement intention decoding. Methods: US and motion capture data was recorded while participants performed wrist and hand movements of four degrees of freedom (DoFs) and their combinations. A linear regression model was used to offline predict hand kinematics from the US (or sEMG, for comparison) features. The method was further validated in real-time for a 3-DoF target reaching task. Results: In the offline analysis, the wearable US system achieved an average R2 of 0.94 in the prediction of four DoFs of the wrist and hand while sEMG reached a performance of R2=0.06 . In online control, the participants achieved an average 93% completion rate of the targets. Conclusion: When tailored for HMIs, the proposed US A-mode system and processing pipeline can successfully regress hand kinematics both in offline and online settings with performances comparable or superior to previously published interfaces. Significance: Wearable US technology may provide a new generation of HMIs that use muscular deformation to estimate limb movements. The wearable US system allowed for robust proportional and simultaneous control over multiple DoFs in both offline and online settings

Improving the Performance of Dynamic Electromyogram-to-Force Models for the Hand-Wrist and Multiple Fingers

Relating surface electromyogram (EMG) activity to force/torque models is used in many areas including: prosthesis control systems, to regulate direction and speed of movement in reaching and matching tasks; clinical biomechanics, to assess muscle deficiency and effort levels; and ergonomics analysis, to assess risk of work-related injury such as back pain, fatigue and skill tests. This thesis work concentrated on improving the performance of dynamic EMG-to-force models for the hand-wrist and multiple fingers. My contributions include: 1) rapid calibration of dynamic hand-wrist EMG-force models using a minimum number of electrodes, 2) efficiently training two degree of freedom (DoF) hand-wrist EMG-force models, and 3) estimating individual and combined fingertip forces from forearm EMG during constant-pose, force-varying tasks. My calibration approach for hand-wrist EMG-force models optimized three main factors for 1-DoF and 2-DoF tasks: training duration (14, 22, 30, 38, 44, 52, 60, 68, 76 s), number of electrodes (2 through 16), and model forms (subject-specific, DoF-specific, universal). The results show that training duration can be reduced from historical 76 s to 40–60 s without statistically affecting the average error for both 1-DoF and 2-DoF tasks. Reducing the number of electrodes depended on the number of DoFs. One-DoF models can be reduced to 2 electrodes with average test error range of 8.3–9.2% maximum voluntary contraction (MVC), depending on the DoF (e.g., flexion-extension, radial-ulnar deviation, pronation-supination, open-close). Additionally, 2-DoF models can be reduced to 6 electrodes with average error of 7.17–9.21 %MVC. Subject-specific models had the lowest error for 1-DoF tasks while DoF-specific and universal were the lowest for 2-DoF tasks. In the EMG-finger project, we studied independent contraction of one, two, three or four fingers (thumb excluded), as well as contraction of four fingers in unison. Using regression, we found that a pseudo-inverse tolerance (ratio of largest to smallest singular value) of 0.01 was optimal. Lower values produced erratic models and higher values produced models with higher errors. EMG-force errors using one finger ranged from 2.5–3.8 %MVC, using the optimal pseudoinverse tolerance. With additional fingers (two, three or four), the average error ranged from 5–8 %MVC. When four fingers contracted in unison, the average error was 4.3 %MVC. Additionally, I participated in two team projects—EMG-force dynamic models about the elbow and relating forearm muscle EMG to finger force during slowly force varying contractions. This work is also described herein

Gesture Based Control and EMG Decomposition

This paper presents two probabilistic developments for use with Electromyograms (EMG). First described is a new-electric interface for virtual device control based on gesture recognition. The second development is a Bayesian method for decomposing EMG into individual motor unit action potentials. This more complex technique will then allow for higher resolution in separating muscle groups for gesture recognition. All examples presented rely upon sampling EMG data from a subject's forearm. The gesture based recognition uses pattern recognition software that has been trained to identify gestures from among a given set of gestures. The pattern recognition software consists of hidden Markov models which are used to recognize the gestures as they are being performed in real-time from moving averages of EMG. Two experiments were conducted to examine the feasibility of this interface technology. The first replicated a virtual joystick interface, and the second replicated a keyboard. Moving averages of EMG do not provide easy distinction between fine muscle groups. To better distinguish between different fine motor skill muscle groups we present a Bayesian algorithm to separate surface EMG into representative motor unit action potentials. The algorithm is based upon differential Variable Component Analysis (dVCA) [l], [2] which was originally developed for Electroencephalograms. The algorithm uses a simple forward model representing a mixture of motor unit action potentials as seen across multiple channels. The parameters of this model are iteratively optimized for each component. Results are presented on both synthetic and experimental EMG data. The synthetic case has additive white noise and is compared with known components. The experimental EMG data was obtained using a custom linear electrode array designed for this study

A real-time and convex model for the estimation of muscle force from surface electromyographic signals in the upper and lower limbs

Surface electromyography (sEMG) is a signal consisting of different motor unit action potential trains and records from the surface of the muscles. One of the applications of sEMG is the estimation of muscle force. We proposed a new real-time convex and interpretable model for solving the sEMG-force estimation. We validated it on the upper limb during isometric voluntary flexions-extensions at 30%, 50%, and 70% Maximum Voluntary Contraction in five subjects, and lower limbs during standing tasks in thirty-three volunteers, without a history of neuromuscular disorders. Moreover, the performance of the proposed method was statistically compared with that of the state-of-the-art (13 methods, including linear-in-the-parameter models, Artificial Neural Networks and Supported Vector Machines, and non-linear models). The envelope of the sEMG signals was estimated, and the representative envelope of each muscle was used in our analysis. The convex form of an exponential EMG-force model was derived, and each muscle's coefficient was estimated using the Least Square method. The goodness-of-fit indices, the residual signal analysis (bias and Bland-Altman plot), and the running time analysis were provided. For the entire model, 30% of the data was used for estimation, while the remaining 20% and 50% were used for validation and testing, respectively. The average R-square (%) of the proposed method was 96.77 +/- 1.67 [94.38, 98.06] for the test sets of the upper limb and 91.08 +/- 6.84 [62.22, 96.62] for the lower-limb dataset (MEAN +/- SD [min, max]). The proposed method was not significantly different from the recorded force signal (p-value = 0.610); that was not the case for the other tested models. The proposed method significantly outperformed the other methods (adj. p-value < 0.05). The average running time of each 250 ms signal of the training and testing of the proposed method was 25.7 +/- 4.0 [22.3, 40.8] and 11.0 +/- 2.9 [4.7, 17.8] in microseconds for the entire dataset. The proposed convex model is thus a promising method for estimating the force from the joints of the upper and lower limbs, with applications in load sharing, robotics, rehabilitation, and prosthesis control for the upper and lower limbs

Computational Intelligence in Electromyography Analysis

Electromyography (EMG) is a technique for evaluating and recording the electrical activity produced by skeletal muscles. EMG may be used clinically for the diagnosis of neuromuscular problems and for assessing biomechanical and motor control deficits and other functional disorders. Furthermore, it can be used as a control signal for interfacing with orthotic and/or prosthetic devices or other rehabilitation assists. This book presents an updated overview of signal processing applications and recent developments in EMG from a number of diverse aspects and various applications in clinical and experimental research. It will provide readers with a detailed introduction to EMG signal processing techniques and applications, while presenting several new results and explanation of existing algorithms. This book is organized into 18 chapters, covering the current theoretical and practical approaches of EMG research

The "Federica" hand: a simple, very efficient prothesis

Hand prostheses partially restore hand appearance and functionalities. Not everyone can afford expensive prostheses and many low-cost prostheses have been proposed. In particular, 3D printers have provided great opportunities by simplifying the manufacturing process and reducing costs. Generally, active prostheses use multiple motors for fingers movement and are controlled by electromyographic (EMG) signals. The "Federica" hand is a single motor prosthesis, equipped with an adaptive grasp and controlled by a force-myographic signal. The "Federica" hand is 3D printed and has an anthropomorphic morphology with five fingers, each consisting of three phalanges. The movement generated by a single servomotor is transmitted to the fingers by inextensible tendons that form a closed chain; practically, no springs are used for passive hand opening. A differential mechanical system simultaneously distributes the motor force in predefined portions on each finger, regardless of their actual positions. Proportional control of hand closure is achieved by measuring the contraction of residual limb muscles by means of a force sensor, replacing the EMG. The electrical current of the servomotor is monitored to provide the user with a sensory feedback of the grip force, through a small vibration motor. A simple Arduino board was adopted as processing unit. The differential mechanism guarantees an efficient transfer of mechanical energy from the motor to the fingers and a secure grasp of any object, regardless of its shape and deformability. The force sensor, being extremely thin, can be easily embedded into the prosthesis socket and positioned on both muscles and tendons; it offers some advantages over the EMG as it does not require any electrical contact or signal processing to extract information about the muscle contraction intensity. The grip speed is high enough to allow the user to grab objects on the fly: from the muscle trigger until to the complete hand closure, "Federica" takes about half a second. The cost of the device is about 100 US$. Preliminary tests carried out on a patient with transcarpal amputation, showed high performances in controlling the prosthesis, after a very rapid training session. The "Federica" hand turned out to be a lightweight, low-cost and extremely efficient prosthesis. The project is intended to be open-source: all the information needed to produce the prosthesis (e.g. CAD files, circuit schematics, software) can be downloaded from a public repository. Thus, allowing everyone to use the "Federica" hand and customize or improve it