Proceedings of the first workshop on Peripheral Machine Interfaces: going beyond traditional surface electromyography

abstract: One of the hottest topics in rehabilitation robotics is that of proper control of prosthetic devices. Despite decades of research, the state of the art is dramatically behind the expectations. To shed light on this issue, in June, 2013 the first international workshop on Present and future of non-invasive peripheral nervous system (PNS)–Machine Interfaces (MI; PMI) was convened, hosted by the International Conference on Rehabilitation Robotics. The keyword PMI has been selected to denote human–machine interfaces targeted at the limb-deficient, mainly upper-limb amputees, dealing with signals gathered from the PNS in a non-invasive way, that is, from the surface of the residuum. The workshop was intended to provide an overview of the state of the art and future perspectives of such interfaces; this paper represents is a collection of opinions expressed by each and every researcher/group involved in it

Robust Electromyography Based Control of Multifunctional Prostheses of The Upper Extremity

Multifunctional, highly dexterous and complex mechanic hand prostheses are emerging and currently entering the market. However, the bottleneck to fully exploiting all capabilities of these mechatronic devices, and to making all available functions controllable reliably and intuitively by the users, remains a considerable challenge. The robustness of scientific methods proposed to overcome this barrier is a crucial factor for their future commercial success. Therefore, in this thesis the matter of robust, multifunctional and dexterous control of prostheses of the upper limb was addressed and some significant advancements in the scientific field were aspired. To this end, several investigations grouped in four studies were conducted, all with the same focus on understanding mechanisms that influence the robustness of myoelectric control and resolving their deteriorating effects. For the first study, a thorough literature review of the field was conducted and it was revealed that many non-stationarities, which could be expected to affect the reliability of surface EMG pattern recognition myoprosthesis control, had been identified and studied previously. However, one significant factor had not been addressed to a sufficient extent: the effect of long-term usage and day-to-day testing. Therefore, a dedicated study was designed and carried out, in order to address the previously unanswered question of how reliable surface electromyography pattern recognition was across days. Eleven subjects, involving both able-bodied and amputees, participated in this study over the course of 5 days, and a pattern recognition system was tested without daily retraining. As the main result of this study, it was revealed that the time between training and testing a classifier was indeed a very relevant factor influencing the classification accuracy. More estimation errors were observed as more time lay between the classifier training and testing. With the insights obtained from the first study, the need for compensating signal non-stationarities was identified. Hence, in a second study, building up on the data obtained from the first investigation, a self-correction mechanism was elaborated. The goal of this approach was to increase the systems robustness towards non-stationarities such as those identified in the first study. The system was capable of detecting and correcting its own mistakes, yielding a better estimation of movements than the uncorrected classification or other, previously proposed strategies for error removal. In the third part of this thesis, the previously investigated ideas for error suppression for increased robustness of a classification based system were extended to regression based movement estimation. While the same method as tested in the second study was not directly applicable to regression, the same underlying idea was used for developing a novel proportional estimator. It was validated in online tests, with the control of physical prostheses by able-bodied and transradial amputee subjects. The proposed method, based on common spatial patterns, outperformed two state-of-the art control methods, demonstrating the benefit of increased robustness in movement estimation during applied tasks. The results showed the superior performance of robust movement estimation in real life investigations, which would have hardly been observable in offline or abstract cursor control tests, underlining the importance of tests with physical prostheses. In the last part of this work, the limitation of sequential movements of the previously explored system was addressed and a methodology for enhancing the system with simultaneous and proportional control was developed. As a result of these efforts, a system robust, natural and fluent in its movements was conceived. Again, online control tests of physical prostheses were performed by able-bodied and amputee subjects, and the novel system proved to outperform the sequential controller of the third study of this thesis, yielding the best control technique tested. An extensive set of tests was conducted with both able-bodied and amputee subjects, in scenarios close to clinical routine. Custom prosthetic sockets were manufactured for all subjects, allowing for experimental control of multifunction prostheses with advanced machine learning based algorithms in real-life scenarios. The tests involved grasping and manipulating objects, in ways as they are often encountered in everyday living. Similar investigations had not been conducted before. One of the main conclusions of this thesis was that the suppression of wrong prosthetic motions was a key factor for robust prosthesis control and that simultaneous wrist control was a beneficial asset especially for experienced users. As a result of all investigations performed, clinically relevant conclusions were drawn from these tests, maximizing the impact of the developed systems on potential future commercialization of the newly conceived control methods. This was emphasized by the close collaboration with Otto Bock as an industrial partner of the AMYO project and hence this work.2016-02-2

A survey on bio-signal analysis for human-robot interaction

The use of bio-signals analysis in human-robot interaction is rapidly increasing. There is an urgent demand for it in various applications, including health care, rehabilitation, research, technology, and manufacturing. Despite several state-of-the-art bio-signals analyses in human-robot interaction (HRI) research, it is unclear which one is the best. In this paper, the following topics will be discussed: robotic systems should be given priority in the rehabilitation and aid of amputees and disabled people; second, domains of feature extraction approaches now in use, which are divided into three main sections (time, frequency, and time-frequency). The various domains will be discussed, then a discussion of each domain's benefits and drawbacks, and finally, a recommendation for a new strategy for robotic systems

Reducing the number of EMG electrodes during online hand gesture classification with changing wrist positions

Abstract Background Myoelectric control based on hand gesture classification can be used for effective, contactless human–machine interfacing in general applications (e.g., consumer market) as well as in the clinical context. However, the accuracy of hand gesture classification can be impacted by several factors including changing wrist position. The present study aimed at investigating how channel configuration (number and placement of electrode pads) affects performance in hand gesture recognition across wrist positions, with the overall goal of reducing the number of channels without the loss of performance with respect to the benchmark (all channels). Methods Matrix electrodes (256 channels) were used to record high-density EMG from the forearm of 13 healthy subjects performing a set of 8 gestures in 3 wrist positions and 2 force levels (low and moderate). A reduced set of channels was chosen by applying sequential forward selection (SFS) and simple circumferential placement (CIRC) and used for gesture classification with linear discriminant analysis. The classification success rate and task completion rate were the main outcome measures for offline analysis across the different number of channels and online control using 8 selected channels, respectively. Results The offline analysis demonstrated that good accuracy (> 90%) can be achieved with only a few channels. However, using data from all wrist positions required more channels to reach the same performance. Despite the targeted placement (SFS) performing similarly to CIRC in the offline analysis, the task completion rate [median (lower–upper quartile)] in the online control was significantly higher for SFS [71.4% (64.8–76.2%)] compared to CIRC [57.1% (51.8–64.8%), p < 0.01], especially for low contraction levels [76.2% (66.7–84.5%) for SFS vs. 57.1% (47.6–60.7%) for CIRC, p < 0.01]. For the reduced number of electrodes, the performance with SFS was comparable to that obtained when using the full matrix, while the selected electrodes were highly subject-specific. Conclusions The present study demonstrated that the number of channels required for gesture classification with changing wrist positions could be decreased substantially without loss of performance, if those channels are placed strategically along the forearm and individually for each subject. The results also emphasize the importance of online assessment and motivate the development of configurable matrix electrodes with integrated channel selection

On the Utility of Representation Learning Algorithms for Myoelectric Interfacing

Electrical activity produced by muscles during voluntary movement is a reflection of the firing patterns of relevant motor neurons and, by extension, the latent motor intent driving the movement. Once transduced via electromyography (EMG) and converted into digital form, this activity can be processed to provide an estimate of the original motor intent and is as such a feasible basis for non-invasive efferent neural interfacing. EMG-based motor intent decoding has so far received the most attention in the field of upper-limb prosthetics, where alternative means of interfacing are scarce and the utility of better control apparent. Whereas myoelectric prostheses have been available since the 1960s, available EMG control interfaces still lag behind the mechanical capabilities of the artificial limbs they are intended to steer—a gap at least partially due to limitations in current methods for translating EMG into appropriate motion commands. As the relationship between EMG signals and concurrent effector kinematics is highly non-linear and apparently stochastic, finding ways to accurately extract and combine relevant information from across electrode sites is still an active area of inquiry.This dissertation comprises an introduction and eight papers that explore issues afflicting the status quo of myoelectric decoding and possible solutions, all related through their use of learning algorithms and deep Artificial Neural Network (ANN) models. Paper I presents a Convolutional Neural Network (CNN) for multi-label movement decoding of high-density surface EMG (HD-sEMG) signals. Inspired by the successful use of CNNs in Paper I and the work of others, Paper II presents a method for automatic design of CNN architectures for use in myocontrol. Paper III introduces an ANN architecture with an appertaining training framework from which simultaneous and proportional control emerges. Paper Iv introduce a dataset of HD-sEMG signals for use with learning algorithms. Paper v applies a Recurrent Neural Network (RNN) model to decode finger forces from intramuscular EMG. Paper vI introduces a Transformer model for myoelectric interfacing that do not need additional training data to function with previously unseen users. Paper vII compares the performance of a Long Short-Term Memory (LSTM) network to that of classical pattern recognition algorithms. Lastly, paper vIII describes a framework for synthesizing EMG from multi-articulate gestures intended to reduce training burden