Donning/Doffing and Arm Positioning Influence in Upper Limb Adaptive Prostheses Control

[EN] New upper limb prostheses controllers are continuously being proposed in the literature. However, most of the prostheses commonly used in the real world are based on very old basic controllers. One reason to explain this reluctance to change is the lack of robustness. Traditional controllers have been validated by many users and years, so the introduction of a new controller paradigm requires a lot of strong evidence of a robust behavior. In this work, we approach the robustness against donning/doffing and arm position for recently proposed linear filter adaptive controllers based on myoelectric signals. The adaptive approach allows to introduce some feedback in a natural way in real time in the human-machine collaboration, so it is not so sensitive to input signals changes due to donning/doffing and arm movements. The average completion rate and path efficiency obtained for eight able-bodied subjects donning/doffing five times in four days is 95.83% and 84.19%, respectively, and for four participants using different arm positions is 93.84% and 88.77%, with no statistically significant difference in the results obtained for the different conditions. All these characteristics make the adaptive linear regression a potential candidate for future real world prostheses controllers.This work is partially supported by Ministerio de Educacion, Cultura y Deporte (Spain) under grant FPU15/02870. The authors would like to thank Lucas Parra for the Myo device and Janne M. Hahne for discussions about the subject of the paper.Igual, C.; Camacho-García, A.; Bernabeu Soler, EJ.; Igual García, J. (2020). Donning/Doffing and Arm Positioning Influence in Upper Limb Adaptive Prostheses Control. Applied Sciences. 10(8):1-19. https://doi.org/10.3390/app10082892S119108Esquenazi, A. (2004). Amputation rehabilitation and prosthetic restoration. From surgery to community reintegration. Disability and Rehabilitation, 26(14-15), 831-836. doi:10.1080/09638280410001708850Ziegler-Graham, K., MacKenzie, E. J., Ephraim, P. L., Travison, T. G., & Brookmeyer, R. (2008). Estimating the Prevalence of Limb Loss in the United States: 2005 to 2050. Archives of Physical Medicine and Rehabilitation, 89(3), 422-429. doi:10.1016/j.apmr.2007.11.005Igual, C., Pardo, L. A., Hahne, J., & Igual, J. M. (2019). Myoelectric Control for Upper Limb Prostheses. Electronics, 8(11), 1244. doi:10.3390/electronics8111244Biddiss, E., & Chau, T. (2007). Upper-Limb Prosthetics. American Journal of Physical Medicine & Rehabilitation, 86(12), 977-987. doi:10.1097/phm.0b013e3181587f6cBiddiss, E. A., & Chau, T. T. (2007). Upper limb prosthesis use and abandonment. Prosthetics & Orthotics International, 31(3), 236-257. doi:10.1080/03093640600994581Davidson, J. (2002). A survey of the satisfaction of upper limb amputees with their prostheses, their lifestyles, and their abilities. Journal of Hand Therapy, 15(1), 62-70. doi:10.1053/hanthe.2002.v15.01562Datta, D., Selvarajah, K., & Davey, N. (2004). Functional outcome of patients with proximal upper limb deficiency–acquired and congenital. Clinical Rehabilitation, 18(2), 172-177. doi:10.1191/0269215504cr716oaVujaklija, I., Farina, D., & Aszmann, O. (2016). New developments in prosthetic arm systems. Orthopedic Research and Reviews, Volume 8, 31-39. doi:10.2147/orr.s71468Scheme, E. J., Englehart, K. B., & Hudgins, B. S. (2011). Selective Classification for Improved Robustness of Myoelectric Control Under Nonideal Conditions. IEEE Transactions on Biomedical Engineering, 58(6), 1698-1705. doi:10.1109/tbme.2011.2113182Englehart, K., & Hudgins, B. (2003). A robust, real-time control scheme for multifunction myoelectric control. IEEE Transactions on Biomedical Engineering, 50(7), 848-854. doi:10.1109/tbme.2003.813539Parker, P., Englehart, K., & Hudgins, B. (2006). Myoelectric signal processing for control of powered limb prostheses. Journal of Electromyography and Kinesiology, 16(6), 541-548. doi:10.1016/j.jelekin.2006.08.006Fougner, A., Stavdahl, Ø., Kyberd, P. J., Losier, Y. G., & Parker, P. A. (2012). Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 20(5), 663-677. doi:10.1109/tnsre.2012.2196711Resnik, L., Huang, H. (Helen), Winslow, A., Crouch, D. L., Zhang, F., & Wolk, N. (2018). Evaluation of EMG pattern recognition for upper limb prosthesis control: a case study in comparison with direct myoelectric control. Journal of NeuroEngineering and Rehabilitation, 15(1). doi:10.1186/s12984-018-0361-3Sartori, M., Durandau, G., Došen, S., & Farina, D. (2018). Robust simultaneous myoelectric control of multiple degrees of freedom in wrist-hand prostheses by real-time neuromusculoskeletal modeling. Journal of Neural Engineering, 15(6), 066026. doi:10.1088/1741-2552/aae26bVelliste, M., Perel, S., Spalding, M. C., Whitford, A. S., & Schwartz, A. B. (2008). Cortical control of a prosthetic arm for self-feeding. Nature, 453(7198), 1098-1101. doi:10.1038/nature06996Amsuess, S., Vujaklija, I., Goebel, P., Roche, A. D., Graimann, B., Aszmann, O. C., & Farina, D. (2016). Context-Dependent Upper Limb Prosthesis Control for Natural and Robust Use. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 24(7), 744-753. doi:10.1109/tnsre.2015.2454240Kuiken, T. A., Miller, L. A., Turner, K., & Hargrove, L. J. (2016). A Comparison of Pattern Recognition Control and Direct Control of a Multiple Degree-of-Freedom Transradial Prosthesis. IEEE Journal of Translational Engineering in Health and Medicine, 4, 1-8. doi:10.1109/jtehm.2016.2616123Phinyomark, A., N. Khushaba, R., & Scheme, E. (2018). Feature Extraction and Selection for Myoelectric Control Based on Wearable EMG Sensors. Sensors, 18(5), 1615. doi:10.3390/s18051615Asghari Oskoei, M., & Hu, H. (2007). Myoelectric control systems—A survey. Biomedical Signal Processing and Control, 2(4), 275-294. doi:10.1016/j.bspc.2007.07.009Spanias, J. A., Perreault, E. J., & Hargrove, L. J. (2016). Detection of and Compensation for EMG Disturbances for Powered Lower Limb Prosthesis Control. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 24(2), 226-234. doi:10.1109/tnsre.2015.2413393Castellini, C., & van der Smagt, P. (2008). Surface EMG in advanced hand prosthetics. Biological Cybernetics, 100(1), 35-47. doi:10.1007/s00422-008-0278-1Ameri, A., Akhaee, M. A., Scheme, E., & Englehart, K. (2019). Regression convolutional neural network for improved simultaneous EMG control. Journal of Neural Engineering, 16(3), 036015. doi:10.1088/1741-2552/ab0e2eHahne, J. M., Biebmann, F., Jiang, N., Rehbaum, H., Farina, D., Meinecke, F. C., … Parra, L. C. (2014). Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 22(2), 269-279. doi:10.1109/tnsre.2014.2305520Ameri, A., Scheme, E. J., Kamavuako, E. N., Englehart, K. B., & Parker, P. A. (2014). Real-Time, Simultaneous Myoelectric Control Using Force and Position-Based Training Paradigms. IEEE Transactions on Biomedical Engineering, 61(2), 279-287. doi:10.1109/tbme.2013.2281595Hochberg, L. R., Serruya, M. D., Friehs, G. M., Mukand, J. A., Saleh, M., Caplan, A. H., … Donoghue, J. P. (2006). Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature, 442(7099), 164-171. doi:10.1038/nature04970Interface Prostheses With Classifier-Feedback-Based User Training. (2017). IEEE Transactions on Biomedical Engineering, 64(11), 2575-2583. doi:10.1109/tbme.2016.2641584Thomas, N., Ung, G., McGarvey, C., & Brown, J. D. (2019). Comparison of vibrotactile and joint-torque feedback in a myoelectric upper-limb prosthesis. Journal of NeuroEngineering and Rehabilitation, 16(1). doi:10.1186/s12984-019-0545-5Guémann, M., Bouvier, S., Halgand, C., Borrini, L., Paclet, F., Lapeyre, E., … de Rugy, A. (2018). Sensory and motor parameter estimation for elbow myoelectric control with vibrotactile feedback. Annals of Physical and Rehabilitation Medicine, 61, e467. doi:10.1016/j.rehab.2018.05.1090Markovic, M., Schweisfurth, M. A., Engels, L. F., Farina, D., & Dosen, S. (2018). Myocontrol is closed-loop control: incidental feedback is sufficient for scaling the prosthesis force in routine grasping. Journal of NeuroEngineering and Rehabilitation, 15(1). doi:10.1186/s12984-018-0422-7Pasquina, P. F., Perry, B. N., Miller, M. E., Ling, G. S. F., & Tsao, J. W. (2015). Recent advances in bioelectric prostheses. Neurology: Clinical Practice, 5(2), 164-170. doi:10.1212/cpj.0000000000000132NING, J., & Dario, F. (2014). Myoelectric control of upper limb prosthesis: current status, challenges and recent advances. Frontiers in Neuroengineering, 7. doi:10.3389/conf.fneng.2014.11.00004Lendaro, E., Mastinu, E., Håkansson, B., & Ortiz-Catalan, M. (2017). Real-time Classification of Non-Weight Bearing Lower-Limb Movements Using EMG to Facilitate Phantom Motor Execution: Engineering and Case Study Application on Phantom Limb Pain. Frontiers in Neurology, 8. doi:10.3389/fneur.2017.00470Mastinu, E., Ortiz-Catalan, M., & Hakansson, B. (2015). Analog front-ends comparison in the way of a portable, low-power and low-cost EMG controller based on pattern recognition. 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). doi:10.1109/embc.2015.7318805BECK, T. W., HOUSH, T. J., CRAMER, J. T., MALEK, M. H., MIELKE, M., HENDRIX, R., & WEIR, J. P. (2008). Electrode Shift and Normalization Reduce the Innervation Zone’s Influence on EMG. Medicine & Science in Sports & Exercise, 40(7), 1314-1322. doi:10.1249/mss.0b013e31816c4822Pasquina, P. F., Evangelista, M., Carvalho, A. J., Lockhart, J., Griffin, S., Nanos, G., … Hankin, D. (2015). First-in-man demonstration of a fully implanted myoelectric sensors system to control an advanced electromechanical prosthetic hand. Journal of Neuroscience Methods, 244, 85-93. doi:10.1016/j.jneumeth.2014.07.016Fougner, A., Scheme, E., Chan, A. D. C., Englehart, K., & Stavdahl, Ø. (2011). Resolving the Limb Position Effect in Myoelectric Pattern Recognition. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 19(6), 644-651. doi:10.1109/tnsre.2011.2163529Hwang, H.-J., Hahne, J. M., & Müller, K.-R. (2017). Real-time robustness evaluation of regression based myoelectric control against arm position change and donning/doffing. PLOS ONE, 12(11), e0186318. doi:10.1371/journal.pone.0186318Young, A. J., Hargrove, L. J., & Kuiken, T. A. (2011). The Effects of Electrode Size and Orientation on the Sensitivity of Myoelectric Pattern Recognition Systems to Electrode Shift. IEEE Transactions on Biomedical Engineering, 58(9), 2537-2544. doi:10.1109/tbme.2011.2159216Prahm, C., Schulz, A., Paaben, B., Schoisswohl, J., Kaniusas, E., Dorffner, G., … Aszmann, O. (2019). Counteracting Electrode Shifts in Upper-Limb Prosthesis Control via Transfer Learning. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 27(5), 956-962. doi:10.1109/tnsre.2019.2907200Cipriani, C., Sassu, R., Controzzi, M., & Carrozza, M. C. (2011). Influence of the weight actions of the hand prosthesis on the performance of pattern recognition based myoelectric control: Preliminary study. 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. doi:10.1109/iembs.2011.6090468Amsuss, S., Paredes, L. P., Rudigkeit, N., Graimann, B., Herrmann, M. J., & Farina, D. (2013). Long term stability of surface EMG pattern classification for prosthetic control. 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). doi:10.1109/embc.2013.6610327Scheme, E., & Englehart, K. (2011). Electromyogram pattern recognition for control of powered upper-limb prostheses: State of the art and challenges for clinical use. The Journal of Rehabilitation Research and Development, 48(6), 643. doi:10.1682/jrrd.2010.09.0177Scheme, E., Fougner, A., Stavdahl, Ø., Chan, A. D. C., & Englehart, K. (2010). Examining the adverse effects of limb position on pattern recognition based myoelectric control. 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology. doi:10.1109/iembs.2010.5627638Dohnalek, P., Gajdos, P., & Peterek, T. (2013). Human activity recognition on raw sensor data via sparse approximation. 2013 36th International Conference on Telecommunications and Signal Processing (TSP). doi:10.1109/tsp.2013.6614027Marasco, P. D., Hebert, J. S., Sensinger, J. W., Shell, C. E., Schofield, J. S., Thumser, Z. C., … Orzell, B. M. (2018). Illusory movement perception improves motor control for prosthetic hands. Science Translational Medicine, 10(432). doi:10.1126/scitranslmed.aao6990Mastinu, E., Doguet, P., Botquin, Y., Hakansson, B., & Ortiz-Catalan, M. (2017). Embedded System for Prosthetic Control Using Implanted Neuromuscular Interfaces Accessed Via an Osseointegrated Implant. IEEE Transactions on Biomedical Circuits and Systems, 11(4), 867-877. doi:10.1109/tbcas.2017.2694710Igual, C., Igual, J., Hahne, J. M., & Parra, L. C. (2019). Adaptive Auto-Regressive Proportional Myoelectric Control. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 27(2), 314-322. doi:10.1109/tnsre.2019.2894464Huang, Y., Englehart, K. B., Hudgins, B., & Chan, A. D. C. (2005). A Gaussian Mixture Model Based Classification Scheme for Myoelectric Control of Powered Upper Limb Prostheses. IEEE Transactions on Biomedical Engineering, 52(11), 1801-1811. doi:10.1109/tbme.2005.856295Hahne, J. M., Dahne, S., Hwang, H.-J., Muller, K.-R., & Parra, L. C. (2015). Concurrent Adaptation of Human and Machine Improves Simultaneous and Proportional Myoelectric Control. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 23(4), 618-627. doi:10.1109/tnsre.2015.240113

A compact system for simultaneous stimulation and recording for closed-loop myoelectric control

Background.Despite important advancements in control and mechatronics of myoelectric prostheses, the communication between the user and his/her bionic limb is still unidirectional, as these systems do not provide somatosensory feedback. Electrotactile stimulation is an attractive technology to close the control loop since it allows flexible modulation of multiple parameters and compact interface design via multi-pad electrodes. However, the stimulation interferes with the recording of myoelectric signals and this can be detrimental to control.The work in this study was supported by the project ROBIN (8022-00243A and 8022-00226B) funded by the Independent Research Fund Denmark

Myoelectric Human Computer Interaction Using Reliable Temporal Sequence-based Myoelectric Classification for Dynamic Hand Gestures

To put a computerized device under human control, various interface techniques have been commonly studied in the realm of Human Computer Interaction (HCI) design. What this dissertation focuses on is a myoelectric interface, which controls a device via neuromuscular electrical signals. Myoelectric interface has advanced by recognizing repeated patterns of the signal (pattern recognition-based myoelectric classification). However, when the myoelectric classification is used to extract multiple discrete states within limited muscle sites, there are robustness issues due to external conditions: limb position changes, electrode shifts, and skin condition changes. Examined in this dissertation is the robustness issue, or drop in the performance of the myoelectric classification when the limb position varies from the position where the system was trained. Two research goals outlined in this dissertation are to increase reliability of myoelectric system and to build a myoelectric HCI to manipulate a 6-DOF robot arm with a 1-DOF gripper. To tackle the robustness issue, the proposed method uses dynamic motions which change their poses and configuration over time. The method assumes that using dynamic motions is more reliable, vis-a-vis the robustness issues, than using static motions. The robustness of the method is evaluated by choosing the training sets and validation sets at different limb positions. Next, an HCI system manipulating a 6-DOF robot arm with a 1-DOF gripper is introduced. The HCI system includes an inertia measurement unit to measure the limb orientation, as well as EMG sensors to acquire muscle force and to classify dynamic motions. Muscle force and the orientation of a forearm are used to generate velocity commands. Classified dynamic motions are used to change the manipulation modes. The performance of the myoelectric interface is measured in terms of real-time classification accuracy, path efficiency, and time-related measures. In conclusion, this dissertation proposes a reliable myoelectric classification and develops a myoelectric interface using the proposed classification method for an HCI application. The robustness of the proposed myoelectric classification is verified as compared to previous myoelectric classification approaches. The usability of the developed myoelectric interface is compared to a well-known interface

AN INVESTIGATION OF ELECTROMYOGRAPHIC (EMG) CONTROL OF DEXTROUS HAND PROSTHESES FOR TRANSRADIAL AMPUTEES

In reference to IEEE copyrighted material which is used with permission in this thesis, the IEEE does not endorse any of Plymouth University's products or services.There are many amputees around the world who have lost a limb through conflict, disease or an accident. Upper-limb prostheses controlled using surface Electromyography (sEMG) offer a solution to help the amputees; however, their functionality is limited by the small number of movements they can perform and their slow reaction times. Pattern recognition (PR)-based EMG control has been proposed to improve the functional performance of prostheses. It is a very promising approach, offering intuitive control, fast reaction times and the ability to control a large number of degrees of freedom (DOF). However, prostheses controlled with PR systems are not available for everyday use by amputees, because there are many major challenges and practical problems that need to be addressed before clinical implementation is possible. These include lack of individual finger control, an impractically large number of EMG electrodes, and the lack of deployment protocols for EMG electrodes site selection and movement optimisation. Moreover, the inability of PR systems to handle multiple forces is a further practical problem that needs to be addressed. The main aim of this project is to investigate the research challenges mentioned above via non-invasive EMG signal acquisition, and to propose practical solutions to help amputees. In a series of experiments, the PR systems presented here were tested with EMG signals acquired from seven transradial amputees, which is unique to this project. Previous studies have been conducted using non-amputees. In this work, the challenges described are addressed and a new protocol is proposed that delivers a fast clinical deployment of multi-functional upper limb prostheses controlled by PR systems. Controlling finger movement is a step towards the restoration of lost human capabilities, and is psychologically important, as well as physically. A central thread running through this work is the assertion that no two amputees are the same, each suffering different injuries and retaining differing nerve and muscle structures. This work is very much about individualised healthcare, and aims to provide the best possible solution for each affected individual on a case-by-case basis. Therefore, the approach has been to optimise the solution (in terms of function and reliability) for each individual, as opposed to developing a generic solution, where performance is optimised against a test population. This work is unique, in that it contributes to improving the quality of life for each individual amputee by optimising function and reliability. The main four contributions of the thesis are as follows: 1- Individual finger control was achieved with high accuracy for a large number of finger movements, using six optimally placed sEMG channels. This was validated on EMG signals for ten non-amputee and six amputee subjects. Thumb movements were classified successfully with high accuracy for the first time. The outcome of this investigation will help to add more movements to the prosthesis, and reduce hardware and computational complexity. 2- A new subject-specific protocol for sEMG site selection and reliable movement subset optimisation, based on the amputee’s needs, has been proposed and validated on seven amputees. This protocol will help clinicians to perform an efficient and fast deployment of prostheses, by finding the optimal number and locations of EMG channels. It will also find a reliable subset of movements that can be achieved with high performance. 3- The relationship between the force of contraction and the statistics of EMG signals has been investigated, utilising an experimental design where visual feedback from a Myoelectric Control Interface (MCI) helped the participants to produce the correct level of force. Kurtosis values were found to decrease monotonically when the contraction level increased, thus indicating that kurtosis can be used to distinguish different forces of contractions. 4- The real practical problem of the degradation of classification performance as a result of the variation of force levels during daily use of the prosthesis has been investigated, and solved by proposing a training approach and the use of a robust feature extraction method, based on the spectrum. The recommendations of this investigation improve the practical robustness of prostheses controlled with PR systems and progress a step further towards clinical implementation and improving the quality of life of amputees. The project showed that PR systems achieved a reliable performance for a large number of amputees, taking into account real life issues such as individual finger control for high dexterity, the effect of force level variation, and optimisation of the movements and EMG channels for each individual amputee. The findings of this thesis showed that the PR systems need to be appropriately tuned before usage, such as training with multiple forces to help to reduce the effect of force variation, aiming to improve practical robustness, and also finding the optimal EMG channel for each amputee, to improve the PR system’s performance. The outcome of this research enables the implementation of PR systems in real prostheses that can be used by amputees.Ministry of Higher Education and Scientific Research and Baghdad University- Baghdad/Ira