Higher order tensor decomposition for proportional myoelectric control based on muscle synergies

In the recent years, muscle synergies have been utilised to provide simultaneous and proportional myoelectric control systems. All of the proposed synergy-based systems relies on matrix factorisation methods to extract the muscle synergies which is limited in terms of task-dimensionality. Here, we seek to demonstrate and discuss the potential of higher-order tensor decompositions as a framework to estimate muscle synergies for proportional myoelectric control. We proposed synergy-based myoelectric control model by utilising muscle synergies extracted by a novel \ac{ctd} technique. Our approach is compared with \ac{NMF} \ac{SNMF}, the current state-of-the-art matrix factorisation models for synergy-based myoelectric control systems. Synergies extracted from three techniques where used to estimate control signals for wrist's \ac{dof} through regression. The reconstructed control signals where evaluated by real glove data that capture the wrist's kinematics. The proposed \ac{ctd} model results was slightly better than matrix factorisation methods. The three models where compared against random generated synergies and all of them were able to reject the null hypothesis. This study provides demonstrate the use of higher-order tensor decomposition in proportional myoelectric control and highlight the potential applications and advantages of using higher-order tensor decomposition in muscle synergy extraction

Real-time robustness evaluation of regression based myoelectric control against arm position change and donning/doffing

There are some practical factors, such as arm position change and donning/doffing, which prevent robust myoelectric control. The objective of this study is to precisely characterize the impacts of the two representative factors on myoelectric controllability in practical control situations, thereby providing useful references that can be potentially used to find better solutions for clinically reliable myoelectric control. To this end, a real-time target acquisition task was performed by fourteen subjects including one individual with congenital upper-limb deficiency, where the impacts of arm position change, donning/doffing and a combination of both factors on control performance was systematically evaluated. The changes in online performance were examined with seven different performance metrics to comprehensively evaluate various aspects of myoelectric controllability. As a result, arm position change significantly affects offline prediction accuracy, but not online control performance due to real-time feedback, thereby showing no significant correlation between offline and online performance. Donning/doffing was still problematic in online control conditions. It was further observed that no benefit was attained when using a control model trained with multiple position data in terms of arm position change, and the degree of electrode shift caused by donning/doffing was not severely associated with the degree of performance loss under practical conditions (around 1 cm electrode shift). Since this study is the first to concurrently investigate the impacts of arm position change and donning/doffing in practical myoelectric control situations, all findings of this study provide new insights into robust myoelectric control with respect to arm position change and donning/doffing.DFG, 325093850, Open Access Publizieren 2017 - 2018 / Technische Universität Berli

System training and assessment in simultaneous proportional myoelectric prosthesis control

Background Pattern recognition control of prosthetic hands take inputs from one or more myoelectric sensors and controls one or more degrees of freedom. However, most systems created allow only sequential control of one motion class at a time. Additionally, only recently have researchers demonstrated proportional myoelectric control in such systems, an option that is believed to make fine control easier for the user. Recent developments suggest improved reliability if the user follows a so-called prosthesis guided training (PGT) scheme. Methods In this study, a system for simultaneous proportional myoelectric control has been developed for a hand prosthesis with two motor functions (hand open/close, and wrist pro-/supination). The prosthesis has been used with a prosthesis socket equivalent designed for normally-limbed subjects. An extended version of PGT was developed for use with proportional control. The control system’s performance was tested for two subjects in the Clothespin Relocation Task and the Southampton Hand Assessment Procedure (SHAP). Simultaneous proportional control was compared with three other control strategies implemented on the same prosthesis: mutex proportional control (the same system but with simultaneous control disabled), mutex on-off control, and a more traditional, sequential proportional control system with co-contractions for state switching. Results The practical tests indicate that the simultaneous proportional control strategy and the two mutex-based pattern recognition strategies performed equally well, and superiorly to the more traditional sequential strategy according to the chosen outcome measures. Conclusions This is the first simultaneous proportional myoelectric control system demonstrated on a prosthesis affixed to the forearm of a subject. The study illustrates that PGT is a promising system training method for proportional control. Due to the limited number of subjects in this study, no definite conclusions can be drawn

Donning/Doffing and Arm Positioning Influence in Upper Limb Adaptive Prostheses Control

[EN] New upper limb prostheses controllers are continuously being proposed in the literature. However, most of the prostheses commonly used in the real world are based on very old basic controllers. One reason to explain this reluctance to change is the lack of robustness. Traditional controllers have been validated by many users and years, so the introduction of a new controller paradigm requires a lot of strong evidence of a robust behavior. In this work, we approach the robustness against donning/doffing and arm position for recently proposed linear filter adaptive controllers based on myoelectric signals. The adaptive approach allows to introduce some feedback in a natural way in real time in the human-machine collaboration, so it is not so sensitive to input signals changes due to donning/doffing and arm movements. The average completion rate and path efficiency obtained for eight able-bodied subjects donning/doffing five times in four days is 95.83% and 84.19%, respectively, and for four participants using different arm positions is 93.84% and 88.77%, with no statistically significant difference in the results obtained for the different conditions. All these characteristics make the adaptive linear regression a potential candidate for future real world prostheses controllers.This work is partially supported by Ministerio de Educacion, Cultura y Deporte (Spain) under grant FPU15/02870. The authors would like to thank Lucas Parra for the Myo device and Janne M. Hahne for discussions about the subject of the paper.Igual, C.; Camacho-García, A.; Bernabeu Soler, EJ.; Igual García, J. (2020). Donning/Doffing and Arm Positioning Influence in Upper Limb Adaptive Prostheses Control. Applied Sciences. 10(8):1-19. https://doi.org/10.3390/app10082892S119108Esquenazi, A. (2004). Amputation rehabilitation and prosthetic restoration. From surgery to community reintegration. Disability and Rehabilitation, 26(14-15), 831-836. doi:10.1080/09638280410001708850Ziegler-Graham, K., MacKenzie, E. J., Ephraim, P. L., Travison, T. G., & Brookmeyer, R. (2008). Estimating the Prevalence of Limb Loss in the United States: 2005 to 2050. Archives of Physical Medicine and Rehabilitation, 89(3), 422-429. doi:10.1016/j.apmr.2007.11.005Igual, C., Pardo, L. A., Hahne, J., & Igual, J. M. (2019). Myoelectric Control for Upper Limb Prostheses. Electronics, 8(11), 1244. doi:10.3390/electronics8111244Biddiss, E., & Chau, T. (2007). Upper-Limb Prosthetics. American Journal of Physical Medicine & Rehabilitation, 86(12), 977-987. doi:10.1097/phm.0b013e3181587f6cBiddiss, E. A., & Chau, T. T. (2007). Upper limb prosthesis use and abandonment. Prosthetics & Orthotics International, 31(3), 236-257. doi:10.1080/03093640600994581Davidson, J. (2002). A survey of the satisfaction of upper limb amputees with their prostheses, their lifestyles, and their abilities. Journal of Hand Therapy, 15(1), 62-70. doi:10.1053/hanthe.2002.v15.01562Datta, D., Selvarajah, K., & Davey, N. (2004). Functional outcome of patients with proximal upper limb deficiency–acquired and congenital. Clinical Rehabilitation, 18(2), 172-177. doi:10.1191/0269215504cr716oaVujaklija, I., Farina, D., & Aszmann, O. (2016). New developments in prosthetic arm systems. Orthopedic Research and Reviews, Volume 8, 31-39. doi:10.2147/orr.s71468Scheme, E. J., Englehart, K. B., & Hudgins, B. S. (2011). Selective Classification for Improved Robustness of Myoelectric Control Under Nonideal Conditions. IEEE Transactions on Biomedical Engineering, 58(6), 1698-1705. doi:10.1109/tbme.2011.2113182Englehart, K., & Hudgins, B. (2003). A robust, real-time control scheme for multifunction myoelectric control. IEEE Transactions on Biomedical Engineering, 50(7), 848-854. doi:10.1109/tbme.2003.813539Parker, P., Englehart, K., & Hudgins, B. (2006). Myoelectric signal processing for control of powered limb prostheses. Journal of Electromyography and Kinesiology, 16(6), 541-548. doi:10.1016/j.jelekin.2006.08.006Fougner, A., Stavdahl, Ø., Kyberd, P. J., Losier, Y. G., & Parker, P. A. (2012). Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 20(5), 663-677. doi:10.1109/tnsre.2012.2196711Resnik, L., Huang, H. (Helen), Winslow, A., Crouch, D. L., Zhang, F., & Wolk, N. (2018). Evaluation of EMG pattern recognition for upper limb prosthesis control: a case study in comparison with direct myoelectric control. Journal of NeuroEngineering and Rehabilitation, 15(1). doi:10.1186/s12984-018-0361-3Sartori, M., Durandau, G., Došen, S., & Farina, D. (2018). Robust simultaneous myoelectric control of multiple degrees of freedom in wrist-hand prostheses by real-time neuromusculoskeletal modeling. Journal of Neural Engineering, 15(6), 066026. doi:10.1088/1741-2552/aae26bVelliste, M., Perel, S., Spalding, M. C., Whitford, A. S., & Schwartz, A. B. (2008). Cortical control of a prosthetic arm for self-feeding. Nature, 453(7198), 1098-1101. doi:10.1038/nature06996Amsuess, S., Vujaklija, I., Goebel, P., Roche, A. D., Graimann, B., Aszmann, O. C., & Farina, D. (2016). Context-Dependent Upper Limb Prosthesis Control for Natural and Robust Use. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 24(7), 744-753. doi:10.1109/tnsre.2015.2454240Kuiken, T. A., Miller, L. A., Turner, K., & Hargrove, L. J. (2016). A Comparison of Pattern Recognition Control and Direct Control of a Multiple Degree-of-Freedom Transradial Prosthesis. IEEE Journal of Translational Engineering in Health and Medicine, 4, 1-8. doi:10.1109/jtehm.2016.2616123Phinyomark, A., N. Khushaba, R., & Scheme, E. (2018). Feature Extraction and Selection for Myoelectric Control Based on Wearable EMG Sensors. Sensors, 18(5), 1615. doi:10.3390/s18051615Asghari Oskoei, M., & Hu, H. (2007). Myoelectric control systems—A survey. Biomedical Signal Processing and Control, 2(4), 275-294. doi:10.1016/j.bspc.2007.07.009Spanias, J. A., Perreault, E. J., & Hargrove, L. J. (2016). Detection of and Compensation for EMG Disturbances for Powered Lower Limb Prosthesis Control. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 24(2), 226-234. doi:10.1109/tnsre.2015.2413393Castellini, C., & van der Smagt, P. (2008). Surface EMG in advanced hand prosthetics. Biological Cybernetics, 100(1), 35-47. doi:10.1007/s00422-008-0278-1Ameri, A., Akhaee, M. A., Scheme, E., & Englehart, K. (2019). Regression convolutional neural network for improved simultaneous EMG control. Journal of Neural Engineering, 16(3), 036015. doi:10.1088/1741-2552/ab0e2eHahne, J. M., Biebmann, F., Jiang, N., Rehbaum, H., Farina, D., Meinecke, F. C., … Parra, L. C. (2014). Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 22(2), 269-279. doi:10.1109/tnsre.2014.2305520Ameri, A., Scheme, E. J., Kamavuako, E. N., Englehart, K. B., & Parker, P. A. (2014). Real-Time, Simultaneous Myoelectric Control Using Force and Position-Based Training Paradigms. IEEE Transactions on Biomedical Engineering, 61(2), 279-287. doi:10.1109/tbme.2013.2281595Hochberg, L. R., Serruya, M. D., Friehs, G. M., Mukand, J. A., Saleh, M., Caplan, A. H., … Donoghue, J. P. (2006). Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature, 442(7099), 164-171. doi:10.1038/nature04970Interface Prostheses With Classifier-Feedback-Based User Training. (2017). IEEE Transactions on Biomedical Engineering, 64(11), 2575-2583. doi:10.1109/tbme.2016.2641584Thomas, N., Ung, G., McGarvey, C., & Brown, J. D. (2019). Comparison of vibrotactile and joint-torque feedback in a myoelectric upper-limb prosthesis. Journal of NeuroEngineering and Rehabilitation, 16(1). doi:10.1186/s12984-019-0545-5Guémann, M., Bouvier, S., Halgand, C., Borrini, L., Paclet, F., Lapeyre, E., … de Rugy, A. (2018). Sensory and motor parameter estimation for elbow myoelectric control with vibrotactile feedback. Annals of Physical and Rehabilitation Medicine, 61, e467. doi:10.1016/j.rehab.2018.05.1090Markovic, M., Schweisfurth, M. A., Engels, L. F., Farina, D., & Dosen, S. (2018). Myocontrol is closed-loop control: incidental feedback is sufficient for scaling the prosthesis force in routine grasping. Journal of NeuroEngineering and Rehabilitation, 15(1). doi:10.1186/s12984-018-0422-7Pasquina, P. F., Perry, B. N., Miller, M. E., Ling, G. S. F., & Tsao, J. W. (2015). Recent advances in bioelectric prostheses. Neurology: Clinical Practice, 5(2), 164-170. doi:10.1212/cpj.0000000000000132NING, J., & Dario, F. (2014). Myoelectric control of upper limb prosthesis: current status, challenges and recent advances. Frontiers in Neuroengineering, 7. doi:10.3389/conf.fneng.2014.11.00004Lendaro, E., Mastinu, E., Håkansson, B., & Ortiz-Catalan, M. (2017). Real-time Classification of Non-Weight Bearing Lower-Limb Movements Using EMG to Facilitate Phantom Motor Execution: Engineering and Case Study Application on Phantom Limb Pain. Frontiers in Neurology, 8. doi:10.3389/fneur.2017.00470Mastinu, E., Ortiz-Catalan, M., & Hakansson, B. (2015). Analog front-ends comparison in the way of a portable, low-power and low-cost EMG controller based on pattern recognition. 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). doi:10.1109/embc.2015.7318805BECK, T. W., HOUSH, T. J., CRAMER, J. T., MALEK, M. H., MIELKE, M., HENDRIX, R., & WEIR, J. P. (2008). Electrode Shift and Normalization Reduce the Innervation Zone’s Influence on EMG. Medicine & Science in Sports & Exercise, 40(7), 1314-1322. doi:10.1249/mss.0b013e31816c4822Pasquina, P. F., Evangelista, M., Carvalho, A. J., Lockhart, J., Griffin, S., Nanos, G., … Hankin, D. (2015). First-in-man demonstration of a fully implanted myoelectric sensors system to control an advanced electromechanical prosthetic hand. Journal of Neuroscience Methods, 244, 85-93. doi:10.1016/j.jneumeth.2014.07.016Fougner, A., Scheme, E., Chan, A. D. C., Englehart, K., & Stavdahl, Ø. (2011). Resolving the Limb Position Effect in Myoelectric Pattern Recognition. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 19(6), 644-651. doi:10.1109/tnsre.2011.2163529Hwang, H.-J., Hahne, J. M., & Müller, K.-R. (2017). Real-time robustness evaluation of regression based myoelectric control against arm position change and donning/doffing. PLOS ONE, 12(11), e0186318. doi:10.1371/journal.pone.0186318Young, A. J., Hargrove, L. J., & Kuiken, T. A. (2011). The Effects of Electrode Size and Orientation on the Sensitivity of Myoelectric Pattern Recognition Systems to Electrode Shift. IEEE Transactions on Biomedical Engineering, 58(9), 2537-2544. doi:10.1109/tbme.2011.2159216Prahm, C., Schulz, A., Paaben, B., Schoisswohl, J., Kaniusas, E., Dorffner, G., … Aszmann, O. (2019). Counteracting Electrode Shifts in Upper-Limb Prosthesis Control via Transfer Learning. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 27(5), 956-962. doi:10.1109/tnsre.2019.2907200Cipriani, C., Sassu, R., Controzzi, M., & Carrozza, M. C. (2011). Influence of the weight actions of the hand prosthesis on the performance of pattern recognition based myoelectric control: Preliminary study. 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. doi:10.1109/iembs.2011.6090468Amsuss, S., Paredes, L. P., Rudigkeit, N., Graimann, B., Herrmann, M. J., & Farina, D. (2013). Long term stability of surface EMG pattern classification for prosthetic control. 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). doi:10.1109/embc.2013.6610327Scheme, E., & Englehart, K. (2011). Electromyogram pattern recognition for control of powered upper-limb prostheses: State of the art and challenges for clinical use. The Journal of Rehabilitation Research and Development, 48(6), 643. doi:10.1682/jrrd.2010.09.0177Scheme, E., Fougner, A., Stavdahl, Ø., Chan, A. D. C., & Englehart, K. (2010). Examining the adverse effects of limb position on pattern recognition based myoelectric control. 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology. doi:10.1109/iembs.2010.5627638Dohnalek, P., Gajdos, P., & Peterek, T. (2013). Human activity recognition on raw sensor data via sparse approximation. 2013 36th International Conference on Telecommunications and Signal Processing (TSP). doi:10.1109/tsp.2013.6614027Marasco, P. D., Hebert, J. S., Sensinger, J. W., Shell, C. E., Schofield, J. S., Thumser, Z. C., … Orzell, B. M. (2018). Illusory movement perception improves motor control for prosthetic hands. Science Translational Medicine, 10(432). doi:10.1126/scitranslmed.aao6990Mastinu, E., Doguet, P., Botquin, Y., Hakansson, B., & Ortiz-Catalan, M. (2017). Embedded System for Prosthetic Control Using Implanted Neuromuscular Interfaces Accessed Via an Osseointegrated Implant. IEEE Transactions on Biomedical Circuits and Systems, 11(4), 867-877. doi:10.1109/tbcas.2017.2694710Igual, C., Igual, J., Hahne, J. M., & Parra, L. C. (2019). Adaptive Auto-Regressive Proportional Myoelectric Control. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 27(2), 314-322. doi:10.1109/tnsre.2019.2894464Huang, Y., Englehart, K. B., Hudgins, B., & Chan, A. D. C. (2005). A Gaussian Mixture Model Based Classification Scheme for Myoelectric Control of Powered Upper Limb Prostheses. IEEE Transactions on Biomedical Engineering, 52(11), 1801-1811. doi:10.1109/tbme.2005.856295Hahne, J. M., Dahne, S., Hwang, H.-J., Muller, K.-R., & Parra, L. C. (2015). Concurrent Adaptation of Human and Machine Improves Simultaneous and Proportional Myoelectric Control. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 23(4), 618-627. doi:10.1109/tnsre.2015.240113

Co-adaptive myoelectric control for upper limb prostheses

[ES] Mucha gente en el mundo se ve afectada por la pérdida de una extremidad (las predicciones estiman que en 2050 habrá más de 3 millones de personas afectadas únicamente en los Estados Unidos de América). A pesar de la continua mejora en las técnicas de amputación y la prostética, vivir sin una extremidad sigue limitando las actividades de los afectados en su vida diaria, provocando una disminución en su calidad de vida. En este trabajo nos centramos en los casos de amputaciones de extremidades superiores, entendiendo por ello la pérdida de cualquier parte del brazo o antebrazo. Esta tesis trata sobre el control mioeléctrico (potenciales eléctricos superficiales generados por la contracción de los músculos) de prótesis de extremidades superiores. Los estudios en este campo han crecido exponencialmente en las últimas décadas intentando reducir el hueco entre la parte investigadora más dinámica y propensa a los cambios e innovación (por ejemplo, usando técnicas como la inteligencia artificial) y la industria prostética, con una gran inercia y poco propensa a introducir cambios en sus controladores y dispositivos. El principal objetivo de esta tesis es desarrollar un nuevo controlador implementable basado en filtros adaptativos que supere los principales problemas del estado del arte. Desde el punto de vista teórico, podríamos considerar dos contribuciones principales. Primero, proponemos un nuevo sistema para modelar la relación entre los patrones de la señales mioélectricas y los movimientos deseados; este nuevo modelo tiene en cuenta a la hora de estimar la posición actual el valor de los estados pasados generando una nueva sinergia entre máquina y ser humano. En segundo lugar, introducimos un nuevo paradigma de entrenamiento más eficiente y personalizado autónomamente, el cual puede aplicarse no sólo a nuestro nuevo controlador, sino a otros regresores disponibles en la literatura. Como consecuencia de este nuevo protocolo, la estructura humano-máquina difiere con respecto del actual estado del arte en dos características: el proceso de aprendizaje del controlador y la estrategia para la generación de las señales de entrada. Como consecuencia directa de todo esto, el diseño de la fase experimental resulta mucho más complejo que con los controladores tradicionales. La dependencia de la posición actual de la prótesis con respecto a estados pasados fuerza a la realización de todos los experimentos de validación del nuevo controlador en tiempo real, algo costoso en recursos tanto humanos como de tiempo. Por lo tanto, una gran parte de esta tesis está dedicada al trabajo de campo necesario para validar el nuevo modelo y estrategia de entrenamiento. Como el objetivo final es proveer un nuevo controlador implementable, la última parte de la tesis está destinada a testear los métodos propuestos en casos reales, tanto en entornos simulados para validar su robustez ante rutinas diarias, como su uso en dispositivos prostéticos comerciales. Como conclusión, este trabajo propone un nuevo paradigma de control mioélectrico para prótesis que puede ser implementado en una prótesis real. Una vez se ha demostrado la viabilidad del sistema, la tesis propone futuras líneas de investigación, mostrando algunos resultados iniciales.[CA] Molta gent en el món es veu afectada per la pèrdua d'una extremitat (les prediccions estimen que en 2050 hi haurà més de 3 milions de persones afectades únicament als Estats Units d'Amèrica). Malgrat la contínua millora en les tècniques d'amputació i la prostètica, viure sense una extremitat continua limitant les activitats dels afectats en la seua vida diària, provocant una disminució en la seua qualitat de vida. En aquest treball ens centrem en els casos d'amputacions d'extremitats superiors, entenent per això la pèrdua de qualsevol part del braç o avantbraç. Aquesta tesi tracta sobre el control mioelèctric (potencials elèctrics superficials generats per la contracció dels músculs) de pròtesis d'extremitats superiors. Els estudis en aquest camp han crescut exponencialment en les últimes dècades intentant reduir el buit entre la part investigadora més dinàmica i propensa als canvis i innovació (per exemple, usant tècniques com la intel·ligència artificial) i la indústria prostètica, amb una gran inèrcia i poc propensa a introduir canvis en els seus controladors i dispositius. Aquesta tesi contribueix a la investigació des de diversos punts de vista. El principal objectiu és desenvolupar un nou controlador basat en filtres adaptatius que supere els principals problemes de l'estat de l'art. Des del punt de vista teòric, podríem considerar dues contribucions principals. Primer, proposem un nou sistema per a modelar la relació entre els patrons de la senyals mioelèctrics i els moviments desitjats; aquest nou model té en compte a l'hora d'estimar la posició actual el valor dels estats passats generant una nova sinergia entre màquina i ésser humà. En segon lloc, introduïm un nou paradigma d'entrenament més eficient i personalitzat autònomament, el qual pot aplicar-se no sols al nostre nou controlador, sinó a uns altres regresors disponibles en la literatura. Com a conseqüència d'aquest nou protocol, l'estructura humà-màquina difereix respecte a l'actual estat de l'art en dues característiques: el procés d'aprenentatge del controlador i l'estratègia per a la generació dels senyals d'entrada. Com a conseqüència directa de tot això, el disseny de la fase experimental resulta molt més complex que amb els controladors tradicionals. La dependència de la posició actual de la pròtesi respecte a estats passats força a la realització de tots els experiments de validació del nou controlador en temps real, una cosa costosa en recursos tant humans com de temps. Per tant, una gran part d'aquesta tesi està dedicada al treball de camp necessari per a validar el nou model i estratègia d'entrenament. Com l'objectiu final és proveir un nou controlador implementable, l'última part de la tesi està destinada a testar els mètodes proposats en casos reals, tant en entorns simulats per a validar la seua robustesa davant rutines diàries, com el seu ús en dispositius prostètics comercials. Com a conclusió, aquest treball proposa un nou paradigma de control mioelèctric per a pròtesi que pot ser implementat en una pròtesi real. Una vegada s'ha demostrat la viabilitat del sistema, la tesi proposa futures línies d'investigació, mostrant alguns resultats inicials.[EN] Many people in the world suffer from the loss of a limb (predictions estimate more than 3 million people by 2050 only in the USA). In spite of the continuous improvement in the amputation rehabilitation and prosthetic restoration, living without a limb keeps limiting the daily life activities leading to a lower quality of life. In this work, we focus in the upper limb amputation case, i.e., the removal of any part of the arm or forearm. This thesis is about upper limb prosthesis control using electromyographic signals (the superficial electric potentials generated during muscle contractions). Studies in this field have grown exponentially in the past decades trying to reduce the gap between a fast growing prosthetic research field, with the introduction of machine learning, and a slower prosthetic industry and limited manufacturing innovation. This thesis contributes to the field from different perspectives. The main goal is to provide and implementable new controller based on adaptive filtering that overcomes the most common state of the art concerns. From the theoretical point of view, there are two main contributions. First, we propose a new system to model the relationship between electromyographic signals and the desired prosthesis movements; this new model takes into account previous states for the estimation of the current position generating a new human-machine synergy. Second, we introduce a new and more efficient autonomously personalized training paradigm, which can benefit not only to our new proposed controller but also other state of the art regressors. As a consequence of this new protocol, the human-machine structure differs with respect to current state of the art in two features: the controller learning process and the input signal generation strategy. As a direct aftereffect of all of this, the experimental phase design results more complex than with traditional controllers. The current state dependency on past states forces the experimentation to be in real time, a very high demanding task in human and time resources. Therefore, a major part of this thesis is the associated fieldwork needed to validate the new model and training strategy. Since the final goal is to provide an implementable new controller, the last part of the thesis is devoted to test the proposed methods in real cases, not only analyzing the robustness and reliability of the controller in real life situations but in real prosthetic devices. As a conclusion, this work provides a new paradigm for the myoelectric prosthetic control that can be implemented in a real device. Once the thesis has proven the system's viability, future work should continue with the development of a physical device where all these ideas are deployed and used by final patients in a daily basis.The work of Carles Igual Bañó to carry out this research and elaborate this dissertation has been supported by the Ministerio de Educación, Cultura y Deporte under the FPU Grant FPU15/02870. One visiting research fellowships (EST18/00544) was also funded by the Ministerio de Educación, Cultura y Deporte of Spain.Igual Bañó, C. (2021). Co-adaptive myoelectric control for upper limb prostheses [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/168192TESI

Biceps brachii synergy and its contribution to target reaching tasks within a virtual cube

Ces dernières années, des travaux importants ont été observés dans le développement du contrôle prothétique afin d'aider les personnes amputées du membre supérieur à améliorer leur qualité de vie au quotidien. Certaines prothèses myoélectriques modernes des membres supérieurs disponibles dans le commerce ont de nombreux degrés de liberté et nécessitent de nombreux signaux de contrôle pour réaliser plusieurs tâches fréquemment utilisées dans la vie quotidienne. Pour obtenir plusieurs signaux de contrôle, de nombreux muscles sont requis mais pour les personnes ayant subi une amputation du membre supérieur, le nombre de muscles disponibles est plus ou moins réduit selon le niveau de l’amputation. Pour accroître le nombre de signaux de contrôle, nous nous sommes intéressés au biceps brachial, vu qu’anatomiquement il est formé de 2 chefs et que de la présence de compartiments a été observée sur sa face interne. Physiologiquement, il a été trouvé que les unités motrices du biceps sont activées à différents endroits du muscle lors de la production de diverses tâches fonctionnelles. De plus, il semblerait que le système nerveux central puisse se servir de la synergie musculaire pour arriver à facilement produire plusieurs mouvements. Dans un premier temps on a donc identifié que la synergie musculaire était présente chez le biceps de sujets normaux et on a montré que les caractéristiques de cette synergie permettaient d’identifier la posture statique de la main lorsque les signaux du biceps avaient été enregistrés. Dans un deuxième temps, on a réussi à démontrer qu’il était possible, dans un cube présenté sur écran, à contrôler la position d’une sphère en vue d’atteindre diverses cibles en utilisant la synergie musculaire du biceps. Les techniques de classification utilisées pourraient servir à faciliter le contrôle des prothèses myoélectriques.In recent years, important work has been done in the development of prosthetic control to help upper limb amputees improve their quality of life on a daily basis. Some modern commercially available upper limb myoelectric prostheses have many degrees of freedom and require many control signals to perform several tasks commonly used in everyday life. To obtain several control signals, many muscles are required, but for people with upper limb amputation, the number of muscles available is more or less reduced, depending on the level of amputation. To increase the number of control signals, we were interested in the biceps brachii, since it is anatomically composed of 2 heads and the presence of compartments was observed on its internal face. Physiologically, it has been found that the motor units of the biceps are activated at different places of the muscle during production of various functional tasks. In addition, it appears that the central nervous system can use muscle synergy to easily produce multiple movements. In this research, muscle synergy was first identified to be present in the biceps of normal subjects, and it was shown that the characteristics of this synergy allowed the identification of static posture of the hand when the biceps signals had been recorded. In a second investigation, we demonstrated that it was possible in a virtual cube presented on a screen to control online the position of a sphere to reach various targets by using muscle synergy of the biceps. Classification techniques have been used to improve the classification of muscular synergy features, and these classification techniques can be integrated with control algorithm that produces dynamic movement of myoelectric prostheses to facilitate the training of prosthetic control

On the Utility of Representation Learning Algorithms for Myoelectric Interfacing

Electrical activity produced by muscles during voluntary movement is a reflection of the firing patterns of relevant motor neurons and, by extension, the latent motor intent driving the movement. Once transduced via electromyography (EMG) and converted into digital form, this activity can be processed to provide an estimate of the original motor intent and is as such a feasible basis for non-invasive efferent neural interfacing. EMG-based motor intent decoding has so far received the most attention in the field of upper-limb prosthetics, where alternative means of interfacing are scarce and the utility of better control apparent. Whereas myoelectric prostheses have been available since the 1960s, available EMG control interfaces still lag behind the mechanical capabilities of the artificial limbs they are intended to steer—a gap at least partially due to limitations in current methods for translating EMG into appropriate motion commands. As the relationship between EMG signals and concurrent effector kinematics is highly non-linear and apparently stochastic, finding ways to accurately extract and combine relevant information from across electrode sites is still an active area of inquiry.This dissertation comprises an introduction and eight papers that explore issues afflicting the status quo of myoelectric decoding and possible solutions, all related through their use of learning algorithms and deep Artificial Neural Network (ANN) models. Paper I presents a Convolutional Neural Network (CNN) for multi-label movement decoding of high-density surface EMG (HD-sEMG) signals. Inspired by the successful use of CNNs in Paper I and the work of others, Paper II presents a method for automatic design of CNN architectures for use in myocontrol. Paper III introduces an ANN architecture with an appertaining training framework from which simultaneous and proportional control emerges. Paper Iv introduce a dataset of HD-sEMG signals for use with learning algorithms. Paper v applies a Recurrent Neural Network (RNN) model to decode finger forces from intramuscular EMG. Paper vI introduces a Transformer model for myoelectric interfacing that do not need additional training data to function with previously unseen users. Paper vII compares the performance of a Long Short-Term Memory (LSTM) network to that of classical pattern recognition algorithms. Lastly, paper vIII describes a framework for synthesizing EMG from multi-articulate gestures intended to reduce training burden

High performance wearable ultrasound as a human-machine interface for wrist and hand kinematic tracking

Objective: Non-invasive human machine interfaces (HMIs) have high potential in medical, entertainment, and industrial applications. Traditionally, surface electromyography (sEMG) has been used to track muscular activity and infer motor intention. Ultrasound (US) has received increasing attention as an alternative to sEMG-based HMIs. Here, we developed a portable US armband system with 24 channels and a multiple receiver approach, and compared it with existing sEMG- and US-based HMIs on movement intention decoding. Methods: US and motion capture data was recorded while participants performed wrist and hand movements of four degrees of freedom (DoFs) and their combinations. A linear regression model was used to offline predict hand kinematics from the US (or sEMG, for comparison) features. The method was further validated in real-time for a 3-DoF target reaching task. Results: In the offline analysis, the wearable US system achieved an average R2 of 0.94 in the prediction of four DoFs of the wrist and hand while sEMG reached a performance of R2=0.06 . In online control, the participants achieved an average 93% completion rate of the targets. Conclusion: When tailored for HMIs, the proposed US A-mode system and processing pipeline can successfully regress hand kinematics both in offline and online settings with performances comparable or superior to previously published interfaces. Significance: Wearable US technology may provide a new generation of HMIs that use muscular deformation to estimate limb movements. The wearable US system allowed for robust proportional and simultaneous control over multiple DoFs in both offline and online settings