Design and Assessment of Control Maps for Multi-Channel sEMG-Driven Prostheses and Supernumerary Limbs

Proportional and simultaneous control algorithms are considered as one of the most effective ways of mapping electromyographic signals to an artificial device. However, the applicability of these methods is limited by the high number of electromyographic features that they require to operate—typically twice as many the actuators to be controlled. Indeed, extracting many independent electromyographic signals is challenging for a number of reasons—ranging from technological to anatomical. On the contrary, the number of actively moving parts in classic prostheses or extra-limbs is often high. This paper faces this issue, by proposing and experimentally assessing a set of algorithms which are capable of proportionally and simultaneously control as many actuators as there are independent electromyographic signals available. Two sets of solutions are considered. The first uses as input electromyographic signals only, while the second adds postural measurements to the sources of information. At first, all the proposed algorithms are experimentally tested in terms of precision, efficiency, and usability on twelve able-bodied subjects, in a virtual environment. A state-of-the-art controller using twice the amount of electromyographic signals as input is adopted as benchmark. We then performed qualitative tests, where the maps are used to control a prototype of upper limb prosthesis. The device is composed of a robotic hand and a wrist implementing active prono-supination movement. Eight able-bodied subjects participated to this second round of testings. Finally, the proposed strategies were tested in exploratory experiments involving two subjects with limb loss. Results coming from the evaluations in virtual and realistic settings show encouraging results and suggest the effectiveness of the proposed approach

On the use of Phantom Motor Execution for the treatment of Phantom Limb Pain

Phantom limb pain (PLP) is a common complaint among amputees and despite having been studiedfor centuries, it remains a mysterious object of debate among researcher. To date, a vast number ofways to treat PLP has been proposed in the literature, however none of them has proven to beuniversally effective, thus creating uncertainty on how to operate clinically. The uncertainty is largelyattributable to the scarcity of well conducted randomized controlled trials (RCTs) to prove the efficacyof PLP treatments.Phantom Motor Execution (PME) -exertion of voluntary phantom limb movements – aims at restoringthe control over the phantom limb and the exercise of such control has been hypothesized to reverseneural changes implicated in PLP. Preliminary evidence supporting this hypothesis has been providedby clinical investigations on upper limb amputees. The main purpose of this Licentiate thesis was toenable a RCT on the use of PME for the treatment of PLP in order to provide robust and unbiasedevidence for clinical practice. However, the implementation and kick-off of this clinical investigationrequired to complete few preparatory steps. For example, most amputees and PLP patients have lowerlimb amputation, thus PME needed to be adapted and validated for this population. Further, the RCTprotocol needed to be carefully planned and made openly accessible, as per guidelines for conductingand publishing clinical RCT. Finally, a secondary aim of this thesis emerged with the need of providinglong term relief from PLP to patient. Preliminary evidence seemed to indicate that in order to maintainpain relief, periodic rehearsal of the phantom motor skills acquired through PME is necessary. Thisraised the question of whether it is beneficial and possible to translate the technology from clinic tohome use, question that was explored employing both quantitative and qualitative methods fromengineering, medical anthropology, and user interface design.The work conducted within this thesis resulted in the extension of PME to lower limb patients byproposal and validation of a new and more user-friendly recording configuration to record EMG signals.The use of PME was then shown to be efficacious in relieving PLP with a case study on a patient. Theprotocol for the RCT was then designed and published. These two first steps permitted theestablishment of the RCT, which is currently ongoing and expected to close in March 2021. With regardto the secondary aim of this thesis, the work conducted enabled PME to be used by the patients in thecomfort of their home, while it also allowed investigate the benefits and challenges generally faced(not only by PME) in the transition from the clinic to home and its effects on treatment adherence. Thework conducted is presented in the three appended publications.Future work includes the presentation of the results of the RCT. Further, having a way to modulate PLPis an incredibly useful tool to study the neural basis of PLP. By capitalizing on this tool, we are currentlyconducting brain imaging studies using fMRI and electroencephalography that are the main focus ofthe work that lies ahead

Novel Bidirectional Body - Machine Interface to Control Upper Limb Prosthesis

Objective. The journey of a bionic prosthetic user is characterized by the opportunities and limitations involved in adopting a device (the prosthesis) that should enable activities of daily living (ADL). Within this context, experiencing a bionic hand as a functional (and, possibly, embodied) limb constitutes the premise for mitigating the risk of its abandonment through the continuous use of the device. To achieve such a result, different aspects must be considered for making the artificial limb an effective support for carrying out ADLs. Among them, intuitive and robust control is fundamental to improving amputees’ quality of life using upper limb prostheses. Still, as artificial proprioception is essential to perceive the prosthesis movement without constant visual attention, a good control framework may not be enough to restore practical functionality to the limb. To overcome this, bidirectional communication between the user and the prosthesis has been recently introduced and is a requirement of utmost importance in developing prosthetic hands. Indeed, closing the control loop between the user and a prosthesis by providing artificial sensory feedback is a fundamental step towards the complete restoration of the lost sensory-motor functions. Within my PhD work, I proposed the development of a more controllable and sensitive human-like hand prosthesis, i.e., the Hannes prosthetic hand, to improve its usability and effectiveness. Approach. To achieve the objectives of this thesis work, I developed a modular and scalable software and firmware architecture to control the Hannes prosthetic multi-Degree of Freedom (DoF) system and to fit all users’ needs (hand aperture, wrist rotation, and wrist flexion in different combinations). On top of this, I developed several Pattern Recognition (PR) algorithms to translate electromyographic (EMG) activity into complex movements. However, stability and repeatability were still unmet requirements in multi-DoF upper limb systems; hence, I started by investigating different strategies to produce a more robust control. To do this, EMG signals were collected from trans-radial amputees using an array of up to six sensors placed over the skin. Secondly, I developed a vibrotactile system to implement haptic feedback to restore proprioception and create a bidirectional connection between the user and the prosthesis. Similarly, I implemented an object stiffness detection to restore tactile sensation able to connect the user with the external word. This closed-loop control between EMG and vibration feedback is essential to implementing a Bidirectional Body - Machine Interface to impact amputees’ daily life strongly. For each of these three activities: (i) implementation of robust pattern recognition control algorithms, (ii) restoration of proprioception, and (iii) restoration of the feeling of the grasped object's stiffness, I performed a study where data from healthy subjects and amputees was collected, in order to demonstrate the efficacy and usability of my implementations. In each study, I evaluated both the algorithms and the subjects’ ability to use the prosthesis by means of the F1Score parameter (offline) and the Target Achievement Control test-TAC (online). With this test, I analyzed the error rate, path efficiency, and time efficiency in completing different tasks. Main results. Among the several tested methods for Pattern Recognition, the Non-Linear Logistic Regression (NLR) resulted to be the best algorithm in terms of F1Score (99%, robustness), whereas the minimum number of electrodes needed for its functioning was determined to be 4 in the conducted offline analyses. Further, I demonstrated that its low computational burden allowed its implementation and integration on a microcontroller running at a sampling frequency of 300Hz (efficiency). Finally, the online implementation allowed the subject to simultaneously control the Hannes prosthesis DoFs, in a bioinspired and human-like way. In addition, I performed further tests with the same NLR-based control by endowing it with closed-loop proprioceptive feedback. In this scenario, the results achieved during the TAC test obtained an error rate of 15% and a path efficiency of 60% in experiments where no sources of information were available (no visual and no audio feedback). Such results demonstrated an improvement in the controllability of the system with an impact on user experience. Significance. The obtained results confirmed the hypothesis of improving robustness and efficiency of a prosthetic control thanks to of the implemented closed-loop approach. The bidirectional communication between the user and the prosthesis is capable to restore the loss of sensory functionality, with promising implications on direct translation in the clinical practice

Human motor augmentation - spinal motor neurons control of redundant degrees-of-freedom

In 1963, Stan Lee introduced a new villain to the Spiderman Universe: Dr Octopus – a human equipped with multiple robotic arms that can be controlled seamlessly in coordination with his natural limbs. Throughout the last decades, turning such fiction into real-life applications gave rise to the research field of human motor augmentation, ultimately aiming to enable humans to perform motor tasks that are sheer impossible with our natural limbs alone. While a significant process was made in designing artificial supernumerary limbs, a central problem remains: identifying adequate bodily signals that allow moving supernumerary degrees-of-freedom together with our natural ones. So far, neural activity in the brain seems to hold the greatest potential for providing all the flexibility needed to ensure such coordination between natural and supernumerary degrees-of-freedom. However, accessing neural populations in the cortical regions is accompanied by an unacceptable risk for most users. A different group of neural cells can be found in the outmost layer of the motor pathway, driving the contraction of muscles and generation of force – spinal motor neurons. The development of novel neural interfaces has made it possible to study single motor neuron activity with minimal harm to the user. This allows a direct and non-invasive window into the neural activity orchestrating human movement. In this dissertation, I investigate whether these neurons innervating our muscles could provide supernumerary control signals. The results indicate, in essence, that features extracted non-invasively from motor neuron activity have the potential to overcome current limitations in supernumerary control and thus could significantly advance human motor augmentation.Open Acces

Haptics: Science, Technology, Applications

This open access book constitutes the proceedings of the 13th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2022, held in Hamburg, Germany, in May 2022. The 36 regular papers included in this book were carefully reviewed and selected from 129 submissions. They were organized in topical sections as follows: haptic science; haptic technology; and haptic applications