Low-cost wearable multichannel surface EMG acquisition for prosthetic hand control

Prosthetic hand control based on the acquisition and processing of surface electromyography signals (sEMG) is a well-established method that makes use of the electric potentials evoked by the physiological contraction processes of one or more muscles. Furthermore intelligent mobile medical devices are on the brink of introducing safe and highly sophisticated systems to help a broad patient community to regain a considerable amount of life quality. The major challenges which are inherent in such integrated system’s design are mainly to be found in obtaining a compact system with a long mobile autonomy, capable of delivering the required signal requirements for EMG based prosthetic control with up to 32 simultaneous acquisition channels and – with an eye on a possible future exploitation as a medical device – a proper perspective on a low priced system. Therefore, according to these requirements we present a wireless, mobile platform for acquisition and communication of sEMG signals embedded into a complete mobile control system structure. This environment further includes a portable device such as a laptop providing the necessary computational power for the control and a commercially available robotic handprosthesis. Means of communication among those devices are based on the Bluetooth standard. We show, that the developed low cost mobile device can be used for proper prosthesis control and that the device can rely on a continuous operation for the usual daily life usage of a patient

Robot Programming by Demonstration: Trajectory Learning Enhanced by sEMG-Based User Hand Stiffness Estimation

Trajectory learning is one of the key components of robot Programming by Demonstration approaches, which in many cases, especially in industrial practice, aim at defining complex manipulation patterns. In order to enhance these methods, which are generally based on a physical interaction between the user and the robot, guided along the desired path, an additional input channel is considered in this article. The hand stiffness, that the operator continuously modulates during the demonstration, is estimated from the forearm surface electromyography and translated into a request for a higher or lower accuracy level. Then, a constrained optimization problem is built (and solved) in the framework of smoothing B-splines to obtain a minimum curvature trajectory approximating, in this manner, the taught path within the precision imposed by the user. Experimental tests in different applicative scenarios, involving both position and orientation, prove the benefits of the proposed approach in terms of the intuitiveness of the programming procedure for the human operator and characteristics of the final motion

Robot Programming by Demonstration: Trajectory Learning Enhanced by sEMG-Based User Hand Stiffness Estimation

Trajectory learning is one of the key components of robot Programming by Demonstration approaches, which in many cases, especially in industrial practice, aim at defining complex manipulation patterns. In order to enhance these methods, which are generally based on a physical interaction between the user and the robot, guided along the desired path, an additional input channel is considered in this article. The hand stiffness, that the operator continuously modulates during the demonstration, is estimated from the forearm surface electromyography and translated into a request for a higher or lower accuracy level. Then, a constrained optimization problem is built (and solved) in the framework of smoothing B-splines to obtain a minimum curvature trajectory approximating, in this manner, the taught path within the precision imposed by the user. Experimental tests in different applicative scenarios, involving both position and orientation, prove the benefits of the proposed approach in terms of the intuitiveness of the programming procedure for the human operator and characteristics of the final motion

A Novel Skin-Stretch Haptic Device for Intuitive Control of Robotic Prostheses and Avatars

Without proprioception, i.e., the intrinsic capability of a body to perceive its own limb position, completing daily life activities would require constant visual attention and it would be challenging or even impossible. This situation is similar to the one experienced after limb amputation and in robotic tele-operation, where the natural sensory-motor loop is broken. While some promising solutions based on skin stretch sensory substitution have been proposed to restore tactile properties in these conditions, there is still room for enhancing the intuitiveness of stimulus delivery and integration of haptic feedback devices within user's body. To contribute to this goal, here, we propose a wearable device based on skin stretch stimulation, the Stretch-Pro, which can provide proprioceptive information on artificial hand aperture. This system can be suitably integrated in a prosthetic socket or can be easily worn by a user controlling remote robots. The system can imitate the stretching of the skin that would naturally occur on the intact limb, when it is used to accomplish motor tasks. Two versions of the system are presented, with one and two actuators, respectively, which deliver the stretch stimulus in different ways. Experiments with able-bodied participants and a preliminary test with one prosthesis user are reported. Results suggest that Stretch-Pro could be a viable solution to convey proprioceptive cues to upper limb prosthesis users, opening promising perspectives for tele-robotics applications

Electromyography Based Human-Robot Interfaces for the Control of Artificial Hands and Wearable Devices

The design of robotic systems is currently facing human-inspired solutions as a road to replicate the human ability and flexibility in performing motor tasks. Especially for control and teleoperation purposes, the human-in-the-loop approach is a key element within the framework know as Human-Robot Interface. This thesis reports the research activity carried out for the design of Human-Robot Interfaces based on the detection of human motion intentions from surface electromyography. The main goal was to investigate intuitive and natural control solutions for the teleoperation of both robotic hands during grasping tasks and wearable devices during elbow assistive applications. The design solutions are based on the human motor control principles and surface electromyography interpretation, which are reviewed with emphasis on the concept of synergies. The electromyography based control strategies for the robotic hand grasping and the wearable device assistance are also reviewed. The contribution of this research for the control of artificial hands rely on the integration of different levels of the motor control synergistic organization, and on the combination of proportional control and machine learning approaches under the guideline of user-centred intuitiveness in the Human-Robot Interface design specifications. From the side of the wearable devices, the control of a novel upper limb assistive device based on the Twisted String Actuation concept is faced. The contribution regards the assistance of the elbow during load lifting tasks, exploring a simplification in the use of the surface electromyography within the design of the Human-Robot Interface. The aim is to work around complex subject-dependent algorithm calibrations required by joint torque estimation methods

Addressing the challenges posed by human machine interfaces based on force sensitive resistors for powered prostheses

Despite the advancements in the mechatronics aspect of prosthetic devices, prostheses control still lacks an interface that satisfies the needs of the majority of users. The research community has put great effort into the advancements of prostheses control techniques to address users’ needs. However, most of these efforts are focused on the development and assessment of technologies in the controlled environments of laboratories. Such findings do not fully transfer to the daily application of prosthetic systems. The objectives of this thesis focus on factors that affect the use of Force Myography (FMG) controlled prostheses in practical scenarios. The first objective of this thesis assessed the use of FMG as an alternative or synergist Human Machine Interface (HMI) to the more traditional HMI, i.e. surface Electromyography (sEMG). The assessment for this study was conducted in conditions that are relatively close to the real use case of prosthetic applications. The HMI was embedded in the custom prosthetic prototype that was developed for the pilot participant of the study using an off-the-shelf prosthetic end effector. Moreover, prostheses control was assessed as the user moved their limb in a dynamic protocol.The results of the aforementioned study motivated the second objective of this thesis: to investigate the possibility of reducing the complexity of high density FMG systems without sacrificing classification accuracies. This was achieved through a design method that uses a high density FMG apparatus and feature selection to determine the number and location of sensors that can be eliminated without significantly sacrificing the system’s performance. The third objective of this thesis investigated two of the factors that contribute to increased errors in force sensitive resistor (FSR) signals used in FMG controlled prostheses: bending of force sensors and variations in the volume of the residual limb. Two studies were conducted that proposed solutions to mitigate the negative impact of these factors. The incorporation of these solutions into prosthetic devices is discussed in these studies.It was demonstrated that FMG is a promising HMI for prostheses control. The facilitation of pattern recognition with FMG showed potential for intuitive prosthetic control. Moreover, a method for the design of a system that can determine the required number of sensors and their locations on each individual to achieve a simpler system with comparable performance to high density FMG systems was proposed and tested. The effects of the two factors considered in the third objective were determined. It was also demonstrated that the proposed solutions in the studies conducted for this objective can be used to increase the accuracy of signals that are commonly used in FMG controlled prostheses

Systematic review of textile-based electrodes for long-term and continuous surface electromyography recording

This systematic review concerns the use of smart textiles enabled applications based on myoelectric activity. Electromyography (EMG) is the technique for recording and evaluating electric signals related to muscle activity (myoelectric). EMG is a well-established technique that provides a wealth of information for clinical diagnosis, monitoring, and treatment. Introducing sensor systems that allow for ubiquitous monitoring of health conditions using textile integrated solutions not only opens possibilities for ambulatory, long-term, and continuous health monitoring outside the hospital, but also for autonomous self-administration. Textile-based electrodes have demonstrated potential as a fully operational alternative to \u27standard\u27 Ag/AgCl electrodes for recording surface electromyography (sEMG) signals. As a substitute for Ag/AgCl electrodes fastened to the skin by taping or pre-gluing adhesive, textile-based electrodes have the advantages of being soft, flexible, and air permeable; thus, they have advantages in medicine and health monitoring, especially when self-administration, real-time, and long-term monitoring is required. Such advances have been achieved through various smart textile techniques; for instance, adding functions in textiles, including fibers, yarns, and fabrics, and various methods for incorporating functionality into textiles, such as knitting, weaving, embroidery, and coating. In this work, we reviewed articles from a textile perspective to provide an overview of sEMG applications enabled by smart textile strategies. The overview is based on a literature evaluation of 41 articles published in both peer-reviewed journals and conference proceedings focusing on electrode materials, fabrication methods, construction, and sEMG applications. We introduce four textile integration levels to further describe the various textile electrode sEMG applications reported in the reviewed literature. We conclude with suggestions for future work along with recommendations for the reporting of essential benchmarking information in current and future textile electrode applications

Novel Bidirectional Body - Machine Interface to Control Upper Limb Prosthesis

Objective. The journey of a bionic prosthetic user is characterized by the opportunities and limitations involved in adopting a device (the prosthesis) that should enable activities of daily living (ADL). Within this context, experiencing a bionic hand as a functional (and, possibly, embodied) limb constitutes the premise for mitigating the risk of its abandonment through the continuous use of the device. To achieve such a result, different aspects must be considered for making the artificial limb an effective support for carrying out ADLs. Among them, intuitive and robust control is fundamental to improving amputees’ quality of life using upper limb prostheses. Still, as artificial proprioception is essential to perceive the prosthesis movement without constant visual attention, a good control framework may not be enough to restore practical functionality to the limb. To overcome this, bidirectional communication between the user and the prosthesis has been recently introduced and is a requirement of utmost importance in developing prosthetic hands. Indeed, closing the control loop between the user and a prosthesis by providing artificial sensory feedback is a fundamental step towards the complete restoration of the lost sensory-motor functions. Within my PhD work, I proposed the development of a more controllable and sensitive human-like hand prosthesis, i.e., the Hannes prosthetic hand, to improve its usability and effectiveness. Approach. To achieve the objectives of this thesis work, I developed a modular and scalable software and firmware architecture to control the Hannes prosthetic multi-Degree of Freedom (DoF) system and to fit all users’ needs (hand aperture, wrist rotation, and wrist flexion in different combinations). On top of this, I developed several Pattern Recognition (PR) algorithms to translate electromyographic (EMG) activity into complex movements. However, stability and repeatability were still unmet requirements in multi-DoF upper limb systems; hence, I started by investigating different strategies to produce a more robust control. To do this, EMG signals were collected from trans-radial amputees using an array of up to six sensors placed over the skin. Secondly, I developed a vibrotactile system to implement haptic feedback to restore proprioception and create a bidirectional connection between the user and the prosthesis. Similarly, I implemented an object stiffness detection to restore tactile sensation able to connect the user with the external word. This closed-loop control between EMG and vibration feedback is essential to implementing a Bidirectional Body - Machine Interface to impact amputees’ daily life strongly. For each of these three activities: (i) implementation of robust pattern recognition control algorithms, (ii) restoration of proprioception, and (iii) restoration of the feeling of the grasped object's stiffness, I performed a study where data from healthy subjects and amputees was collected, in order to demonstrate the efficacy and usability of my implementations. In each study, I evaluated both the algorithms and the subjects’ ability to use the prosthesis by means of the F1Score parameter (offline) and the Target Achievement Control test-TAC (online). With this test, I analyzed the error rate, path efficiency, and time efficiency in completing different tasks. Main results. Among the several tested methods for Pattern Recognition, the Non-Linear Logistic Regression (NLR) resulted to be the best algorithm in terms of F1Score (99%, robustness), whereas the minimum number of electrodes needed for its functioning was determined to be 4 in the conducted offline analyses. Further, I demonstrated that its low computational burden allowed its implementation and integration on a microcontroller running at a sampling frequency of 300Hz (efficiency). Finally, the online implementation allowed the subject to simultaneously control the Hannes prosthesis DoFs, in a bioinspired and human-like way. In addition, I performed further tests with the same NLR-based control by endowing it with closed-loop proprioceptive feedback. In this scenario, the results achieved during the TAC test obtained an error rate of 15% and a path efficiency of 60% in experiments where no sources of information were available (no visual and no audio feedback). Such results demonstrated an improvement in the controllability of the system with an impact on user experience. Significance. The obtained results confirmed the hypothesis of improving robustness and efficiency of a prosthetic control thanks to of the implemented closed-loop approach. The bidirectional communication between the user and the prosthesis is capable to restore the loss of sensory functionality, with promising implications on direct translation in the clinical practice