Novel Bidirectional Body - Machine Interface to Control Upper Limb Prosthesis

Objective. The journey of a bionic prosthetic user is characterized by the opportunities and limitations involved in adopting a device (the prosthesis) that should enable activities of daily living (ADL). Within this context, experiencing a bionic hand as a functional (and, possibly, embodied) limb constitutes the premise for mitigating the risk of its abandonment through the continuous use of the device. To achieve such a result, different aspects must be considered for making the artificial limb an effective support for carrying out ADLs. Among them, intuitive and robust control is fundamental to improving amputees’ quality of life using upper limb prostheses. Still, as artificial proprioception is essential to perceive the prosthesis movement without constant visual attention, a good control framework may not be enough to restore practical functionality to the limb. To overcome this, bidirectional communication between the user and the prosthesis has been recently introduced and is a requirement of utmost importance in developing prosthetic hands. Indeed, closing the control loop between the user and a prosthesis by providing artificial sensory feedback is a fundamental step towards the complete restoration of the lost sensory-motor functions. Within my PhD work, I proposed the development of a more controllable and sensitive human-like hand prosthesis, i.e., the Hannes prosthetic hand, to improve its usability and effectiveness. Approach. To achieve the objectives of this thesis work, I developed a modular and scalable software and firmware architecture to control the Hannes prosthetic multi-Degree of Freedom (DoF) system and to fit all users’ needs (hand aperture, wrist rotation, and wrist flexion in different combinations). On top of this, I developed several Pattern Recognition (PR) algorithms to translate electromyographic (EMG) activity into complex movements. However, stability and repeatability were still unmet requirements in multi-DoF upper limb systems; hence, I started by investigating different strategies to produce a more robust control. To do this, EMG signals were collected from trans-radial amputees using an array of up to six sensors placed over the skin. Secondly, I developed a vibrotactile system to implement haptic feedback to restore proprioception and create a bidirectional connection between the user and the prosthesis. Similarly, I implemented an object stiffness detection to restore tactile sensation able to connect the user with the external word. This closed-loop control between EMG and vibration feedback is essential to implementing a Bidirectional Body - Machine Interface to impact amputees’ daily life strongly. For each of these three activities: (i) implementation of robust pattern recognition control algorithms, (ii) restoration of proprioception, and (iii) restoration of the feeling of the grasped object's stiffness, I performed a study where data from healthy subjects and amputees was collected, in order to demonstrate the efficacy and usability of my implementations. In each study, I evaluated both the algorithms and the subjects’ ability to use the prosthesis by means of the F1Score parameter (offline) and the Target Achievement Control test-TAC (online). With this test, I analyzed the error rate, path efficiency, and time efficiency in completing different tasks. Main results. Among the several tested methods for Pattern Recognition, the Non-Linear Logistic Regression (NLR) resulted to be the best algorithm in terms of F1Score (99%, robustness), whereas the minimum number of electrodes needed for its functioning was determined to be 4 in the conducted offline analyses. Further, I demonstrated that its low computational burden allowed its implementation and integration on a microcontroller running at a sampling frequency of 300Hz (efficiency). Finally, the online implementation allowed the subject to simultaneously control the Hannes prosthesis DoFs, in a bioinspired and human-like way. In addition, I performed further tests with the same NLR-based control by endowing it with closed-loop proprioceptive feedback. In this scenario, the results achieved during the TAC test obtained an error rate of 15% and a path efficiency of 60% in experiments where no sources of information were available (no visual and no audio feedback). Such results demonstrated an improvement in the controllability of the system with an impact on user experience. Significance. The obtained results confirmed the hypothesis of improving robustness and efficiency of a prosthetic control thanks to of the implemented closed-loop approach. The bidirectional communication between the user and the prosthesis is capable to restore the loss of sensory functionality, with promising implications on direct translation in the clinical practice

Design of an under-actuated wrist based on adaptive synergies

An effective robotic wrist represents a key enabling element in robotic manipulation, especially in prosthetics. In this paper, we propose an under-actuated wrist system, which is also adaptable and allows to implement different under-actuation schemes. Our approach leverages upon the idea of soft synergies - in particular the design method of adaptive synergies - as it derives from the field of robot hand design. First we introduce the design principle and its implementation and function in a configurable test bench prototype, which can be used to demonstrate the feasibility of our idea. Furthermore, we report on results from preliminary experiments with humans, aiming to identify the most probable wrist pose during the pre-grasp phase in activities of daily living. Based on these outcomes, we calibrate our wrist prototype accordingly and demonstrate its effectiveness to accomplish grasping and manipulation tasks

Design, development and evaluation of Stanford/Ames Extra-Vehicular Activity (EVA) prehensors

A summary is given of progress to date on work proposed in 1983 and continued in 1985, including design iterations on three different types of manually powered prehensors, construction of functional mockups of each and culminating in detailed drawings and specifications for suit-compatible sealed units for testing under realistic conditions

Anthropomorphism Index of Mobility for Artificial Hands

The increasing development of anthropomorphic artificial hands makes necessary quick metrics that analyze their anthropomorphism. In this study, a human grasp experiment on the most important grasp types was undertaken in order to obtain an Anthropomorphism Index of Mobility (AIM) for artificial hands. The AIM evaluates the topology of the whole hand, joints and degrees of freedom (DoFs), and the possibility to control these DoFs independently. It uses a set of weighting factors, obtained from analysis of human grasping, depending on the relevance of the different groups of DoFs of the hand. The computation of the index is straightforward, making it a useful tool for analyzing new artificial hands in early stages of the design process and for grading human-likeness of existing artificial hands. Thirteen artificial hands, both prosthetic and robotic, were evaluated and compared using the AIM, highlighting the reasons behind their differences. The AIM was also compared with other indexes in the literature with more cumbersome computation, ranking equally different artificial hands. As the index was primarily proposed for prosthetic hands, normally used as nondominant hands in unilateral amputees, the grasp types selected for the human grasp experiment were the most relevant for the human nondominant hand to reinforce bimanual grasping in activities of daily living. However, it was shown that the effect of using the grasping information from the dominant hand is small, indicating that the index is also valid for evaluating the artificial hand as dominant and so being valid for bilateral amputees or robotic hands

Prototypical Arm Motions from Human Demonstration for Upper-Limb Prosthetic Device Control

Controlling a complex upper limb prosthesis, akin to a healthy arm, is still an open challenge due to the inadequate number of inputs available to amputees. Designs have therefore largely focused on a limited number of controllable degrees of freedom, developing a complex hand and grasp functionality rather than the wrist. This thesis investigates joint coordination based on human demonstrations that aims to vastly simplify the controls of wrist, elbow-wrist, and shoulder-elbow wrist devices.The wide range of motions performed by the human arm during daily tasks makes it desirable to find representative subsets to reduce the dimensionality of these movements for a variety of applications, including the design and control of robotic and prosthetic devices. Here I present the results of an extensive human subjects study and two methods that were used to obtain representative categories of arm use that span naturalistic motions during activities of daily living. First, I sought to identify sets of prototypical upper-limb motions that are functions of a single variable, allowing, for instance, an entire prosthetic or robotic arm to be controlled with a single input from a user, along with a means to select between motions for different tasks. Second, I decouple the orientation from the location of the hand and analyze the hand location in three ways and orientation in three reference frames. Both of these analyses are an application of data driven approaches that reduce the wide range of hand and arm use to a smaller representative set. Together these provide insight into our arm usage in daily life and inform an implementation in prosthetic or robotic devices without the need for additional hardware. To demonstrate the control efficacy of prototypical arm motions in upper-limb prosthetic devices, I developed an immersive virtual reality environment where able-bodied participants tested out different devices and controls. I coined prototypical arm motion control as trajectory control, and I found that as device complexity increased from 3 DOF wrist to 4 DOF elbow-wrist and 7 DOF shoulder-elbow-wrist, it enables users to complete tasks faster with a more intuitive interface without additional body compensation, while featuring better movement cosmesis when compared to standard controls

Study to design and develop remote manipulator system

Modeling of human performance in remote manipulation tasks is reported by automated procedures using computers to analyze and count motions during a manipulation task. Performance is monitored by an on-line computer capable of measuring the joint angles of both master and slave and in some cases the trajectory and velocity of the hand itself. In this way the operator's strategies with different transmission delays, displays, tasks, and manipulators can be analyzed in detail for comparison. Some progress is described in obtaining a set of standard tasks and difficulty measures for evaluating manipulator performance

Nonlinear control strategy for a cost effective myoelectric prosthetic hand

The loss of a limb tremendously impacts the life of the affected individual. In the past decades, researchers have been developing artificial limbs that may return some of the missing functions and cosmetics. However, the development of dexterous mechanisms capable of mimicking the function of the human hand is a complex venture. Even though myoelectric prostheses have advanced, several issues remain to be solved before an artificial limb may be comparable to its human counterpart. Moreover, the high cost of advanced limbs prevents their widespread use among the low-income population. This dissertation presents a strategy for the low-level of control of a cost effective robotic hand for prosthetic applications. The main purpose of this work is to reduce the high cost associated with limb replacement. The presented strategy uses an electromyographic signal classifier, which detects user intent by classifying 4 different wrist movements. This information is supplied as 4 different pre-shapes of the robotic hand to the low-level of control for safely and effectively performing the grasping tasks. Two proof-of-concept prototypes were implemented, consisting on five-finger underactuated hands driven by inexpensive DC motors and equipped with low-cost sensors. To overcome the limitations and nonlinearities of inexpensive components, a multi-stage control methodology was designed for modulating the grasping force based on slippage detection and nonlinear force control. A multi-stage control methodology for modulating the grasping force based on slippage detection and nonlinear force control was designed. The two main stages of the control strategy are the force control stage and the detection stage. The control strategy uses the force control stage to maintain a constant level of force over the object. The results of the experiments performed over this stage showed a rising time of less than 1 second, force overshoot of less than 1 N and steady state error of less than 0.15 N. The detection stage is used to monitor any sliding of the object from the hand. The experiments performed over this stage demonstrated a delay in the slip detection process of less than 200 milliseconds. The initial force, and the amount of force incremented after sliding is detected, were adjusted to reduce object displacement. Experiments were then performed to test the control strategy on situations often encountered in the ADL. The results showed that the control strategy was able to detect the dynamic changes in mass of the object and to successfully adjust the grasping force to prevent the object from dropping. The evaluation of the proposed control strategy suggests that this methodology can overcome the limitation of inexpensive sensors and actuators. Therefore, this control strategy may reduce the cost of current myoelectric prosthesis. We believe that the work presented here is a major step towards the development of a cost effective myoelectric prosthetic hand

On the development of a cybernetic prosthetic hand

The human hand is the end organ of the upper limb, which in humans serves the important function of prehension, as well as being an important organ for sensation and communication. It is a marvellous example of how a complex mechanism can be implemented, capable of realizing very complex and useful tasks using a very effective combination of mechanisms, sensing, actuation and control functions. In this thesis, the road towards the realization of a cybernetic hand has been presented. After a detailed analysis of the model, the human hand, a deep review of the state of the art of artificial hands has been carried out. In particular, the performance of prosthetic hands used in clinical practice has been compared with the research prototypes, both for prosthetic and for robotic applications. By following a biomechatronic approach, i.e. by comparing the characteristics of these hands with the natural model, the human hand, the limitations of current artificial devices will be put in evidence, thus outlining the design goals for a new cybernetic device. Three hand prototypes with a high number of degrees of freedom have been realized and tested: the first one uses microactuators embedded inside the structure of the fingers, and the second and third prototypes exploit the concept of microactuation in order to increase the dexterity of the hand while maintaining the simplicity for the control. In particular, a framework for the definition and realization of the closed-loop electromyographic control of these devices has been presented and implemented. The results were quite promising, putting in evidence that, in the future, there could be two different approaches for the realization of artificial devices. On one side there could be the EMG-controlled hands, with compliant fingers but only one active degree of freedom. On the other side, more performing artificial hands could be directly interfaced with the peripheral nervous system, thus establishing a bi-directional communication with the human brain